2024-09-12T21:53:32.807 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T21:53:32.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T21:53:32.913 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/admin_socket_objecter_requests thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7902915' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd memory target: 1610612736 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 8861 sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a targets: smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB2I2BtgVf458swpDNz+5nmaUfEQe05vm0RG/0SA1BUVmgOK3cOpv8XRsP36Uo99+Kd9BOEpuy2i0W+8ulHh4mE= smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEbXkDAre/lMWFXFXeXEJrlA2Usy2hAX+Br/+h3so5/Qm94caKSSubGNJ+6HwUDN5dcGJg9t0TRVfm1/0IAZptg= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG7VeiPJPuNkxl9CAzcLDr5ZZHt20Q/vEUUSrBDQUmFnnqeL/fYpMwwAcWEyZ0ezZkdZ57L0/f4ObN7H9CoIvFI= smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGiiQyw1nQiTBhQqeUVVx/y2//RQ3rW5dnmFnZW8p/0GsV+XLUlDk3t0st7mxBgmhyvm1AEoFogMM/3Jy1nkctQ= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_21:32:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T21:53:32.913 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa; will attempt to use it 2024-09-12T21:53:32.914 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa/tasks 2024-09-12T21:53:32.914 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T21:53:32.916 INFO:teuthology.task.internal:Checking packages... 2024-09-12T21:53:32.937 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '086c737fa75c22d521a3932c59b31c5e1d1c9ef4' 2024-09-12T21:53:32.937 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T21:53:32.937 INFO:teuthology.packaging:ref: None 2024-09-12T21:53:32.937 INFO:teuthology.packaging:tag: None 2024-09-12T21:53:32.937 INFO:teuthology.packaging:branch: squid 2024-09-12T21:53:32.937 INFO:teuthology.packaging:sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T21:53:32.937 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T21:53:33.136 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-322.g7741f7f9 2024-09-12T21:53:33.137 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T21:53:33.143 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T21:53:33.143 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T21:53:33.149 INFO:teuthology.task.internal:Saving configuration 2024-09-12T21:53:33.164 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T21:53:33.170 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T21:53:33.196 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 21:48:32.423264', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB2I2BtgVf458swpDNz+5nmaUfEQe05vm0RG/0SA1BUVmgOK3cOpv8XRsP36Uo99+Kd9BOEpuy2i0W+8ulHh4mE='} 2024-09-12T21:53:33.221 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 21:48:32.421864', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEbXkDAre/lMWFXFXeXEJrlA2Usy2hAX+Br/+h3so5/Qm94caKSSubGNJ+6HwUDN5dcGJg9t0TRVfm1/0IAZptg='} 2024-09-12T21:53:33.240 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 21:48:32.419835', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG7VeiPJPuNkxl9CAzcLDr5ZZHt20Q/vEUUSrBDQUmFnnqeL/fYpMwwAcWEyZ0ezZkdZ57L0/f4ObN7H9CoIvFI='} 2024-09-12T21:53:33.263 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 21:48:32.424694', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGiiQyw1nQiTBhQqeUVVx/y2//RQ3rW5dnmFnZW8p/0GsV+XLUlDk3t0st7mxBgmhyvm1AEoFogMM/3Jy1nkctQ='} 2024-09-12T21:53:33.263 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T21:53:33.270 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-09-12T21:53:33.270 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['osd.0'] 2024-09-12T21:53:33.270 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['osd.1'] 2024-09-12T21:53:33.270 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['osd.2'] 2024-09-12T21:53:33.270 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T21:53:33.372 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f462bc6b2e0>, signals=[15]) 2024-09-12T21:53:33.373 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T21:53:33.378 INFO:teuthology.task.internal:Opening connections... 2024-09-12T21:53:33.378 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T21:53:33.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:53:33.459 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T21:53:33.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:53:33.577 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T21:53:33.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:53:33.655 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2024-09-12T21:53:33.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:53:33.730 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T21:53:33.737 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-09-12T21:53:33.755 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-09-12T21:53:33.756 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-09-12T21:53:33.813 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-09-12T21:53:33.813 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2024-09-12T21:53:33.813 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-09-12T21:53:33.813 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-09-12T21:53:33.813 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2024-09-12T21:53:33.813 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2024-09-12T21:53:33.813 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T21:53:33.813 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-09-12T21:53:33.813 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2024-09-12T21:53:33.813 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T21:53:33.814 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-09-12T21:53:33.814 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T21:53:33.814 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T21:53:33.814 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T21:53:33.814 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-09-12T21:53:33.839 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-09-12T21:53:33.857 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-09-12T21:53:33.858 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-09-12T21:53:33.916 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-09-12T21:53:33.916 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-09-12T21:53:33.916 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-09-12T21:53:33.916 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-09-12T21:53:33.916 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-09-12T21:53:33.916 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-09-12T21:53:33.917 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T21:53:33.917 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-09-12T21:53:33.917 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-09-12T21:53:33.917 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T21:53:33.917 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-09-12T21:53:33.917 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T21:53:33.917 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T21:53:33.917 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T21:53:33.917 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-09-12T21:53:33.939 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-09-12T21:53:33.958 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-09-12T21:53:33.958 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-09-12T21:53:34.016 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-09-12T21:53:34.016 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-09-12T21:53:34.016 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-09-12T21:53:34.016 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-09-12T21:53:34.017 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-09-12T21:53:34.017 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-09-12T21:53:34.017 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T21:53:34.017 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-09-12T21:53:34.017 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-09-12T21:53:34.017 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T21:53:34.017 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-09-12T21:53:34.017 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T21:53:34.017 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T21:53:34.017 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T21:53:34.018 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-09-12T21:53:34.039 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2024-09-12T21:53:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2024-09-12T21:53:34.058 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-09-12T21:53:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2024-09-12T21:53:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9" 2024-09-12T21:53:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2024-09-12T21:53:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2024-09-12T21:53:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9" 2024-09-12T21:53:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9" 2024-09-12T21:53:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T21:53:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2024-09-12T21:53:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon" 2024-09-12T21:53:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T21:53:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2024-09-12T21:53:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T21:53:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T21:53:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T21:53:34.117 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-09-12T21:53:34.139 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T21:53:34.147 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T21:53:34.153 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T21:53:34.153 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-09-12T21:53:34.156 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-09-12T21:53:34.158 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-09-12T21:53:34.160 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2024-09-12T21:53:34.177 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T21:53:34.183 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T21:53:34.183 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-09-12T21:53:34.213 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-09-12T21:53:34.215 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-09-12T21:53:34.217 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2024-09-12T21:53:34.512 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T21:53:34.606 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T21:53:34.620 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T21:53:34.620 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T21:53:34.621 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T21:53:34.622 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T21:53:34.622 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T21:53:34.623 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T21:53:34.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:53:34.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:53:34.642 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-09-12T21:53:34.642 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-12T21:53:34.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:53:34.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:53:34.644 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-09-12T21:53:34.644 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-09-12T21:53:34.699 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-503.el9.x86_64 2024-09-12T21:53:34.699 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.14.0-503.el9.x86_64 2024-09-12T21:53:34.699 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum install -y kernel 2024-09-12T21:53:34.701 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-503.el9.x86_64 2024-09-12T21:53:34.701 INFO:teuthology.task.kernel:Running kernel on smithi110: 5.14.0-503.el9.x86_64 2024-09-12T21:53:34.701 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum install -y kernel 2024-09-12T21:53:34.703 INFO:teuthology.orchestra.run.smithi146.stdout:5.14.0-503.el9.x86_64 2024-09-12T21:53:34.703 INFO:teuthology.task.kernel:Running kernel on smithi146: 5.14.0-503.el9.x86_64 2024-09-12T21:53:34.703 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum install -y kernel 2024-09-12T21:53:34.704 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-503.el9.x86_64 2024-09-12T21:53:34.705 INFO:teuthology.task.kernel:Running kernel on smithi043: 5.14.0-503.el9.x86_64 2024-09-12T21:53:34.705 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum install -y kernel 2024-09-12T21:53:36.934 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-12T21:53:37.339 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-12T21:53:37.921 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.2 MB 00:01 2024-09-12T21:53:38.171 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-12T21:53:39.607 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-12T21:53:39.901 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-12T21:53:40.022 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-12T21:53:41.139 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-09-12T21:53:44.058 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.5 MB 00:00 2024-09-12T21:53:44.552 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-12T21:53:45.608 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-12T21:53:45.681 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-12T21:53:45.689 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 6.5 MB 00:00 2024-09-12T21:53:46.119 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 19 kB 00:00 2024-09-12T21:53:46.730 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-12T21:53:47.206 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-12T21:53:47.248 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 19 kB 00:00 2024-09-12T21:53:47.265 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-12T21:53:48.044 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-12T21:53:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T21:53:52.152 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T21:53:52.937 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T21:53:53.616 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-12T21:53:53.875 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T21:53:54.133 INFO:teuthology.orchestra.run.smithi110.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T21:53:54.133 INFO:teuthology.orchestra.run.smithi110.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T21:53:54.218 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-12T21:53:54.225 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-12T21:53:54.225 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-09-12T21:53:54.226 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-12T21:53:54.226 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-12T21:53:54.226 INFO:teuthology.orchestra.run.smithi110.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T21:53:54.226 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-12T21:53:54.226 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T21:53:54.226 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T21:53:54.226 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T21:53:54.226 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T21:53:54.226 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-12T21:53:54.226 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-12T21:53:54.226 INFO:teuthology.orchestra.run.smithi110.stdout:Install 4 Packages 2024-09-12T21:53:54.226 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T21:53:54.227 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 79 M 2024-09-12T21:53:54.227 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 126 M 2024-09-12T21:53:54.227 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-12T21:53:54.479 INFO:teuthology.orchestra.run.smithi110.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 167 kB/s | 23 kB 00:00 2024-09-12T21:53:54.961 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T21:53:54.961 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T21:53:55.057 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-12T21:53:55.062 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-12T21:53:55.062 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2024-09-12T21:53:55.062 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-12T21:53:55.062 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-12T21:53:55.063 INFO:teuthology.orchestra.run.smithi043.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T21:53:55.063 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-12T21:53:55.063 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T21:53:55.063 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T21:53:55.063 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T21:53:55.063 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T21:53:55.063 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-12T21:53:55.063 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-12T21:53:55.063 INFO:teuthology.orchestra.run.smithi043.stdout:Install 4 Packages 2024-09-12T21:53:55.063 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T21:53:55.063 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 79 M 2024-09-12T21:53:55.063 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 126 M 2024-09-12T21:53:55.064 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-12T21:53:55.297 INFO:teuthology.orchestra.run.smithi043.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 196 kB/s | 23 kB 00:00 2024-09-12T21:53:55.573 INFO:teuthology.orchestra.run.smithi146.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T21:53:55.573 INFO:teuthology.orchestra.run.smithi146.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T21:53:55.587 INFO:teuthology.orchestra.run.smithi110.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-12T21:53:55.679 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-12T21:53:55.688 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-12T21:53:55.688 INFO:teuthology.orchestra.run.smithi146.stdout: Package Architecture Version Repository Size 2024-09-12T21:53:55.689 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-12T21:53:55.689 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-12T21:53:55.689 INFO:teuthology.orchestra.run.smithi146.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T21:53:55.689 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-12T21:53:55.689 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T21:53:55.689 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T21:53:55.689 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T21:53:55.689 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T21:53:55.689 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-12T21:53:55.689 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-12T21:53:55.689 INFO:teuthology.orchestra.run.smithi146.stdout:Install 4 Packages 2024-09-12T21:53:55.689 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T21:53:55.690 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 79 M 2024-09-12T21:53:55.690 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 126 M 2024-09-12T21:53:55.690 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-12T21:53:55.939 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T21:53:55.939 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T21:53:56.041 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T21:53:56.050 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T21:53:56.050 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-12T21:53:56.050 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T21:53:56.051 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T21:53:56.051 INFO:teuthology.orchestra.run.smithi047.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T21:53:56.051 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T21:53:56.051 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T21:53:56.051 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T21:53:56.051 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T21:53:56.051 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T21:53:56.051 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T21:53:56.051 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T21:53:56.051 INFO:teuthology.orchestra.run.smithi047.stdout:Install 4 Packages 2024-09-12T21:53:56.051 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T21:53:56.052 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 79 M 2024-09-12T21:53:56.052 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 126 M 2024-09-12T21:53:56.052 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T21:53:56.084 INFO:teuthology.orchestra.run.smithi146.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 264 kB/s | 23 kB 00:00 2024-09-12T21:53:56.089 INFO:teuthology.orchestra.run.smithi043.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-12T21:53:56.218 INFO:teuthology.orchestra.run.smithi047.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 190 kB/s | 23 kB 00:00 2024-09-12T21:53:56.476 INFO:teuthology.orchestra.run.smithi146.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-12T21:53:56.579 INFO:teuthology.orchestra.run.smithi110.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 15 MB/s | 35 MB 00:02 2024-09-12T21:53:56.714 INFO:teuthology.orchestra.run.smithi043.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 23 MB/s | 35 MB 00:01 2024-09-12T21:53:56.877 INFO:teuthology.orchestra.run.smithi047.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 43 MB/s | 29 MB 00:00 2024-09-12T21:53:56.918 INFO:teuthology.orchestra.run.smithi146.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 38 MB/s | 35 MB 00:00 2024-09-12T21:53:57.113 INFO:teuthology.orchestra.run.smithi110.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 11 MB/s | 29 MB 00:02 2024-09-12T21:53:57.113 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-12T21:53:57.113 INFO:teuthology.orchestra.run.smithi110.stdout:Total 27 MB/s | 79 MB 00:02 2024-09-12T21:53:57.173 INFO:teuthology.orchestra.run.smithi043.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 15 MB/s | 29 MB 00:01 2024-09-12T21:53:57.173 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-12T21:53:57.173 INFO:teuthology.orchestra.run.smithi043.stdout:Total 37 MB/s | 79 MB 00:02 2024-09-12T21:53:57.243 INFO:teuthology.orchestra.run.smithi047.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 30 MB/s | 35 MB 00:01 2024-09-12T21:53:57.394 INFO:teuthology.orchestra.run.smithi047.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-12T21:53:57.394 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T21:53:57.394 INFO:teuthology.orchestra.run.smithi047.stdout:Total 59 MB/s | 79 MB 00:01 2024-09-12T21:53:57.560 INFO:teuthology.orchestra.run.smithi146.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 19 MB/s | 29 MB 00:01 2024-09-12T21:53:57.560 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-12T21:53:57.560 INFO:teuthology.orchestra.run.smithi146.stdout:Total 42 MB/s | 79 MB 00:01 2024-09-12T21:53:57.801 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-12T21:53:57.885 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-12T21:53:58.106 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T21:53:58.138 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-12T21:53:58.138 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-12T21:53:58.236 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-12T21:53:58.236 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-12T21:53:58.240 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-12T21:53:58.469 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T21:53:58.469 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T21:53:58.593 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-12T21:53:58.593 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-12T21:53:59.073 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-12T21:53:59.073 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-12T21:53:59.221 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-12T21:53:59.222 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-12T21:53:59.435 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T21:53:59.436 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T21:53:59.543 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-12T21:53:59.544 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-12T21:54:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-12T21:54:01.799 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-12T21:54:01.976 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-12T21:54:02.018 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T21:54:02.131 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:54:02.206 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:54:02.477 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:54:02.575 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:54:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:54:02.682 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:54:02.751 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:54:02.762 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:54:04.984 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:54:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:54:05.373 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:54:05.502 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:54:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:54:05.556 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:54:05.655 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:54:05.688 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:54:09.948 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:54:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:10.471 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:54:10.538 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:10.618 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:54:10.660 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:54:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:14.920 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:15.374 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:15.805 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:16.032 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:54:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:54:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:54:53.561 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:53.601 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:53.963 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:53.963 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:54:53.963 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:54:53.963 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:54:54.031 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:54.031 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T21:54:54.031 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-12T21:54:54.032 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T21:54:54.032 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T21:54:54.032 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T21:54:54.032 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T21:54:54.032 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T21:54:54.032 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-12T21:54:54.393 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:54:54.478 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:54:54.479 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:54:54.479 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T21:54:54.479 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T21:54:54.479 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T21:54:54.480 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-09-12T21:54:54.480 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T21:54:54.480 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:54:54.538 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:54:54.538 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:54:54.538 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -qi grub2-tools 2024-09-12T21:54:54.570 INFO:teuthology.orchestra.run.smithi110.stdout:Name : grub2-tools 2024-09-12T21:54:54.571 INFO:teuthology.orchestra.run.smithi110.stdout:Epoch : 1 2024-09-12T21:54:54.571 INFO:teuthology.orchestra.run.smithi110.stdout:Version : 2.06 2024-09-12T21:54:54.571 INFO:teuthology.orchestra.run.smithi110.stdout:Release : 82.el9 2024-09-12T21:54:54.571 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: x86_64 2024-09-12T21:54:54.571 INFO:teuthology.orchestra.run.smithi110.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T21:54:54.571 INFO:teuthology.orchestra.run.smithi110.stdout:Group : Unspecified 2024-09-12T21:54:54.571 INFO:teuthology.orchestra.run.smithi110.stdout:Size : 8274670 2024-09-12T21:54:54.571 INFO:teuthology.orchestra.run.smithi110.stdout:License : GPLv3+ 2024-09-12T21:54:54.571 INFO:teuthology.orchestra.run.smithi110.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T21:54:54.571 INFO:teuthology.orchestra.run.smithi110.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T21:54:54.571 INFO:teuthology.orchestra.run.smithi110.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T21:54:54.571 INFO:teuthology.orchestra.run.smithi110.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T21:54:54.572 INFO:teuthology.orchestra.run.smithi110.stdout:Packager : builder@centos.org 2024-09-12T21:54:54.572 INFO:teuthology.orchestra.run.smithi110.stdout:Vendor : CentOS 2024-09-12T21:54:54.572 INFO:teuthology.orchestra.run.smithi110.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T21:54:54.572 INFO:teuthology.orchestra.run.smithi110.stdout:Summary : Support tools for GRUB. 2024-09-12T21:54:54.572 INFO:teuthology.orchestra.run.smithi110.stdout:Description : 2024-09-12T21:54:54.572 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T21:54:54.572 INFO:teuthology.orchestra.run.smithi110.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T21:54:54.572 INFO:teuthology.orchestra.run.smithi110.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T21:54:54.572 INFO:teuthology.orchestra.run.smithi110.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T21:54:54.572 INFO:teuthology.orchestra.run.smithi110.stdout:hardware devices. 2024-09-12T21:54:54.573 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T21:54:54.573 INFO:teuthology.orchestra.run.smithi110.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T21:54:54.573 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T21:54:54.573 INFO:teuthology.task.kernel:Updating grub on smithi110 to boot 5.14.0-505.el9.x86_64 2024-09-12T21:54:54.574 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T21:54:54.808 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:54.808 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T21:54:54.808 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-12T21:54:54.808 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T21:54:54.808 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T21:54:54.808 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T21:54:54.808 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T21:54:54.808 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T21:54:54.808 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-12T21:54:54.908 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:54.949 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:55.104 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:55.141 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:54:55.146 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:55.223 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:54:55.224 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:54:55.224 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T21:54:55.224 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T21:54:55.224 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T21:54:55.224 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-09-12T21:54:55.224 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T21:54:55.224 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:54:55.225 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-09-12T21:54:55.273 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:55.273 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:54:55.274 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:54:55.274 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:54:55.282 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:54:55.283 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:54:55.283 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -qi grub2-tools 2024-09-12T21:54:55.319 INFO:teuthology.orchestra.run.smithi146.stdout:Name : grub2-tools 2024-09-12T21:54:55.319 INFO:teuthology.orchestra.run.smithi146.stdout:Epoch : 1 2024-09-12T21:54:55.319 INFO:teuthology.orchestra.run.smithi146.stdout:Version : 2.06 2024-09-12T21:54:55.319 INFO:teuthology.orchestra.run.smithi146.stdout:Release : 82.el9 2024-09-12T21:54:55.319 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: x86_64 2024-09-12T21:54:55.319 INFO:teuthology.orchestra.run.smithi146.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T21:54:55.319 INFO:teuthology.orchestra.run.smithi146.stdout:Group : Unspecified 2024-09-12T21:54:55.319 INFO:teuthology.orchestra.run.smithi146.stdout:Size : 8274670 2024-09-12T21:54:55.320 INFO:teuthology.orchestra.run.smithi146.stdout:License : GPLv3+ 2024-09-12T21:54:55.320 INFO:teuthology.orchestra.run.smithi146.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T21:54:55.320 INFO:teuthology.orchestra.run.smithi146.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T21:54:55.320 INFO:teuthology.orchestra.run.smithi146.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T21:54:55.320 INFO:teuthology.orchestra.run.smithi146.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T21:54:55.320 INFO:teuthology.orchestra.run.smithi146.stdout:Packager : builder@centos.org 2024-09-12T21:54:55.320 INFO:teuthology.orchestra.run.smithi146.stdout:Vendor : CentOS 2024-09-12T21:54:55.320 INFO:teuthology.orchestra.run.smithi146.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T21:54:55.320 INFO:teuthology.orchestra.run.smithi146.stdout:Summary : Support tools for GRUB. 2024-09-12T21:54:55.321 INFO:teuthology.orchestra.run.smithi146.stdout:Description : 2024-09-12T21:54:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T21:54:55.321 INFO:teuthology.orchestra.run.smithi146.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T21:54:55.321 INFO:teuthology.orchestra.run.smithi146.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T21:54:55.321 INFO:teuthology.orchestra.run.smithi146.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T21:54:55.321 INFO:teuthology.orchestra.run.smithi146.stdout:hardware devices. 2024-09-12T21:54:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T21:54:55.321 INFO:teuthology.orchestra.run.smithi146.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T21:54:55.322 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T21:54:55.322 INFO:teuthology.task.kernel:Updating grub on smithi146 to boot 5.14.0-505.el9.x86_64 2024-09-12T21:54:55.322 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T21:54:55.516 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:55.516 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:54:55.516 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:54:55.517 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:54:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2024-09-12T21:54:56.142 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:56.142 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T21:54:56.143 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-12T21:54:56.143 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T21:54:56.143 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T21:54:56.143 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T21:54:56.143 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T21:54:56.143 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T21:54:56.143 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-12T21:54:56.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:54:56.340 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T21:54:56.340 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T21:54:56.340 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T21:54:56.340 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T21:54:56.340 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T21:54:56.340 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T21:54:56.340 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T21:54:56.340 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T21:54:56.525 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:54:56.612 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:54:56.612 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:54:56.612 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T21:54:56.613 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T21:54:56.613 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T21:54:56.613 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T21:54:56.613 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T21:54:56.613 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:54:56.635 INFO:teuthology.orchestra.run.smithi110.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T21:54:56.663 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:54:56.672 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:54:56.672 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:54:56.672 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -qi grub2-tools 2024-09-12T21:54:56.674 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-09-12T21:54:56.676 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-09-12T21:54:56.691 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.4agIz8D1rv 2024-09-12T21:54:56.692 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4agIz8D1rv 2024-09-12T21:54:56.710 INFO:teuthology.orchestra.run.smithi043.stdout:Name : grub2-tools 2024-09-12T21:54:56.710 INFO:teuthology.orchestra.run.smithi043.stdout:Epoch : 1 2024-09-12T21:54:56.710 INFO:teuthology.orchestra.run.smithi043.stdout:Version : 2.06 2024-09-12T21:54:56.710 INFO:teuthology.orchestra.run.smithi043.stdout:Release : 82.el9 2024-09-12T21:54:56.711 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: x86_64 2024-09-12T21:54:56.711 INFO:teuthology.orchestra.run.smithi043.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T21:54:56.711 INFO:teuthology.orchestra.run.smithi043.stdout:Group : Unspecified 2024-09-12T21:54:56.711 INFO:teuthology.orchestra.run.smithi043.stdout:Size : 8274670 2024-09-12T21:54:56.711 INFO:teuthology.orchestra.run.smithi043.stdout:License : GPLv3+ 2024-09-12T21:54:56.711 INFO:teuthology.orchestra.run.smithi043.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T21:54:56.711 INFO:teuthology.orchestra.run.smithi043.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T21:54:56.711 INFO:teuthology.orchestra.run.smithi043.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T21:54:56.711 INFO:teuthology.orchestra.run.smithi043.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T21:54:56.711 INFO:teuthology.orchestra.run.smithi043.stdout:Packager : builder@centos.org 2024-09-12T21:54:56.711 INFO:teuthology.orchestra.run.smithi043.stdout:Vendor : CentOS 2024-09-12T21:54:56.711 INFO:teuthology.orchestra.run.smithi043.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T21:54:56.711 INFO:teuthology.orchestra.run.smithi043.stdout:Summary : Support tools for GRUB. 2024-09-12T21:54:56.711 INFO:teuthology.orchestra.run.smithi043.stdout:Description : 2024-09-12T21:54:56.712 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T21:54:56.712 INFO:teuthology.orchestra.run.smithi043.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T21:54:56.712 INFO:teuthology.orchestra.run.smithi043.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T21:54:56.712 INFO:teuthology.orchestra.run.smithi043.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T21:54:56.712 INFO:teuthology.orchestra.run.smithi043.stdout:hardware devices. 2024-09-12T21:54:56.712 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T21:54:56.712 INFO:teuthology.orchestra.run.smithi043.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T21:54:56.713 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T21:54:56.713 INFO:teuthology.task.kernel:Updating grub on smithi043 to boot 5.14.0-505.el9.x86_64 2024-09-12T21:54:56.713 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T21:54:56.747 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:54:56.748 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:54:56.748 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T21:54:56.748 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T21:54:56.748 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T21:54:56.748 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-09-12T21:54:56.748 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T21:54:56.749 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:54:56.758 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.4agIz8D1rv 2024-09-12T21:54:56.810 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:54:56.810 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:54:56.810 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-09-12T21:54:56.851 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-09-12T21:54:56.851 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-09-12T21:54:56.851 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.06 2024-09-12T21:54:56.851 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 82.el9 2024-09-12T21:54:56.851 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-09-12T21:54:56.851 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T21:54:56.851 INFO:teuthology.orchestra.run.smithi047.stdout:Group : Unspecified 2024-09-12T21:54:56.852 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 8274670 2024-09-12T21:54:56.852 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-09-12T21:54:56.852 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T21:54:56.852 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T21:54:56.852 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T21:54:56.852 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T21:54:56.852 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : builder@centos.org 2024-09-12T21:54:56.852 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-09-12T21:54:56.852 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T21:54:56.852 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-09-12T21:54:56.852 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-09-12T21:54:56.852 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T21:54:56.852 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T21:54:56.852 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T21:54:56.853 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T21:54:56.853 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-09-12T21:54:56.853 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T21:54:56.853 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T21:54:56.854 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T21:54:56.854 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 5.14.0-505.el9.x86_64 2024-09-12T21:54:56.854 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T21:54:56.906 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.4agIz8D1rv is 6KB 2024-09-12T21:54:56.926 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.4agIz8D1rv 2024-09-12T21:54:56.940 DEBUG:teuthology.orchestra.run.smithi110:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T21:54:57.004 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T21:54:57.004 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T21:54:57.004 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T21:54:57.004 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T21:54:57.005 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T21:54:57.150 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-09-12T21:54:57.339 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2024-09-12T21:54:57.348 INFO:teuthology.orchestra.run.smithi146.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T21:54:57.375 INFO:teuthology.orchestra.run.smithi146.stderr:done 2024-09-12T21:54:57.377 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-09-12T21:54:57.393 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.MTmczGU8Ra 2024-09-12T21:54:57.393 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.MTmczGU8Ra 2024-09-12T21:54:57.460 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.MTmczGU8Ra 2024-09-12T21:54:57.481 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-09-12T21:54:57.603 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.MTmczGU8Ra is 6KB 2024-09-12T21:54:57.652 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.MTmczGU8Ra 2024-09-12T21:54:57.667 DEBUG:teuthology.orchestra.run.smithi146:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T21:54:57.739 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T21:54:57.740 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T21:54:57.740 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T21:54:57.740 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T21:54:57.741 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T21:54:57.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2024-09-12T21:54:57.978 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-09-12T21:54:58.754 INFO:teuthology.orchestra.run.smithi043.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T21:54:58.774 INFO:teuthology.orchestra.run.smithi043.stderr:done 2024-09-12T21:54:58.782 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-12T21:54:58.787 INFO:teuthology.orchestra.run.smithi047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T21:54:58.799 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.YnHVgMH1X3 2024-09-12T21:54:58.799 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YnHVgMH1X3 2024-09-12T21:54:58.816 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-09-12T21:54:58.826 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-09-12T21:54:58.842 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.9Z1Tv0gPff 2024-09-12T21:54:58.843 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9Z1Tv0gPff 2024-09-12T21:54:58.868 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.YnHVgMH1X3 2024-09-12T21:54:58.909 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.9Z1Tv0gPff 2024-09-12T21:54:59.009 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.YnHVgMH1X3 is 6KB 2024-09-12T21:54:59.050 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.9Z1Tv0gPff is 6KB 2024-09-12T21:54:59.060 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.YnHVgMH1X3 2024-09-12T21:54:59.075 DEBUG:teuthology.orchestra.run.smithi043:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T21:54:59.098 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.9Z1Tv0gPff 2024-09-12T21:54:59.113 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T21:54:59.137 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T21:54:59.137 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T21:54:59.137 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T21:54:59.138 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T21:54:59.139 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T21:54:59.182 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T21:54:59.183 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T21:54:59.183 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T21:54:59.183 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T21:54:59.184 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T21:54:59.302 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2024-09-12T21:54:59.330 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-09-12T21:55:27.181 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-09-12T21:55:27.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-12T21:55:27.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:55:27.915 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-09-12T21:55:27.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-12T21:55:27.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:55:29.307 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T21:55:29.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T21:55:29.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:55:29.333 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-09-12T21:55:29.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T21:55:29.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:55:45.597 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-09-12T21:55:46.369 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-09-12T21:55:47.649 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-09-12T21:55:47.901 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-09-12T21:55:54.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-12T21:55:54.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:55:55.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-12T21:55:55.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:55:56.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T21:55:56.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:55:56.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T21:55:56.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:55:58.429 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-09-12T21:56:10.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-12T21:56:10.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:56:28.865 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-09-12T21:56:43.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-12T21:56:43.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:56:44.240 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-09-12T21:56:44.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-12T21:56:44.667 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.14.0-505.el9.x86_64"... 2024-09-12T21:56:44.667 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-09-12T21:56:44.682 INFO:teuthology.orchestra.run.smithi146.stdout:5.14.0-505.el9.x86_64 2024-09-12T21:56:44.682 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T21:56:44.682 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T21:56:44.682 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T21:56:45.683 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-09-12T21:56:45.683 DEBUG:teuthology.orchestra.run.smithi146:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T21:56:45.770 INFO:teuthology.orchestra.run.smithi146.stdout:ttyS1 2024-09-12T21:56:45.800 DEBUG:teuthology.parallel:result is None 2024-09-12T21:56:54.604 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T21:56:56.654 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T21:56:56.905 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T21:57:06.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-12T21:57:06.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:57:07.028 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-12T21:57:07.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-12T21:57:07.394 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.14.0-505.el9.x86_64"... 2024-09-12T21:57:07.394 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-09-12T21:57:07.411 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-505.el9.x86_64 2024-09-12T21:57:07.411 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T21:57:07.411 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T21:57:07.411 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T21:57:08.412 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-09-12T21:57:08.412 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T21:57:08.485 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2024-09-12T21:57:08.510 DEBUG:teuthology.parallel:result is None 2024-09-12T21:57:08.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T21:57:08.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:57:08.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T21:57:08.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:57:09.076 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-09-12T21:57:09.288 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-12T21:57:09.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T21:57:09.438 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T21:57:09.438 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-09-12T21:57:09.455 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-505.el9.x86_64 2024-09-12T21:57:09.455 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T21:57:09.455 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T21:57:09.455 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T21:57:09.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T21:57:09.658 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T21:57:09.658 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-12T21:57:09.675 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-505.el9.x86_64 2024-09-12T21:57:09.675 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T21:57:09.676 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T21:57:09.676 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T21:57:10.456 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T21:57:10.456 DEBUG:teuthology.orchestra.run.smithi043:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T21:57:10.529 INFO:teuthology.orchestra.run.smithi043.stdout:ttyS1 2024-09-12T21:57:10.552 DEBUG:teuthology.parallel:result is None 2024-09-12T21:57:10.676 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-09-12T21:57:10.676 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T21:57:10.743 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-09-12T21:57:10.762 DEBUG:teuthology.parallel:result is None 2024-09-12T21:57:10.763 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T21:57:10.774 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T21:57:10.774 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T21:57:10.777 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T21:57:10.779 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T21:57:10.782 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T21:57:10.801 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T21:57:10.812 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T21:57:10.825 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T21:57:10.825 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T21:57:10.835 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T21:57:10.837 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T21:57:10.841 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T21:57:10.874 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T21:57:10.884 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T21:57:10.885 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T21:57:10.898 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T21:57:10.904 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T21:57:10.907 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T21:57:10.933 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:57:10.939 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:57:10.939 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:57:10.945 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:57:10.945 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:57:10.950 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:57:10.951 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:57:10.956 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:57:10.958 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T21:57:10.971 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T21:57:10.971 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T21:57:10.990 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T21:57:10.995 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T21:57:10.998 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T21:57:11.025 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T21:57:11.035 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T21:57:11.035 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T21:57:11.060 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T21:57:11.063 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T21:57:11.067 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T21:57:11.083 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:57:11.161 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:57:11.214 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:57:11.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:57:11.342 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T21:57:11.342 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T21:57:11.410 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:57:11.454 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:57:11.511 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:57:11.592 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:57:11.638 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T21:57:11.638 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T21:57:11.705 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:57:11.744 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:57:11.801 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:57:11.883 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:57:11.929 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T21:57:11.929 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T21:57:11.996 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:57:12.041 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:57:12.095 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:57:12.177 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:57:12.222 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-12T21:57:12.222 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T21:57:12.289 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-09-12T21:57:12.291 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-09-12T21:57:12.294 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-09-12T21:57:12.297 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2024-09-12T21:57:12.340 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T21:57:12.341 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T21:57:12.349 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T21:57:12.370 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T21:57:12.854 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T21:57:13.110 INFO:teuthology.task.internal:Starting timer... 2024-09-12T21:57:13.110 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T21:57:13.119 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T21:57:13.127 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-12T21:57:13.127 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2024-09-12T21:57:13.180 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2024-09-12T21:57:13.182 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-09-12T21:57:13.243 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-09-12T21:57:13.245 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2024-09-12T21:57:13.293 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: 2024-09-12T21:57:13.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2024-09-12T21:57:13.367 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: 2024-09-12T21:57:13.370 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T21:57:13.370 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2024-09-12T21:57:13.389 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2024-09-12T21:57:13.390 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-09-12T21:57:13.410 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-09-12T21:57:13.411 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2024-09-12T21:57:13.435 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2024-09-12T21:57:13.436 DEBUG:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2024-09-12T21:57:13.464 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2024-09-12T21:57:13.464 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi043.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi110.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi146.front.sepia.ceph.com': 'permissive'} 2024-09-12T21:57:13.464 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T21:57:13.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:57:13.493 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T21:57:13.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:57:13.521 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T21:57:13.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:57:13.550 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T21:57:13.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:57:13.579 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T21:57:13.579 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2024-09-12T21:57:13.622 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-09-12T21:57:13.653 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2024-09-12T21:57:13.689 DEBUG:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2024-09-12T21:57:13.726 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T21:57:13.735 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T21:57:13.749 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T21:57:13.750 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi047.front.sepia.ceph.com,smithi110.front.sepia.ceph.com,smithi146.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T22:01:03.748 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com'), Remote(name='ubuntu@smithi146.front.sepia.ceph.com')] 2024-09-12T22:01:03.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T22:01:03.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:01:03.839 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-09-12T22:01:03.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T22:01:03.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T22:01:03.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:01:04.008 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-12T22:01:04.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T22:01:04.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-12T22:01:04.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:01:04.171 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-12T22:01:04.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-12T22:01:04.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-12T22:01:04.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:01:04.343 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-09-12T22:01:04.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-12T22:01:04.424 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T22:01:04.438 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T22:01:04.438 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:01:04.439 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:01:04.441 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:01:04.441 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:01:04.444 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:01:04.444 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:01:04.446 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:01:04.447 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:01:04.474 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:01:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:01:04.478 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:01:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:01:04.494 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:01:04.494 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:01:04.497 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:01:04.514 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:01:04.519 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2024-09-12T22:01:04.521 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2024-09-12T22:01:04.522 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-09-12T22:01:04.532 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2024-09-12T22:01:04.532 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2024-09-12T22:01:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-09-12T22:01:04.540 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2024-09-12T22:01:04.547 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:01:04.547 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:01:04.550 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:01:04.552 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2024-09-12T22:01:04.564 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:01:04.566 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:01:04.567 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:01:04.567 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:01:04.582 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:01:04.618 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:01:04.621 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:01:04.621 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-09-12T22:01:04.621 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.621 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.621 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.621 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.622 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:01:04.625 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:01:04.626 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:01:04.626 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-09-12T22:01:04.626 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.626 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.626 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.626 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:01:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-09-12T22:01:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.636 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:01:04.639 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:01:04.639 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-09-12T22:01:04.639 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.639 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.640 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.640 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:01:04.640 INFO:teuthology.run_tasks:Running task install... 2024-09-12T22:01:04.650 DEBUG:teuthology.task.install:project ceph 2024-09-12T22:01:04.650 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}} 2024-09-12T22:01:04.650 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'} 2024-09-12T22:01:04.650 INFO:teuthology.task.install:Using flavor: default 2024-09-12T22:01:04.655 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T22:01:04.655 INFO:teuthology.task.install:extra packages: [] 2024-09-12T22:01:04.655 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:01:04.656 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:01:04.657 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:01:04.657 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:01:04.658 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:01:04.659 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:01:04.659 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:01:04.660 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:01:04.817 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:01:04.817 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:01:04.820 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:01:04.821 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:01:04.823 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:01:04.823 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:01:04.832 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:01:04.832 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:01:04.940 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:01:04.941 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T22:01:04.941 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:01:04.943 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:01:04.943 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T22:01:04.943 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:01:04.951 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:01:04.951 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-12T22:01:04.951 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:01:04.960 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:01:04.960 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T22:01:04.961 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:01:04.969 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:01:04.969 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:01:04.970 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:01:04.970 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:01:04.977 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:01:04.977 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:01:04.988 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:01:04.989 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:01:05.036 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:01:05.040 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:01:05.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:01:05.057 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:01:05.111 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:01:05.115 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:01:05.116 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:01:05.137 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:01:05.175 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2024-09-12T22:01:05.177 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2024-09-12T22:01:05.180 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2024-09-12T22:01:05.182 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2024-09-12T22:01:05.182 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2024-09-12T22:01:05.183 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2024-09-12T22:01:05.204 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-09-12T22:01:05.206 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-09-12T22:01:05.403 INFO:teuthology.orchestra.run.smithi110.stdout:45 files removed 2024-09-12T22:01:05.419 INFO:teuthology.orchestra.run.smithi146.stdout:45 files removed 2024-09-12T22:01:05.425 INFO:teuthology.orchestra.run.smithi043.stdout:45 files removed 2024-09-12T22:01:05.430 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:01:05.446 INFO:teuthology.orchestra.run.smithi047.stdout:45 files removed 2024-09-12T22:01:05.449 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:01:05.453 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:01:05.473 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:01:05.976 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 313 kB/s | 83 kB 00:00 2024-09-12T22:01:06.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 311 kB/s | 83 kB 00:00 2024-09-12T22:01:06.025 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 306 kB/s | 83 kB 00:00 2024-09-12T22:01:06.042 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 309 kB/s | 83 kB 00:00 2024-09-12T22:01:06.319 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 39 kB/s | 12 kB 00:00 2024-09-12T22:01:06.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 38 kB/s | 12 kB 00:00 2024-09-12T22:01:06.376 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 38 kB/s | 12 kB 00:00 2024-09-12T22:01:06.392 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 38 kB/s | 12 kB 00:00 2024-09-12T22:01:06.595 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-12T22:01:06.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-12T22:01:06.652 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T22:01:06.677 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-12T22:01:07.119 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-12T22:01:07.277 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-12T22:01:08.312 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-09-12T22:01:08.609 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-09-12T22:01:09.103 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-12T22:01:09.287 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-12T22:01:11.388 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-12T22:01:11.819 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 20 MB 00:02 2024-09-12T22:01:13.454 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 18 MB/s | 6.5 MB 00:00 2024-09-12T22:01:14.997 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-12T22:01:15.013 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-12T22:01:15.908 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.5 MB 00:00 2024-09-12T22:01:16.175 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-12T22:01:16.353 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T22:01:17.314 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-12T22:01:17.837 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 95 kB/s | 19 kB 00:00 2024-09-12T22:01:18.110 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T22:01:18.282 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-12T22:01:19.170 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-12T22:01:19.219 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T22:01:21.873 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T22:01:23.692 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-12T22:01:24.293 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:01:24.293 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:01:24.367 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-12T22:01:24.385 INFO:teuthology.orchestra.run.smithi043.stdout:====================================================================================== 2024-09-12T22:01:24.385 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-09-12T22:01:24.385 INFO:teuthology.orchestra.run.smithi043.stdout:====================================================================================== 2024-09-12T22:01:24.386 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-12T22:01:24.386 INFO:teuthology.orchestra.run.smithi043.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:01:24.386 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:01:24.386 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:01:24.386 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:01:24.386 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:01:24.386 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:01:24.386 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:01:24.386 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:01:24.386 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:01:24.386 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:01:24.386 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:01:24.386 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:01:24.387 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:01:24.387 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:01:24.387 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:01:24.387 INFO:teuthology.orchestra.run.smithi043.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:01:24.387 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:01:24.387 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:01:24.387 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:01:24.387 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:01:24.387 INFO:teuthology.orchestra.run.smithi043.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:01:24.387 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:01:24.387 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:01:24.387 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:01:24.388 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:01:24.388 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:01:24.388 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:01:24.388 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:01:24.388 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:01:24.388 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:01:24.388 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:01:24.388 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-09-12T22:01:24.388 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:01:24.388 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:01:24.388 INFO:teuthology.orchestra.run.smithi043.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:01:24.388 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:01:24.389 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-12T22:01:24.389 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:01:24.389 INFO:teuthology.orchestra.run.smithi043.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:01:24.389 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:01:24.389 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:01:24.389 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:01:24.389 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:01:24.389 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:01:24.389 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:01:24.389 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:01:24.389 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:01:24.389 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:01:24.389 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:01:24.389 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:01:24.390 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:01:24.390 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:01:24.390 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:01:24.390 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:01:24.390 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:01:24.390 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:01:24.390 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:01:24.390 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:01:24.390 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:01:24.390 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:01:24.390 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:01:24.390 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:01:24.390 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:01:24.391 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:01:24.391 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:01:24.391 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:01:24.391 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:01:24.391 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:01:24.391 INFO:teuthology.orchestra.run.smithi043.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:01:24.391 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:01:24.391 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:01:24.391 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:01:24.391 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:01:24.391 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:01:24.391 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:01:24.391 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:01:24.392 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:01:24.392 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:01:24.392 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:01:24.392 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:01:24.392 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:01:24.392 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:01:24.392 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:01:24.392 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:01:24.392 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:01:24.392 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:01:24.392 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:01:24.392 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:01:24.392 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:01:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:01:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:01:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:01:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:01:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:01:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:01:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:01:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:01:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:01:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:01:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:01:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:01:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:01:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:01:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:01:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:01:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:01:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:01:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:01:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:01:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:01:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:01:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:01:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:01:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:01:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:01:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:01:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:01:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:01:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:01:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:01:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:01:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:01:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:01:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:01:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:01:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:01:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:01:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:01:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:01:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:01:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:01:24.396 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:01:24.396 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:01:24.396 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:01:24.396 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:01:24.396 INFO:teuthology.orchestra.run.smithi043.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:01:24.396 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:01:24.396 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:01:24.396 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:01:24.396 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:01:24.396 INFO:teuthology.orchestra.run.smithi043.stdout:Installing weak dependencies: 2024-09-12T22:01:24.396 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:01:24.396 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:01:24.396 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-12T22:01:24.397 INFO:teuthology.orchestra.run.smithi043.stdout:====================================================================================== 2024-09-12T22:01:24.397 INFO:teuthology.orchestra.run.smithi043.stdout:Install 135 Packages 2024-09-12T22:01:24.397 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 4 Packages 2024-09-12T22:01:24.397 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:01:24.397 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 213 M 2024-09-12T22:01:24.397 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-12T22:01:24.692 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-12T22:01:24.906 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T22:01:25.007 INFO:teuthology.orchestra.run.smithi043.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-12T22:01:25.191 INFO:teuthology.orchestra.run.smithi043.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 4.8 MB/s | 896 kB 00:00 2024-09-12T22:01:25.250 INFO:teuthology.orchestra.run.smithi043.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 2.4 MB/s | 145 kB 00:00 2024-09-12T22:01:25.433 INFO:teuthology.orchestra.run.smithi043.stdout:(4/139): ceph-base-19.1.1-314.g086c737f.el9.x86 9.8 MB/s | 5.4 MB 00:00 2024-09-12T22:01:25.500 INFO:teuthology.orchestra.run.smithi043.stdout:(5/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 9.5 MB/s | 2.4 MB 00:00 2024-09-12T22:01:25.609 INFO:teuthology.orchestra.run.smithi043.stdout:(6/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 8.7 MB/s | 1.5 MB 00:00 2024-09-12T22:01:25.901 INFO:teuthology.orchestra.run.smithi043.stdout:(7/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-12T22:01:26.019 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:01:26.020 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:01:26.090 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-12T22:01:26.111 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2024-09-12T22:01:26.112 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-09-12T22:01:26.112 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2024-09-12T22:01:26.112 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-12T22:01:26.112 INFO:teuthology.orchestra.run.smithi146.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:01:26.112 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:01:26.112 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:01:26.112 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:01:26.112 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:01:26.112 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:01:26.112 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:01:26.112 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:01:26.113 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:01:26.113 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:01:26.113 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:01:26.113 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:01:26.113 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:01:26.113 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:01:26.113 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:01:26.113 INFO:teuthology.orchestra.run.smithi146.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:01:26.113 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:01:26.113 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:01:26.113 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:01:26.113 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:01:26.113 INFO:teuthology.orchestra.run.smithi146.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:01:26.113 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:01:26.114 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:01:26.114 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:01:26.114 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:01:26.114 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:01:26.114 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:01:26.114 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:01:26.114 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:01:26.114 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:01:26.114 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:01:26.114 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2024-09-12T22:01:26.114 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:01:26.114 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:01:26.114 INFO:teuthology.orchestra.run.smithi146.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:01:26.115 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:01:26.115 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-12T22:01:26.115 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:01:26.115 INFO:teuthology.orchestra.run.smithi146.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:01:26.115 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:01:26.115 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:01:26.115 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:01:26.115 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:01:26.115 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:01:26.115 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:01:26.115 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:01:26.115 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:01:26.115 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:01:26.116 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:01:26.116 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:01:26.116 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:01:26.116 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:01:26.116 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:01:26.116 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:01:26.116 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:01:26.116 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:01:26.116 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:01:26.116 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:01:26.116 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:01:26.116 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:01:26.116 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:01:26.117 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:01:26.117 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:01:26.117 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:01:26.117 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:01:26.117 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:01:26.117 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:01:26.117 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:01:26.117 INFO:teuthology.orchestra.run.smithi146.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:01:26.117 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:01:26.117 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:01:26.117 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:01:26.117 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:01:26.117 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:01:26.117 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:01:26.118 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:01:26.118 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:01:26.118 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:01:26.118 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:01:26.118 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:01:26.118 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:01:26.118 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:01:26.118 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:01:26.118 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:01:26.118 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:01:26.118 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:01:26.118 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:01:26.118 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:01:26.118 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:01:26.119 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:01:26.119 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:01:26.119 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:01:26.119 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:01:26.119 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:01:26.119 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:01:26.119 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:01:26.119 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:01:26.119 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:01:26.119 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:01:26.119 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:01:26.119 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:01:26.119 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:01:26.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:01:26.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:01:26.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:01:26.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:01:26.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:01:26.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:01:26.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:01:26.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:01:26.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:01:26.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:01:26.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:01:26.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:01:26.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:01:26.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:01:26.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:01:26.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:01:26.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:01:26.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:01:26.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:01:26.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:01:26.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:01:26.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:01:26.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:01:26.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:01:26.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:01:26.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:01:26.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:01:26.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:01:26.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:01:26.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:01:26.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:01:26.122 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:01:26.122 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:01:26.122 INFO:teuthology.orchestra.run.smithi146.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:01:26.122 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:01:26.122 INFO:teuthology.orchestra.run.smithi146.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:01:26.122 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:01:26.122 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:01:26.122 INFO:teuthology.orchestra.run.smithi146.stdout:Installing weak dependencies: 2024-09-12T22:01:26.122 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:01:26.122 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:01:26.123 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-12T22:01:26.123 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2024-09-12T22:01:26.123 INFO:teuthology.orchestra.run.smithi146.stdout:Install 135 Packages 2024-09-12T22:01:26.123 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 4 Packages 2024-09-12T22:01:26.123 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:01:26.123 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 213 M 2024-09-12T22:01:26.124 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-12T22:01:26.334 INFO:teuthology.orchestra.run.smithi043.stdout:(8/139): ceph-common-19.1.1-314.g086c737f.el9.x 15 MB/s | 21 MB 00:01 2024-09-12T22:01:26.384 INFO:teuthology.orchestra.run.smithi043.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 508 kB/s | 25 kB 00:00 2024-09-12T22:01:26.651 INFO:teuthology.orchestra.run.smithi043.stdout:(10/139): ceph-osd-19.1.1-314.g086c737f.el9.x86 16 MB/s | 17 MB 00:01 2024-09-12T22:01:26.768 INFO:teuthology.orchestra.run.smithi043.stdout:(11/139): ceph-radosgw-19.1.1-314.g086c737f.el9 12 MB/s | 11 MB 00:00 2024-09-12T22:01:26.794 INFO:teuthology.orchestra.run.smithi043.stdout:(12/139): libcephfs-devel-19.1.1-314.g086c737f. 224 kB/s | 32 kB 00:00 2024-09-12T22:01:26.844 INFO:teuthology.orchestra.run.smithi043.stdout:(13/139): libcephfs2-19.1.1-314.g086c737f.el9.x 9.8 MB/s | 753 kB 00:00 2024-09-12T22:01:26.869 INFO:teuthology.orchestra.run.smithi043.stdout:(14/139): libcephsqlite-19.1.1-314.g086c737f.el 2.1 MB/s | 164 kB 00:00 2024-09-12T22:01:26.894 INFO:teuthology.orchestra.run.smithi043.stdout:(15/139): librados-devel-19.1.1-314.g086c737f.e 2.5 MB/s | 127 kB 00:00 2024-09-12T22:01:26.928 INFO:teuthology.orchestra.run.smithi043.stdout:(16/139): libradosstriper1-19.1.1-314.g086c737f 8.4 MB/s | 506 kB 00:00 2024-09-12T22:01:26.943 INFO:teuthology.orchestra.run.smithi146.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 46 kB/s | 6.5 kB 00:00 2024-09-12T22:01:27.003 INFO:teuthology.orchestra.run.smithi043.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 601 kB/s | 45 kB 00:00 2024-09-12T22:01:27.036 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:01:27.036 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:01:27.078 INFO:teuthology.orchestra.run.smithi043.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 1.8 MB/s | 136 kB 00:00 2024-09-12T22:01:27.105 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-12T22:01:27.128 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================== 2024-09-12T22:01:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-12T22:01:27.128 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================== 2024-09-12T22:01:27.128 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-12T22:01:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:01:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:01:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:01:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:01:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:01:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:01:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:01:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:01:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:01:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:01:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:01:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:01:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:01:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:01:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:01:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:01:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:01:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:01:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:01:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:01:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:01:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:01:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:01:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:01:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:01:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:01:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:01:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:01:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:01:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:01:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:01:27.131 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-09-12T22:01:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:01:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:01:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:01:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:01:27.131 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-12T22:01:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:01:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:01:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:01:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:01:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:01:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:01:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:01:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:01:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:01:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:01:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:01:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:01:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:01:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:01:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:01:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:01:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:01:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:01:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:01:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:01:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:01:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:01:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:01:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:01:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:01:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:01:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:01:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:01:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:01:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:01:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:01:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:01:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:01:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:01:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:01:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:01:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:01:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:01:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:01:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:01:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:01:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:01:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:01:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:01:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:01:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:01:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:01:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:01:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:01:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:01:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:01:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:01:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:01:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:01:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:01:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:01:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:01:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:01:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:01:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:01:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:01:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:01:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:01:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:01:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:01:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:01:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:01:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:01:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:01:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:01:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:01:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:01:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:01:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:01:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:01:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:01:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:01:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:01:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:01:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:01:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:01:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:01:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:01:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:01:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:01:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:01:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:01:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:01:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:01:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:01:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:01:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:01:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:01:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:01:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:01:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:01:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:01:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:01:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:01:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:01:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:01:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:01:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:01:27.140 INFO:teuthology.orchestra.run.smithi110.stdout:Installing weak dependencies: 2024-09-12T22:01:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:01:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:01:27.140 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-12T22:01:27.140 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================== 2024-09-12T22:01:27.140 INFO:teuthology.orchestra.run.smithi110.stdout:Install 135 Packages 2024-09-12T22:01:27.140 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 4 Packages 2024-09-12T22:01:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:01:27.141 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 213 M 2024-09-12T22:01:27.141 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-12T22:01:27.162 INFO:teuthology.orchestra.run.smithi043.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 1.9 MB/s | 162 kB 00:00 2024-09-12T22:01:27.237 INFO:teuthology.orchestra.run.smithi043.stdout:(20/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-12T22:01:27.271 INFO:teuthology.orchestra.run.smithi043.stdout:(21/139): python3-rados-19.1.1-314.g086c737f.el 2.9 MB/s | 320 kB 00:00 2024-09-12T22:01:27.296 INFO:teuthology.orchestra.run.smithi043.stdout:(22/139): python3-rbd-19.1.1-314.g086c737f.el9. 5.0 MB/s | 301 kB 00:00 2024-09-12T22:01:27.322 INFO:teuthology.orchestra.run.smithi043.stdout:(23/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.9 MB/s | 99 kB 00:00 2024-09-12T22:01:27.347 INFO:teuthology.orchestra.run.smithi043.stdout:(24/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T22:01:27.359 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:01:27.360 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:01:27.402 INFO:teuthology.orchestra.run.smithi146.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 1.9 MB/s | 896 kB 00:00 2024-09-12T22:01:27.414 INFO:teuthology.orchestra.run.smithi043.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-12T22:01:27.434 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T22:01:27.461 INFO:teuthology.orchestra.run.smithi047.stdout:====================================================================================== 2024-09-12T22:01:27.461 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T22:01:27.461 INFO:teuthology.orchestra.run.smithi047.stdout:====================================================================================== 2024-09-12T22:01:27.461 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T22:01:27.461 INFO:teuthology.orchestra.run.smithi047.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:01:27.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:01:27.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:01:27.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:01:27.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:01:27.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:01:27.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:01:27.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:01:27.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:01:27.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:01:27.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:01:27.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:01:27.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:01:27.463 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:01:27.463 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:01:27.463 INFO:teuthology.orchestra.run.smithi047.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:01:27.463 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:01:27.463 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:01:27.463 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:01:27.463 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:01:27.463 INFO:teuthology.orchestra.run.smithi047.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:01:27.463 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:01:27.463 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:01:27.463 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:01:27.463 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:01:27.463 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:01:27.464 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:01:27.464 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:01:27.464 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:01:27.464 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:01:27.464 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:01:27.464 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-09-12T22:01:27.464 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:01:27.464 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:01:27.464 INFO:teuthology.orchestra.run.smithi047.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:01:27.464 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:01:27.464 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T22:01:27.464 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:01:27.465 INFO:teuthology.orchestra.run.smithi047.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:01:27.465 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:01:27.465 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:01:27.465 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:01:27.465 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:01:27.465 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:01:27.465 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:01:27.465 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:01:27.465 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:01:27.465 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:01:27.465 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:01:27.465 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:01:27.465 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:01:27.466 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:01:27.466 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:01:27.466 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:01:27.466 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:01:27.466 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:01:27.466 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:01:27.466 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:01:27.466 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:01:27.466 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:01:27.466 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:01:27.466 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:01:27.466 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:01:27.466 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:01:27.467 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:01:27.467 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:01:27.467 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:01:27.467 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:01:27.467 INFO:teuthology.orchestra.run.smithi047.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:01:27.467 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:01:27.467 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:01:27.467 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:01:27.467 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:01:27.467 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:01:27.467 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:01:27.467 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:01:27.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:01:27.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:01:27.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:01:27.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:01:27.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:01:27.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:01:27.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:01:27.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:01:27.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:01:27.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:01:27.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:01:27.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:01:27.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:01:27.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:01:27.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:01:27.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:01:27.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:01:27.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:01:27.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:01:27.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:01:27.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:01:27.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:01:27.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:01:27.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:01:27.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:01:27.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:01:27.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:01:27.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:01:27.470 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:01:27.470 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:01:27.470 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:01:27.470 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:01:27.470 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:01:27.470 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:01:27.470 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:01:27.470 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:01:27.470 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:01:27.470 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:01:27.470 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:01:27.470 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:01:27.470 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:01:27.471 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:01:27.471 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:01:27.471 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:01:27.471 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:01:27.471 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:01:27.471 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:01:27.471 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:01:27.471 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:01:27.471 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:01:27.471 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:01:27.471 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:01:27.471 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:01:27.471 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:01:27.471 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:01:27.472 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:01:27.472 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:01:27.472 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:01:27.472 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:01:27.472 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:01:27.472 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:01:27.472 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:01:27.472 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:01:27.472 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:01:27.472 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-09-12T22:01:27.472 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:01:27.472 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:01:27.472 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T22:01:27.473 INFO:teuthology.orchestra.run.smithi047.stdout:====================================================================================== 2024-09-12T22:01:27.473 INFO:teuthology.orchestra.run.smithi047.stdout:Install 135 Packages 2024-09-12T22:01:27.473 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 4 Packages 2024-09-12T22:01:27.473 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:01:27.474 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 213 M 2024-09-12T22:01:27.474 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T22:01:27.480 INFO:teuthology.orchestra.run.smithi043.stdout:(26/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 20 MB/s | 3.1 MB 00:00 2024-09-12T22:01:27.502 INFO:teuthology.orchestra.run.smithi146.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 1.4 MB/s | 145 kB 00:00 2024-09-12T22:01:27.506 INFO:teuthology.orchestra.run.smithi043.stdout:(27/139): ceph-grafana-dashboards-19.1.1-314.g0 347 kB/s | 32 kB 00:00 2024-09-12T22:01:27.540 INFO:teuthology.orchestra.run.smithi043.stdout:(28/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 2.4 MB/s | 146 kB 00:00 2024-09-12T22:01:27.832 INFO:teuthology.orchestra.run.smithi043.stdout:(29/139): ceph-mgr-dashboard-19.1.1-314.g086c73 11 MB/s | 3.6 MB 00:00 2024-09-12T22:01:27.890 INFO:teuthology.orchestra.run.smithi043.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 4.2 MB/s | 249 kB 00:00 2024-09-12T22:01:27.965 INFO:teuthology.orchestra.run.smithi043.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 659 kB/s | 49 kB 00:00 2024-09-12T22:01:28.035 INFO:teuthology.orchestra.run.smithi110.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 44 kB/s | 6.5 kB 00:00 2024-09-12T22:01:28.049 INFO:teuthology.orchestra.run.smithi043.stdout:(32/139): ceph-mgr-diskprediction-local-19.1.1- 15 MB/s | 7.4 MB 00:00 2024-09-12T22:01:28.074 INFO:teuthology.orchestra.run.smithi043.stdout:(33/139): ceph-prometheus-alerts-19.1.1-314.g08 151 kB/s | 16 kB 00:00 2024-09-12T22:01:28.100 INFO:teuthology.orchestra.run.smithi043.stdout:(34/139): ceph-volume-19.1.1-314.g086c737f.el9. 5.6 MB/s | 285 kB 00:00 2024-09-12T22:01:28.144 INFO:teuthology.orchestra.run.smithi146.stdout:(4/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 3.7 MB/s | 2.4 MB 00:00 2024-09-12T22:01:28.150 INFO:teuthology.orchestra.run.smithi043.stdout:(35/139): cephadm-19.1.1-314.g086c737f.el9.noar 9.9 MB/s | 765 kB 00:00 2024-09-12T22:01:28.250 INFO:teuthology.orchestra.run.smithi043.stdout:(36/139): fuse-2.9.9-16.el9.x86_64.rpm 532 kB/s | 80 kB 00:00 2024-09-12T22:01:28.252 INFO:teuthology.orchestra.run.smithi110.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 4.0 MB/s | 896 kB 00:00 2024-09-12T22:01:28.334 INFO:teuthology.orchestra.run.smithi043.stdout:(37/139): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-12T22:01:28.336 INFO:teuthology.orchestra.run.smithi110.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 1.7 MB/s | 145 kB 00:00 2024-09-12T22:01:28.367 INFO:teuthology.orchestra.run.smithi043.stdout:(38/139): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-12T22:01:28.401 INFO:teuthology.orchestra.run.smithi043.stdout:(39/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-12T22:01:28.453 INFO:teuthology.orchestra.run.smithi146.stdout:(5/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 4.9 MB/s | 1.5 MB 00:00 2024-09-12T22:01:28.523 INFO:teuthology.orchestra.run.smithi047.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 29 kB/s | 6.5 kB 00:00 2024-09-12T22:01:28.594 INFO:teuthology.orchestra.run.smithi110.stdout:(4/139): ceph-base-19.1.1-314.g086c737f.el9.x86 7.6 MB/s | 5.4 MB 00:00 2024-09-12T22:01:28.615 INFO:teuthology.orchestra.run.smithi043.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 500 kB/s | 106 kB 00:00 2024-09-12T22:01:28.645 INFO:teuthology.orchestra.run.smithi110.stdout:(5/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 7.7 MB/s | 2.4 MB 00:00 2024-09-12T22:01:28.804 INFO:teuthology.orchestra.run.smithi110.stdout:(6/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 7.3 MB/s | 1.5 MB 00:00 2024-09-12T22:01:28.898 INFO:teuthology.orchestra.run.smithi146.stdout:(6/139): ceph-base-19.1.1-314.g086c737f.el9.x86 2.6 MB/s | 5.4 MB 00:02 2024-09-12T22:01:28.982 INFO:teuthology.orchestra.run.smithi047.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 1.9 MB/s | 896 kB 00:00 2024-09-12T22:01:28.995 INFO:teuthology.orchestra.run.smithi146.stdout:(7/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 8.7 MB/s | 4.7 MB 00:00 2024-09-12T22:01:29.052 INFO:teuthology.orchestra.run.smithi043.stdout:(41/139): ceph-test-19.1.1-314.g086c737f.el9.x8 18 MB/s | 49 MB 00:02 2024-09-12T22:01:29.103 INFO:teuthology.orchestra.run.smithi043.stdout:(42/139): python3-cryptography-36.0.1-4.el9.x86 1.7 MB/s | 1.2 MB 00:00 2024-09-12T22:01:29.127 INFO:teuthology.orchestra.run.smithi043.stdout:(43/139): python3-pycparser-2.20-6.el9.noarch.r 264 kB/s | 135 kB 00:00 2024-09-12T22:01:29.152 INFO:teuthology.orchestra.run.smithi043.stdout:(44/139): python3-urllib3-1.26.5-6.el9.noarch.r 4.3 MB/s | 215 kB 00:00 2024-09-12T22:01:29.170 INFO:teuthology.orchestra.run.smithi110.stdout:(7/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 9.0 MB/s | 4.7 MB 00:00 2024-09-12T22:01:29.190 INFO:teuthology.orchestra.run.smithi047.stdout:(3/139): ceph-base-19.1.1-314.g086c737f.el9.x86 6.1 MB/s | 5.4 MB 00:00 2024-09-12T22:01:29.217 INFO:teuthology.orchestra.run.smithi047.stdout:(4/139): ceph-immutable-object-cache-19.1.1-314 622 kB/s | 145 kB 00:00 2024-09-12T22:01:29.227 INFO:teuthology.orchestra.run.smithi043.stdout:(45/139): python3-requests-2.25.1-8.el9.noarch. 711 kB/s | 125 kB 00:00 2024-09-12T22:01:29.386 INFO:teuthology.orchestra.run.smithi043.stdout:(46/139): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-12T22:01:29.428 INFO:teuthology.orchestra.run.smithi043.stdout:(47/139): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-12T22:01:29.453 INFO:teuthology.orchestra.run.smithi043.stdout:(48/139): boost-program-options-1.75.0-8.el9.x8 474 kB/s | 107 kB 00:00 2024-09-12T22:01:29.479 INFO:teuthology.orchestra.run.smithi043.stdout:(49/139): elfutils-libelf-devel-0.191-4.el9.x86 236 kB/s | 22 kB 00:00 2024-09-12T22:01:29.504 INFO:teuthology.orchestra.run.smithi043.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-09-12T22:01:29.549 INFO:teuthology.orchestra.run.smithi047.stdout:(5/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 4.6 MB/s | 1.5 MB 00:00 2024-09-12T22:01:29.554 INFO:teuthology.orchestra.run.smithi043.stdout:(51/139): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-12T22:01:29.596 INFO:teuthology.orchestra.run.smithi043.stdout:(52/139): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-09-12T22:01:29.625 INFO:teuthology.orchestra.run.smithi043.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-09-12T22:01:29.655 INFO:teuthology.orchestra.run.smithi043.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T22:01:29.680 INFO:teuthology.orchestra.run.smithi043.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-09-12T22:01:29.714 INFO:teuthology.orchestra.run.smithi043.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-12T22:01:29.764 INFO:teuthology.orchestra.run.smithi043.stdout:(57/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-09-12T22:01:29.790 INFO:teuthology.orchestra.run.smithi043.stdout:(58/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-12T22:01:29.815 INFO:teuthology.orchestra.run.smithi043.stdout:(59/139): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-09-12T22:01:29.840 INFO:teuthology.orchestra.run.smithi043.stdout:(60/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-12T22:01:29.865 INFO:teuthology.orchestra.run.smithi043.stdout:(61/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-12T22:01:29.891 INFO:teuthology.orchestra.run.smithi043.stdout:(62/139): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-12T22:01:29.916 INFO:teuthology.orchestra.run.smithi043.stdout:(63/139): openblas-0.3.26-2.el9.x86_64.rpm 509 kB/s | 38 kB 00:00 2024-09-12T22:01:29.991 INFO:teuthology.orchestra.run.smithi043.stdout:(64/139): protobuf-3.14.0-13.el9.x86_64.rpm 14 MB/s | 1.0 MB 00:00 2024-09-12T22:01:30.066 INFO:teuthology.orchestra.run.smithi043.stdout:(65/139): openblas-openmp-0.3.26-2.el9.x86_64.r 25 MB/s | 4.9 MB 00:00 2024-09-12T22:01:30.133 INFO:teuthology.orchestra.run.smithi043.stdout:(66/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-12T22:01:30.175 INFO:teuthology.orchestra.run.smithi043.stdout:(67/139): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-12T22:01:30.242 INFO:teuthology.orchestra.run.smithi043.stdout:(68/139): python3-jinja2-2.11.3-6.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-09-12T22:01:30.259 INFO:teuthology.orchestra.run.smithi043.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 306 kB/s | 26 kB 00:00 2024-09-12T22:01:30.284 INFO:teuthology.orchestra.run.smithi043.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 459 kB/s | 19 kB 00:00 2024-09-12T22:01:30.308 INFO:teuthology.orchestra.run.smithi047.stdout:(6/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 6.2 MB/s | 4.7 MB 00:00 2024-09-12T22:01:30.318 INFO:teuthology.orchestra.run.smithi043.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-12T22:01:30.335 INFO:teuthology.orchestra.run.smithi043.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-12T22:01:30.341 INFO:teuthology.orchestra.run.smithi110.stdout:(8/139): ceph-osd-19.1.1-314.g086c737f.el9.x86_ 11 MB/s | 17 MB 00:01 2024-09-12T22:01:30.392 INFO:teuthology.orchestra.run.smithi047.stdout:(7/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 2.0 MB/s | 2.4 MB 00:01 2024-09-12T22:01:30.410 INFO:teuthology.orchestra.run.smithi043.stdout:(73/139): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-12T22:01:30.435 INFO:teuthology.orchestra.run.smithi043.stdout:(74/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-12T22:01:30.436 INFO:teuthology.orchestra.run.smithi146.stdout:(8/139): ceph-radosgw-19.1.1-314.g086c737f.el9. 7.4 MB/s | 11 MB 00:01 2024-09-12T22:01:30.469 INFO:teuthology.orchestra.run.smithi043.stdout:(75/139): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-12T22:01:30.487 INFO:teuthology.orchestra.run.smithi146.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 507 kB/s | 25 kB 00:00 2024-09-12T22:01:30.494 INFO:teuthology.orchestra.run.smithi043.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T22:01:30.519 INFO:teuthology.orchestra.run.smithi043.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-09-12T22:01:30.538 INFO:teuthology.orchestra.run.smithi110.stdout:(9/139): ceph-radosgw-19.1.1-314.g086c737f.el9. 7.8 MB/s | 11 MB 00:01 2024-09-12T22:01:30.553 INFO:teuthology.orchestra.run.smithi043.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-12T22:01:30.563 INFO:teuthology.orchestra.run.smithi110.stdout:(10/139): ceph-selinux-19.1.1-314.g086c737f.el9 113 kB/s | 25 kB 00:00 2024-09-12T22:01:30.578 INFO:teuthology.orchestra.run.smithi043.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-12T22:01:30.612 INFO:teuthology.orchestra.run.smithi043.stdout:(80/139): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-12T22:01:30.637 INFO:teuthology.orchestra.run.smithi043.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 868 kB/s | 51 kB 00:00 2024-09-12T22:01:30.638 INFO:teuthology.orchestra.run.smithi110.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 424 kB/s | 32 kB 00:00 2024-09-12T22:01:30.713 INFO:teuthology.orchestra.run.smithi043.stdout:(82/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-12T22:01:30.738 INFO:teuthology.orchestra.run.smithi043.stdout:(83/139): python3-requests-oauthlib-1.3.0-12.el 427 kB/s | 54 kB 00:00 2024-09-12T22:01:30.771 INFO:teuthology.orchestra.run.smithi043.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-09-12T22:01:30.797 INFO:teuthology.orchestra.run.smithi110.stdout:(12/139): libcephfs2-19.1.1-314.g086c737f.el9.x 4.6 MB/s | 753 kB 00:00 2024-09-12T22:01:30.797 INFO:teuthology.orchestra.run.smithi043.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T22:01:30.830 INFO:teuthology.orchestra.run.smithi043.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 614 kB/s | 36 kB 00:00 2024-09-12T22:01:30.856 INFO:teuthology.orchestra.run.smithi043.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-09-12T22:01:30.889 INFO:teuthology.orchestra.run.smithi110.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 1.7 MB/s | 164 kB 00:00 2024-09-12T22:01:30.889 INFO:teuthology.orchestra.run.smithi043.stdout:(88/139): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T22:01:30.914 INFO:teuthology.orchestra.run.smithi043.stdout:(89/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-12T22:01:30.956 INFO:teuthology.orchestra.run.smithi110.stdout:(14/139): librados-devel-19.1.1-314.g086c737f.e 1.9 MB/s | 127 kB 00:00 2024-09-12T22:01:30.965 INFO:teuthology.orchestra.run.smithi043.stdout:(90/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 897 kB/s | 45 kB 00:00 2024-09-12T22:01:30.970 INFO:teuthology.orchestra.run.smithi146.stdout:(10/139): ceph-common-19.1.1-314.g086c737f.el9. 5.1 MB/s | 21 MB 00:04 2024-09-12T22:01:30.990 INFO:teuthology.orchestra.run.smithi043.stdout:(91/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 634 kB/s | 64 kB 00:00 2024-09-12T22:01:31.048 INFO:teuthology.orchestra.run.smithi110.stdout:(15/139): libradosstriper1-19.1.1-314.g086c737f 5.4 MB/s | 506 kB 00:00 2024-09-12T22:01:31.070 INFO:teuthology.orchestra.run.smithi146.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 319 kB/s | 32 kB 00:00 2024-09-12T22:01:31.074 INFO:teuthology.orchestra.run.smithi043.stdout:(92/139): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-12T22:01:31.229 INFO:teuthology.orchestra.run.smithi146.stdout:(12/139): libcephfs2-19.1.1-314.g086c737f.el9.x 4.7 MB/s | 753 kB 00:00 2024-09-12T22:01:31.241 INFO:teuthology.orchestra.run.smithi043.stdout:(93/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-12T22:01:31.242 INFO:teuthology.orchestra.run.smithi047.stdout:(8/139): ceph-common-19.1.1-314.g086c737f.el9.x 7.2 MB/s | 21 MB 00:02 2024-09-12T22:01:31.273 INFO:teuthology.orchestra.run.smithi110.stdout:(16/139): ceph-common-19.1.1-314.g086c737f.el9. 6.3 MB/s | 21 MB 00:03 2024-09-12T22:01:31.299 INFO:teuthology.orchestra.run.smithi043.stdout:(94/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 2.4 MB/s | 548 kB 00:00 2024-09-12T22:01:31.300 INFO:teuthology.orchestra.run.smithi047.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 433 kB/s | 25 kB 00:00 2024-09-12T22:01:31.313 INFO:teuthology.orchestra.run.smithi146.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 1.9 MB/s | 164 kB 00:00 2024-09-12T22:01:31.324 INFO:teuthology.orchestra.run.smithi043.stdout:(95/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 4.0 MB/s | 308 kB 00:00 2024-09-12T22:01:31.350 INFO:teuthology.orchestra.run.smithi043.stdout:(96/139): grpc-data-1.46.7-10.el9.noarch.rpm 389 kB/s | 19 kB 00:00 2024-09-12T22:01:31.365 INFO:teuthology.orchestra.run.smithi110.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 493 kB/s | 45 kB 00:00 2024-09-12T22:01:31.375 INFO:teuthology.orchestra.run.smithi043.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T22:01:31.400 INFO:teuthology.orchestra.run.smithi043.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T22:01:31.421 INFO:teuthology.orchestra.run.smithi146.stdout:(14/139): librados-devel-19.1.1-314.g086c737f.e 1.1 MB/s | 127 kB 00:00 2024-09-12T22:01:31.425 INFO:teuthology.orchestra.run.smithi043.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T22:01:31.451 INFO:teuthology.orchestra.run.smithi043.stdout:(100/139): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-12T22:01:31.474 INFO:teuthology.orchestra.run.smithi110.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 1.2 MB/s | 136 kB 00:00 2024-09-12T22:01:31.484 INFO:teuthology.orchestra.run.smithi043.stdout:(101/139): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-12T22:01:31.526 INFO:teuthology.orchestra.run.smithi043.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 14 MB/s | 548 kB 00:00 2024-09-12T22:01:31.551 INFO:teuthology.orchestra.run.smithi043.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T22:01:31.585 INFO:teuthology.orchestra.run.smithi043.stdout:(104/139): python3-cachetools-4.2.4-1.el9.noarc 973 kB/s | 32 kB 00:00 2024-09-12T22:01:31.591 INFO:teuthology.orchestra.run.smithi110.stdout:(19/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 9.8 MB/s | 5.3 MB 00:00 2024-09-12T22:01:31.596 INFO:teuthology.orchestra.run.smithi146.stdout:(15/139): libradosstriper1-19.1.1-314.g086c737f 2.8 MB/s | 506 kB 00:00 2024-09-12T22:01:31.610 INFO:teuthology.orchestra.run.smithi043.stdout:(105/139): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-12T22:01:31.616 INFO:teuthology.orchestra.run.smithi110.stdout:(20/139): python3-cephfs-19.1.1-314.g086c737f.e 1.1 MB/s | 162 kB 00:00 2024-09-12T22:01:31.635 INFO:teuthology.orchestra.run.smithi043.stdout:(106/139): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-12T22:01:31.669 INFO:teuthology.orchestra.run.smithi043.stdout:(107/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-09-12T22:01:31.675 INFO:teuthology.orchestra.run.smithi110.stdout:(21/139): python3-rados-19.1.1-314.g086c737f.el 3.7 MB/s | 320 kB 00:00 2024-09-12T22:01:31.702 INFO:teuthology.orchestra.run.smithi043.stdout:(108/139): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-12T22:01:31.716 INFO:teuthology.orchestra.run.smithi110.stdout:(22/139): python3-rbd-19.1.1-314.g086c737f.el9. 2.9 MB/s | 301 kB 00:00 2024-09-12T22:01:31.728 INFO:teuthology.orchestra.run.smithi043.stdout:(109/139): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T22:01:31.753 INFO:teuthology.orchestra.run.smithi043.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T22:01:31.767 INFO:teuthology.orchestra.run.smithi110.stdout:(23/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.1 MB/s | 99 kB 00:00 2024-09-12T22:01:31.778 INFO:teuthology.orchestra.run.smithi043.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-12T22:01:31.800 INFO:teuthology.orchestra.run.smithi110.stdout:(24/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.0 MB/s | 85 kB 00:00 2024-09-12T22:01:31.803 INFO:teuthology.orchestra.run.smithi043.stdout:(112/139): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-12T22:01:31.829 INFO:teuthology.orchestra.run.smithi043.stdout:(113/139): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-12T22:01:31.846 INFO:teuthology.orchestra.run.smithi043.stdout:(114/139): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-12T22:01:31.863 INFO:teuthology.orchestra.run.smithi043.stdout:(115/139): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-12T22:01:31.909 INFO:teuthology.orchestra.run.smithi110.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 1.5 MB/s | 171 kB 00:00 2024-09-12T22:01:31.922 INFO:teuthology.orchestra.run.smithi043.stdout:(116/139): python3-kubernetes-26.1.0-2.el9.noar 17 MB/s | 1.0 MB 00:00 2024-09-12T22:01:31.939 INFO:teuthology.orchestra.run.smithi043.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-12T22:01:31.981 INFO:teuthology.orchestra.run.smithi043.stdout:(118/139): python3-grpcio-1.46.7-10.el9.x86_64. 7.3 MB/s | 2.0 MB 00:00 2024-09-12T22:01:32.001 INFO:teuthology.orchestra.run.smithi110.stdout:(26/139): ceph-grafana-dashboards-19.1.1-314.g0 347 kB/s | 32 kB 00:00 2024-09-12T22:01:32.006 INFO:teuthology.orchestra.run.smithi043.stdout:(119/139): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-12T22:01:32.073 INFO:teuthology.orchestra.run.smithi043.stdout:(120/139): libarrow-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2024-09-12T22:01:32.092 INFO:teuthology.orchestra.run.smithi047.stdout:(10/139): ceph-osd-19.1.1-314.g086c737f.el9.x86 9.4 MB/s | 17 MB 00:01 2024-09-12T22:01:32.093 INFO:teuthology.orchestra.run.smithi110.stdout:(27/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 9.5 MB/s | 3.1 MB 00:00 2024-09-12T22:01:32.098 INFO:teuthology.orchestra.run.smithi043.stdout:(121/139): python3-natsort-7.1.1-5.el9.noarch.r 629 kB/s | 58 kB 00:00 2024-09-12T22:01:32.119 INFO:teuthology.orchestra.run.smithi110.stdout:(28/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 1.2 MB/s | 146 kB 00:00 2024-09-12T22:01:32.123 INFO:teuthology.orchestra.run.smithi043.stdout:(122/139): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-12T22:01:32.148 INFO:teuthology.orchestra.run.smithi043.stdout:(123/139): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-12T22:01:32.159 INFO:teuthology.orchestra.run.smithi047.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 476 kB/s | 32 kB 00:00 2024-09-12T22:01:32.174 INFO:teuthology.orchestra.run.smithi043.stdout:(124/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-12T22:01:32.199 INFO:teuthology.orchestra.run.smithi043.stdout:(125/139): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T22:01:32.224 INFO:teuthology.orchestra.run.smithi043.stdout:(126/139): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-09-12T22:01:32.249 INFO:teuthology.orchestra.run.smithi043.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T22:01:32.275 INFO:teuthology.orchestra.run.smithi043.stdout:(128/139): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-12T22:01:32.300 INFO:teuthology.orchestra.run.smithi043.stdout:(129/139): python3-typing-extensions-4.12.2-2.e 990 kB/s | 74 kB 00:00 2024-09-12T22:01:32.334 INFO:teuthology.orchestra.run.smithi043.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-12T22:01:32.343 INFO:teuthology.orchestra.run.smithi047.stdout:(12/139): libcephfs2-19.1.1-314.g086c737f.el9.x 4.0 MB/s | 753 kB 00:00 2024-09-12T22:01:32.350 INFO:teuthology.orchestra.run.smithi043.stdout:(131/139): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-12T22:01:32.376 INFO:teuthology.orchestra.run.smithi043.stdout:(132/139): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-12T22:01:32.401 INFO:teuthology.orchestra.run.smithi043.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T22:01:32.426 INFO:teuthology.orchestra.run.smithi043.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T22:01:32.435 INFO:teuthology.orchestra.run.smithi047.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 1.7 MB/s | 164 kB 00:00 2024-09-12T22:01:32.435 INFO:teuthology.orchestra.run.smithi110.stdout:(29/139): ceph-mgr-dashboard-19.1.1-314.g086c73 10 MB/s | 3.6 MB 00:00 2024-09-12T22:01:32.496 INFO:teuthology.orchestra.run.smithi043.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-12T22:01:32.502 INFO:teuthology.orchestra.run.smithi047.stdout:(14/139): librados-devel-19.1.1-314.g086c737f.e 1.9 MB/s | 127 kB 00:00 2024-09-12T22:01:32.519 INFO:teuthology.orchestra.run.smithi110.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 2.9 MB/s | 249 kB 00:00 2024-09-12T22:01:32.577 INFO:teuthology.orchestra.run.smithi043.stdout:(136/139): openssl-3.2.2-6.el9.x86_64.rpm 19 MB/s | 1.4 MB 00:00 2024-09-12T22:01:32.577 INFO:teuthology.orchestra.run.smithi047.stdout:(15/139): libradosstriper1-19.1.1-314.g086c737f 6.6 MB/s | 506 kB 00:00 2024-09-12T22:01:32.611 INFO:teuthology.orchestra.run.smithi110.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 539 kB/s | 49 kB 00:00 2024-09-12T22:01:32.660 INFO:teuthology.orchestra.run.smithi043.stdout:(137/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-12T22:01:32.696 INFO:teuthology.orchestra.run.smithi110.stdout:(32/139): ceph-prometheus-alerts-19.1.1-314.g08 197 kB/s | 16 kB 00:00 2024-09-12T22:01:32.778 INFO:teuthology.orchestra.run.smithi110.stdout:(33/139): ceph-volume-19.1.1-314.g086c737f.el9. 3.3 MB/s | 285 kB 00:00 2024-09-12T22:01:32.895 INFO:teuthology.orchestra.run.smithi110.stdout:(34/139): cephadm-19.1.1-314.g086c737f.el9.noar 6.4 MB/s | 765 kB 00:00 2024-09-12T22:01:32.969 INFO:teuthology.orchestra.run.smithi043.stdout:(138/139): librados2-19.1.1-314.g086c737f.el9.x 6.0 MB/s | 3.4 MB 00:00 2024-09-12T22:01:32.988 INFO:teuthology.orchestra.run.smithi146.stdout:(16/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 3.8 MB/s | 5.3 MB 00:01 2024-09-12T22:01:33.055 INFO:teuthology.orchestra.run.smithi146.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 680 kB/s | 45 kB 00:00 2024-09-12T22:01:33.181 INFO:teuthology.orchestra.run.smithi146.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 1.1 MB/s | 136 kB 00:00 2024-09-12T22:01:33.236 INFO:teuthology.orchestra.run.smithi047.stdout:(16/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 8.1 MB/s | 5.3 MB 00:00 2024-09-12T22:01:33.256 INFO:teuthology.orchestra.run.smithi146.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 2.1 MB/s | 162 kB 00:00 2024-09-12T22:01:33.271 INFO:teuthology.orchestra.run.smithi110.stdout:(35/139): fuse-2.9.9-16.el9.x86_64.rpm 213 kB/s | 80 kB 00:00 2024-09-12T22:01:33.304 INFO:teuthology.orchestra.run.smithi047.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 679 kB/s | 45 kB 00:00 2024-09-12T22:01:33.348 INFO:teuthology.orchestra.run.smithi146.stdout:(20/139): python3-rados-19.1.1-314.g086c737f.el 3.4 MB/s | 320 kB 00:00 2024-09-12T22:01:33.361 INFO:teuthology.orchestra.run.smithi047.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 2.3 MB/s | 136 kB 00:00 2024-09-12T22:01:33.363 INFO:teuthology.orchestra.run.smithi110.stdout:(36/139): ceph-mgr-diskprediction-local-19.1.1- 6.0 MB/s | 7.4 MB 00:01 2024-09-12T22:01:33.428 INFO:teuthology.orchestra.run.smithi047.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 2.4 MB/s | 162 kB 00:00 2024-09-12T22:01:33.456 INFO:teuthology.orchestra.run.smithi146.stdout:(21/139): python3-rbd-19.1.1-314.g086c737f.el9. 2.7 MB/s | 301 kB 00:00 2024-09-12T22:01:33.495 INFO:teuthology.orchestra.run.smithi047.stdout:(20/139): python3-rados-19.1.1-314.g086c737f.el 4.7 MB/s | 320 kB 00:00 2024-09-12T22:01:33.523 INFO:teuthology.orchestra.run.smithi146.stdout:(22/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.5 MB/s | 99 kB 00:00 2024-09-12T22:01:33.562 INFO:teuthology.orchestra.run.smithi047.stdout:(21/139): python3-rbd-19.1.1-314.g086c737f.el9. 4.4 MB/s | 301 kB 00:00 2024-09-12T22:01:33.590 INFO:teuthology.orchestra.run.smithi146.stdout:(23/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-12T22:01:33.629 INFO:teuthology.orchestra.run.smithi047.stdout:(22/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.5 MB/s | 99 kB 00:00 2024-09-12T22:01:33.696 INFO:teuthology.orchestra.run.smithi047.stdout:(23/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.3 MB/s | 85 kB 00:00 2024-09-12T22:01:33.830 INFO:teuthology.orchestra.run.smithi110.stdout:(37/139): libgfortran-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 801 kB 00:00 2024-09-12T22:01:33.916 INFO:teuthology.orchestra.run.smithi110.stdout:(38/139): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-12T22:01:33.936 INFO:teuthology.orchestra.run.smithi043.stdout:(139/139): librbd1-19.1.1-314.g086c737f.el9.x86 2.1 MB/s | 3.2 MB 00:01 2024-09-12T22:01:33.942 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:01:33.942 INFO:teuthology.orchestra.run.smithi043.stdout:Total 22 MB/s | 213 MB 00:09 2024-09-12T22:01:33.947 INFO:teuthology.orchestra.run.smithi110.stdout:(39/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-12T22:01:34.064 INFO:teuthology.orchestra.run.smithi110.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 912 kB/s | 106 kB 00:00 2024-09-12T22:01:34.088 INFO:teuthology.orchestra.run.smithi047.stdout:(24/139): ceph-radosgw-19.1.1-314.g086c737f.el9 2.9 MB/s | 11 MB 00:03 2024-09-12T22:01:34.147 INFO:teuthology.orchestra.run.smithi047.stdout:(25/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 6.9 MB/s | 3.1 MB 00:00 2024-09-12T22:01:34.172 INFO:teuthology.orchestra.run.smithi047.stdout:(26/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-12T22:01:34.181 INFO:teuthology.orchestra.run.smithi110.stdout:(41/139): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-12T22:01:34.191 INFO:teuthology.orchestra.run.smithi146.stdout:(24/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 5.2 MB/s | 3.1 MB 00:00 2024-09-12T22:01:34.197 INFO:teuthology.orchestra.run.smithi047.stdout:(27/139): ceph-grafana-dashboards-19.1.1-314.g0 634 kB/s | 32 kB 00:00 2024-09-12T22:01:34.230 INFO:teuthology.orchestra.run.smithi047.stdout:(28/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 2.4 MB/s | 146 kB 00:00 2024-09-12T22:01:34.268 INFO:teuthology.orchestra.run.smithi146.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-12T22:01:34.298 INFO:teuthology.orchestra.run.smithi110.stdout:(42/139): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-12T22:01:34.341 INFO:teuthology.orchestra.run.smithi146.stdout:(26/139): ceph-grafana-dashboards-19.1.1-314.g0 439 kB/s | 32 kB 00:00 2024-09-12T22:01:34.400 INFO:teuthology.orchestra.run.smithi146.stdout:(27/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 2.5 MB/s | 146 kB 00:00 2024-09-12T22:01:34.572 INFO:teuthology.orchestra.run.smithi047.stdout:(29/139): ceph-mgr-dashboard-19.1.1-314.g086c73 9.5 MB/s | 3.6 MB 00:00 2024-09-12T22:01:34.631 INFO:teuthology.orchestra.run.smithi047.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 4.2 MB/s | 249 kB 00:00 2024-09-12T22:01:34.690 INFO:teuthology.orchestra.run.smithi047.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 845 kB/s | 49 kB 00:00 2024-09-12T22:01:34.748 INFO:teuthology.orchestra.run.smithi047.stdout:(32/139): ceph-prometheus-alerts-19.1.1-314.g08 282 kB/s | 16 kB 00:00 2024-09-12T22:01:34.790 INFO:teuthology.orchestra.run.smithi110.stdout:(43/139): ceph-test-19.1.1-314.g086c737f.el9.x8 11 MB/s | 49 MB 00:04 2024-09-12T22:01:34.807 INFO:teuthology.orchestra.run.smithi047.stdout:(33/139): ceph-volume-19.1.1-314.g086c737f.el9. 4.8 MB/s | 285 kB 00:00 2024-09-12T22:01:34.824 INFO:teuthology.orchestra.run.smithi110.stdout:(44/139): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-12T22:01:34.857 INFO:teuthology.orchestra.run.smithi110.stdout:(45/139): python3-urllib3-1.26.5-6.el9.noarch.r 384 kB/s | 215 kB 00:00 2024-09-12T22:01:34.875 INFO:teuthology.orchestra.run.smithi146.stdout:(28/139): ceph-mgr-dashboard-19.1.1-314.g086c73 7.5 MB/s | 3.6 MB 00:00 2024-09-12T22:01:34.899 INFO:teuthology.orchestra.run.smithi047.stdout:(34/139): cephadm-19.1.1-314.g086c737f.el9.noar 8.2 MB/s | 765 kB 00:00 2024-09-12T22:01:34.948 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-12T22:01:34.983 INFO:teuthology.orchestra.run.smithi110.stdout:(46/139): boost-program-options-1.75.0-8.el9.x8 855 kB/s | 107 kB 00:00 2024-09-12T22:01:35.016 INFO:teuthology.orchestra.run.smithi110.stdout:(47/139): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-12T22:01:35.049 INFO:teuthology.orchestra.run.smithi047.stdout:(35/139): fuse-2.9.9-16.el9.x86_64.rpm 532 kB/s | 80 kB 00:00 2024-09-12T22:01:35.050 INFO:teuthology.orchestra.run.smithi110.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-09-12T22:01:35.098 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-12T22:01:35.098 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-12T22:01:35.100 INFO:teuthology.orchestra.run.smithi110.stdout:(49/139): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-12T22:01:35.126 INFO:teuthology.orchestra.run.smithi110.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 433 kB/s | 33 kB 00:00 2024-09-12T22:01:35.151 INFO:teuthology.orchestra.run.smithi110.stdout:(51/139): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-12T22:01:35.177 INFO:teuthology.orchestra.run.smithi110.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-12T22:01:35.202 INFO:teuthology.orchestra.run.smithi110.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-12T22:01:35.227 INFO:teuthology.orchestra.run.smithi110.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-12T22:01:35.252 INFO:teuthology.orchestra.run.smithi110.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-12T22:01:35.286 INFO:teuthology.orchestra.run.smithi110.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-12T22:01:35.292 INFO:teuthology.orchestra.run.smithi146.stdout:(29/139): ceph-test-19.1.1-314.g086c737f.el9.x8 10 MB/s | 49 MB 00:04 2024-09-12T22:01:35.342 INFO:teuthology.orchestra.run.smithi146.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 4.9 MB/s | 249 kB 00:00 2024-09-12T22:01:35.353 INFO:teuthology.orchestra.run.smithi110.stdout:(57/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-12T22:01:35.378 INFO:teuthology.orchestra.run.smithi110.stdout:(58/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 266 kB/s | 24 kB 00:00 2024-09-12T22:01:35.393 INFO:teuthology.orchestra.run.smithi146.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 990 kB/s | 49 kB 00:00 2024-09-12T22:01:35.403 INFO:teuthology.orchestra.run.smithi110.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-12T22:01:35.437 INFO:teuthology.orchestra.run.smithi110.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-12T22:01:35.443 INFO:teuthology.orchestra.run.smithi146.stdout:(32/139): ceph-prometheus-alerts-19.1.1-314.g08 330 kB/s | 16 kB 00:00 2024-09-12T22:01:35.471 INFO:teuthology.orchestra.run.smithi110.stdout:(61/139): libtool-2.4.6-46.el9.x86_64.rpm 2.6 MB/s | 581 kB 00:00 2024-09-12T22:01:35.491 INFO:teuthology.orchestra.run.smithi047.stdout:(36/139): ceph-test-19.1.1-314.g086c737f.el9.x8 12 MB/s | 49 MB 00:04 2024-09-12T22:01:35.496 INFO:teuthology.orchestra.run.smithi110.stdout:(62/139): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-12T22:01:35.521 INFO:teuthology.orchestra.run.smithi110.stdout:(63/139): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T22:01:35.580 INFO:teuthology.orchestra.run.smithi110.stdout:(64/139): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-12T22:01:35.602 INFO:teuthology.orchestra.run.smithi146.stdout:(33/139): ceph-osd-19.1.1-314.g086c737f.el9.x86 2.5 MB/s | 17 MB 00:06 2024-09-12T22:01:35.627 INFO:teuthology.orchestra.run.smithi146.stdout:(34/139): ceph-volume-19.1.1-314.g086c737f.el9. 1.5 MB/s | 285 kB 00:00 2024-09-12T22:01:35.655 INFO:teuthology.orchestra.run.smithi110.stdout:(65/139): openblas-openmp-0.3.26-2.el9.x86_64.r 27 MB/s | 4.9 MB 00:00 2024-09-12T22:01:35.709 INFO:teuthology.orchestra.run.smithi047.stdout:(37/139): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-12T22:01:35.730 INFO:teuthology.orchestra.run.smithi110.stdout:(66/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-12T22:01:35.756 INFO:teuthology.orchestra.run.smithi110.stdout:(67/139): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-12T22:01:35.781 INFO:teuthology.orchestra.run.smithi110.stdout:(68/139): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-12T22:01:35.794 INFO:teuthology.orchestra.run.smithi146.stdout:(35/139): fuse-2.9.9-16.el9.x86_64.rpm 479 kB/s | 80 kB 00:00 2024-09-12T22:01:35.807 INFO:teuthology.orchestra.run.smithi110.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-09-12T22:01:35.808 INFO:teuthology.orchestra.run.smithi047.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-12T22:01:35.832 INFO:teuthology.orchestra.run.smithi110.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-12T22:01:35.857 INFO:teuthology.orchestra.run.smithi110.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-12T22:01:35.859 INFO:teuthology.orchestra.run.smithi047.stdout:(39/139): libquadmath-11.5.0-2.el9.x86_64.rpm 521 kB/s | 191 kB 00:00 2024-09-12T22:01:35.882 INFO:teuthology.orchestra.run.smithi110.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-12T22:01:35.927 INFO:teuthology.orchestra.run.smithi146.stdout:(36/139): cephadm-19.1.1-314.g086c737f.el9.noar 2.3 MB/s | 765 kB 00:00 2024-09-12T22:01:35.934 INFO:teuthology.orchestra.run.smithi047.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-12T22:01:35.968 INFO:teuthology.orchestra.run.smithi047.stdout:(41/139): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-09-12T22:01:35.976 INFO:teuthology.orchestra.run.smithi110.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.6 MB/s | 250 kB 00:00 2024-09-12T22:01:35.983 INFO:teuthology.orchestra.run.smithi146.stdout:(37/139): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-12T22:01:36.045 INFO:teuthology.orchestra.run.smithi146.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 253 kB 00:00 2024-09-12T22:01:36.058 INFO:teuthology.orchestra.run.smithi110.stdout:(74/139): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-12T22:01:36.059 INFO:teuthology.orchestra.run.smithi047.stdout:(42/139): ceph-mgr-diskprediction-local-19.1.1- 4.1 MB/s | 7.4 MB 00:01 2024-09-12T22:01:36.083 INFO:teuthology.orchestra.run.smithi110.stdout:(75/139): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-12T22:01:36.085 INFO:teuthology.orchestra.run.smithi047.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-12T22:01:36.110 INFO:teuthology.orchestra.run.smithi047.stdout:(44/139): python3-pycparser-2.20-6.el9.noarch.r 769 kB/s | 135 kB 00:00 2024-09-12T22:01:36.117 INFO:teuthology.orchestra.run.smithi110.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T22:01:36.143 INFO:teuthology.orchestra.run.smithi110.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 717 kB/s | 42 kB 00:00 2024-09-12T22:01:36.153 INFO:teuthology.orchestra.run.smithi146.stdout:(39/139): libquadmath-11.5.0-2.el9.x86_64.rpm 848 kB/s | 191 kB 00:00 2024-09-12T22:01:36.203 INFO:teuthology.orchestra.run.smithi146.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T22:01:36.209 INFO:teuthology.orchestra.run.smithi110.stdout:(78/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-12T22:01:36.227 INFO:teuthology.orchestra.run.smithi047.stdout:(45/139): python3-urllib3-1.26.5-6.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-09-12T22:01:36.235 INFO:teuthology.orchestra.run.smithi110.stdout:(79/139): python3-protobuf-3.14.0-13.el9.noarch 2.2 MB/s | 269 kB 00:00 2024-09-12T22:01:36.260 INFO:teuthology.orchestra.run.smithi110.stdout:(80/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-12T22:01:36.262 INFO:teuthology.orchestra.run.smithi146.stdout:(41/139): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-12T22:01:36.285 INFO:teuthology.orchestra.run.smithi110.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T22:01:36.302 INFO:teuthology.orchestra.run.smithi047.stdout:(46/139): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-09-12T22:01:36.311 INFO:teuthology.orchestra.run.smithi110.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T22:01:36.336 INFO:teuthology.orchestra.run.smithi047.stdout:(47/139): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 689 kB 00:00 2024-09-12T22:01:36.336 INFO:teuthology.orchestra.run.smithi110.stdout:(83/139): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-12T22:01:36.354 INFO:teuthology.orchestra.run.smithi146.stdout:(42/139): ceph-mgr-diskprediction-local-19.1.1- 5.0 MB/s | 7.4 MB 00:01 2024-09-12T22:01:36.361 INFO:teuthology.orchestra.run.smithi110.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-09-12T22:01:36.361 INFO:teuthology.orchestra.run.smithi047.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 372 kB/s | 22 kB 00:00 2024-09-12T22:01:36.379 INFO:teuthology.orchestra.run.smithi146.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-12T22:01:36.386 INFO:teuthology.orchestra.run.smithi047.stdout:(49/139): boost-program-options-1.75.0-8.el9.x8 672 kB/s | 107 kB 00:00 2024-09-12T22:01:36.387 INFO:teuthology.orchestra.run.smithi110.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T22:01:36.412 INFO:teuthology.orchestra.run.smithi047.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-12T22:01:36.412 INFO:teuthology.orchestra.run.smithi110.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-12T22:01:36.437 INFO:teuthology.orchestra.run.smithi047.stdout:(51/139): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-12T22:01:36.437 INFO:teuthology.orchestra.run.smithi110.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-12T22:01:36.446 INFO:teuthology.orchestra.run.smithi146.stdout:(44/139): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-09-12T22:01:36.454 INFO:teuthology.orchestra.run.smithi047.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 435 kB/s | 18 kB 00:00 2024-09-12T22:01:36.462 INFO:teuthology.orchestra.run.smithi110.stdout:(88/139): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T22:01:36.471 INFO:teuthology.orchestra.run.smithi047.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 334 kB/s | 11 kB 00:00 2024-09-12T22:01:36.488 INFO:teuthology.orchestra.run.smithi110.stdout:(89/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T22:01:36.496 INFO:teuthology.orchestra.run.smithi047.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-09-12T22:01:36.513 INFO:teuthology.orchestra.run.smithi047.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-12T22:01:36.513 INFO:teuthology.orchestra.run.smithi110.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T22:01:36.538 INFO:teuthology.orchestra.run.smithi110.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-09-12T22:01:36.547 INFO:teuthology.orchestra.run.smithi047.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-09-12T22:01:36.580 INFO:teuthology.orchestra.run.smithi047.stdout:(57/139): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-12T22:01:36.588 INFO:teuthology.orchestra.run.smithi146.stdout:(45/139): python3-urllib3-1.26.5-6.el9.noarch.r 919 kB/s | 215 kB 00:00 2024-09-12T22:01:36.605 INFO:teuthology.orchestra.run.smithi047.stdout:(58/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-12T22:01:36.631 INFO:teuthology.orchestra.run.smithi047.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-12T22:01:36.656 INFO:teuthology.orchestra.run.smithi047.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T22:01:36.681 INFO:teuthology.orchestra.run.smithi047.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-12T22:01:36.706 INFO:teuthology.orchestra.run.smithi047.stdout:(62/139): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-12T22:01:36.757 INFO:teuthology.orchestra.run.smithi047.stdout:(63/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.1 MB/s | 3.0 MB 00:00 2024-09-12T22:01:36.764 INFO:teuthology.orchestra.run.smithi110.stdout:(92/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-12T22:01:36.789 INFO:teuthology.orchestra.run.smithi110.stdout:(93/139): lua-devel-5.4.4-4.el9.x86_64.rpm 81 kB/s | 22 kB 00:00 2024-09-12T22:01:36.815 INFO:teuthology.orchestra.run.smithi047.stdout:(64/139): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-12T22:01:36.848 INFO:teuthology.orchestra.run.smithi110.stdout:(94/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 6.4 MB/s | 548 kB 00:00 2024-09-12T22:01:36.873 INFO:teuthology.orchestra.run.smithi110.stdout:(95/139): protobuf-compiler-3.14.0-13.el9.x86_6 2.5 MB/s | 863 kB 00:00 2024-09-12T22:01:36.882 INFO:teuthology.orchestra.run.smithi047.stdout:(65/139): openblas-openmp-0.3.26-2.el9.x86_64.r 25 MB/s | 4.9 MB 00:00 2024-09-12T22:01:36.898 INFO:teuthology.orchestra.run.smithi110.stdout:(96/139): grpc-data-1.46.7-10.el9.noarch.rpm 388 kB/s | 19 kB 00:00 2024-09-12T22:01:36.932 INFO:teuthology.orchestra.run.smithi110.stdout:(97/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 2.1 MB/s | 308 kB 00:00 2024-09-12T22:01:36.957 INFO:teuthology.orchestra.run.smithi110.stdout:(98/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 508 kB/s | 26 kB 00:00 2024-09-12T22:01:36.958 INFO:teuthology.orchestra.run.smithi047.stdout:(66/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-12T22:01:36.982 INFO:teuthology.orchestra.run.smithi110.stdout:(99/139): liboath-2.6.7-2.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2024-09-12T22:01:36.983 INFO:teuthology.orchestra.run.smithi047.stdout:(67/139): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-12T22:01:37.008 INFO:teuthology.orchestra.run.smithi110.stdout:(100/139): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-12T22:01:37.008 INFO:teuthology.orchestra.run.smithi047.stdout:(68/139): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-12T22:01:37.033 INFO:teuthology.orchestra.run.smithi110.stdout:(101/139): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-12T22:01:37.042 INFO:teuthology.orchestra.run.smithi047.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 435 kB/s | 26 kB 00:00 2024-09-12T22:01:37.067 INFO:teuthology.orchestra.run.smithi047.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 325 kB/s | 19 kB 00:00 2024-09-12T22:01:37.075 INFO:teuthology.orchestra.run.smithi110.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T22:01:37.093 INFO:teuthology.orchestra.run.smithi047.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-12T22:01:37.101 INFO:teuthology.orchestra.run.smithi110.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T22:01:37.118 INFO:teuthology.orchestra.run.smithi047.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-12T22:01:37.134 INFO:teuthology.orchestra.run.smithi110.stdout:(104/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-12T22:01:37.160 INFO:teuthology.orchestra.run.smithi110.stdout:(105/139): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-09-12T22:01:37.185 INFO:teuthology.orchestra.run.smithi110.stdout:(106/139): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-12T22:01:37.210 INFO:teuthology.orchestra.run.smithi047.stdout:(73/139): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-12T22:01:37.210 INFO:teuthology.orchestra.run.smithi110.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T22:01:37.235 INFO:teuthology.orchestra.run.smithi047.stdout:(74/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-12T22:01:37.244 INFO:teuthology.orchestra.run.smithi110.stdout:(108/139): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T22:01:37.269 INFO:teuthology.orchestra.run.smithi110.stdout:(109/139): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T22:01:37.277 INFO:teuthology.orchestra.run.smithi047.stdout:(75/139): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-09-12T22:01:37.277 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-12T22:01:37.278 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-12T22:01:37.302 INFO:teuthology.orchestra.run.smithi047.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-12T22:01:37.303 INFO:teuthology.orchestra.run.smithi110.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T22:01:37.322 INFO:teuthology.orchestra.run.smithi146.stdout:(46/139): boost-program-options-1.75.0-8.el9.x8 146 kB/s | 107 kB 00:00 2024-09-12T22:01:37.327 INFO:teuthology.orchestra.run.smithi047.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-12T22:01:37.328 INFO:teuthology.orchestra.run.smithi110.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-12T22:01:37.353 INFO:teuthology.orchestra.run.smithi047.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-12T22:01:37.353 INFO:teuthology.orchestra.run.smithi110.stdout:(112/139): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-12T22:01:37.378 INFO:teuthology.orchestra.run.smithi047.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T22:01:37.379 INFO:teuthology.orchestra.run.smithi110.stdout:(113/139): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-09-12T22:01:37.403 INFO:teuthology.orchestra.run.smithi047.stdout:(80/139): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-12T22:01:37.404 INFO:teuthology.orchestra.run.smithi110.stdout:(114/139): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-12T22:01:37.429 INFO:teuthology.orchestra.run.smithi047.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T22:01:37.429 INFO:teuthology.orchestra.run.smithi110.stdout:(115/139): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-12T22:01:37.454 INFO:teuthology.orchestra.run.smithi047.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T22:01:37.480 INFO:teuthology.orchestra.run.smithi110.stdout:(116/139): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-12T22:01:37.505 INFO:teuthology.orchestra.run.smithi110.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T22:01:37.521 INFO:teuthology.orchestra.run.smithi047.stdout:(83/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-12T22:01:37.530 INFO:teuthology.orchestra.run.smithi110.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T22:01:37.546 INFO:teuthology.orchestra.run.smithi047.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 454 kB/s | 42 kB 00:00 2024-09-12T22:01:37.556 INFO:teuthology.orchestra.run.smithi110.stdout:(119/139): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T22:01:37.571 INFO:teuthology.orchestra.run.smithi047.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T22:01:37.598 INFO:teuthology.orchestra.run.smithi110.stdout:(120/139): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-12T22:01:37.613 INFO:teuthology.orchestra.run.smithi047.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 536 kB/s | 36 kB 00:00 2024-09-12T22:01:37.623 INFO:teuthology.orchestra.run.smithi110.stdout:(121/139): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-12T22:01:37.647 INFO:teuthology.orchestra.run.smithi047.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-12T22:01:37.681 INFO:teuthology.orchestra.run.smithi047.stdout:(88/139): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-12T22:01:37.682 INFO:teuthology.orchestra.run.smithi110.stdout:(122/139): libarrow-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 4.4 MB 00:00 2024-09-12T22:01:37.697 INFO:teuthology.orchestra.run.smithi047.stdout:(89/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T22:01:37.707 INFO:teuthology.orchestra.run.smithi110.stdout:(123/139): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-09-12T22:01:37.723 INFO:teuthology.orchestra.run.smithi047.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-12T22:01:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-12T22:01:37.748 INFO:teuthology.orchestra.run.smithi047.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-12T22:01:37.758 INFO:teuthology.orchestra.run.smithi110.stdout:(125/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 669 kB/s | 90 kB 00:00 2024-09-12T22:01:37.772 INFO:teuthology.orchestra.run.smithi146.stdout:(47/139): automake-1.16.2-8.el9.noarch.rpm 495 kB/s | 689 kB 00:01 2024-09-12T22:01:37.783 INFO:teuthology.orchestra.run.smithi110.stdout:(126/139): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-12T22:01:37.809 INFO:teuthology.orchestra.run.smithi110.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-12T22:01:37.834 INFO:teuthology.orchestra.run.smithi110.stdout:(128/139): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-12T22:01:37.847 INFO:teuthology.orchestra.run.smithi146.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 41 kB/s | 22 kB 00:00 2024-09-12T22:01:37.859 INFO:teuthology.orchestra.run.smithi110.stdout:(129/139): python3-typing-extensions-4.12.2-2.e 982 kB/s | 74 kB 00:00 2024-09-12T22:01:37.884 INFO:teuthology.orchestra.run.smithi110.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T22:01:37.918 INFO:teuthology.orchestra.run.smithi110.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-12T22:01:37.944 INFO:teuthology.orchestra.run.smithi110.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-09-12T22:01:37.990 INFO:teuthology.orchestra.run.smithi047.stdout:(92/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-12T22:01:37.994 INFO:teuthology.orchestra.run.smithi110.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-12T22:01:38.008 INFO:teuthology.orchestra.run.smithi146.stdout:(49/139): bison-3.7.4-5.el9.x86_64.rpm 605 kB/s | 943 kB 00:01 2024-09-12T22:01:38.016 INFO:teuthology.orchestra.run.smithi047.stdout:(93/139): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-09-12T22:01:38.019 INFO:teuthology.orchestra.run.smithi110.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-12T22:01:38.069 INFO:teuthology.orchestra.run.smithi110.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-12T22:01:38.074 INFO:teuthology.orchestra.run.smithi047.stdout:(94/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 6.4 MB/s | 548 kB 00:00 2024-09-12T22:01:38.099 INFO:teuthology.orchestra.run.smithi047.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-12T22:01:38.124 INFO:teuthology.orchestra.run.smithi047.stdout:(96/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 2.8 MB/s | 308 kB 00:00 2024-09-12T22:01:38.141 INFO:teuthology.orchestra.run.smithi047.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-12T22:01:38.158 INFO:teuthology.orchestra.run.smithi047.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-12T22:01:38.183 INFO:teuthology.orchestra.run.smithi047.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T22:01:38.217 INFO:teuthology.orchestra.run.smithi047.stdout:(100/139): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-12T22:01:38.251 INFO:teuthology.orchestra.run.smithi047.stdout:(101/139): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-12T22:01:38.293 INFO:teuthology.orchestra.run.smithi047.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T22:01:38.318 INFO:teuthology.orchestra.run.smithi047.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T22:01:38.343 INFO:teuthology.orchestra.run.smithi047.stdout:(104/139): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T22:01:38.369 INFO:teuthology.orchestra.run.smithi047.stdout:(105/139): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-12T22:01:38.394 INFO:teuthology.orchestra.run.smithi047.stdout:(106/139): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-12T22:01:38.416 INFO:teuthology.orchestra.run.smithi146.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 58 kB/s | 33 kB 00:00 2024-09-12T22:01:38.427 INFO:teuthology.orchestra.run.smithi047.stdout:(107/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 839 kB 00:00 2024-09-12T22:01:38.453 INFO:teuthology.orchestra.run.smithi047.stdout:(108/139): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T22:01:38.478 INFO:teuthology.orchestra.run.smithi047.stdout:(109/139): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T22:01:38.511 INFO:teuthology.orchestra.run.smithi047.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T22:01:38.537 INFO:teuthology.orchestra.run.smithi047.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-12T22:01:38.562 INFO:teuthology.orchestra.run.smithi047.stdout:(112/139): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-12T22:01:38.581 INFO:teuthology.orchestra.run.smithi146.stdout:(51/139): flex-2.6.4-9.el9.x86_64.rpm 388 kB/s | 313 kB 00:00 2024-09-12T22:01:38.587 INFO:teuthology.orchestra.run.smithi047.stdout:(113/139): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-12T22:01:38.611 INFO:teuthology.orchestra.run.smithi110.stdout:(136/139): librados2-19.1.1-314.g086c737f.el9.x 5.5 MB/s | 3.4 MB 00:00 2024-09-12T22:01:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:(114/139): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-12T22:01:38.638 INFO:teuthology.orchestra.run.smithi047.stdout:(115/139): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-12T22:01:38.705 INFO:teuthology.orchestra.run.smithi047.stdout:(116/139): libarrow-9.0.0-11.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-09-12T22:01:38.730 INFO:teuthology.orchestra.run.smithi047.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T22:01:38.745 INFO:teuthology.orchestra.run.smithi110.stdout:(137/139): librbd1-19.1.1-314.g086c737f.el9.x86 4.4 MB/s | 3.2 MB 00:00 2024-09-12T22:01:38.755 INFO:teuthology.orchestra.run.smithi047.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T22:01:38.781 INFO:teuthology.orchestra.run.smithi047.stdout:(119/139): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T22:01:38.786 INFO:teuthology.orchestra.run.smithi110.stdout:(138/139): openssl-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 1.4 MB 00:00 2024-09-12T22:01:38.831 INFO:teuthology.orchestra.run.smithi047.stdout:(120/139): python3-grpcio-1.46.7-10.el9.x86_64. 5.4 MB/s | 2.0 MB 00:00 2024-09-12T22:01:38.865 INFO:teuthology.orchestra.run.smithi047.stdout:(121/139): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-09-12T22:01:38.890 INFO:teuthology.orchestra.run.smithi047.stdout:(122/139): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-12T22:01:38.915 INFO:teuthology.orchestra.run.smithi146.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-12T22:01:38.915 INFO:teuthology.orchestra.run.smithi047.stdout:(123/139): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-09-12T22:01:38.940 INFO:teuthology.orchestra.run.smithi047.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-12T22:01:38.966 INFO:teuthology.orchestra.run.smithi047.stdout:(125/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 894 kB/s | 90 kB 00:00 2024-09-12T22:01:38.991 INFO:teuthology.orchestra.run.smithi047.stdout:(126/139): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-12T22:01:39.016 INFO:teuthology.orchestra.run.smithi047.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T22:01:39.041 INFO:teuthology.orchestra.run.smithi047.stdout:(128/139): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-12T22:01:39.067 INFO:teuthology.orchestra.run.smithi047.stdout:(129/139): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-12T22:01:39.074 INFO:teuthology.orchestra.run.smithi146.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-12T22:01:39.092 INFO:teuthology.orchestra.run.smithi047.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T22:01:39.117 INFO:teuthology.orchestra.run.smithi047.stdout:(131/139): python3-zc-lockfile-2.0-10.el9.noarc 792 kB/s | 20 kB 00:00 2024-09-12T22:01:39.143 INFO:teuthology.orchestra.run.smithi047.stdout:(132/139): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-12T22:01:39.217 INFO:teuthology.orchestra.run.smithi146.stdout:(54/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.5 MB/s | 3.0 MB 00:01 2024-09-12T22:01:39.217 INFO:teuthology.orchestra.run.smithi047.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T22:01:39.217 INFO:teuthology.orchestra.run.smithi047.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T22:01:39.243 INFO:teuthology.orchestra.run.smithi047.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T22:01:39.352 INFO:teuthology.orchestra.run.smithi047.stdout:(136/139): openssl-3.2.2-6.el9.x86_64.rpm 13 MB/s | 1.4 MB 00:00 2024-09-12T22:01:39.362 INFO:teuthology.orchestra.run.smithi110.stdout:(139/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 2.4 MB 00:00 2024-09-12T22:01:39.368 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:01:39.369 INFO:teuthology.orchestra.run.smithi110.stdout:Total 17 MB/s | 213 MB 00:12 2024-09-12T22:01:39.469 INFO:teuthology.orchestra.run.smithi047.stdout:(137/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-09-12T22:01:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:(55/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 213 kB/s | 160 kB 00:00 2024-09-12T22:01:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:(56/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-09-12T22:01:39.836 INFO:teuthology.orchestra.run.smithi047.stdout:(138/139): librbd1-19.1.1-314.g086c737f.el9.x86 4.9 MB/s | 3.2 MB 00:00 2024-09-12T22:01:40.003 INFO:teuthology.orchestra.run.smithi047.stdout:(139/139): librados2-19.1.1-314.g086c737f.el9.x 4.1 MB/s | 3.4 MB 00:00 2024-09-12T22:01:40.008 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:01:40.009 INFO:teuthology.orchestra.run.smithi047.stdout:Total 17 MB/s | 213 MB 00:12 2024-09-12T22:01:40.160 INFO:teuthology.orchestra.run.smithi146.stdout:(57/139): librdkafka-1.6.1-102.el9.x86_64.rpm 696 kB/s | 662 kB 00:00 2024-09-12T22:01:40.283 INFO:teuthology.orchestra.run.smithi146.stdout:(58/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 41 kB/s | 24 kB 00:00 2024-09-12T22:01:40.385 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-12T22:01:40.525 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-12T22:01:40.525 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-12T22:01:40.592 INFO:teuthology.orchestra.run.smithi146.stdout:(59/139): libtool-2.4.6-46.el9.x86_64.rpm 628 kB/s | 581 kB 00:00 2024-09-12T22:01:40.808 INFO:teuthology.orchestra.run.smithi146.stdout:(60/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 73 kB/s | 47 kB 00:00 2024-09-12T22:01:41.052 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T22:01:41.076 INFO:teuthology.orchestra.run.smithi146.stdout:(61/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 369 kB/s | 292 kB 00:00 2024-09-12T22:01:41.206 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T22:01:41.206 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T22:01:41.326 INFO:teuthology.orchestra.run.smithi146.stdout:(62/139): lua-5.4.4-4.el9.x86_64.rpm 257 kB/s | 188 kB 00:00 2024-09-12T22:01:41.376 INFO:teuthology.orchestra.run.smithi146.stdout:(63/139): openblas-0.3.26-2.el9.x86_64.rpm 69 kB/s | 38 kB 00:00 2024-09-12T22:01:42.410 INFO:teuthology.orchestra.run.smithi146.stdout:(64/139): openblas-openmp-0.3.26-2.el9.x86_64.r 3.7 MB/s | 4.9 MB 00:01 2024-09-12T22:01:42.460 INFO:teuthology.orchestra.run.smithi146.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 954 kB/s | 1.0 MB 00:01 2024-09-12T22:01:42.624 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-12T22:01:42.625 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-12T22:01:42.677 INFO:teuthology.orchestra.run.smithi146.stdout:(66/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 4.4 MB 00:01 2024-09-12T22:01:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-12T22:01:43.089 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:01:43.134 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:01:43.219 INFO:teuthology.orchestra.run.smithi146.stdout:(67/139): python3-devel-3.9.19-8.el9.x86_64.rpm 323 kB/s | 245 kB 00:00 2024-09-12T22:01:43.394 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:01:43.412 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T22:01:43.412 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T22:01:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:01:43.458 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:01:43.469 INFO:teuthology.orchestra.run.smithi146.stdout:(68/139): python3-jinja2-2.11.3-6.el9.noarch.rp 320 kB/s | 248 kB 00:00 2024-09-12T22:01:43.513 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:01:43.636 INFO:teuthology.orchestra.run.smithi146.stdout:(69/139): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-09-12T22:01:43.811 INFO:teuthology.orchestra.run.smithi146.stdout:(70/139): python3-jsonpatch-1.21-16.el9.noarch. 43 kB/s | 26 kB 00:00 2024-09-12T22:01:43.859 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:01:43.975 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:01:43.994 INFO:teuthology.orchestra.run.smithi146.stdout:(71/139): python3-jsonpointer-2.0-4.el9.noarch. 36 kB/s | 19 kB 00:00 2024-09-12T22:01:44.102 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:01:44.134 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:01:44.226 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:01:44.266 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:01:44.294 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:01:44.361 INFO:teuthology.orchestra.run.smithi146.stdout:(72/139): python3-mako-1.1.4-6.el9.noarch.rpm 237 kB/s | 172 kB 00:00 2024-09-12T22:01:44.400 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:01:44.412 INFO:teuthology.orchestra.run.smithi146.stdout:(73/139): python3-markupsafe-1.1.1-12.el9.x86_6 58 kB/s | 35 kB 00:00 2024-09-12T22:01:44.428 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:01:44.491 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:01:44.521 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:01:44.543 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:01:44.750 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:01:44.780 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:01:44.891 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:01:44.987 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:01:45.020 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:01:45.055 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:01:45.104 INFO:teuthology.orchestra.run.smithi146.stdout:(74/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-09-12T22:01:45.129 INFO:teuthology.orchestra.run.smithi146.stdout:(75/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 327 kB/s | 250 kB 00:00 2024-09-12T22:01:45.154 INFO:teuthology.orchestra.run.smithi146.stdout:(76/139): python3-oauthlib-3.1.1-5.el9.noarch.r 299 kB/s | 222 kB 00:00 2024-09-12T22:01:45.154 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:01:45.207 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:01:45.247 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:01:45.290 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:01:45.323 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:01:45.351 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:01:45.422 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:01:45.482 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:01:45.515 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:01:45.555 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:01:45.633 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:01:45.666 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:01:45.710 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:01:45.738 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:01:45.738 INFO:teuthology.orchestra.run.smithi146.stdout:(77/139): python3-packaging-20.9-5.el9.noarch.r 122 kB/s | 77 kB 00:00 2024-09-12T22:01:45.763 INFO:teuthology.orchestra.run.smithi146.stdout:(78/139): python3-prettytable-0.7.2-27.el9.noar 67 kB/s | 42 kB 00:00 2024-09-12T22:01:45.801 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:01:45.853 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:01:45.921 INFO:teuthology.orchestra.run.smithi146.stdout:(79/139): python3-protobuf-3.14.0-13.el9.noarch 351 kB/s | 269 kB 00:00 2024-09-12T22:01:45.929 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:01:46.066 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:01:46.131 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:01:46.438 INFO:teuthology.orchestra.run.smithi146.stdout:(80/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 227 kB/s | 159 kB 00:00 2024-09-12T22:01:46.547 INFO:teuthology.orchestra.run.smithi146.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 81 kB/s | 51 kB 00:00 2024-09-12T22:01:46.572 INFO:teuthology.orchestra.run.smithi146.stdout:(82/139): python3-pyasn1-modules-0.4.8-6.el9.no 345 kB/s | 279 kB 00:00 2024-09-12T22:01:46.683 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:01:46.777 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:01:46.813 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:01:46.856 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:01:46.894 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:01:46.937 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:01:47.081 INFO:teuthology.orchestra.run.smithi146.stdout:(83/139): python3-requests-oauthlib-1.3.0-12.el 84 kB/s | 54 kB 00:00 2024-09-12T22:01:47.106 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:01:47.163 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:01:47.173 INFO:teuthology.orchestra.run.smithi146.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 69 kB/s | 42 kB 00:00 2024-09-12T22:01:47.219 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:01:47.293 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:01:47.331 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:01:47.367 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:01:47.415 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:01:47.459 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:01:47.501 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:01:47.643 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:01:47.686 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:01:47.727 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:01:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:(85/139): qatlib-service-24.02.0-1.el9.x86_64.r 63 kB/s | 36 kB 00:00 2024-09-12T22:01:47.833 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:01:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:(86/139): qatlib-24.02.0-1.el9.x86_64.rpm 288 kB/s | 221 kB 00:00 2024-09-12T22:01:47.869 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:01:47.910 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:01:47.943 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:01:47.967 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:01:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:(87/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-12T22:01:48.060 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:01:48.190 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:01:48.224 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:01:48.255 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:01:48.290 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:01:48.320 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:01:48.354 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:01:48.369 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-12T22:01:48.387 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:01:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:(88/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 64 kB/s | 47 kB 00:00 2024-09-12T22:01:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:01:48.513 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:01:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:01:48.563 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:01:48.618 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:01:48.654 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:01:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:(89/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 146 kB/s | 96 kB 00:00 2024-09-12T22:01:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:01:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:01:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:(90/139): socat-1.7.4.1-6.el9.x86_64.rpm 358 kB/s | 304 kB 00:00 2024-09-12T22:01:48.702 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:01:48.733 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:01:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:01:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:(91/139): lua-devel-5.4.4-4.el9.x86_64.rpm 268 kB/s | 22 kB 00:00 2024-09-12T22:01:48.839 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:01:48.893 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:01:49.065 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:01:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:(92/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 98 kB/s | 64 kB 00:00 2024-09-12T22:01:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:01:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:(93/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 9.3 MB/s | 548 kB 00:00 2024-09-12T22:01:49.233 INFO:teuthology.orchestra.run.smithi146.stdout:(94/139): protobuf-compiler-3.14.0-13.el9.x86_6 1.9 MB/s | 863 kB 00:00 2024-09-12T22:01:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T22:01:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:(95/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 74 kB/s | 45 kB 00:00 2024-09-12T22:01:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:(96/139): grpc-data-1.46.7-10.el9.noarch.rpm 295 kB/s | 19 kB 00:00 2024-09-12T22:01:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:01:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:(97/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 2.2 MB/s | 308 kB 00:00 2024-09-12T22:01:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:01:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:01:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:(98/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 535 kB/s | 26 kB 00:00 2024-09-12T22:01:49.376 INFO:teuthology.orchestra.run.smithi146.stdout:(99/139): liboath-2.6.7-2.el9.x86_64.rpm 973 kB/s | 49 kB 00:00 2024-09-12T22:01:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:(100/139): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-12T22:01:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:01:49.422 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:01:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:(101/139): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-12T22:01:49.463 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:01:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:01:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:(102/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-12T22:01:49.491 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:01:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:(103/139): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-12T22:01:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:01:49.519 INFO:teuthology.orchestra.run.smithi146.stdout:(104/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 868 kB/s | 43 kB 00:00 2024-09-12T22:01:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:01:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:(105/139): python3-cachetools-4.2.4-1.el9.noarc 963 kB/s | 32 kB 00:00 2024-09-12T22:01:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:(106/139): python3-certifi-2023.05.07-4.el9.noa 421 kB/s | 14 kB 00:00 2024-09-12T22:01:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-12T22:01:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:01:49.594 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:01:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:(108/139): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T22:01:49.617 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:01:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:(109/139): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T22:01:49.643 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:01:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T22:01:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-12T22:01:49.689 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:01:49.689 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:01:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:(112/139): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-09-12T22:01:49.723 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:01:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:01:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:(113/139): python3-jaraco-collections-3.0.0-8.e 940 kB/s | 23 kB 00:00 2024-09-12T22:01:49.752 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:01:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:(114/139): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-12T22:01:49.790 INFO:teuthology.orchestra.run.smithi146.stdout:(115/139): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-12T22:01:49.825 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:01:49.856 INFO:teuthology.orchestra.run.smithi146.stdout:(116/139): python3-grpcio-1.46.7-10.el9.x86_64. 8.1 MB/s | 2.0 MB 00:00 2024-09-12T22:01:49.857 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:01:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T22:01:49.907 INFO:teuthology.orchestra.run.smithi146.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T22:01:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:(119/139): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T22:01:49.933 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:01:49.946 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:01:49.966 INFO:teuthology.orchestra.run.smithi146.stdout:(120/139): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-12T22:01:49.977 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:01:49.991 INFO:teuthology.orchestra.run.smithi146.stdout:(121/139): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-12T22:01:50.017 INFO:teuthology.orchestra.run.smithi146.stdout:(122/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T22:01:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:(123/139): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-12T22:01:50.047 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:01:50.060 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:01:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-12T22:01:50.071 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:01:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:01:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:(125/139): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T22:01:50.150 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:01:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:(126/139): libarrow-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 4.4 MB 00:00 2024-09-12T22:01:50.177 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:01:50.178 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:01:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 357 kB/s | 36 kB 00:00 2024-09-12T22:01:50.202 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:01:50.210 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:01:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:(128/139): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-12T22:01:50.245 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:01:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:(129/139): python3-typing-extensions-4.12.2-2.e 889 kB/s | 74 kB 00:00 2024-09-12T22:01:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-12T22:01:50.295 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:01:50.302 INFO:teuthology.orchestra.run.smithi146.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-12T22:01:50.326 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:01:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T22:01:50.334 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:01:50.353 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:01:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-12T22:01:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:01:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-12T22:01:50.412 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:01:50.452 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:01:50.455 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:01:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-12T22:01:50.480 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:01:50.488 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:01:50.515 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:01:50.542 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:01:50.573 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:01:50.585 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:01:50.594 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:01:50.647 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:01:50.681 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:01:50.729 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:01:50.784 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:01:50.806 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:01:50.813 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:01:50.849 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:01:50.864 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:01:50.892 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:01:50.904 INFO:teuthology.orchestra.run.smithi146.stdout:(136/139): openssl-3.2.2-6.el9.x86_64.rpm 3.1 MB/s | 1.4 MB 00:00 2024-09-12T22:01:50.918 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:01:50.920 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:01:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:(137/139): librados2-19.1.1-314.g086c737f.el9.x 5.7 MB/s | 3.4 MB 00:00 2024-09-12T22:01:50.984 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:01:50.989 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:01:51.022 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:01:51.035 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:01:51.055 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:01:51.092 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:01:51.109 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:01:51.165 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:01:51.217 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:01:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:01:51.248 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:01:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:01:51.304 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:01:51.324 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:01:51.351 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:01:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:(138/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 5.0 MB/s | 2.4 MB 00:00 2024-09-12T22:01:51.424 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:01:51.592 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:01:51.625 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:01:51.665 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:01:51.729 INFO:teuthology.orchestra.run.smithi146.stdout:(139/139): librbd1-19.1.1-314.g086c737f.el9.x86 2.4 MB/s | 3.2 MB 00:01 2024-09-12T22:01:51.736 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:01:51.737 INFO:teuthology.orchestra.run.smithi146.stdout:Total 8.3 MB/s | 213 MB 00:25 2024-09-12T22:01:51.744 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:01:51.775 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:01:51.811 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:01:51.834 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:01:51.839 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:01:51.912 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:01:51.916 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:01:51.946 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:01:51.954 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:01:51.997 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:01:52.031 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:01:52.043 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:01:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:01:52.169 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:01:52.215 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:01:52.254 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:01:52.310 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:01:52.310 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:01:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:01:52.403 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:01:52.431 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:01:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:01:52.464 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:01:52.464 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:01:52.500 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:01:52.555 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:01:52.600 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:01:52.643 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:01:52.739 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-12T22:01:52.772 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:01:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:01:52.801 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:01:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:01:52.854 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:01:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:01:52.868 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:01:52.874 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-12T22:01:52.874 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-12T22:01:52.889 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:01:52.933 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:01:52.960 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:01:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:01:52.970 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:01:52.990 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:01:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:01:53.004 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:01:53.026 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:01:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:01:53.086 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:01:53.111 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:01:53.164 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:01:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:01:53.223 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:01:53.279 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:01:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:01:53.354 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:01:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:01:53.391 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:01:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:01:53.427 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:01:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:01:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:01:53.474 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:01:53.498 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:01:53.527 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:01:53.531 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:01:53.534 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:01:53.570 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:01:53.590 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:01:53.633 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:01:53.713 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:01:53.726 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:01:53.754 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:01:53.771 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:01:53.788 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:01:53.795 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:01:53.802 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:01:53.869 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:01:53.898 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:01:53.902 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:01:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:01:53.937 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:01:53.978 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:01:54.010 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:01:54.035 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:01:54.126 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:01:54.150 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:01:54.260 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:01:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:01:54.331 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:01:54.366 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:01:54.396 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:01:54.430 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:01:54.464 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:01:54.717 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:01:54.749 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:01:54.845 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:01:54.858 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:01:54.897 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:01:54.905 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:01:54.935 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:01:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:01:55.039 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-12T22:01:55.040 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-12T22:01:55.043 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:01:55.046 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:01:55.081 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:01:55.096 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:01:55.264 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:01:55.304 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:01:55.381 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:01:55.866 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:01:55.916 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:01:55.950 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:01:56.039 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:01:56.054 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:01:56.092 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:01:56.143 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:01:56.286 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:01:56.314 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:01:56.395 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:01:56.654 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:01:56.686 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:01:57.089 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:01:57.204 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:01:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:01:57.306 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:01:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:01:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:01:57.398 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:01:57.398 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:01:57.398 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:01:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:01:57.498 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:01:57.525 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:01:57.559 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:01:57.867 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:01:57.913 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:01:58.004 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:01:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:01:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:01:58.551 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:01:58.559 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:01:58.583 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:01:58.638 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:01:58.654 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:01:58.666 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:01:58.685 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:01:58.699 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:01:59.038 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:01:59.073 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:01:59.174 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:01:59.203 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:01:59.247 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:01:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:01:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:01:59.856 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:01:59.886 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:02:00.839 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-12T22:02:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:02:00.996 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:02:01.050 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:02:01.091 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:02:01.150 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:02:01.209 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:02:01.346 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:02:01.382 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:02:01.550 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:02:01.676 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:02:01.799 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:02:01.827 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:02:01.910 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:02:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:02:01.950 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:02:01.978 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:02:01.978 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:02:02.068 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:02:02.072 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:02:02.072 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:02:02.072 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:02:02.072 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:02.096 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:02:02.112 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:02:02.142 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:02:02.172 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:02:02.201 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:02:02.405 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:02:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:02:02.546 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:02:02.642 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:02:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:02:02.695 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:02:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:02:02.732 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:02:02.777 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:02:02.822 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:02:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:02:02.898 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:02:02.932 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:02:02.959 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:02:03.028 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:02:03.081 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:02:03.118 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:02:03.156 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:02:03.232 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:02:03.267 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:02:03.311 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:02:03.320 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:02:03.338 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:02:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:02:03.409 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:02:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:02:03.454 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:02:03.455 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:02:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:03.461 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:02:03.495 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:02:03.535 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:02:03.668 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:02:03.722 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:02:04.237 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:02:04.317 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:02:04.347 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:02:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:02:04.427 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:02:04.470 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:02:04.628 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:02:04.689 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:02:04.752 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:02:04.832 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:02:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:02:04.900 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:02:04.947 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:02:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:02:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:02:05.169 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:02:05.211 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:02:05.252 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:02:05.354 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:02:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:02:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:02:05.485 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:02:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:02:05.608 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:02:05.735 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:02:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:02:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:02:05.865 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:02:05.895 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:02:05.930 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:02:05.963 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:02:06.005 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:02:06.039 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:02:06.126 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:02:06.169 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:02:06.208 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:02:06.321 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:02:06.376 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:02:07.095 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:02:07.143 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:02:07.177 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:02:07.295 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:02:07.327 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:02:07.513 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:02:07.542 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:02:07.620 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:02:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:02:08.380 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:02:09.632 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:02:09.711 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:02:09.727 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:02:09.727 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2024-09-12T22:02:09.728 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2024-09-12T22:02:09.728 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2024-09-12T22:02:09.728 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2024-09-12T22:02:09.728 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2024-09-12T22:02:09.728 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /root 2024-09-12T22:02:09.728 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2024-09-12T22:02:09.728 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:09.738 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:02:09.772 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:02:09.903 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:02:10.236 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:02:10.237 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:10.237 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:02:10.237 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:10.237 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:02:10.237 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:02:10.237 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:02:10.258 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:02:10.302 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:02:10.783 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:02:10.829 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:02:10.883 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:02:10.914 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:02:11.481 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:02:11.509 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:02:11.509 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:11.509 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:02:11.509 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:02:11.509 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:02:11.510 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:11.741 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:02:11.764 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:02:11.764 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:11.764 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:02:11.764 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:02:11.764 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:02:11.765 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:12.224 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:02:12.249 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:02:12.249 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:12.249 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:02:12.249 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:02:12.249 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:02:12.249 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:12.363 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:02:12.421 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:02:12.484 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:02:12.675 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:02:12.725 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:02:12.804 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:02:12.901 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:02:13.043 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:02:13.094 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:02:13.131 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:02:13.159 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:02:13.196 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:02:13.235 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:02:13.623 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:02:13.649 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:02:13.681 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:02:13.744 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:02:13.772 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:02:13.801 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:02:13.847 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:02:13.923 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:02:13.923 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:02:13.923 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:02:13.923 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:13.956 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:02:13.973 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:02:13.974 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2024-09-12T22:02:13.974 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2024-09-12T22:02:13.974 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2024-09-12T22:02:13.974 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2024-09-12T22:02:13.974 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2024-09-12T22:02:13.974 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /root 2024-09-12T22:02:13.974 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2024-09-12T22:02:13.974 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:14.167 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:02:14.184 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:02:14.184 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:14.184 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:02:14.184 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:14.869 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:02:14.907 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:02:15.560 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:02:15.560 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-09-12T22:02:15.560 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-09-12T22:02:15.560 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-09-12T22:02:15.560 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-09-12T22:02:15.560 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-09-12T22:02:15.560 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-09-12T22:02:15.560 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-09-12T22:02:15.560 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:15.662 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:02:15.689 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:02:15.689 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:15.689 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:02:15.690 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:02:15.690 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:02:15.690 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:15.739 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:02:15.755 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:02:15.755 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:15.755 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:02:15.755 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:15.913 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:02:15.921 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:02:15.936 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:02:15.936 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:15.936 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:02:15.937 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:02:15.937 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:02:15.937 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:15.949 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:02:16.056 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:02:16.227 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:02:16.259 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:02:16.285 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:02:16.285 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:16.285 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:02:16.285 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:02:16.285 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:02:16.285 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:16.335 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:02:16.346 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:02:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:02:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:02:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:02:16.395 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:02:16.396 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:02:16.396 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:16.448 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:02:16.510 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:02:16.511 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:02:16.559 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:02:16.622 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:02:16.808 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:02:16.856 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:02:16.935 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:02:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:02:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:02:17.207 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:02:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:02:17.266 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:02:17.309 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:02:17.337 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:02:17.337 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:17.338 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:02:17.338 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:02:17.338 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:02:17.338 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:17.487 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:02:17.513 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:02:17.538 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:02:17.538 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:17.538 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:02:17.538 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:02:17.538 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:02:17.538 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:17.576 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:02:17.588 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:02:17.602 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:02:17.602 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:17.602 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:02:17.602 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:02:17.602 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:02:17.602 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:17.613 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:02:17.613 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:17.613 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:02:17.613 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:02:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:02:17.729 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:02:17.792 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:02:17.821 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:02:17.930 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:02:17.955 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:02:17.955 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:17.955 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:02:17.955 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:02:17.955 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:02:17.955 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:18.060 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:02:18.087 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:02:18.087 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:18.087 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:02:18.087 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:02:18.087 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:02:18.087 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:18.208 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:02:18.265 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:02:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:02:18.532 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:02:18.595 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:02:18.676 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:02:18.765 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:02:18.856 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:02:18.890 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:02:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:02:18.954 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:02:18.985 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:02:19.012 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:02:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:02:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:02:19.526 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:02:19.591 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:02:19.617 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:02:19.850 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:02:19.874 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:02:19.975 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:02:20.138 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:02:20.167 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:02:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:02:20.192 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:20.192 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:02:20.192 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:02:20.192 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:02:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:02:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:02:20.352 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:02:20.428 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:02:20.723 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:02:20.761 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:02:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:02:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:02:21.412 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:02:21.412 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:21.412 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:02:21.412 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:02:21.412 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:02:21.413 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:21.464 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:02:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:02:21.488 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:21.488 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:02:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:21.780 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:02:21.789 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:02:21.811 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:02:21.813 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:02:21.813 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:21.813 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:02:21.813 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:02:21.813 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:02:21.813 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:21.919 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:02:22.089 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:02:22.113 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:02:22.139 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:02:22.139 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:22.139 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:02:22.139 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:02:22.140 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:02:22.140 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:22.189 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:02:22.202 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:02:22.303 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:02:22.364 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:02:22.793 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:02:22.834 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:02:22.875 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:02:22.907 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:02:22.933 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:02:23.355 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:02:23.383 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:02:23.408 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:02:23.409 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:23.409 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:02:23.409 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:02:23.409 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:02:23.409 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:23.451 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:02:23.475 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:02:23.475 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:23.475 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:02:23.475 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:23.801 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:02:23.826 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:02:23.827 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:23.827 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:02:23.827 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:02:23.827 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:02:23.827 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:23.832 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:02:23.934 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:02:23.992 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:02:24.104 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:02:24.137 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:02:24.171 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:02:24.171 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:02:24.264 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:02:24.264 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:02:24.348 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:02:24.415 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:02:25.564 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:02:25.564 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2024-09-12T22:02:25.565 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2024-09-12T22:02:25.565 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2024-09-12T22:02:25.565 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2024-09-12T22:02:25.565 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2024-09-12T22:02:25.565 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /root 2024-09-12T22:02:25.565 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2024-09-12T22:02:25.565 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:25.758 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:02:25.775 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:02:25.775 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:25.775 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:02:25.775 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:02:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:02:26.483 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:02:26.515 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:02:26.542 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:02:27.277 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:02:27.304 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:02:27.304 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:27.305 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:02:27.305 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:02:27.305 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:02:27.305 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:02:27.461 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:02:27.519 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:02:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:02:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:02:27.569 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:27.569 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:02:27.569 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:02:27.569 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:02:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:27.625 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:02:27.656 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:02:27.681 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:02:27.682 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:02:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:02:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:02:27.855 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:02:27.924 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:02:28.004 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:02:28.027 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:02:28.028 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:28.028 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:02:28.028 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:02:28.028 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:02:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:28.142 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:02:28.190 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:02:28.245 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:02:28.433 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:02:28.481 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:02:28.560 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:02:28.646 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:02:28.672 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:02:28.714 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:02:28.755 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:02:28.780 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:02:28.811 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:02:28.817 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:02:28.838 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:02:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:02:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:02:29.310 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:02:29.339 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:02:29.370 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:02:29.433 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:02:29.470 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:02:29.650 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:02:29.650 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:02:29.650 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:02:29.650 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:02:29.651 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:02:29.651 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:02:29.651 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:02:29.651 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:02:29.651 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:02:29.651 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:02:29.651 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:02:29.651 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:02:29.651 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:02:29.651 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:02:29.651 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:02:29.652 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:02:29.652 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:02:29.652 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:02:29.652 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:02:29.652 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:02:29.652 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:02:29.652 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:02:29.652 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:02:29.652 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:02:29.652 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:02:29.653 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:02:29.653 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:02:29.653 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:02:29.653 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:02:29.653 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:02:29.653 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:02:29.653 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:02:29.653 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:02:29.653 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:02:29.653 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:02:29.654 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:02:29.654 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:02:29.654 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:02:29.654 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:02:29.654 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:02:29.655 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:02:29.655 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:02:29.655 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:02:29.655 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:02:29.655 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:02:29.655 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:02:29.655 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:02:29.655 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:02:29.655 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:02:29.655 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:02:29.656 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:02:29.656 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:02:29.656 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:02:29.656 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:02:29.656 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:02:29.656 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:02:29.656 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:02:29.656 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:02:29.656 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:02:29.656 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:02:29.656 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:02:29.656 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:02:29.657 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:02:29.657 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:02:29.657 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:02:29.657 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:02:29.657 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:02:29.657 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:02:29.657 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:02:29.657 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:02:29.657 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:02:29.657 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:02:29.657 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:02:29.657 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:02:29.658 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:02:29.658 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:02:29.658 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:02:29.658 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:02:29.658 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:02:29.658 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:02:29.658 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:02:29.658 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:02:29.658 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:02:29.658 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:02:29.658 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:02:29.658 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:02:29.659 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:02:29.659 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:02:29.659 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:02:29.659 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:02:29.659 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:02:29.659 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:02:29.659 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:02:29.659 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:02:29.659 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:02:29.659 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:02:29.659 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:02:29.659 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:02:29.659 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:02:29.659 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:02:29.660 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:02:29.660 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:02:29.660 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:02:29.660 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:02:29.660 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:02:29.660 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:02:29.660 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:02:29.660 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:02:29.660 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:02:29.660 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:02:29.660 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:02:29.660 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:02:29.660 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:02:29.660 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:02:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:02:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:02:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:02:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:02:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:02:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:02:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:02:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:02:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:02:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:02:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:02:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:02:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:02:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:02:29.662 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:02:29.662 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:02:29.662 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:02:29.662 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:02:29.662 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:02:29.662 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:02:29.662 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:02:29.662 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:02:29.662 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:02:29.662 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:02:29.662 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:02:29.662 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:02:29.662 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:02:29.662 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:02:29.663 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:02:29.742 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:02:29.830 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:02:29.886 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:02:30.002 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:02:30.034 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:02:30.068 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:02:30.068 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:02:30.152 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:02:30.152 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:02:30.237 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:02:30.303 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:02:30.520 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:02:30.555 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:02:31.522 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:02:31.555 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:02:31.657 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:02:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:02:31.849 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:02:31.873 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:02:31.873 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:31.873 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:02:31.874 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:02:31.874 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:02:31.874 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:31.925 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:02:31.937 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:02:32.037 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:02:32.097 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:02:32.246 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:02:32.246 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:32.246 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-09-12T22:02:32.246 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.247 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.247 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:02:32.247 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:02:32.247 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-12T22:02:32.247 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:02:32.247 INFO:teuthology.orchestra.run.smithi043.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:02:32.247 INFO:teuthology.orchestra.run.smithi043.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:02:32.247 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:02:32.247 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.247 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.247 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.247 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.247 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:32.248 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.248 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.248 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.248 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:32.248 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:32.248 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:32.248 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:32.248 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:32.248 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.248 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.248 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:32.248 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.248 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.248 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.249 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:32.249 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:32.249 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:02:32.249 INFO:teuthology.orchestra.run.smithi043.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:02:32.249 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:02:32.249 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:02:32.249 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:02:32.249 INFO:teuthology.orchestra.run.smithi043.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:02:32.249 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:02:32.249 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:02:32.249 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:02:32.249 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:02:32.249 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:02:32.250 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.250 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.250 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.250 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:02:32.250 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:02:32.250 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:02:32.250 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:02:32.250 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:02:32.250 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.250 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.250 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:02:32.250 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.250 INFO:teuthology.orchestra.run.smithi043.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:02:32.250 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:02:32.251 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:02:32.251 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:02:32.251 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:02:32.251 INFO:teuthology.orchestra.run.smithi043.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:02:32.251 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:02:32.251 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:02:32.251 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:02:32.251 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:02:32.251 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:02:32.251 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:02:32.251 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:02:32.251 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:02:32.251 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:02:32.251 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:02:32.252 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:02:32.252 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:02:32.252 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.252 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.252 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.252 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:02:32.252 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:02:32.252 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:02:32.252 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:02:32.252 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:02:32.252 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:02:32.252 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:02:32.252 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:02:32.252 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:02:32.253 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:02:32.253 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:02:32.253 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:02:32.253 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:02:32.253 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:02:32.253 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:02:32.253 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:02:32.253 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:02:32.253 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:02:32.253 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:02:32.253 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:02:32.253 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:02:32.253 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:02:32.253 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:02:32.254 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:02:32.254 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:02:32.254 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:02:32.254 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:02:32.254 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:02:32.254 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:02:32.254 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:02:32.254 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:02:32.254 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:02:32.254 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:02:32.254 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:02:32.254 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:02:32.254 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:02:32.254 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:02:32.255 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.255 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.255 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:02:32.255 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:02:32.255 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:02:32.255 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.255 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:02:32.255 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:02:32.255 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:02:32.255 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:02:32.255 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:02:32.255 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:02:32.255 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:02:32.255 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:02:32.256 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:02:32.256 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:02:32.256 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:02:32.256 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:02:32.256 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:02:32.256 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:02:32.256 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.256 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.256 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:32.256 INFO:teuthology.orchestra.run.smithi043.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:02:32.256 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:02:32.256 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:02:32.256 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:02:32.256 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:02:32.257 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:02:32.257 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:32.257 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-12T22:02:32.582 DEBUG:teuthology.parallel:result is None 2024-09-12T22:02:33.037 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:02:33.069 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:02:33.094 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:02:33.094 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:33.094 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:02:33.094 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:02:33.094 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:02:33.094 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:33.136 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:02:33.160 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:02:33.160 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:33.160 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:02:33.160 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:33.475 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:02:33.475 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:02:33.475 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:02:33.476 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:02:33.476 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:02:33.476 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:02:33.476 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:02:33.476 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:02:33.476 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:02:33.476 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:02:33.476 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:02:33.476 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:02:33.476 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:02:33.476 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:02:33.477 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:02:33.477 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:02:33.477 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:02:33.477 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:02:33.477 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:02:33.477 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:02:33.477 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:02:33.477 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:02:33.477 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:02:33.477 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:02:33.477 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:02:33.477 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:02:33.477 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:02:33.477 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:02:33.485 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:02:33.488 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:02:33.488 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:02:33.488 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:02:33.488 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:02:33.488 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:02:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:02:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:02:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:02:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:02:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:02:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:02:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:02:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:02:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:02:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:02:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:02:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:02:33.489 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:02:33.490 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:02:33.490 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:02:33.490 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:02:33.490 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:02:33.490 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:02:33.490 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:02:33.490 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:02:33.490 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:02:33.490 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:02:33.490 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:02:33.490 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:02:33.490 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:02:33.491 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:02:33.491 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:02:33.491 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:02:33.491 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:02:33.491 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:02:33.491 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:02:33.491 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:02:33.491 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:02:33.491 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:02:33.491 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:02:33.491 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:02:33.491 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:02:33.491 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:02:33.492 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:02:33.492 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:02:33.492 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:02:33.492 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:02:33.492 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:02:33.492 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:02:33.492 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:02:33.492 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:02:33.492 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:02:33.493 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:02:33.493 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:02:33.493 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:02:33.493 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:02:33.493 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:02:33.493 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:02:33.493 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:02:33.493 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:02:33.493 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:02:33.493 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:02:33.493 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:02:33.493 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:02:33.493 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:02:33.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:02:33.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:02:33.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:02:33.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:02:33.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:02:33.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:02:33.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:02:33.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:02:33.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:02:33.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:02:33.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:02:33.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:02:33.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:02:33.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:02:33.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:02:33.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:02:33.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:02:33.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:02:33.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:02:33.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:02:33.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:02:33.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:02:33.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:02:33.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:02:33.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:02:33.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:02:33.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:02:33.496 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:02:33.496 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:02:33.496 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:02:33.496 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:02:33.496 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:02:33.496 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:02:33.496 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:02:33.496 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:02:33.496 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:02:33.496 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:02:33.496 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:02:33.496 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:02:33.496 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:02:33.497 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:02:33.497 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:02:33.497 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:02:33.497 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:02:33.497 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:02:33.497 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:02:33.497 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:02:33.497 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:02:33.497 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:02:33.497 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:02:33.503 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:02:33.503 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:02:33.503 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:02:33.504 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:02:33.504 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:02:33.504 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:35.649 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:02:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:02:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:02:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:02:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:02:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:02:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:02:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:02:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:02:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:02:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:02:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:02:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:02:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:02:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:02:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:02:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:02:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:02:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:02:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:02:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:02:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:02:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:02:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:02:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:02:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:02:35.652 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:02:35.652 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:02:35.652 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:02:35.652 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:02:35.661 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:02:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:02:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:02:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:02:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:02:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:02:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:02:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:02:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:02:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:02:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:02:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:02:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:02:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:02:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:02:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:02:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:02:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:02:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:02:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:02:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:02:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:02:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:02:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:02:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:02:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:02:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:02:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:02:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:02:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:02:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:02:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:02:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:02:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:02:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:02:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:02:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:02:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:02:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:02:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:02:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:02:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:02:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:02:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:02:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:02:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:02:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:02:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:02:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:02:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:02:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:02:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:02:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:02:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:02:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:02:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:02:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:02:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:02:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:02:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:02:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:02:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:02:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:02:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:02:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:02:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:02:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:02:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:02:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:02:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:02:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:02:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:02:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:02:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:02:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:02:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:02:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:02:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:02:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:02:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:02:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:02:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:02:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:02:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:02:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:02:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:02:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:02:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:02:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:02:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:02:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:02:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:02:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:02:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:02:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:02:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:02:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:02:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:02:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:02:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:02:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:02:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:02:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:02:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:02:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:02:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:02:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:02:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:02:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:02:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:02:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:02:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:02:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:02:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:02:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:35.928 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-09-12T22:02:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:02:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:02:35.929 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-12T22:02:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:02:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:02:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:02:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:02:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:02:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:02:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:02:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:02:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:02:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:02:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:02:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:02:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:02:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:02:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:02:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:02:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:02:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:02:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:02:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:02:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:02:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:02:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:02:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:02:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:02:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:02:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:02:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:02:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:02:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:02:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:02:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:02:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:02:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:02:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:02:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:02:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:02:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:02:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:02:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:02:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:02:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:02:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:02:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:02:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:02:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:02:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:02:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:02:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:02:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:02:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:02:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:02:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:02:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:02:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:02:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:02:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:02:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:02:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:02:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:02:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:02:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:02:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:02:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:02:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:02:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:02:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:02:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:02:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:02:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:02:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:02:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:02:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:02:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:02:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:02:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:02:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:02:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:02:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:02:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:02:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:02:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:02:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:02:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:02:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:02:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:02:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:02:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:02:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:02:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:02:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:02:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:02:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:02:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:02:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:02:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:02:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:02:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:02:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:02:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:35.939 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-12T22:02:36.279 DEBUG:teuthology.parallel:result is None 2024-09-12T22:02:38.087 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:02:38.087 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:38.088 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-09-12T22:02:38.088 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.088 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.088 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:02:38.088 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:02:38.088 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T22:02:38.088 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:02:38.088 INFO:teuthology.orchestra.run.smithi047.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:02:38.088 INFO:teuthology.orchestra.run.smithi047.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:02:38.088 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:02:38.088 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.088 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.088 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.089 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.089 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:38.089 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.089 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.089 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.089 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:38.089 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:38.089 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:38.089 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:38.089 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:38.089 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.089 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.089 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:38.090 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.090 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.090 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.090 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:38.090 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:38.090 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:02:38.090 INFO:teuthology.orchestra.run.smithi047.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:02:38.090 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:02:38.090 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:02:38.090 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:02:38.090 INFO:teuthology.orchestra.run.smithi047.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:02:38.090 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:02:38.090 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:02:38.091 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:02:38.091 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:02:38.091 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:02:38.091 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.091 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.091 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.091 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:02:38.091 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:02:38.091 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:02:38.091 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:02:38.091 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:02:38.091 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.091 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.092 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:02:38.092 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.092 INFO:teuthology.orchestra.run.smithi047.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:02:38.092 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:02:38.092 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:02:38.092 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:02:38.092 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:02:38.092 INFO:teuthology.orchestra.run.smithi047.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:02:38.092 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:02:38.092 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:02:38.092 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:02:38.092 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:02:38.092 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:02:38.092 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:02:38.093 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:02:38.093 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:02:38.093 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:02:38.093 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:02:38.093 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:02:38.093 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:02:38.093 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.093 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.093 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.093 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:02:38.093 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:02:38.093 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:02:38.093 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:02:38.094 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:02:38.094 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:02:38.094 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:02:38.094 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:02:38.094 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:02:38.094 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:02:38.094 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:02:38.094 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:02:38.094 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:02:38.094 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:02:38.094 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:02:38.094 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:02:38.094 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:02:38.094 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:02:38.095 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:02:38.095 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:02:38.095 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:02:38.095 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:02:38.095 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:02:38.095 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:02:38.095 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:02:38.095 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:02:38.095 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:02:38.095 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:02:38.095 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:02:38.095 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:02:38.095 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:02:38.096 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:02:38.096 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:02:38.096 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:02:38.096 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:02:38.096 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:02:38.096 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:02:38.096 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.096 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.096 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:02:38.096 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:02:38.096 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:02:38.096 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.096 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:02:38.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:02:38.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:02:38.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:02:38.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:02:38.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:02:38.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:02:38.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:02:38.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:02:38.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:02:38.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:02:38.097 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:02:38.097 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:02:38.097 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:02:38.097 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.098 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.098 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:38.098 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:02:38.098 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:02:38.098 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:02:38.098 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:02:38.098 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:02:38.098 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:02:38.099 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:38.099 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T22:02:38.107 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:02:38.148 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:02:38.189 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:02:38.221 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:02:38.248 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:02:38.446 DEBUG:teuthology.parallel:result is None 2024-09-12T22:02:39.101 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:02:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:02:39.257 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:02:39.372 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:02:39.410 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:02:39.444 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:02:39.444 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:02:39.511 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:02:39.511 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:02:39.579 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:02:39.643 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:02:45.132 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:02:45.132 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:02:45.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:02:45.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:02:45.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:02:45.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:02:45.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:02:45.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:02:45.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:02:45.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:02:45.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:02:45.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:02:45.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:02:45.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:02:45.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:02:45.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:02:45.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:02:45.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:02:45.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:02:45.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:02:45.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:02:45.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:02:45.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:02:45.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:02:45.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:02:45.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:02:45.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:02:45.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:02:45.144 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:02:45.144 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:02:45.144 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:02:45.144 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:02:45.144 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:02:45.144 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:02:45.144 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:02:45.145 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:02:45.145 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:02:45.145 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:02:45.145 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:02:45.145 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:02:45.145 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:02:45.145 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:02:45.145 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:02:45.145 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:02:45.145 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:02:45.145 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:02:45.145 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:02:45.145 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:02:45.145 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:02:45.146 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:02:45.146 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:02:45.146 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:02:45.146 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:02:45.146 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:02:45.146 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:02:45.146 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:02:45.146 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:02:45.146 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:02:45.146 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:02:45.146 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:02:45.146 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:02:45.146 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:02:45.147 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:02:45.147 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:02:45.147 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:02:45.147 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:02:45.147 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:02:45.147 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:02:45.147 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:02:45.147 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:02:45.147 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:02:45.147 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:02:45.147 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:02:45.147 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:02:45.147 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:02:45.148 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:02:45.148 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:02:45.148 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:02:45.148 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:02:45.148 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:02:45.148 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:02:45.148 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:02:45.148 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:02:45.148 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:02:45.148 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:02:45.148 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:02:45.148 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:02:45.148 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:02:45.149 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:02:45.149 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:02:45.149 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:02:45.149 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:02:45.149 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:02:45.149 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:02:45.149 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:02:45.149 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:02:45.149 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:02:45.149 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:02:45.149 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:02:45.149 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:02:45.149 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:02:45.150 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:02:45.150 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:02:45.150 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:02:45.150 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:02:45.150 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:02:45.150 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:02:45.150 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:02:45.150 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:02:45.150 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:02:45.150 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:02:45.150 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:02:45.150 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:02:45.150 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:02:45.151 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:02:45.151 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:02:45.151 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:02:45.151 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:02:45.151 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:02:45.151 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:02:45.151 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:02:45.151 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:02:45.151 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:02:45.151 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:02:45.151 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:02:45.151 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:02:45.151 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:02:45.152 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:02:45.152 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:02:45.152 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:02:45.152 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:02:45.152 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:02:45.152 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:02:45.152 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:02:45.152 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:02:45.152 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:02:45.152 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:02:45.152 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:02:45.152 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:02:45.153 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:02:45.153 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:02:45.153 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:02:45.153 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:02:47.539 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:02:47.539 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:47.539 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2024-09-12T22:02:47.539 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.539 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.539 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:02:47.539 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:02:47.539 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-12T22:02:47.539 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:02:47.539 INFO:teuthology.orchestra.run.smithi146.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:02:47.539 INFO:teuthology.orchestra.run.smithi146.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:02:47.540 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:02:47.540 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.540 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.540 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.540 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.540 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:47.540 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.540 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.540 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.540 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:47.540 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:47.540 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:47.541 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:47.541 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:47.541 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.541 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.541 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:47.541 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.541 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.541 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.541 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:47.541 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:02:47.541 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:02:47.541 INFO:teuthology.orchestra.run.smithi146.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:02:47.541 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:02:47.542 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:02:47.542 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:02:47.542 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:02:47.542 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:02:47.542 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:02:47.542 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:02:47.542 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:02:47.542 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:02:47.542 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.542 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.542 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.542 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:02:47.542 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:02:47.543 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:02:47.543 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:02:47.543 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:02:47.543 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.543 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.543 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:02:47.543 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.543 INFO:teuthology.orchestra.run.smithi146.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:02:47.543 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:02:47.543 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:02:47.543 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:02:47.543 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:02:47.543 INFO:teuthology.orchestra.run.smithi146.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:02:47.544 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:02:47.544 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:02:47.544 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:02:47.544 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:02:47.544 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:02:47.544 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:02:47.544 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:02:47.544 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:02:47.544 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:02:47.544 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:02:47.544 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:02:47.544 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:02:47.544 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.545 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.545 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.545 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:02:47.545 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:02:47.545 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:02:47.545 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:02:47.545 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:02:47.545 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:02:47.545 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:02:47.545 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:02:47.545 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:02:47.545 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:02:47.545 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:02:47.546 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:02:47.546 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:02:47.546 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:02:47.546 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:02:47.546 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:02:47.546 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:02:47.546 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:02:47.546 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:02:47.546 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:02:47.546 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:02:47.546 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:02:47.546 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:02:47.546 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:02:47.547 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:02:47.547 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:02:47.547 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:02:47.547 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:02:47.547 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:02:47.547 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:02:47.547 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:02:47.547 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:02:47.547 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:02:47.547 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:02:47.547 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:02:47.547 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:02:47.547 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:02:47.548 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.548 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.548 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:02:47.548 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:02:47.548 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:02:47.548 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.548 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:02:47.548 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:02:47.548 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:02:47.548 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:02:47.548 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:02:47.548 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:02:47.548 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:02:47.549 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:02:47.549 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:02:47.549 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:02:47.549 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:02:47.549 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:02:47.549 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:02:47.549 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:02:47.549 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.549 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.549 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:02:47.549 INFO:teuthology.orchestra.run.smithi146.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:02:47.549 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:02:47.549 INFO:teuthology.orchestra.run.smithi146.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:02:47.549 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:02:47.550 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:02:47.550 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:02:47.550 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:47.550 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-12T22:02:47.890 DEBUG:teuthology.parallel:result is None 2024-09-12T22:02:47.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:02:48.036 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:02:48.064 INFO:teuthology.orchestra.run.smithi043.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:02:48.064 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:02:48.065 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:02:48.066 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:02:48.216 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:02:48.243 INFO:teuthology.orchestra.run.smithi047.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:02:48.243 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:02:48.243 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:02:48.245 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:02:48.382 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:02:48.408 INFO:teuthology.orchestra.run.smithi110.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:02:48.408 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:02:48.409 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:02:48.410 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:02:48.554 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:02:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:02:48.577 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:02:48.577 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:02:48.579 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T22:02:48.579 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T22:02:48.579 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:02:48.613 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T22:02:48.614 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:02:48.647 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T22:02:48.647 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:02:48.679 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-12T22:02:48.679 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:02:48.708 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T22:02:48.709 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T22:02:48.709 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:02:48.739 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:02:48.810 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T22:02:48.810 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:02:48.840 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:02:48.910 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T22:02:48.910 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:02:48.940 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:02:49.008 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-12T22:02:49.009 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:02:49.037 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:02:49.106 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T22:02:49.106 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T22:02:49.106 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:02:49.137 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:02:49.203 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T22:02:49.204 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:02:49.235 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:02:49.305 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T22:02:49.305 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:02:49.335 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:02:49.404 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-12T22:02:49.404 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:02:49.433 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:02:49.502 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T22:02:49.502 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T22:02:49.503 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:02:49.530 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:02:49.595 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T22:02:49.595 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:02:49.627 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:02:49.697 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T22:02:49.697 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:02:49.726 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:02:49.794 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-12T22:02:49.794 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:02:49.824 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:02:49.892 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T22:02:49.968 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T22:02:49.968 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /var/log/ceph 2024-09-12T22:02:49.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /var/log/ceph 2024-09-12T22:02:49.974 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2024-09-12T22:02:49.976 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2024-09-12T22:02:50.005 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T22:02:50.005 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:02:50.037 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:02:50.045 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:02:50.047 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:02:50.075 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T22:02:50.075 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:02:50.102 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:02:50.115 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:02:50.118 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:02:50.155 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T22:02:50.155 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T22:02:50.155 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7902915', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 8861, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'targets': {'smithi043.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB2I2BtgVf458swpDNz+5nmaUfEQe05vm0RG/0SA1BUVmgOK3cOpv8XRsP36Uo99+Kd9BOEpuy2i0W+8ulHh4mE=', 'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEbXkDAre/lMWFXFXeXEJrlA2Usy2hAX+Br/+h3so5/Qm94caKSSubGNJ+6HwUDN5dcGJg9t0TRVfm1/0IAZptg=', 'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG7VeiPJPuNkxl9CAzcLDr5ZZHt20Q/vEUUSrBDQUmFnnqeL/fYpMwwAcWEyZ0ezZkdZ57L0/f4ObN7H9CoIvFI=', 'smithi146.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGiiQyw1nQiTBhQqeUVVx/y2//RQ3rW5dnmFnZW8p/0GsV+XLUlDk3t0st7mxBgmhyvm1AEoFogMM/3Jy1nkctQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_21:32:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T22:02:50.155 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:02:50.167 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:02:50.185 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:02:50.188 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:02:50.205 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:02:50.222 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:02:50.243 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:02:50.245 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:02:50.271 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T22:02:50.271 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T22:02:50.328 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T22:02:50.328 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-09-12T22:02:50.385 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T22:02:50.386 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:02:50.386 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T22:02:50.386 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:02:50.386 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:02:50.386 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 22:02:30.668089839 +0000 2024-09-12T22:02:50.386 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 22:00:43.566541803 +0000 2024-09-12T22:02:50.386 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 22:00:43.566541803 +0000 2024-09-12T22:02:50.386 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-12 22:00:43.566541803 +0000 2024-09-12T22:02:50.386 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T22:02:50.452 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T22:02:50.452 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T22:02:50.452 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000110422 s, 4.6 MB/s 2024-09-12T22:02:50.454 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T22:02:50.512 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-09-12T22:02:50.569 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T22:02:50.569 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:02:50.569 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T22:02:50.569 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:02:50.569 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:02:50.569 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 22:02:30.669089818 +0000 2024-09-12T22:02:50.569 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 22:00:43.889535189 +0000 2024-09-12T22:02:50.569 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 22:00:43.889535189 +0000 2024-09-12T22:02:50.569 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-12 22:00:43.889535189 +0000 2024-09-12T22:02:50.570 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T22:02:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T22:02:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T22:02:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000108329 s, 4.7 MB/s 2024-09-12T22:02:50.636 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T22:02:50.693 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-09-12T22:02:50.750 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T22:02:50.750 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:02:50.751 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T22:02:50.751 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:02:50.751 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:02:50.751 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 22:02:30.669089818 +0000 2024-09-12T22:02:50.751 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 22:00:44.217528472 +0000 2024-09-12T22:02:50.751 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 22:00:44.217528472 +0000 2024-09-12T22:02:50.751 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-12 22:00:44.217528472 +0000 2024-09-12T22:02:50.751 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T22:02:50.816 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T22:02:50.816 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T22:02:50.817 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000106308 s, 4.8 MB/s 2024-09-12T22:02:50.818 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T22:02:50.875 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-09-12T22:02:50.933 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T22:02:50.933 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:02:50.933 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T22:02:50.933 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:02:50.933 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:02:50.933 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 22:02:30.670089798 +0000 2024-09-12T22:02:50.933 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 22:00:44.541521836 +0000 2024-09-12T22:02:50.933 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 22:00:44.541521836 +0000 2024-09-12T22:02:50.933 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-12 22:00:44.541521836 +0000 2024-09-12T22:02:50.933 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T22:02:50.998 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T22:02:50.998 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T22:02:50.998 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000104469 s, 4.9 MB/s 2024-09-12T22:02:51.000 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T22:02:51.057 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T22:02:51.057 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T22:02:51.057 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T22:02:51.074 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T22:02:51.074 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-09-12T22:02:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T22:02:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:02:51.129 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T22:02:51.129 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:02:51.129 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:02:51.129 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-12 22:02:28.268945177 +0000 2024-09-12T22:02:51.129 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-12 22:00:42.566635056 +0000 2024-09-12T22:02:51.130 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-12 22:00:42.566635056 +0000 2024-09-12T22:02:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-12 22:00:42.566635056 +0000 2024-09-12T22:02:51.130 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T22:02:51.192 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-12T22:02:51.192 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-12T22:02:51.192 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000109223 s, 4.7 MB/s 2024-09-12T22:02:51.194 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T22:02:51.250 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-09-12T22:02:51.305 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T22:02:51.305 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:02:51.305 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T22:02:51.305 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:02:51.305 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:02:51.305 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-12 22:02:28.268945177 +0000 2024-09-12T22:02:51.305 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-12 22:00:42.889629784 +0000 2024-09-12T22:02:51.305 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-12 22:00:42.889629784 +0000 2024-09-12T22:02:51.305 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-12 22:00:42.889629784 +0000 2024-09-12T22:02:51.306 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T22:02:51.368 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-12T22:02:51.368 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-12T22:02:51.368 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 8.3203e-05 s, 6.2 MB/s 2024-09-12T22:02:51.369 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T22:02:51.425 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-09-12T22:02:51.480 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T22:02:51.480 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:02:51.481 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T22:02:51.481 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:02:51.481 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:02:51.481 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-12 22:02:28.268945177 +0000 2024-09-12T22:02:51.481 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-12 22:00:43.210624544 +0000 2024-09-12T22:02:51.481 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-12 22:00:43.210624544 +0000 2024-09-12T22:02:51.481 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-12 22:00:43.210624544 +0000 2024-09-12T22:02:51.481 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T22:02:51.544 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-12T22:02:51.544 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-12T22:02:51.544 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000100569 s, 5.1 MB/s 2024-09-12T22:02:51.545 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T22:02:51.601 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-09-12T22:02:51.656 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T22:02:51.656 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:02:51.656 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T22:02:51.656 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:02:51.656 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:02:51.657 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-12 22:02:28.269945160 +0000 2024-09-12T22:02:51.657 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-12 22:00:43.526619386 +0000 2024-09-12T22:02:51.657 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-12 22:00:43.526619386 +0000 2024-09-12T22:02:51.657 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-12 22:00:43.526619386 +0000 2024-09-12T22:02:51.657 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T22:02:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-12T22:02:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-12T22:02:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000101258 s, 5.1 MB/s 2024-09-12T22:02:51.720 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T22:02:51.776 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T22:02:51.776 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-12T22:02:51.776 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T22:02:51.795 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T22:02:51.796 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2024-09-12T22:02:51.855 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T22:02:51.855 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:02:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T22:02:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:02:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:02:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-12 22:02:40.001243502 +0000 2024-09-12T22:02:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-12 22:00:42.724257826 +0000 2024-09-12T22:02:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-12 22:00:42.724257826 +0000 2024-09-12T22:02:51.855 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-12 22:00:42.724257826 +0000 2024-09-12T22:02:51.855 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T22:02:51.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-12T22:02:51.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-12T22:02:51.923 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000227247 s, 2.3 MB/s 2024-09-12T22:02:51.925 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T22:02:51.984 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2024-09-12T22:02:52.041 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T22:02:52.042 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:02:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T22:02:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:02:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:02:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-12 22:02:40.001243502 +0000 2024-09-12T22:02:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-12 22:00:43.056253016 +0000 2024-09-12T22:02:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-12 22:00:43.056253016 +0000 2024-09-12T22:02:52.042 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-12 22:00:43.056253016 +0000 2024-09-12T22:02:52.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T22:02:52.109 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-12T22:02:52.109 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-12T22:02:52.109 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000187204 s, 2.7 MB/s 2024-09-12T22:02:52.110 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T22:02:52.169 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2024-09-12T22:02:52.227 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T22:02:52.227 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:02:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T22:02:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:02:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:02:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-12 22:02:40.001243502 +0000 2024-09-12T22:02:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-12 22:00:43.381248307 +0000 2024-09-12T22:02:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-12 22:00:43.381248307 +0000 2024-09-12T22:02:52.228 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-12 22:00:43.381248307 +0000 2024-09-12T22:02:52.228 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T22:02:52.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-12T22:02:52.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-12T22:02:52.293 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000191828 s, 2.7 MB/s 2024-09-12T22:02:52.294 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T22:02:52.351 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2024-09-12T22:02:52.408 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T22:02:52.408 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:02:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T22:02:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:02:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:02:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-12 22:02:40.002243486 +0000 2024-09-12T22:02:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-12 22:00:43.713243497 +0000 2024-09-12T22:02:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-12 22:00:43.713243497 +0000 2024-09-12T22:02:52.409 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-12 22:00:43.713243497 +0000 2024-09-12T22:02:52.409 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T22:02:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-12T22:02:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-12T22:02:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000180808 s, 2.8 MB/s 2024-09-12T22:02:52.475 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T22:02:52.533 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T22:02:52.533 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T22:02:52.533 INFO:tasks.ceph:Generating config... 2024-09-12T22:02:52.534 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T22:02:52.534 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T22:02:52.534 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T22:02:52.534 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T22:02:52.534 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T22:02:52.534 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T22:02:52.534 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T22:02:52.534 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T22:02:52.534 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T22:02:52.534 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T22:02:52.535 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T22:02:52.535 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T22:02:52.535 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T22:02:52.535 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T22:02:52.535 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T22:02:52.535 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T22:02:52.535 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T22:02:52.535 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T22:02:52.535 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T22:02:52.535 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T22:02:52.535 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T22:02:52.535 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2024-09-12T22:02:52.535 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T22:02:52.535 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T22:02:52.536 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T22:02:52.593 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T22:02:52.596 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T22:02:52.644 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:02:52.671 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.43'), ('mon.b', '[v2:172.21.15.43:3301,v1:172.21.15.43:6790]'), ('mon.c', '[v2:172.21.15.43:3302,v1:172.21.15.43:6791]')] 2024-09-12T22:02:52.671 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2024-09-12T22:02:52.672 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T22:02:52.672 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T22:02:52.728 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.43 --addv b '[v2:172.21.15.43:3301,v1:172.21.15.43:6790]' --addv c '[v2:172.21.15.43:3302,v1:172.21.15.43:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:02:52.817 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: generated fsid 1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7 2024-09-12T22:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:setting min_mon_release = quincy 2024-09-12T22:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 0 2024-09-12T22:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:fsid 1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7 2024-09-12T22:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:last_changed 2024-09-12T22:02:52.817545+0000 2024-09-12T22:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-09-12T22:02:52.817545+0000 2024-09-12T22:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:min_mon_release 17 (quincy) 2024-09-12T22:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:election_strategy: 1 2024-09-12T22:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T22:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:1: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.b 2024-09-12T22:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:2: [v2:172.21.15.43:3302/0,v1:172.21.15.43:6791/0] mon.c 2024-09-12T22:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T22:02:52.820 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T22:02:52.836 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7... 2024-09-12T22:02:52.836 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:02:52.878 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:02:52.881 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:02:52.883 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:02:52.921 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-09-12T22:02:52.921 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2024-09-12T22:02:52.921 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:02:52.921 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2024-09-12T22:02:52.921 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.921 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2024-09-12T22:02:52.921 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2024-09-12T22:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2024-09-12T22:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2024-09-12T22:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2024-09-12T22:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2024-09-12T22:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2024-09-12T22:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]" 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = 1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2024-09-12T22:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2024-09-12T22:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2024-09-12T22:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2024-09-12T22:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2024-09-12T22:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug trim objects = true 2024-09-12T22:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2024-09-12T22:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2024-09-12T22:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: bdev async discard = True 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: bdev enable discard = True 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 1/20 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 1/20 2024-09-12T22:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-12T22:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2024-09-12T22:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 4/10 2024-09-12T22:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2024-09-12T22:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout: osd max markdown count = 1000 2024-09-12T22:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout: osd memory target = 1610612736 2024-09-12T22:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2024-09-12T22:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2024-09-12T22:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-12T22:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2024-09-12T22:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-12T22:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-12T22:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2024-09-12T22:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2024-09-12T22:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-12T22:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-12T22:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2024-09-12T22:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-12T22:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2024-09-12T22:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2024-09-12T22:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2024-09-12T22:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2024-09-12T22:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2024-09-12T22:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2024-09-12T22:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2024-09-12T22:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2024-09-12T22:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2024-09-12T22:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2024-09-12T22:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2024-09-12T22:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2024-09-12T22:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-09-12T22:02:52.931 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-09-12T22:02:52.931 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T22:02:52.931 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-09-12T22:02:52.932 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-09-12T22:02:52.932 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:02:52.932 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-09-12T22:02:52.932 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.932 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-09-12T22:02:52.932 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.932 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-09-12T22:02:52.932 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.932 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-09-12T22:02:52.932 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-09-12T22:02:52.932 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.933 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-09-12T22:02:52.933 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-09-12T22:02:52.933 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.933 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:02:52.933 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-09-12T22:02:52.933 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.933 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:02:52.933 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:02:52.933 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.933 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-09-12T22:02:52.933 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.933 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-09-12T22:02:52.933 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-09-12T22:02:52.933 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:02:52.934 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:02:52.934 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-09-12T22:02:52.934 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:02:52.934 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-09-12T22:02:52.934 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:02:52.934 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:02:52.934 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-09-12T22:02:52.934 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.934 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:02:52.934 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.934 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-09-12T22:02:52.934 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.934 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-09-12T22:02:52.935 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.935 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-09-12T22:02:52.935 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-09-12T22:02:52.935 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-09-12T22:02:52.935 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]" 2024-09-12T22:02:52.935 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = 1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7 2024-09-12T22:02:52.935 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.935 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-09-12T22:02:52.935 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-09-12T22:02:52.935 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.935 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-09-12T22:02:52.935 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-09-12T22:02:52.935 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:02:52.935 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.936 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-09-12T22:02:52.936 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-09-12T22:02:52.936 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.936 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-09-12T22:02:52.936 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-09-12T22:02:52.936 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-09-12T22:02:52.936 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug trim objects = true 2024-09-12T22:02:52.936 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.936 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-09-12T22:02:52.936 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-09-12T22:02:52.936 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.936 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:02:52.936 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.936 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: bdev async discard = True 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: bdev enable discard = True 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 1/20 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 1/20 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-09-12T22:02:52.937 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 4/10 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: osd max markdown count = 1000 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: osd memory target = 1610612736 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-09-12T22:02:52.938 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:02:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:02:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-09-12T22:02:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.939 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-09-12T22:02:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-09-12T22:02:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-09-12T22:02:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-09-12T22:02:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-09-12T22:02:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-09-12T22:02:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-09-12T22:02:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:02:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-09-12T22:02:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-09-12T22:02:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T22:02:52.940 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-09-12T22:02:52.941 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-09-12T22:02:52.941 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-09-12T22:02:52.941 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-09-12T22:02:52.941 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:02:52.941 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:02:52.941 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-09-12T22:02:52.941 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-09-12T22:02:52.941 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-09-12T22:02:52.941 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-09-12T22:02:52.941 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-09-12T22:02:52.941 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T22:02:52.942 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-09-12T22:02:52.942 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-09-12T22:02:52.942 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:02:52.942 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-09-12T22:02:52.942 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.942 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-09-12T22:02:52.942 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.942 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-09-12T22:02:52.942 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.942 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-09-12T22:02:52.942 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-09-12T22:02:52.942 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.943 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-09-12T22:02:52.943 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-09-12T22:02:52.943 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.943 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:02:52.943 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-09-12T22:02:52.943 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.943 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:02:52.943 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:02:52.943 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.943 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-09-12T22:02:52.943 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.943 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-09-12T22:02:52.943 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-09-12T22:02:52.943 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:02:52.944 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:02:52.944 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-09-12T22:02:52.944 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:02:52.944 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-09-12T22:02:52.944 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:02:52.944 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:02:52.944 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-09-12T22:02:52.944 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.944 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:02:52.944 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.944 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-09-12T22:02:52.944 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.944 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]" 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.945 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug trim objects = true 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-09-12T22:02:52.946 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: bdev async discard = True 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: bdev enable discard = True 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 1/20 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 1/20 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 4/10 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-09-12T22:02:52.947 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:02:52.948 INFO:teuthology.orchestra.run.smithi047.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:02:52.948 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:02:52.948 INFO:teuthology.orchestra.run.smithi047.stdout: osd max markdown count = 1000 2024-09-12T22:02:52.948 INFO:teuthology.orchestra.run.smithi047.stdout: osd memory target = 1610612736 2024-09-12T22:02:52.948 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-09-12T22:02:52.948 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.948 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-09-12T22:02:52.948 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-12T22:02:52.948 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-09-12T22:02:52.948 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-09-12T22:02:52.948 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-09-12T22:02:52.948 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:02:52.948 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:02:52.948 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:02:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-09-12T22:02:52.950 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:02:52.951 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:02:52.951 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-09-12T22:02:52.951 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-09-12T22:02:52.951 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-09-12T22:02:52.951 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-09-12T22:02:52.951 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-09-12T22:02:52.951 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T22:02:52.951 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2024-09-12T22:02:52.951 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2024-09-12T22:02:52.951 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:02:52.951 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2024-09-12T22:02:52.951 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.951 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:02:52.952 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.953 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2024-09-12T22:02:52.953 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.953 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2024-09-12T22:02:52.953 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2024-09-12T22:02:52.953 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:02:52.953 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:02:52.953 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2024-09-12T22:02:52.953 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:02:52.953 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2024-09-12T22:02:52.953 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:02:52.953 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:02:52.953 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2024-09-12T22:02:52.953 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]" 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2024-09-12T22:02:52.954 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug trim objects = true 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.955 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:02:52.956 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.956 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2024-09-12T22:02:52.956 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.956 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2024-09-12T22:02:52.956 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.956 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:02:52.956 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2024-09-12T22:02:52.956 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.956 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2024-09-12T22:02:52.956 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2024-09-12T22:02:52.956 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2024-09-12T22:02:52.956 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2024-09-12T22:02:52.956 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2024-09-12T22:02:52.956 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2024-09-12T22:02:52.957 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2024-09-12T22:02:52.957 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2024-09-12T22:02:52.957 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-12T22:02:52.957 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2024-09-12T22:02:52.957 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2024-09-12T22:02:52.957 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:02:52.957 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2024-09-12T22:02:52.957 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:02:52.957 INFO:teuthology.orchestra.run.smithi146.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:02:52.957 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:02:52.957 INFO:teuthology.orchestra.run.smithi146.stdout: osd max markdown count = 1000 2024-09-12T22:02:52.957 INFO:teuthology.orchestra.run.smithi146.stdout: osd memory target = 1610612736 2024-09-12T22:02:52.958 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2024-09-12T22:02:52.958 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.958 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2024-09-12T22:02:52.958 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-12T22:02:52.958 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2024-09-12T22:02:52.958 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-12T22:02:52.958 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-12T22:02:52.958 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:02:52.958 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:02:52.958 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2024-09-12T22:02:52.958 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.958 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2024-09-12T22:02:52.958 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-12T22:02:52.958 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:02:52.959 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:02:52.960 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:02:52.960 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.960 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2024-09-12T22:02:52.960 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:02:52.960 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.960 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:02:52.960 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-12T22:02:52.960 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2024-09-12T22:02:52.960 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2024-09-12T22:02:52.960 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2024-09-12T22:02:52.960 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2024-09-12T22:02:52.960 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:02:52.960 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:02:52.961 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2024-09-12T22:02:52.961 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2024-09-12T22:02:52.961 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2024-09-12T22:02:52.961 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2024-09-12T22:02:52.961 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-12T22:02:52.961 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T22:02:52.963 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T22:02:52.963 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T22:02:53.059 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T22:02:53.059 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T22:02:53.059 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T22:02:53.075 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T22:02:53.075 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T22:02:53.131 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T22:02:53.132 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T22:02:53.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:02:53.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:02:53.208 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T22:02:53.208 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:02:53.263 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T22:02:53.264 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T22:02:53.264 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:02:53.264 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:02:53.305 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T22:02:53.305 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:02:53.361 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T22:02:53.361 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T22:02:53.361 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:02:53.361 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:02:53.402 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T22:02:53.402 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:02:53.461 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2024-09-12T22:02:53.461 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-12T22:02:53.462 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:02:53.462 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:02:53.501 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-12T22:02:53.501 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:02:53.559 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T22:02:53.559 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T22:02:53.560 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T22:02:53.614 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T22:02:53.616 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T22:02:53.671 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T22:02:53.673 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T22:02:53.674 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T22:02:53.726 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T22:02:53.728 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T22:02:53.754 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T22:02:53.754 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T22:02:53.837 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T22:02:53.850 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T22:02:53.850 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T22:02:53.851 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T22:02:53.878 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T22:02:53.878 INFO:tasks.ceph:role: osd.0 2024-09-12T22:02:53.878 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T22:02:53.878 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T22:02:53.943 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T22:02:53.944 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T22:02:53.944 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T22:02:53.944 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T22:02:53.944 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T22:02:53.944 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-09-12T22:02:53.944 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T22:02:53.944 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T22:02:53.944 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T22:02:53.944 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T22:02:53.980 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-09-12T22:02:53.982 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-09-12T22:02:53.982 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T22:02:54.052 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T22:02:54.124 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:02:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T22:02:54.227+0000 7fb7f9e24640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T22:02:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T22:02:54.227+0000 7fb7f9e24640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T22:02:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T22:02:54.227+0000 7fb7f9e24640 -1 bdev(0x55da2bd1b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T22:02:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T22:02:54.227+0000 7fb7f9e24640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T22:02:57.652 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T22:02:57.683 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T22:02:57.712 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T22:02:57.712 INFO:tasks.ceph:role: osd.1 2024-09-12T22:02:57.713 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T22:02:57.713 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T22:02:57.782 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T22:02:57.782 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T22:02:57.782 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T22:02:57.782 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T22:02:57.782 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T22:02:57.783 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-09-12T22:02:57.783 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T22:02:57.783 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T22:02:57.783 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T22:02:57.783 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T22:02:57.815 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-09-12T22:02:57.871 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-09-12T22:02:57.871 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-12T22:02:57.941 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T22:02:58.011 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:02:58.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T22:02:58.107+0000 7fd43c016640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T22:02:58.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T22:02:58.107+0000 7fd43c016640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T22:02:58.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T22:02:58.107+0000 7fd43c016640 -1 bdev(0x5649b391f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T22:02:58.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T22:02:58.108+0000 7fd43c016640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T22:03:01.261 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T22:03:01.289 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T22:03:01.319 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T22:03:01.319 INFO:tasks.ceph:role: osd.2 2024-09-12T22:03:01.319 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-12T22:03:01.319 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T22:03:01.394 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T22:03:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T22:03:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T22:03:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T22:03:01.395 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T22:03:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-12T22:03:01.395 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T22:03:01.395 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T22:03:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T22:03:01.395 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T22:03:01.908 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-12T22:03:01.910 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-12T22:03:01.910 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-12T22:03:02.021 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T22:03:02.052 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:03:02.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-12T22:03:02.198+0000 7fd2f4e31640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T22:03:02.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-12T22:03:02.202+0000 7fd2f4e31640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T22:03:02.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-12T22:03:02.202+0000 7fd2f4e31640 -1 bdev(0x55a03b07d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T22:03:02.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-12T22:03:02.202+0000 7fd2f4e31640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T22:03:05.380 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T22:03:05.410 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T22:03:05.413 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T22:03:05.413 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T22:03:05.445 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T22:03:05.445 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T22:03:05.515 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T22:03:05.515 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T22:03:05.587 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T22:03:05.587 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T22:03:05.619 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T22:03:05.619 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T22:03:05.649 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-12T22:03:05.649 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T22:03:05.679 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T22:03:05.679 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T22:03:05.699 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T22:03:05.699 DEBUG:teuthology.orchestra.run.smithi043:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T22:03:05.767 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.x] 2024-09-12T22:03:05.768 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQANZeNmDMeZJBAArLz3rV2ZKw132af15979YQ== 2024-09-12T22:03:05.768 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.y] 2024-09-12T22:03:05.768 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQANZeNm3rj9JxAAdZwna5qvEr631iI+ih4Cxw== 2024-09-12T22:03:05.768 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-09-12T22:03:05.768 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQANZeNmp8JIKxAAWqyuS4VIs66q5Rc6FpRf1Q== 2024-09-12T22:03:05.768 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.0] 2024-09-12T22:03:05.768 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAOZeNmzKecDRAAdSuQEM09yaFOwPNYnjkZKA== 2024-09-12T22:03:05.768 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.1] 2024-09-12T22:03:05.768 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQASZeNmwch6BhAAVl2o8AkJ/tiSSFZ48yo7xg== 2024-09-12T22:03:05.768 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.2] 2024-09-12T22:03:05.768 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAWZeNmworyCxAAJOp+lIkiaWmU0nn/Ak35uQ== 2024-09-12T22:03:05.768 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-09-12T22:03:05.768 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQANZeNm2NPmMRAAKot8K8IT+9Oa1MTDQ7O7xg== 2024-09-12T22:03:05.769 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T22:03:05.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T22:03:05.925 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T22:03:05.981 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T22:03:06.033 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T22:03:06.085 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T22:03:06.137 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T22:03:06.192 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T22:03:06.192 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T22:03:06.217 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T22:03:06.316 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T22:03:06.342 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T22:03:06.408 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T22:03:06.504 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T22:03:06.529 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T22:03:06.596 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T22:03:06.692 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T22:03:06.718 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:03:06.773 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T22:03:06.774 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T22:03:06.774 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T22:03:06.816 INFO:tasks.ceph.mon.a:Started 2024-09-12T22:03:06.816 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T22:03:06.816 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T22:03:06.818 INFO:tasks.ceph.mon.b:Started 2024-09-12T22:03:06.818 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T22:03:06.819 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T22:03:06.821 INFO:tasks.ceph.mon.c:Started 2024-09-12T22:03:06.821 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T22:03:06.821 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T22:03:06.821 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T22:03:06.823 INFO:tasks.ceph.mgr.x:Started 2024-09-12T22:03:06.823 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T22:03:06.824 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T22:03:06.826 INFO:tasks.ceph.mgr.y:Started 2024-09-12T22:03:06.826 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T22:03:06.826 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T22:03:12.058 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2024-09-12T22:03:12.071 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T22:03:12.072 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T22:03:12.072 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T22:03:12.072 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T22:03:12.088 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:12.087+0000 7f9ac6bef040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T22:03:12.102 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T22:03:12.103 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T22:03:12.132 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-12T22:03:12.132 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T22:03:12.133 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:12.131+0000 7f9ac6bef040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T22:03:12.162 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new eb292153-0043-4981-8743-115f848d2064 0 2024-09-12T22:03:12.277 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:12.276+0000 7f9ac6bef040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T22:03:12.330 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:12.329+0000 7f9ac6bef040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T22:03:12.387 INFO:teuthology.orchestra.run.smithi146.stdout:0 2024-09-12T22:03:12.398 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 5f0330a2-15ce-4ffb-a697-da1f930db079 1 2024-09-12T22:03:12.509 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:12.507+0000 7f9ac6bef040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:03:12.574 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-12T22:03:12.584 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new ae0b014f-768c-4f57-82c6-3edf9aa9f856 2 2024-09-12T22:03:12.625 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:12.624+0000 7f9ac6bef040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T22:03:12.760 INFO:teuthology.orchestra.run.smithi146.stdout:2 2024-09-12T22:03:12.771 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T22:03:12.771 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T22:03:12.773 INFO:tasks.ceph.osd.0:Started 2024-09-12T22:03:12.773 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T22:03:12.773 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T22:03:12.776 INFO:tasks.ceph.osd.1:Started 2024-09-12T22:03:12.776 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T22:03:12.776 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T22:03:12.778 INFO:tasks.ceph.osd.2:Started 2024-09-12T22:03:12.779 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:03:12.952 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:12.953 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","created":"2024-09-12T22:03:11.964028+0000","modified":"2024-09-12T22:03:12.758606+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T22:03:12.758606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"eb292153-0043-4981-8743-115f848d2064","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5f0330a2-15ce-4ffb-a697-da1f930db079","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ae0b014f-768c-4f57-82c6-3edf9aa9f856","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:03:12.964 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T22:03:12.964 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T22:03:12.980 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:12.980+0000 7f9ac6bef040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T22:03:13.022 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:13.021+0000 7fda9a012040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T22:03:13.040 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:13.039+0000 7f9ac6bef040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T22:03:13.065 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:13.064+0000 7fda9a012040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T22:03:13.201 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:13.200+0000 7f9ac6bef040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T22:03:13.204 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:13.203+0000 7fda9a012040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T22:03:13.255 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:13.254+0000 7fda9a012040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T22:03:13.266 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T22:03:13.374 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:13.373+0000 7fda9a012040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:03:13.446 INFO:teuthology.misc.health.smithi043.stdout: 2024-09-12T22:03:13.446 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":5,"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","created":"2024-09-12T22:03:11.964028+0000","modified":"2024-09-12T22:03:12.758606+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T22:03:12.758606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"eb292153-0043-4981-8743-115f848d2064","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5f0330a2-15ce-4ffb-a697-da1f930db079","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ae0b014f-768c-4f57-82c6-3edf9aa9f856","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:03:13.456 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T22:03:13.476 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:13.475+0000 7fda9a012040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T22:03:13.755 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:13.754+0000 7fda9a012040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T22:03:13.801 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:13.800+0000 7fda9a012040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T22:03:13.925 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:13.924+0000 7fda9a012040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T22:03:14.190 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:14.188+0000 7f46e3032640 -1 Falling back to public interface 2024-09-12T22:03:14.191 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:14.190+0000 7f8b78fb9640 -1 Falling back to public interface 2024-09-12T22:03:14.214 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:14.212+0000 7f9ac6bef040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T22:03:14.270 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:14.268+0000 7f9ac6bef040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T22:03:14.662 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:14.661+0000 7f9ac6bef040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T22:03:14.671 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:14.670+0000 7fda9a012040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T22:03:14.682 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:14.681+0000 7f75a6c15640 -1 Falling back to public interface 2024-09-12T22:03:14.717 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:14.716+0000 7fda9a012040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T22:03:14.752 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:14.751+0000 7f9ac6bef040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T22:03:14.866 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:14.865+0000 7f9ac6bef040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:03:14.915 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:14.914+0000 7f9ac6bef040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T22:03:15.037 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:15.036+0000 7f9ac6bef040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T22:03:15.049 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:15.049+0000 7fda9a012040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T22:03:15.094 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:15.093+0000 7f9ac6bef040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T22:03:15.138 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:15.137+0000 7fda9a012040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T22:03:15.142 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:15.141+0000 7f9ac6bef040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T22:03:15.251 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:15.250+0000 7fda9a012040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:03:15.260 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:15.260+0000 7f9ac6bef040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T22:03:15.296 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:15.295+0000 7fda9a012040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T22:03:15.315 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:15.313+0000 7f9ac6bef040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T22:03:15.369 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:15.368+0000 7f9ac6bef040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T22:03:15.413 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:15.412+0000 7fda9a012040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T22:03:15.440 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:15.440+0000 7f9ac6bef040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T22:03:15.468 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:15.467+0000 7fda9a012040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T22:03:15.489 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:15.487+0000 7f9ac6bef040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T22:03:15.512 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:15.511+0000 7fda9a012040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T22:03:15.535 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:15.534+0000 7f9ac6bef040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T22:03:15.631 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:15.630+0000 7fda9a012040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T22:03:15.682 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:15.681+0000 7fda9a012040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T22:03:15.732 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:15.731+0000 7fda9a012040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T22:03:15.787 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:15.786+0000 7fda9a012040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T22:03:15.832 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:15.831+0000 7fda9a012040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T22:03:15.876 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:15.875+0000 7fda9a012040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T22:03:16.230 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:16.229+0000 7f9ac6bef040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T22:03:16.484 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T22:03:16.483+0000 7fda9a012040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T22:03:17.246 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:17.245+0000 7f9a674bc640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T22:03:17.246 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-12T22:03:17.245+0000 7f9a674bc640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T22:03:17.927 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:17.926+0000 7f46e3032640 -1 osd.0 0 log_to_monitors true 2024-09-12T22:03:18.421 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:18.420+0000 7f8b78fb9640 -1 osd.1 0 log_to_monitors true 2024-09-12T22:03:18.914 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:18.913+0000 7f75a6c15640 -1 osd.2 0 log_to_monitors true 2024-09-12T22:03:19.759 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T22:03:20.051 INFO:teuthology.misc.health.smithi043.stdout: 2024-09-12T22:03:20.051 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":7,"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","created":"2024-09-12T22:03:11.964028+0000","modified":"2024-09-12T22:03:19.289382+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T22:03:12.758606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"eb292153-0043-4981-8743-115f848d2064","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5f0330a2-15ce-4ffb-a697-da1f930db079","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ae0b014f-768c-4f57-82c6-3edf9aa9f856","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:03:20.062 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T22:03:20.086 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:20.085+0000 7f46ddd4f640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T22:03:20.105 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:20.104+0000 7f46d6381640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:03:21.098 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:21.096+0000 7f8b74725640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T22:03:21.111 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:21.111+0000 7f8b6cd57640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:03:21.237 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:21.236+0000 7f75a2d3a640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T22:03:21.252 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:21.251+0000 7f759a335640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:03:26.366 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T22:03:26.657 INFO:teuthology.misc.health.smithi043.stdout: 2024-09-12T22:03:26.657 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":12,"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","created":"2024-09-12T22:03:11.964028+0000","modified":"2024-09-12T22:03:24.312790+0000","last_up_change":"2024-09-12T22:03:21.299348+0000","last_in_change":"2024-09-12T22:03:12.758606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:03:22.281699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb292153-0043-4981-8743-115f848d2064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6801","nonce":1281227380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6803","nonce":1281227380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6807","nonce":1281227380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6805","nonce":1281227380}]},"public_addr":"172.21.15.47:6801/1281227380","cluster_addr":"172.21.15.47:6803/1281227380","heartbeat_back_addr":"172.21.15.47:6807/1281227380","heartbeat_front_addr":"172.21.15.47:6805/1281227380","state":["exists","up"]},{"osd":1,"uuid":"5f0330a2-15ce-4ffb-a697-da1f930db079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6801","nonce":1334802479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6803","nonce":1334802479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6807","nonce":1334802479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6805","nonce":1334802479}]},"public_addr":"172.21.15.110:6801/1334802479","cluster_addr":"172.21.15.110:6803/1334802479","heartbeat_back_addr":"172.21.15.110:6807/1334802479","heartbeat_front_addr":"172.21.15.110:6805/1334802479","state":["exists","up"]},{"osd":2,"uuid":"ae0b014f-768c-4f57-82c6-3edf9aa9f856","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6801","nonce":3565874056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6803","nonce":3565874056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6807","nonce":3565874056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6805","nonce":3565874056}]},"public_addr":"172.21.15.146:6801/3565874056","cluster_addr":"172.21.15.146:6803/3565874056","heartbeat_back_addr":"172.21.15.146:6807/3565874056","heartbeat_front_addr":"172.21.15.146:6805/3565874056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:18.927187+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.386650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.957366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:03:26.668 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-12T22:03:26.668 INFO:tasks.ceph:Creating RBD pool 2024-09-12T22:03:26.668 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T22:03:27.325 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'rbd' created 2024-09-12T22:03:27.340 DEBUG:teuthology.orchestra.run.smithi043:> rbd --cluster ceph pool init rbd 2024-09-12T22:03:30.348 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T22:03:30.348 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T22:03:30.349 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T22:03:30.351 INFO:tasks.ceph.mds.a:Started 2024-09-12T22:03:30.351 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T22:03:30.351 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:03:30.433 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2024-09-12T22:03:30.690 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:30.690 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":2,"btime":"2024-09-12T22:03:30:435795+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6803/129948218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":129948218},{"type":"v1","addr":"172.21.15.43:6803","nonce":129948218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T22:03:30.690 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 2 2024-09-12T22:03:30.703 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T22:03:30.995 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:30.995 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2024-09-12T22:03:30.995 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:30.995 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2024-09-12T22:03:30.995 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2024-09-12T22:03:30.995 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:30.995 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:30.995 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2024-09-12T22:03:30.995 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2024-09-12T22:03:30.995 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:30.995 INFO:teuthology.orchestra.run.smithi043.stdout:] 2024-09-12T22:03:31.007 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T22:03:31.007 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T22:03:31.440 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2024-09-12T22:03:31.453 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T22:03:32.448 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2024-09-12T22:03:32.465 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T22:03:33.445 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 3 and data pool 4 2024-09-12T22:03:33.465 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:03:33.763 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:33.763 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":19,"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","created":"2024-09-12T22:03:11.964028+0000","modified":"2024-09-12T22:03:32.797690+0000","last_up_change":"2024-09-12T22:03:21.299348+0000","last_in_change":"2024-09-12T22:03:12.758606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:03:22.281699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:03:26.987767+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:03:31.328134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:03:31.777050+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb292153-0043-4981-8743-115f848d2064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6801","nonce":1281227380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6803","nonce":1281227380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6807","nonce":1281227380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6805","nonce":1281227380}]},"public_addr":"172.21.15.47:6801/1281227380","cluster_addr":"172.21.15.47:6803/1281227380","heartbeat_back_addr":"172.21.15.47:6807/1281227380","heartbeat_front_addr":"172.21.15.47:6805/1281227380","state":["exists","up"]},{"osd":1,"uuid":"5f0330a2-15ce-4ffb-a697-da1f930db079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6801","nonce":1334802479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6803","nonce":1334802479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6807","nonce":1334802479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6805","nonce":1334802479}]},"public_addr":"172.21.15.110:6801/1334802479","cluster_addr":"172.21.15.110:6803/1334802479","heartbeat_back_addr":"172.21.15.110:6807/1334802479","heartbeat_front_addr":"172.21.15.110:6805/1334802479","state":["exists","up"]},{"osd":2,"uuid":"ae0b014f-768c-4f57-82c6-3edf9aa9f856","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6801","nonce":3565874056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6803","nonce":3565874056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6807","nonce":3565874056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6805","nonce":3565874056}]},"public_addr":"172.21.15.146:6801/3565874056","cluster_addr":"172.21.15.146:6803/3565874056","heartbeat_back_addr":"172.21.15.146:6807/3565874056","heartbeat_front_addr":"172.21.15.146:6805/3565874056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:18.927187+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.386650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.957366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:03:33.776 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:03:34.065 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:34.066 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":19,"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","created":"2024-09-12T22:03:11.964028+0000","modified":"2024-09-12T22:03:32.797690+0000","last_up_change":"2024-09-12T22:03:21.299348+0000","last_in_change":"2024-09-12T22:03:12.758606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:03:22.281699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:03:26.987767+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:03:31.328134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:03:31.777050+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb292153-0043-4981-8743-115f848d2064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6801","nonce":1281227380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6803","nonce":1281227380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6807","nonce":1281227380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6805","nonce":1281227380}]},"public_addr":"172.21.15.47:6801/1281227380","cluster_addr":"172.21.15.47:6803/1281227380","heartbeat_back_addr":"172.21.15.47:6807/1281227380","heartbeat_front_addr":"172.21.15.47:6805/1281227380","state":["exists","up"]},{"osd":1,"uuid":"5f0330a2-15ce-4ffb-a697-da1f930db079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6801","nonce":1334802479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6803","nonce":1334802479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6807","nonce":1334802479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6805","nonce":1334802479}]},"public_addr":"172.21.15.110:6801/1334802479","cluster_addr":"172.21.15.110:6803/1334802479","heartbeat_back_addr":"172.21.15.110:6807/1334802479","heartbeat_front_addr":"172.21.15.110:6805/1334802479","state":["exists","up"]},{"osd":2,"uuid":"ae0b014f-768c-4f57-82c6-3edf9aa9f856","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6801","nonce":3565874056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6803","nonce":3565874056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6807","nonce":3565874056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6805","nonce":3565874056}]},"public_addr":"172.21.15.146:6801/3565874056","cluster_addr":"172.21.15.146:6803/3565874056","heartbeat_back_addr":"172.21.15.146:6807/3565874056","heartbeat_front_addr":"172.21.15.146:6805/3565874056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:18.927187+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.386650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.957366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:03:34.079 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T22:03:34.470 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T22:03:34.471 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T22:03:35.443 INFO:tasks.ceph.mds.a.smithi043.stderr:2024-09-12T22:03:35.441+0000 7f8234243640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T22:03:35.473 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T22:03:35.473 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:03:35.802 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:35.802 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"btime":"2024-09-12T22:03:35:455062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:03:32.797994+0000","modified":"2024-09-12T22:03:34.799743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.43:6803/129948218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":129948218},{"type":"v1","addr":"172.21.15.43:6803","nonce":129948218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-09-12T22:03:35.802 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 5 2024-09-12T22:03:35.815 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:03:36.103 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:36.103 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":20,"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","created":"2024-09-12T22:03:11.964028+0000","modified":"2024-09-12T22:03:34.450484+0000","last_up_change":"2024-09-12T22:03:21.299348+0000","last_in_change":"2024-09-12T22:03:12.758606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:03:22.281699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:03:26.987767+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:03:31.328134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:03:31.777050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb292153-0043-4981-8743-115f848d2064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6801","nonce":1281227380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6803","nonce":1281227380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6807","nonce":1281227380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6805","nonce":1281227380}]},"public_addr":"172.21.15.47:6801/1281227380","cluster_addr":"172.21.15.47:6803/1281227380","heartbeat_back_addr":"172.21.15.47:6807/1281227380","heartbeat_front_addr":"172.21.15.47:6805/1281227380","state":["exists","up"]},{"osd":1,"uuid":"5f0330a2-15ce-4ffb-a697-da1f930db079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6801","nonce":1334802479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6803","nonce":1334802479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6807","nonce":1334802479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6805","nonce":1334802479}]},"public_addr":"172.21.15.110:6801/1334802479","cluster_addr":"172.21.15.110:6803/1334802479","heartbeat_back_addr":"172.21.15.110:6807/1334802479","heartbeat_front_addr":"172.21.15.110:6805/1334802479","state":["exists","up"]},{"osd":2,"uuid":"ae0b014f-768c-4f57-82c6-3edf9aa9f856","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6801","nonce":3565874056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6803","nonce":3565874056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6807","nonce":3565874056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6805","nonce":3565874056}]},"public_addr":"172.21.15.146:6801/3565874056","cluster_addr":"172.21.15.146:6803/3565874056","heartbeat_back_addr":"172.21.15.146:6807/3565874056","heartbeat_front_addr":"172.21.15.146:6805/3565874056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:18.927187+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.386650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.957366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:03:36.116 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:03:36.116 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:03:36.412 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:36.413 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:03:36.423 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-12T22:03:36.238923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":99320,"kb_used_data":1592,"kb_used_omap":4,"kb_used_meta":97659,"kb_avail":283016200,"statfs":{"total":289910292480,"available":289808588800,"internally_reserved":0,"allocated":1630208,"data_stored":1317887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":100003151},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.800465"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442819+0000","last_change":"2024-09-12T22:03:31.442819+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442819+0000","last_undegraded":"2024-09-12T22:03:31.442819+0000","last_fullsized":"2024-09-12T22:03:31.442819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440784+0000","last_change":"2024-09-12T22:03:31.440784+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440784+0000","last_undegraded":"2024-09-12T22:03:31.440784+0000","last_fullsized":"2024-09-12T22:03:31.440784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.441679+0000","last_change":"2024-09-12T22:03:31.441679+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.441679+0000","last_undegraded":"2024-09-12T22:03:31.441679+0000","last_fullsized":"2024-09-12T22:03:31.441679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442111+0000","last_change":"2024-09-12T22:03:31.442111+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442111+0000","last_undegraded":"2024-09-12T22:03:31.442111+0000","last_fullsized":"2024-09-12T22:03:31.442111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440045+0000","last_change":"2024-09-12T22:03:31.440045+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440045+0000","last_undegraded":"2024-09-12T22:03:31.440045+0000","last_fullsized":"2024-09-12T22:03:31.440045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442800+0000","last_change":"2024-09-12T22:03:31.442800+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442800+0000","last_undegraded":"2024-09-12T22:03:31.442800+0000","last_fullsized":"2024-09-12T22:03:31.442800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442133+0000","last_change":"2024-09-12T22:03:31.442133+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442133+0000","last_undegraded":"2024-09-12T22:03:31.442133+0000","last_fullsized":"2024-09-12T22:03:31.442133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.441678+0000","last_change":"2024-09-12T22:03:31.441678+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.441678+0000","last_undegraded":"2024-09-12T22:03:31.441678+0000","last_fullsized":"2024-09-12T22:03:31.441678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440006+0000","last_change":"2024-09-12T22:03:31.440006+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440006+0000","last_undegraded":"2024-09-12T22:03:31.440006+0000","last_fullsized":"2024-09-12T22:03:31.440006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440676+0000","last_change":"2024-09-12T22:03:31.440676+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440676+0000","last_undegraded":"2024-09-12T22:03:31.440676+0000","last_fullsized":"2024-09-12T22:03:31.440676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":218,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443720+0000","last_change":"2024-09-12T22:03:23.315624+0000","last_active":"2024-09-12T22:03:31.443720+0000","last_peered":"2024-09-12T22:03:31.443720+0000","last_clean":"2024-09-12T22:03:31.443720+0000","last_became_active":"2024-09-12T22:03:23.315346+0000","last_became_peered":"2024-09-12T22:03:23.315346+0000","last_unstale":"2024-09-12T22:03:31.443720+0000","last_undegraded":"2024-09-12T22:03:31.443720+0000","last_fullsized":"2024-09-12T22:03:31.443720+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:15.864121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443893+0000","last_change":"2024-09-12T22:03:30.339678+0000","last_active":"2024-09-12T22:03:31.443893+0000","last_peered":"2024-09-12T22:03:31.443893+0000","last_clean":"2024-09-12T22:03:31.443893+0000","last_became_active":"2024-09-12T22:03:28.335855+0000","last_became_peered":"2024-09-12T22:03:28.335855+0000","last_unstale":"2024-09-12T22:03:31.443893+0000","last_undegraded":"2024-09-12T22:03:31.443893+0000","last_fullsized":"2024-09-12T22:03:31.443893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:11.750803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443722+0000","last_change":"2024-09-12T22:03:30.339569+0000","last_active":"2024-09-12T22:03:31.443722+0000","last_peered":"2024-09-12T22:03:31.443722+0000","last_clean":"2024-09-12T22:03:31.443722+0000","last_became_active":"2024-09-12T22:03:28.336643+0000","last_became_peered":"2024-09-12T22:03:28.336643+0000","last_unstale":"2024-09-12T22:03:31.443722+0000","last_undegraded":"2024-09-12T22:03:31.443722+0000","last_fullsized":"2024-09-12T22:03:31.443722+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:56.968092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039518000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:03:30.343746+0000","last_change":"2024-09-12T22:03:30.343746+0000","last_active":"2024-09-12T22:03:30.343746+0000","last_peered":"2024-09-12T22:03:30.343746+0000","last_clean":"2024-09-12T22:03:30.343746+0000","last_became_active":"2024-09-12T22:03:28.335895+0000","last_became_peered":"2024-09-12T22:03:28.335895+0000","last_unstale":"2024-09-12T22:03:30.343746+0000","last_undegraded":"2024-09-12T22:03:30.343746+0000","last_fullsized":"2024-09-12T22:03:30.343746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.827420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070116600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.439838+0000","last_change":"2024-09-12T22:03:31.439838+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.439838+0000","last_undegraded":"2024-09-12T22:03:31.439838+0000","last_fullsized":"2024-09-12T22:03:31.439838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443818+0000","last_change":"2024-09-12T22:03:30.339989+0000","last_active":"2024-09-12T22:03:31.443818+0000","last_peered":"2024-09-12T22:03:31.443818+0000","last_clean":"2024-09-12T22:03:31.443818+0000","last_became_active":"2024-09-12T22:03:28.335760+0000","last_became_peered":"2024-09-12T22:03:28.335760+0000","last_unstale":"2024-09-12T22:03:31.443818+0000","last_undegraded":"2024-09-12T22:03:31.443818+0000","last_fullsized":"2024-09-12T22:03:31.443818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:29.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.441786+0000","last_change":"2024-09-12T22:03:31.441786+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.441786+0000","last_undegraded":"2024-09-12T22:03:31.441786+0000","last_fullsized":"2024-09-12T22:03:31.441786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442101+0000","last_change":"2024-09-12T22:03:31.442101+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442101+0000","last_undegraded":"2024-09-12T22:03:31.442101+0000","last_fullsized":"2024-09-12T22:03:31.442101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:03:30.343489+0000","last_change":"2024-09-12T22:03:30.343489+0000","last_active":"2024-09-12T22:03:30.343489+0000","last_peered":"2024-09-12T22:03:30.343489+0000","last_clean":"2024-09-12T22:03:30.343489+0000","last_became_active":"2024-09-12T22:03:28.335875+0000","last_became_peered":"2024-09-12T22:03:28.335875+0000","last_unstale":"2024-09-12T22:03:30.343489+0000","last_undegraded":"2024-09-12T22:03:30.343489+0000","last_fullsized":"2024-09-12T22:03:30.343489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:34.561003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042932700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.441335+0000","last_change":"2024-09-12T22:03:30.649265+0000","last_active":"2024-09-12T22:03:31.441335+0000","last_peered":"2024-09-12T22:03:31.441335+0000","last_clean":"2024-09-12T22:03:31.441335+0000","last_became_active":"2024-09-12T22:03:28.337193+0000","last_became_peered":"2024-09-12T22:03:28.337193+0000","last_unstale":"2024-09-12T22:03:31.441335+0000","last_undegraded":"2024-09-12T22:03:31.441335+0000","last_fullsized":"2024-09-12T22:03:31.441335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:43.899511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:03:30.343485+0000","last_change":"2024-09-12T22:03:30.343485+0000","last_active":"2024-09-12T22:03:30.343485+0000","last_peered":"2024-09-12T22:03:30.343485+0000","last_clean":"2024-09-12T22:03:30.343485+0000","last_became_active":"2024-09-12T22:03:28.335961+0000","last_became_peered":"2024-09-12T22:03:28.335961+0000","last_unstale":"2024-09-12T22:03:30.343485+0000","last_undegraded":"2024-09-12T22:03:30.343485+0000","last_fullsized":"2024-09-12T22:03:30.343485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:24.041899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043906199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.444071+0000","last_change":"2024-09-12T22:03:30.339817+0000","last_active":"2024-09-12T22:03:31.444071+0000","last_peered":"2024-09-12T22:03:31.444071+0000","last_clean":"2024-09-12T22:03:31.444071+0000","last_became_active":"2024-09-12T22:03:28.336599+0000","last_became_peered":"2024-09-12T22:03:28.336599+0000","last_unstale":"2024-09-12T22:03:31.444071+0000","last_undegraded":"2024-09-12T22:03:31.444071+0000","last_fullsized":"2024-09-12T22:03:31.444071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:36.442618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058522100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442886+0000","last_change":"2024-09-12T22:03:31.442886+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442886+0000","last_undegraded":"2024-09-12T22:03:31.442886+0000","last_fullsized":"2024-09-12T22:03:31.442886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.439993+0000","last_change":"2024-09-12T22:03:31.439993+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.439993+0000","last_undegraded":"2024-09-12T22:03:31.439993+0000","last_fullsized":"2024-09-12T22:03:31.439993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442288+0000","last_change":"2024-09-12T22:03:31.442288+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442288+0000","last_undegraded":"2024-09-12T22:03:31.442288+0000","last_fullsized":"2024-09-12T22:03:31.442288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440093+0000","last_change":"2024-09-12T22:03:31.440093+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440093+0000","last_undegraded":"2024-09-12T22:03:31.440093+0000","last_fullsized":"2024-09-12T22:03:31.440093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440062+0000","last_change":"2024-09-12T22:03:31.440062+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440062+0000","last_undegraded":"2024-09-12T22:03:31.440062+0000","last_fullsized":"2024-09-12T22:03:31.440062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.443376+0000","last_change":"2024-09-12T22:03:31.443376+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.443376+0000","last_undegraded":"2024-09-12T22:03:31.443376+0000","last_fullsized":"2024-09-12T22:03:31.443376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440794+0000","last_change":"2024-09-12T22:03:31.440794+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440794+0000","last_undegraded":"2024-09-12T22:03:31.440794+0000","last_fullsized":"2024-09-12T22:03:31.440794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":741376,"data_stored":637455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36076,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335764,"statfs":{"total":96636764160,"available":96599822336,"internally_reserved":0,"allocated":745472,"data_stored":637474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":143360,"data_stored":42958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:03:36.427 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:03:36.755 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:36.757 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:03:36.767 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-12T22:03:36.238923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":99320,"kb_used_data":1592,"kb_used_omap":4,"kb_used_meta":97659,"kb_avail":283016200,"statfs":{"total":289910292480,"available":289808588800,"internally_reserved":0,"allocated":1630208,"data_stored":1317887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":100003151},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.800465"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442819+0000","last_change":"2024-09-12T22:03:31.442819+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442819+0000","last_undegraded":"2024-09-12T22:03:31.442819+0000","last_fullsized":"2024-09-12T22:03:31.442819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440784+0000","last_change":"2024-09-12T22:03:31.440784+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440784+0000","last_undegraded":"2024-09-12T22:03:31.440784+0000","last_fullsized":"2024-09-12T22:03:31.440784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.441679+0000","last_change":"2024-09-12T22:03:31.441679+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.441679+0000","last_undegraded":"2024-09-12T22:03:31.441679+0000","last_fullsized":"2024-09-12T22:03:31.441679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442111+0000","last_change":"2024-09-12T22:03:31.442111+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442111+0000","last_undegraded":"2024-09-12T22:03:31.442111+0000","last_fullsized":"2024-09-12T22:03:31.442111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440045+0000","last_change":"2024-09-12T22:03:31.440045+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440045+0000","last_undegraded":"2024-09-12T22:03:31.440045+0000","last_fullsized":"2024-09-12T22:03:31.440045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442800+0000","last_change":"2024-09-12T22:03:31.442800+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442800+0000","last_undegraded":"2024-09-12T22:03:31.442800+0000","last_fullsized":"2024-09-12T22:03:31.442800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442133+0000","last_change":"2024-09-12T22:03:31.442133+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442133+0000","last_undegraded":"2024-09-12T22:03:31.442133+0000","last_fullsized":"2024-09-12T22:03:31.442133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.441678+0000","last_change":"2024-09-12T22:03:31.441678+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.441678+0000","last_undegraded":"2024-09-12T22:03:31.441678+0000","last_fullsized":"2024-09-12T22:03:31.441678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440006+0000","last_change":"2024-09-12T22:03:31.440006+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440006+0000","last_undegraded":"2024-09-12T22:03:31.440006+0000","last_fullsized":"2024-09-12T22:03:31.440006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440676+0000","last_change":"2024-09-12T22:03:31.440676+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440676+0000","last_undegraded":"2024-09-12T22:03:31.440676+0000","last_fullsized":"2024-09-12T22:03:31.440676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":218,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443720+0000","last_change":"2024-09-12T22:03:23.315624+0000","last_active":"2024-09-12T22:03:31.443720+0000","last_peered":"2024-09-12T22:03:31.443720+0000","last_clean":"2024-09-12T22:03:31.443720+0000","last_became_active":"2024-09-12T22:03:23.315346+0000","last_became_peered":"2024-09-12T22:03:23.315346+0000","last_unstale":"2024-09-12T22:03:31.443720+0000","last_undegraded":"2024-09-12T22:03:31.443720+0000","last_fullsized":"2024-09-12T22:03:31.443720+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:15.864121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443893+0000","last_change":"2024-09-12T22:03:30.339678+0000","last_active":"2024-09-12T22:03:31.443893+0000","last_peered":"2024-09-12T22:03:31.443893+0000","last_clean":"2024-09-12T22:03:31.443893+0000","last_became_active":"2024-09-12T22:03:28.335855+0000","last_became_peered":"2024-09-12T22:03:28.335855+0000","last_unstale":"2024-09-12T22:03:31.443893+0000","last_undegraded":"2024-09-12T22:03:31.443893+0000","last_fullsized":"2024-09-12T22:03:31.443893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:11.750803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443722+0000","last_change":"2024-09-12T22:03:30.339569+0000","last_active":"2024-09-12T22:03:31.443722+0000","last_peered":"2024-09-12T22:03:31.443722+0000","last_clean":"2024-09-12T22:03:31.443722+0000","last_became_active":"2024-09-12T22:03:28.336643+0000","last_became_peered":"2024-09-12T22:03:28.336643+0000","last_unstale":"2024-09-12T22:03:31.443722+0000","last_undegraded":"2024-09-12T22:03:31.443722+0000","last_fullsized":"2024-09-12T22:03:31.443722+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:56.968092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039518000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:03:30.343746+0000","last_change":"2024-09-12T22:03:30.343746+0000","last_active":"2024-09-12T22:03:30.343746+0000","last_peered":"2024-09-12T22:03:30.343746+0000","last_clean":"2024-09-12T22:03:30.343746+0000","last_became_active":"2024-09-12T22:03:28.335895+0000","last_became_peered":"2024-09-12T22:03:28.335895+0000","last_unstale":"2024-09-12T22:03:30.343746+0000","last_undegraded":"2024-09-12T22:03:30.343746+0000","last_fullsized":"2024-09-12T22:03:30.343746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.827420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070116600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.439838+0000","last_change":"2024-09-12T22:03:31.439838+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.439838+0000","last_undegraded":"2024-09-12T22:03:31.439838+0000","last_fullsized":"2024-09-12T22:03:31.439838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443818+0000","last_change":"2024-09-12T22:03:30.339989+0000","last_active":"2024-09-12T22:03:31.443818+0000","last_peered":"2024-09-12T22:03:31.443818+0000","last_clean":"2024-09-12T22:03:31.443818+0000","last_became_active":"2024-09-12T22:03:28.335760+0000","last_became_peered":"2024-09-12T22:03:28.335760+0000","last_unstale":"2024-09-12T22:03:31.443818+0000","last_undegraded":"2024-09-12T22:03:31.443818+0000","last_fullsized":"2024-09-12T22:03:31.443818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:29.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.441786+0000","last_change":"2024-09-12T22:03:31.441786+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.441786+0000","last_undegraded":"2024-09-12T22:03:31.441786+0000","last_fullsized":"2024-09-12T22:03:31.441786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442101+0000","last_change":"2024-09-12T22:03:31.442101+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442101+0000","last_undegraded":"2024-09-12T22:03:31.442101+0000","last_fullsized":"2024-09-12T22:03:31.442101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:03:30.343489+0000","last_change":"2024-09-12T22:03:30.343489+0000","last_active":"2024-09-12T22:03:30.343489+0000","last_peered":"2024-09-12T22:03:30.343489+0000","last_clean":"2024-09-12T22:03:30.343489+0000","last_became_active":"2024-09-12T22:03:28.335875+0000","last_became_peered":"2024-09-12T22:03:28.335875+0000","last_unstale":"2024-09-12T22:03:30.343489+0000","last_undegraded":"2024-09-12T22:03:30.343489+0000","last_fullsized":"2024-09-12T22:03:30.343489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:34.561003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042932700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.441335+0000","last_change":"2024-09-12T22:03:30.649265+0000","last_active":"2024-09-12T22:03:31.441335+0000","last_peered":"2024-09-12T22:03:31.441335+0000","last_clean":"2024-09-12T22:03:31.441335+0000","last_became_active":"2024-09-12T22:03:28.337193+0000","last_became_peered":"2024-09-12T22:03:28.337193+0000","last_unstale":"2024-09-12T22:03:31.441335+0000","last_undegraded":"2024-09-12T22:03:31.441335+0000","last_fullsized":"2024-09-12T22:03:31.441335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:43.899511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:03:30.343485+0000","last_change":"2024-09-12T22:03:30.343485+0000","last_active":"2024-09-12T22:03:30.343485+0000","last_peered":"2024-09-12T22:03:30.343485+0000","last_clean":"2024-09-12T22:03:30.343485+0000","last_became_active":"2024-09-12T22:03:28.335961+0000","last_became_peered":"2024-09-12T22:03:28.335961+0000","last_unstale":"2024-09-12T22:03:30.343485+0000","last_undegraded":"2024-09-12T22:03:30.343485+0000","last_fullsized":"2024-09-12T22:03:30.343485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:24.041899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043906199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.444071+0000","last_change":"2024-09-12T22:03:30.339817+0000","last_active":"2024-09-12T22:03:31.444071+0000","last_peered":"2024-09-12T22:03:31.444071+0000","last_clean":"2024-09-12T22:03:31.444071+0000","last_became_active":"2024-09-12T22:03:28.336599+0000","last_became_peered":"2024-09-12T22:03:28.336599+0000","last_unstale":"2024-09-12T22:03:31.444071+0000","last_undegraded":"2024-09-12T22:03:31.444071+0000","last_fullsized":"2024-09-12T22:03:31.444071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:36.442618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058522100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442886+0000","last_change":"2024-09-12T22:03:31.442886+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442886+0000","last_undegraded":"2024-09-12T22:03:31.442886+0000","last_fullsized":"2024-09-12T22:03:31.442886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.439993+0000","last_change":"2024-09-12T22:03:31.439993+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.439993+0000","last_undegraded":"2024-09-12T22:03:31.439993+0000","last_fullsized":"2024-09-12T22:03:31.439993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442288+0000","last_change":"2024-09-12T22:03:31.442288+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442288+0000","last_undegraded":"2024-09-12T22:03:31.442288+0000","last_fullsized":"2024-09-12T22:03:31.442288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440093+0000","last_change":"2024-09-12T22:03:31.440093+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440093+0000","last_undegraded":"2024-09-12T22:03:31.440093+0000","last_fullsized":"2024-09-12T22:03:31.440093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440062+0000","last_change":"2024-09-12T22:03:31.440062+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440062+0000","last_undegraded":"2024-09-12T22:03:31.440062+0000","last_fullsized":"2024-09-12T22:03:31.440062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.443376+0000","last_change":"2024-09-12T22:03:31.443376+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.443376+0000","last_undegraded":"2024-09-12T22:03:31.443376+0000","last_fullsized":"2024-09-12T22:03:31.443376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440794+0000","last_change":"2024-09-12T22:03:31.440794+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440794+0000","last_undegraded":"2024-09-12T22:03:31.440794+0000","last_fullsized":"2024-09-12T22:03:31.440794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:31.436642+0000","last_change":"2024-09-12T22:03:31.436642+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.436642+0000","last_undegraded":"2024-09-12T22:03:31.436642+0000","last_fullsized":"2024-09-12T22:03:31.436642+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":741376,"data_stored":637455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36076,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335764,"statfs":{"total":96636764160,"available":96599822336,"internally_reserved":0,"allocated":745472,"data_stored":637474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":143360,"data_stored":42958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:03:36.771 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:03:37.102 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:37.103 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:03:37.113 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-12T22:03:36.946547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590969,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":214,"num_write_kb":3463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":103524,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":283011996,"statfs":{"total":289910292480,"available":289804283904,"internally_reserved":0,"allocated":1671168,"data_stored":1336914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":601,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.708204"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727634+0000","last_change":"2024-09-12T22:03:33.461075+0000","last_active":"2024-09-12T22:03:34.727634+0000","last_peered":"2024-09-12T22:03:34.727634+0000","last_clean":"2024-09-12T22:03:34.727634+0000","last_became_active":"2024-09-12T22:03:33.459892+0000","last_became_peered":"2024-09-12T22:03:33.459892+0000","last_unstale":"2024-09-12T22:03:34.727634+0000","last_undegraded":"2024-09-12T22:03:34.727634+0000","last_fullsized":"2024-09-12T22:03:34.727634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:25.087808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728226+0000","last_change":"2024-09-12T22:03:33.457075+0000","last_active":"2024-09-12T22:03:34.728226+0000","last_peered":"2024-09-12T22:03:34.728226+0000","last_clean":"2024-09-12T22:03:34.728226+0000","last_became_active":"2024-09-12T22:03:33.456463+0000","last_became_peered":"2024-09-12T22:03:33.456463+0000","last_unstale":"2024-09-12T22:03:34.728226+0000","last_undegraded":"2024-09-12T22:03:34.728226+0000","last_fullsized":"2024-09-12T22:03:34.728226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:40.945193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727387+0000","last_change":"2024-09-12T22:03:33.457934+0000","last_active":"2024-09-12T22:03:34.727387+0000","last_peered":"2024-09-12T22:03:34.727387+0000","last_clean":"2024-09-12T22:03:34.727387+0000","last_became_active":"2024-09-12T22:03:33.457458+0000","last_became_peered":"2024-09-12T22:03:33.457458+0000","last_unstale":"2024-09-12T22:03:34.727387+0000","last_undegraded":"2024-09-12T22:03:34.727387+0000","last_fullsized":"2024-09-12T22:03:34.727387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:32.748239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726460+0000","last_change":"2024-09-12T22:03:33.466950+0000","last_active":"2024-09-12T22:03:34.726460+0000","last_peered":"2024-09-12T22:03:34.726460+0000","last_clean":"2024-09-12T22:03:34.726460+0000","last_became_active":"2024-09-12T22:03:33.466609+0000","last_became_peered":"2024-09-12T22:03:33.466609+0000","last_unstale":"2024-09-12T22:03:34.726460+0000","last_undegraded":"2024-09-12T22:03:34.726460+0000","last_fullsized":"2024-09-12T22:03:34.726460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:34.396185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727817+0000","last_change":"2024-09-12T22:03:33.465866+0000","last_active":"2024-09-12T22:03:34.727817+0000","last_peered":"2024-09-12T22:03:34.727817+0000","last_clean":"2024-09-12T22:03:34.727817+0000","last_became_active":"2024-09-12T22:03:33.464254+0000","last_became_peered":"2024-09-12T22:03:33.464254+0000","last_unstale":"2024-09-12T22:03:34.727817+0000","last_undegraded":"2024-09-12T22:03:34.727817+0000","last_fullsized":"2024-09-12T22:03:34.727817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:51.045864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727572+0000","last_change":"2024-09-12T22:03:33.460674+0000","last_active":"2024-09-12T22:03:34.727572+0000","last_peered":"2024-09-12T22:03:34.727572+0000","last_clean":"2024-09-12T22:03:34.727572+0000","last_became_active":"2024-09-12T22:03:33.458902+0000","last_became_peered":"2024-09-12T22:03:33.458902+0000","last_unstale":"2024-09-12T22:03:34.727572+0000","last_undegraded":"2024-09-12T22:03:34.727572+0000","last_fullsized":"2024-09-12T22:03:34.727572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:01.247039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726620+0000","last_change":"2024-09-12T22:03:33.459380+0000","last_active":"2024-09-12T22:03:34.726620+0000","last_peered":"2024-09-12T22:03:34.726620+0000","last_clean":"2024-09-12T22:03:34.726620+0000","last_became_active":"2024-09-12T22:03:33.458357+0000","last_became_peered":"2024-09-12T22:03:33.458357+0000","last_unstale":"2024-09-12T22:03:34.726620+0000","last_undegraded":"2024-09-12T22:03:34.726620+0000","last_fullsized":"2024-09-12T22:03:34.726620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:15.811200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442819+0000","last_change":"2024-09-12T22:03:31.442819+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442819+0000","last_undegraded":"2024-09-12T22:03:31.442819+0000","last_fullsized":"2024-09-12T22:03:31.442819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726921+0000","last_change":"2024-09-12T22:03:32.458436+0000","last_active":"2024-09-12T22:03:34.726921+0000","last_peered":"2024-09-12T22:03:34.726921+0000","last_clean":"2024-09-12T22:03:34.726921+0000","last_became_active":"2024-09-12T22:03:32.457647+0000","last_became_peered":"2024-09-12T22:03:32.457647+0000","last_unstale":"2024-09-12T22:03:34.726921+0000","last_undegraded":"2024-09-12T22:03:34.726921+0000","last_fullsized":"2024-09-12T22:03:34.726921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:57.394698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728072+0000","last_change":"2024-09-12T22:03:33.466388+0000","last_active":"2024-09-12T22:03:34.728072+0000","last_peered":"2024-09-12T22:03:34.728072+0000","last_clean":"2024-09-12T22:03:34.728072+0000","last_became_active":"2024-09-12T22:03:33.464101+0000","last_became_peered":"2024-09-12T22:03:33.464101+0000","last_unstale":"2024-09-12T22:03:34.728072+0000","last_undegraded":"2024-09-12T22:03:34.728072+0000","last_fullsized":"2024-09-12T22:03:34.728072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:39:52.512160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440784+0000","last_change":"2024-09-12T22:03:31.440784+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440784+0000","last_undegraded":"2024-09-12T22:03:31.440784+0000","last_fullsized":"2024-09-12T22:03:31.440784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727739+0000","last_change":"2024-09-12T22:03:33.464983+0000","last_active":"2024-09-12T22:03:34.727739+0000","last_peered":"2024-09-12T22:03:34.727739+0000","last_clean":"2024-09-12T22:03:34.727739+0000","last_became_active":"2024-09-12T22:03:33.464497+0000","last_became_peered":"2024-09-12T22:03:33.464497+0000","last_unstale":"2024-09-12T22:03:34.727739+0000","last_undegraded":"2024-09-12T22:03:34.727739+0000","last_fullsized":"2024-09-12T22:03:34.727739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:20.643181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.441679+0000","last_change":"2024-09-12T22:03:31.441679+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.441679+0000","last_undegraded":"2024-09-12T22:03:31.441679+0000","last_fullsized":"2024-09-12T22:03:31.441679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442111+0000","last_change":"2024-09-12T22:03:31.442111+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442111+0000","last_undegraded":"2024-09-12T22:03:31.442111+0000","last_fullsized":"2024-09-12T22:03:31.442111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440045+0000","last_change":"2024-09-12T22:03:31.440045+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440045+0000","last_undegraded":"2024-09-12T22:03:31.440045+0000","last_fullsized":"2024-09-12T22:03:31.440045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442800+0000","last_change":"2024-09-12T22:03:31.442800+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442800+0000","last_undegraded":"2024-09-12T22:03:31.442800+0000","last_fullsized":"2024-09-12T22:03:31.442800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442133+0000","last_change":"2024-09-12T22:03:31.442133+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442133+0000","last_undegraded":"2024-09-12T22:03:31.442133+0000","last_fullsized":"2024-09-12T22:03:31.442133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726846+0000","last_change":"2024-09-12T22:03:33.465572+0000","last_active":"2024-09-12T22:03:34.726846+0000","last_peered":"2024-09-12T22:03:34.726846+0000","last_clean":"2024-09-12T22:03:34.726846+0000","last_became_active":"2024-09-12T22:03:33.465000+0000","last_became_peered":"2024-09-12T22:03:33.465000+0000","last_unstale":"2024-09-12T22:03:34.726846+0000","last_undegraded":"2024-09-12T22:03:34.726846+0000","last_fullsized":"2024-09-12T22:03:34.726846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:37.418482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727734+0000","last_change":"2024-09-12T22:03:32.458041+0000","last_active":"2024-09-12T22:03:34.727734+0000","last_peered":"2024-09-12T22:03:34.727734+0000","last_clean":"2024-09-12T22:03:34.727734+0000","last_became_active":"2024-09-12T22:03:32.457583+0000","last_became_peered":"2024-09-12T22:03:32.457583+0000","last_unstale":"2024-09-12T22:03:34.727734+0000","last_undegraded":"2024-09-12T22:03:34.727734+0000","last_fullsized":"2024-09-12T22:03:34.727734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:15.688344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.441678+0000","last_change":"2024-09-12T22:03:31.441678+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.441678+0000","last_undegraded":"2024-09-12T22:03:31.441678+0000","last_fullsized":"2024-09-12T22:03:31.441678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440006+0000","last_change":"2024-09-12T22:03:31.440006+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440006+0000","last_undegraded":"2024-09-12T22:03:31.440006+0000","last_fullsized":"2024-09-12T22:03:31.440006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440676+0000","last_change":"2024-09-12T22:03:31.440676+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440676+0000","last_undegraded":"2024-09-12T22:03:31.440676+0000","last_fullsized":"2024-09-12T22:03:31.440676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727868+0000","last_change":"2024-09-12T22:03:33.459649+0000","last_active":"2024-09-12T22:03:34.727868+0000","last_peered":"2024-09-12T22:03:34.727868+0000","last_clean":"2024-09-12T22:03:34.727868+0000","last_became_active":"2024-09-12T22:03:33.458085+0000","last_became_peered":"2024-09-12T22:03:33.458085+0000","last_unstale":"2024-09-12T22:03:34.727868+0000","last_undegraded":"2024-09-12T22:03:34.727868+0000","last_fullsized":"2024-09-12T22:03:34.727868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:56.693491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":218,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443720+0000","last_change":"2024-09-12T22:03:23.315624+0000","last_active":"2024-09-12T22:03:31.443720+0000","last_peered":"2024-09-12T22:03:31.443720+0000","last_clean":"2024-09-12T22:03:31.443720+0000","last_became_active":"2024-09-12T22:03:23.315346+0000","last_became_peered":"2024-09-12T22:03:23.315346+0000","last_unstale":"2024-09-12T22:03:31.443720+0000","last_undegraded":"2024-09-12T22:03:31.443720+0000","last_fullsized":"2024-09-12T22:03:31.443720+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:15.864121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443893+0000","last_change":"2024-09-12T22:03:30.339678+0000","last_active":"2024-09-12T22:03:31.443893+0000","last_peered":"2024-09-12T22:03:31.443893+0000","last_clean":"2024-09-12T22:03:31.443893+0000","last_became_active":"2024-09-12T22:03:28.335855+0000","last_became_peered":"2024-09-12T22:03:28.335855+0000","last_unstale":"2024-09-12T22:03:31.443893+0000","last_undegraded":"2024-09-12T22:03:31.443893+0000","last_fullsized":"2024-09-12T22:03:31.443893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:11.750803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727087+0000","last_change":"2024-09-12T22:03:32.459986+0000","last_active":"2024-09-12T22:03:34.727087+0000","last_peered":"2024-09-12T22:03:34.727087+0000","last_clean":"2024-09-12T22:03:34.727087+0000","last_became_active":"2024-09-12T22:03:32.459353+0000","last_became_peered":"2024-09-12T22:03:32.459353+0000","last_unstale":"2024-09-12T22:03:34.727087+0000","last_undegraded":"2024-09-12T22:03:34.727087+0000","last_fullsized":"2024-09-12T22:03:34.727087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:57.496962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443722+0000","last_change":"2024-09-12T22:03:30.339569+0000","last_active":"2024-09-12T22:03:31.443722+0000","last_peered":"2024-09-12T22:03:31.443722+0000","last_clean":"2024-09-12T22:03:31.443722+0000","last_became_active":"2024-09-12T22:03:28.336643+0000","last_became_peered":"2024-09-12T22:03:28.336643+0000","last_unstale":"2024-09-12T22:03:31.443722+0000","last_undegraded":"2024-09-12T22:03:31.443722+0000","last_fullsized":"2024-09-12T22:03:31.443722+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:56.968092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039518000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727009+0000","last_change":"2024-09-12T22:03:32.454155+0000","last_active":"2024-09-12T22:03:34.727009+0000","last_peered":"2024-09-12T22:03:34.727009+0000","last_clean":"2024-09-12T22:03:34.727009+0000","last_became_active":"2024-09-12T22:03:32.453733+0000","last_became_peered":"2024-09-12T22:03:32.453733+0000","last_unstale":"2024-09-12T22:03:34.727009+0000","last_undegraded":"2024-09-12T22:03:34.727009+0000","last_fullsized":"2024-09-12T22:03:34.727009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:09.186165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727073+0000","last_change":"2024-09-12T22:03:30.343746+0000","last_active":"2024-09-12T22:03:34.727073+0000","last_peered":"2024-09-12T22:03:34.727073+0000","last_clean":"2024-09-12T22:03:34.727073+0000","last_became_active":"2024-09-12T22:03:28.335895+0000","last_became_peered":"2024-09-12T22:03:28.335895+0000","last_unstale":"2024-09-12T22:03:34.727073+0000","last_undegraded":"2024-09-12T22:03:34.727073+0000","last_fullsized":"2024-09-12T22:03:34.727073+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.827420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070116600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.439838+0000","last_change":"2024-09-12T22:03:31.439838+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.439838+0000","last_undegraded":"2024-09-12T22:03:31.439838+0000","last_fullsized":"2024-09-12T22:03:31.439838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727964+0000","last_change":"2024-09-12T22:03:33.458277+0000","last_active":"2024-09-12T22:03:34.727964+0000","last_peered":"2024-09-12T22:03:34.727964+0000","last_clean":"2024-09-12T22:03:34.727964+0000","last_became_active":"2024-09-12T22:03:33.457320+0000","last_became_peered":"2024-09-12T22:03:33.457320+0000","last_unstale":"2024-09-12T22:03:34.727964+0000","last_undegraded":"2024-09-12T22:03:34.727964+0000","last_fullsized":"2024-09-12T22:03:34.727964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:46.703481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443818+0000","last_change":"2024-09-12T22:03:30.339989+0000","last_active":"2024-09-12T22:03:31.443818+0000","last_peered":"2024-09-12T22:03:31.443818+0000","last_clean":"2024-09-12T22:03:31.443818+0000","last_became_active":"2024-09-12T22:03:28.335760+0000","last_became_peered":"2024-09-12T22:03:28.335760+0000","last_unstale":"2024-09-12T22:03:31.443818+0000","last_undegraded":"2024-09-12T22:03:31.443818+0000","last_fullsized":"2024-09-12T22:03:31.443818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:29.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.441786+0000","last_change":"2024-09-12T22:03:31.441786+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.441786+0000","last_undegraded":"2024-09-12T22:03:31.441786+0000","last_fullsized":"2024-09-12T22:03:31.441786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727602+0000","last_change":"2024-09-12T22:03:33.458311+0000","last_active":"2024-09-12T22:03:34.727602+0000","last_peered":"2024-09-12T22:03:34.727602+0000","last_clean":"2024-09-12T22:03:34.727602+0000","last_became_active":"2024-09-12T22:03:33.456397+0000","last_became_peered":"2024-09-12T22:03:33.456397+0000","last_unstale":"2024-09-12T22:03:34.727602+0000","last_undegraded":"2024-09-12T22:03:34.727602+0000","last_fullsized":"2024-09-12T22:03:34.727602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:51.305559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442101+0000","last_change":"2024-09-12T22:03:31.442101+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442101+0000","last_undegraded":"2024-09-12T22:03:31.442101+0000","last_fullsized":"2024-09-12T22:03:31.442101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727685+0000","last_change":"2024-09-12T22:03:30.343489+0000","last_active":"2024-09-12T22:03:34.727685+0000","last_peered":"2024-09-12T22:03:34.727685+0000","last_clean":"2024-09-12T22:03:34.727685+0000","last_became_active":"2024-09-12T22:03:28.335875+0000","last_became_peered":"2024-09-12T22:03:28.335875+0000","last_unstale":"2024-09-12T22:03:34.727685+0000","last_undegraded":"2024-09-12T22:03:34.727685+0000","last_fullsized":"2024-09-12T22:03:34.727685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:34.561003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042932700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727682+0000","last_change":"2024-09-12T22:03:32.460055+0000","last_active":"2024-09-12T22:03:34.727682+0000","last_peered":"2024-09-12T22:03:34.727682+0000","last_clean":"2024-09-12T22:03:34.727682+0000","last_became_active":"2024-09-12T22:03:32.459276+0000","last_became_peered":"2024-09-12T22:03:32.459276+0000","last_unstale":"2024-09-12T22:03:34.727682+0000","last_undegraded":"2024-09-12T22:03:34.727682+0000","last_fullsized":"2024-09-12T22:03:34.727682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:23.776211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.441335+0000","last_change":"2024-09-12T22:03:30.649265+0000","last_active":"2024-09-12T22:03:31.441335+0000","last_peered":"2024-09-12T22:03:31.441335+0000","last_clean":"2024-09-12T22:03:31.441335+0000","last_became_active":"2024-09-12T22:03:28.337193+0000","last_became_peered":"2024-09-12T22:03:28.337193+0000","last_unstale":"2024-09-12T22:03:31.441335+0000","last_undegraded":"2024-09-12T22:03:31.441335+0000","last_fullsized":"2024-09-12T22:03:31.441335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:43.899511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728256+0000","last_change":"2024-09-12T22:03:32.460426+0000","last_active":"2024-09-12T22:03:34.728256+0000","last_peered":"2024-09-12T22:03:34.728256+0000","last_clean":"2024-09-12T22:03:34.728256+0000","last_became_active":"2024-09-12T22:03:32.460161+0000","last_became_peered":"2024-09-12T22:03:32.460161+0000","last_unstale":"2024-09-12T22:03:34.728256+0000","last_undegraded":"2024-09-12T22:03:34.728256+0000","last_fullsized":"2024-09-12T22:03:34.728256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.472907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728136+0000","last_change":"2024-09-12T22:03:30.343485+0000","last_active":"2024-09-12T22:03:34.728136+0000","last_peered":"2024-09-12T22:03:34.728136+0000","last_clean":"2024-09-12T22:03:34.728136+0000","last_became_active":"2024-09-12T22:03:28.335961+0000","last_became_peered":"2024-09-12T22:03:28.335961+0000","last_unstale":"2024-09-12T22:03:34.728136+0000","last_undegraded":"2024-09-12T22:03:34.728136+0000","last_fullsized":"2024-09-12T22:03:34.728136+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:24.041899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043906199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727163+0000","last_change":"2024-09-12T22:03:33.464709+0000","last_active":"2024-09-12T22:03:34.727163+0000","last_peered":"2024-09-12T22:03:34.727163+0000","last_clean":"2024-09-12T22:03:34.727163+0000","last_became_active":"2024-09-12T22:03:33.464016+0000","last_became_peered":"2024-09-12T22:03:33.464016+0000","last_unstale":"2024-09-12T22:03:34.727163+0000","last_undegraded":"2024-09-12T22:03:34.727163+0000","last_fullsized":"2024-09-12T22:03:34.727163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:07.598247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:35.449232+0000","last_change":"2024-09-12T22:03:32.458014+0000","last_active":"2024-09-12T22:03:35.449232+0000","last_peered":"2024-09-12T22:03:35.449232+0000","last_clean":"2024-09-12T22:03:35.449232+0000","last_became_active":"2024-09-12T22:03:32.457654+0000","last_became_peered":"2024-09-12T22:03:32.457654+0000","last_unstale":"2024-09-12T22:03:35.449232+0000","last_undegraded":"2024-09-12T22:03:35.449232+0000","last_fullsized":"2024-09-12T22:03:35.449232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:08.446521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.444071+0000","last_change":"2024-09-12T22:03:30.339817+0000","last_active":"2024-09-12T22:03:31.444071+0000","last_peered":"2024-09-12T22:03:31.444071+0000","last_clean":"2024-09-12T22:03:31.444071+0000","last_became_active":"2024-09-12T22:03:28.336599+0000","last_became_peered":"2024-09-12T22:03:28.336599+0000","last_unstale":"2024-09-12T22:03:31.444071+0000","last_undegraded":"2024-09-12T22:03:31.444071+0000","last_fullsized":"2024-09-12T22:03:31.444071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:36.442618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058522100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442886+0000","last_change":"2024-09-12T22:03:31.442886+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442886+0000","last_undegraded":"2024-09-12T22:03:31.442886+0000","last_fullsized":"2024-09-12T22:03:31.442886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726767+0000","last_change":"2024-09-12T22:03:33.458365+0000","last_active":"2024-09-12T22:03:34.726767+0000","last_peered":"2024-09-12T22:03:34.726767+0000","last_clean":"2024-09-12T22:03:34.726767+0000","last_became_active":"2024-09-12T22:03:33.456256+0000","last_became_peered":"2024-09-12T22:03:33.456256+0000","last_unstale":"2024-09-12T22:03:34.726767+0000","last_undegraded":"2024-09-12T22:03:34.726767+0000","last_fullsized":"2024-09-12T22:03:34.726767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:12.145709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.439993+0000","last_change":"2024-09-12T22:03:31.439993+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.439993+0000","last_undegraded":"2024-09-12T22:03:31.439993+0000","last_fullsized":"2024-09-12T22:03:31.439993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442288+0000","last_change":"2024-09-12T22:03:31.442288+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442288+0000","last_undegraded":"2024-09-12T22:03:31.442288+0000","last_fullsized":"2024-09-12T22:03:31.442288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726877+0000","last_change":"2024-09-12T22:03:33.465561+0000","last_active":"2024-09-12T22:03:34.726877+0000","last_peered":"2024-09-12T22:03:34.726877+0000","last_clean":"2024-09-12T22:03:34.726877+0000","last_became_active":"2024-09-12T22:03:33.464837+0000","last_became_peered":"2024-09-12T22:03:33.464837+0000","last_unstale":"2024-09-12T22:03:34.726877+0000","last_undegraded":"2024-09-12T22:03:34.726877+0000","last_fullsized":"2024-09-12T22:03:34.726877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:32.859664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728159+0000","last_change":"2024-09-12T22:03:32.458964+0000","last_active":"2024-09-12T22:03:34.728159+0000","last_peered":"2024-09-12T22:03:34.728159+0000","last_clean":"2024-09-12T22:03:34.728159+0000","last_became_active":"2024-09-12T22:03:32.458346+0000","last_became_peered":"2024-09-12T22:03:32.458346+0000","last_unstale":"2024-09-12T22:03:34.728159+0000","last_undegraded":"2024-09-12T22:03:34.728159+0000","last_fullsized":"2024-09-12T22:03:34.728159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:37.178897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726711+0000","last_change":"2024-09-12T22:03:33.458060+0000","last_active":"2024-09-12T22:03:34.726711+0000","last_peered":"2024-09-12T22:03:34.726711+0000","last_clean":"2024-09-12T22:03:34.726711+0000","last_became_active":"2024-09-12T22:03:33.457390+0000","last_became_peered":"2024-09-12T22:03:33.457390+0000","last_unstale":"2024-09-12T22:03:34.726711+0000","last_undegraded":"2024-09-12T22:03:34.726711+0000","last_fullsized":"2024-09-12T22:03:34.726711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:14.711011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727230+0000","last_change":"2024-09-12T22:03:32.460441+0000","last_active":"2024-09-12T22:03:34.727230+0000","last_peered":"2024-09-12T22:03:34.727230+0000","last_clean":"2024-09-12T22:03:34.727230+0000","last_became_active":"2024-09-12T22:03:32.460126+0000","last_became_peered":"2024-09-12T22:03:32.460126+0000","last_unstale":"2024-09-12T22:03:34.727230+0000","last_undegraded":"2024-09-12T22:03:34.727230+0000","last_fullsized":"2024-09-12T22:03:34.727230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:52.150617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727653+0000","last_change":"2024-09-12T22:03:33.466167+0000","last_active":"2024-09-12T22:03:34.727653+0000","last_peered":"2024-09-12T22:03:34.727653+0000","last_clean":"2024-09-12T22:03:34.727653+0000","last_became_active":"2024-09-12T22:03:33.465116+0000","last_became_peered":"2024-09-12T22:03:33.465116+0000","last_unstale":"2024-09-12T22:03:34.727653+0000","last_undegraded":"2024-09-12T22:03:34.727653+0000","last_fullsized":"2024-09-12T22:03:34.727653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:19.683631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726948+0000","last_change":"2024-09-12T22:03:32.454262+0000","last_active":"2024-09-12T22:03:34.726948+0000","last_peered":"2024-09-12T22:03:34.726948+0000","last_clean":"2024-09-12T22:03:34.726948+0000","last_became_active":"2024-09-12T22:03:32.453776+0000","last_became_peered":"2024-09-12T22:03:32.453776+0000","last_unstale":"2024-09-12T22:03:34.726948+0000","last_undegraded":"2024-09-12T22:03:34.726948+0000","last_fullsized":"2024-09-12T22:03:34.726948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:57.091523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440093+0000","last_change":"2024-09-12T22:03:31.440093+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440093+0000","last_undegraded":"2024-09-12T22:03:31.440093+0000","last_fullsized":"2024-09-12T22:03:31.440093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440062+0000","last_change":"2024-09-12T22:03:31.440062+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440062+0000","last_undegraded":"2024-09-12T22:03:31.440062+0000","last_fullsized":"2024-09-12T22:03:31.440062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.443376+0000","last_change":"2024-09-12T22:03:31.443376+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.443376+0000","last_undegraded":"2024-09-12T22:03:31.443376+0000","last_fullsized":"2024-09-12T22:03:31.443376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440794+0000","last_change":"2024-09-12T22:03:31.440794+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440794+0000","last_undegraded":"2024-09-12T22:03:31.440794+0000","last_fullsized":"2024-09-12T22:03:31.440794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727964+0000","last_change":"2024-09-12T22:03:32.460314+0000","last_active":"2024-09-12T22:03:34.727964+0000","last_peered":"2024-09-12T22:03:34.727964+0000","last_clean":"2024-09-12T22:03:34.727964+0000","last_became_active":"2024-09-12T22:03:32.459890+0000","last_became_peered":"2024-09-12T22:03:32.459890+0000","last_unstale":"2024-09-12T22:03:34.727964+0000","last_undegraded":"2024-09-12T22:03:34.727964+0000","last_fullsized":"2024-09-12T22:03:34.727964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:00.774244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728024+0000","last_change":"2024-09-12T22:03:32.459293+0000","last_active":"2024-09-12T22:03:34.728024+0000","last_peered":"2024-09-12T22:03:34.728024+0000","last_clean":"2024-09-12T22:03:34.728024+0000","last_became_active":"2024-09-12T22:03:32.458679+0000","last_became_peered":"2024-09-12T22:03:32.458679+0000","last_unstale":"2024-09-12T22:03:34.728024+0000","last_undegraded":"2024-09-12T22:03:34.728024+0000","last_fullsized":"2024-09-12T22:03:34.728024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:21.083182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":741376,"data_stored":637455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36076,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335764,"statfs":{"total":96636764160,"available":96599822336,"internally_reserved":0,"allocated":745472,"data_stored":637474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35536,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336304,"statfs":{"total":96636764160,"available":96600375296,"internally_reserved":0,"allocated":184320,"data_stored":61985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:03:37.116 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3f is not active+clean 2024-09-12T22:03:37.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.117 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3e is not active+clean 2024-09-12T22:03:37.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.117 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3d is not active+clean 2024-09-12T22:03:37.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.117 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3c is not active+clean 2024-09-12T22:03:37.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.117 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3b is not active+clean 2024-09-12T22:03:37.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.117 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3a is not active+clean 2024-09-12T22:03:37.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.118 INFO:tasks.ceph.ceph_manager.ceph:PG 4.39 is not active+clean 2024-09-12T22:03:37.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.118 INFO:tasks.ceph.ceph_manager.ceph:PG 4.38 is not active+clean 2024-09-12T22:03:37.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.118 INFO:tasks.ceph.ceph_manager.ceph:PG 4.36 is not active+clean 2024-09-12T22:03:37.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.118 INFO:tasks.ceph.ceph_manager.ceph:PG 4.35 is not active+clean 2024-09-12T22:03:37.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.118 INFO:tasks.ceph.ceph_manager.ceph:PG 4.34 is not active+clean 2024-09-12T22:03:37.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.118 INFO:tasks.ceph.ceph_manager.ceph:PG 4.33 is not active+clean 2024-09-12T22:03:37.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.118 INFO:tasks.ceph.ceph_manager.ceph:PG 4.32 is not active+clean 2024-09-12T22:03:37.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.119 INFO:tasks.ceph.ceph_manager.ceph:PG 4.31 is not active+clean 2024-09-12T22:03:37.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.119 INFO:tasks.ceph.ceph_manager.ceph:PG 4.30 is not active+clean 2024-09-12T22:03:37.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.119 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2e is not active+clean 2024-09-12T22:03:37.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.119 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2c is not active+clean 2024-09-12T22:03:37.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.119 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2b is not active+clean 2024-09-12T22:03:37.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.119 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2a is not active+clean 2024-09-12T22:03:37.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.120 INFO:tasks.ceph.ceph_manager.ceph:PG 4.28 is not active+clean 2024-09-12T22:03:37.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.120 INFO:tasks.ceph.ceph_manager.ceph:PG 4.27 is not active+clean 2024-09-12T22:03:37.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.120 INFO:tasks.ceph.ceph_manager.ceph:PG 4.25 is not active+clean 2024-09-12T22:03:37.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.120 INFO:tasks.ceph.ceph_manager.ceph:PG 4.24 is not active+clean 2024-09-12T22:03:37.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.120 INFO:tasks.ceph.ceph_manager.ceph:PG 4.22 is not active+clean 2024-09-12T22:03:37.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.120 INFO:tasks.ceph.ceph_manager.ceph:PG 4.20 is not active+clean 2024-09-12T22:03:37.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.121 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-09-12T22:03:37.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.121 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-12T22:03:37.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.442819+0000', 'last_change': '2024-09-12T22:03:31.442819+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.442819+0000', 'last_undegraded': '2024-09-12T22:03:31.442819+0000', 'last_fullsized': '2024-09-12T22:03:31.442819+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:03:37.121 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-12T22:03:37.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.121 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-12T22:03:37.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.440784+0000', 'last_change': '2024-09-12T22:03:31.440784+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.440784+0000', 'last_undegraded': '2024-09-12T22:03:31.440784+0000', 'last_fullsized': '2024-09-12T22:03:31.440784+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:03:37.121 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-12T22:03:37.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.441679+0000', 'last_change': '2024-09-12T22:03:31.441679+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.441679+0000', 'last_undegraded': '2024-09-12T22:03:31.441679+0000', 'last_fullsized': '2024-09-12T22:03:31.441679+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:03:37.121 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-12T22:03:37.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.442111+0000', 'last_change': '2024-09-12T22:03:31.442111+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.442111+0000', 'last_undegraded': '2024-09-12T22:03:31.442111+0000', 'last_fullsized': '2024-09-12T22:03:31.442111+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:03:37.122 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-12T22:03:37.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.122 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-12T22:03:37.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.440045+0000', 'last_change': '2024-09-12T22:03:31.440045+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.440045+0000', 'last_undegraded': '2024-09-12T22:03:31.440045+0000', 'last_fullsized': '2024-09-12T22:03:31.440045+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:03:37.122 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-12T22:03:37.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.122 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-12T22:03:37.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.442800+0000', 'last_change': '2024-09-12T22:03:31.442800+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.442800+0000', 'last_undegraded': '2024-09-12T22:03:31.442800+0000', 'last_fullsized': '2024-09-12T22:03:31.442800+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:03:37.122 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-12T22:03:37.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.122 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-12T22:03:37.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.442133+0000', 'last_change': '2024-09-12T22:03:31.442133+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.442133+0000', 'last_undegraded': '2024-09-12T22:03:31.442133+0000', 'last_fullsized': '2024-09-12T22:03:31.442133+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:03:37.123 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-12T22:03:37.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.123 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-12T22:03:37.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.441678+0000', 'last_change': '2024-09-12T22:03:31.441678+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.441678+0000', 'last_undegraded': '2024-09-12T22:03:31.441678+0000', 'last_fullsized': '2024-09-12T22:03:31.441678+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:03:37.123 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-12T22:03:37.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.123 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-12T22:03:37.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.440006+0000', 'last_change': '2024-09-12T22:03:31.440006+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.440006+0000', 'last_undegraded': '2024-09-12T22:03:31.440006+0000', 'last_fullsized': '2024-09-12T22:03:31.440006+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:03:37.123 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-12T22:03:37.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.123 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-12T22:03:37.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.440676+0000', 'last_change': '2024-09-12T22:03:31.440676+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.440676+0000', 'last_undegraded': '2024-09-12T22:03:31.440676+0000', 'last_fullsized': '2024-09-12T22:03:31.440676+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:03:37.124 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-12T22:03:37.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.124 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-12T22:03:37.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.124 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-12T22:03:37.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.439838+0000', 'last_change': '2024-09-12T22:03:31.439838+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.439838+0000', 'last_undegraded': '2024-09-12T22:03:31.439838+0000', 'last_fullsized': '2024-09-12T22:03:31.439838+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:03:37.124 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-12T22:03:37.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.441786+0000', 'last_change': '2024-09-12T22:03:31.441786+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.441786+0000', 'last_undegraded': '2024-09-12T22:03:31.441786+0000', 'last_fullsized': '2024-09-12T22:03:31.441786+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:03:37.124 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-12T22:03:37.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.442101+0000', 'last_change': '2024-09-12T22:03:31.442101+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.442101+0000', 'last_undegraded': '2024-09-12T22:03:31.442101+0000', 'last_fullsized': '2024-09-12T22:03:31.442101+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:03:37.124 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-12T22:03:37.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.125 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-12T22:03:37.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.125 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-12T22:03:37.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.125 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-12T22:03:37.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.125 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-12T22:03:37.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.442886+0000', 'last_change': '2024-09-12T22:03:31.442886+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.442886+0000', 'last_undegraded': '2024-09-12T22:03:31.442886+0000', 'last_fullsized': '2024-09-12T22:03:31.442886+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:03:37.125 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-12T22:03:37.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.439993+0000', 'last_change': '2024-09-12T22:03:31.439993+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.439993+0000', 'last_undegraded': '2024-09-12T22:03:31.439993+0000', 'last_fullsized': '2024-09-12T22:03:31.439993+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:03:37.125 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-12T22:03:37.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.442288+0000', 'last_change': '2024-09-12T22:03:31.442288+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.442288+0000', 'last_undegraded': '2024-09-12T22:03:31.442288+0000', 'last_fullsized': '2024-09-12T22:03:31.442288+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:03:37.126 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-12T22:03:37.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.126 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-12T22:03:37.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.126 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-12T22:03:37.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.440093+0000', 'last_change': '2024-09-12T22:03:31.440093+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.440093+0000', 'last_undegraded': '2024-09-12T22:03:31.440093+0000', 'last_fullsized': '2024-09-12T22:03:31.440093+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:03:37.126 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-12T22:03:37.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.127 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-12T22:03:37.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.440062+0000', 'last_change': '2024-09-12T22:03:31.440062+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.440062+0000', 'last_undegraded': '2024-09-12T22:03:31.440062+0000', 'last_fullsized': '2024-09-12T22:03:31.440062+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:03:37.127 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-12T22:03:37.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.127 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-12T22:03:37.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.443376+0000', 'last_change': '2024-09-12T22:03:31.443376+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.443376+0000', 'last_undegraded': '2024-09-12T22:03:31.443376+0000', 'last_fullsized': '2024-09-12T22:03:31.443376+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:03:37.127 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-12T22:03:37.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.127 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-12T22:03:37.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:03:31.440794+0000', 'last_change': '2024-09-12T22:03:31.440794+0000', 'last_active': '2024-09-12T22:03:31.436642+0000', 'last_peered': '2024-09-12T22:03:31.436642+0000', 'last_clean': '2024-09-12T22:03:31.436642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:31.440794+0000', 'last_undegraded': '2024-09-12T22:03:31.440794+0000', 'last_fullsized': '2024-09-12T22:03:31.440794+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:31.436642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:03:37.127 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-12T22:03:37.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.128 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-12T22:03:37.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:03:32.438151+0000', 'last_change': '2024-09-12T22:03:32.438151+0000', 'last_active': '2024-09-12T22:03:32.438151+0000', 'last_peered': '2024-09-12T22:03:32.438151+0000', 'last_clean': '2024-09-12T22:03:32.438151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:03:32.438151+0000', 'last_undegraded': '2024-09-12T22:03:32.438151+0000', 'last_fullsized': '2024-09-12T22:03:32.438151+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'last_clean_scrub_stamp': '2024-09-12T22:03:32.438151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:03:37.128 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T22:03:37.508 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:37.508 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":25,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":3,"num_up_osds":3,"osd_up_since":1726178601,"num_in_osds":3,"osd_in_since":1726178592,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":76},{"state_name":"creating+peering","count":20},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":4,"data_bytes":590387,"bytes_used":101703680,"bytes_avail":289808588800,"bytes_total":289910292480,"unknown_pgs_ratio":0.72380954027175903,"inactive_pgs_ratio":0.190476194024086,"write_bytes_sec":426,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":5,"btime":"2024-09-12T22:03:35:455062+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4202}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-12T22:03:11.965260+0000","services":{}},"progress_events":{}} 2024-09-12T22:03:37.521 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T22:03:37.521 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:03:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:37.819 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:03:37.828 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-12T22:03:36.946547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590969,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":214,"num_write_kb":3463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":103524,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":283011996,"statfs":{"total":289910292480,"available":289804283904,"internally_reserved":0,"allocated":1671168,"data_stored":1336914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":601,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.708204"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727634+0000","last_change":"2024-09-12T22:03:33.461075+0000","last_active":"2024-09-12T22:03:34.727634+0000","last_peered":"2024-09-12T22:03:34.727634+0000","last_clean":"2024-09-12T22:03:34.727634+0000","last_became_active":"2024-09-12T22:03:33.459892+0000","last_became_peered":"2024-09-12T22:03:33.459892+0000","last_unstale":"2024-09-12T22:03:34.727634+0000","last_undegraded":"2024-09-12T22:03:34.727634+0000","last_fullsized":"2024-09-12T22:03:34.727634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:25.087808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728226+0000","last_change":"2024-09-12T22:03:33.457075+0000","last_active":"2024-09-12T22:03:34.728226+0000","last_peered":"2024-09-12T22:03:34.728226+0000","last_clean":"2024-09-12T22:03:34.728226+0000","last_became_active":"2024-09-12T22:03:33.456463+0000","last_became_peered":"2024-09-12T22:03:33.456463+0000","last_unstale":"2024-09-12T22:03:34.728226+0000","last_undegraded":"2024-09-12T22:03:34.728226+0000","last_fullsized":"2024-09-12T22:03:34.728226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:40.945193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727387+0000","last_change":"2024-09-12T22:03:33.457934+0000","last_active":"2024-09-12T22:03:34.727387+0000","last_peered":"2024-09-12T22:03:34.727387+0000","last_clean":"2024-09-12T22:03:34.727387+0000","last_became_active":"2024-09-12T22:03:33.457458+0000","last_became_peered":"2024-09-12T22:03:33.457458+0000","last_unstale":"2024-09-12T22:03:34.727387+0000","last_undegraded":"2024-09-12T22:03:34.727387+0000","last_fullsized":"2024-09-12T22:03:34.727387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:32.748239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726460+0000","last_change":"2024-09-12T22:03:33.466950+0000","last_active":"2024-09-12T22:03:34.726460+0000","last_peered":"2024-09-12T22:03:34.726460+0000","last_clean":"2024-09-12T22:03:34.726460+0000","last_became_active":"2024-09-12T22:03:33.466609+0000","last_became_peered":"2024-09-12T22:03:33.466609+0000","last_unstale":"2024-09-12T22:03:34.726460+0000","last_undegraded":"2024-09-12T22:03:34.726460+0000","last_fullsized":"2024-09-12T22:03:34.726460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:34.396185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727817+0000","last_change":"2024-09-12T22:03:33.465866+0000","last_active":"2024-09-12T22:03:34.727817+0000","last_peered":"2024-09-12T22:03:34.727817+0000","last_clean":"2024-09-12T22:03:34.727817+0000","last_became_active":"2024-09-12T22:03:33.464254+0000","last_became_peered":"2024-09-12T22:03:33.464254+0000","last_unstale":"2024-09-12T22:03:34.727817+0000","last_undegraded":"2024-09-12T22:03:34.727817+0000","last_fullsized":"2024-09-12T22:03:34.727817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:51.045864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727572+0000","last_change":"2024-09-12T22:03:33.460674+0000","last_active":"2024-09-12T22:03:34.727572+0000","last_peered":"2024-09-12T22:03:34.727572+0000","last_clean":"2024-09-12T22:03:34.727572+0000","last_became_active":"2024-09-12T22:03:33.458902+0000","last_became_peered":"2024-09-12T22:03:33.458902+0000","last_unstale":"2024-09-12T22:03:34.727572+0000","last_undegraded":"2024-09-12T22:03:34.727572+0000","last_fullsized":"2024-09-12T22:03:34.727572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:01.247039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726620+0000","last_change":"2024-09-12T22:03:33.459380+0000","last_active":"2024-09-12T22:03:34.726620+0000","last_peered":"2024-09-12T22:03:34.726620+0000","last_clean":"2024-09-12T22:03:34.726620+0000","last_became_active":"2024-09-12T22:03:33.458357+0000","last_became_peered":"2024-09-12T22:03:33.458357+0000","last_unstale":"2024-09-12T22:03:34.726620+0000","last_undegraded":"2024-09-12T22:03:34.726620+0000","last_fullsized":"2024-09-12T22:03:34.726620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:15.811200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442819+0000","last_change":"2024-09-12T22:03:31.442819+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442819+0000","last_undegraded":"2024-09-12T22:03:31.442819+0000","last_fullsized":"2024-09-12T22:03:31.442819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726921+0000","last_change":"2024-09-12T22:03:32.458436+0000","last_active":"2024-09-12T22:03:34.726921+0000","last_peered":"2024-09-12T22:03:34.726921+0000","last_clean":"2024-09-12T22:03:34.726921+0000","last_became_active":"2024-09-12T22:03:32.457647+0000","last_became_peered":"2024-09-12T22:03:32.457647+0000","last_unstale":"2024-09-12T22:03:34.726921+0000","last_undegraded":"2024-09-12T22:03:34.726921+0000","last_fullsized":"2024-09-12T22:03:34.726921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:57.394698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728072+0000","last_change":"2024-09-12T22:03:33.466388+0000","last_active":"2024-09-12T22:03:34.728072+0000","last_peered":"2024-09-12T22:03:34.728072+0000","last_clean":"2024-09-12T22:03:34.728072+0000","last_became_active":"2024-09-12T22:03:33.464101+0000","last_became_peered":"2024-09-12T22:03:33.464101+0000","last_unstale":"2024-09-12T22:03:34.728072+0000","last_undegraded":"2024-09-12T22:03:34.728072+0000","last_fullsized":"2024-09-12T22:03:34.728072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:39:52.512160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440784+0000","last_change":"2024-09-12T22:03:31.440784+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440784+0000","last_undegraded":"2024-09-12T22:03:31.440784+0000","last_fullsized":"2024-09-12T22:03:31.440784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727739+0000","last_change":"2024-09-12T22:03:33.464983+0000","last_active":"2024-09-12T22:03:34.727739+0000","last_peered":"2024-09-12T22:03:34.727739+0000","last_clean":"2024-09-12T22:03:34.727739+0000","last_became_active":"2024-09-12T22:03:33.464497+0000","last_became_peered":"2024-09-12T22:03:33.464497+0000","last_unstale":"2024-09-12T22:03:34.727739+0000","last_undegraded":"2024-09-12T22:03:34.727739+0000","last_fullsized":"2024-09-12T22:03:34.727739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:20.643181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.441679+0000","last_change":"2024-09-12T22:03:31.441679+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.441679+0000","last_undegraded":"2024-09-12T22:03:31.441679+0000","last_fullsized":"2024-09-12T22:03:31.441679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442111+0000","last_change":"2024-09-12T22:03:31.442111+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442111+0000","last_undegraded":"2024-09-12T22:03:31.442111+0000","last_fullsized":"2024-09-12T22:03:31.442111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440045+0000","last_change":"2024-09-12T22:03:31.440045+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440045+0000","last_undegraded":"2024-09-12T22:03:31.440045+0000","last_fullsized":"2024-09-12T22:03:31.440045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442800+0000","last_change":"2024-09-12T22:03:31.442800+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442800+0000","last_undegraded":"2024-09-12T22:03:31.442800+0000","last_fullsized":"2024-09-12T22:03:31.442800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442133+0000","last_change":"2024-09-12T22:03:31.442133+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442133+0000","last_undegraded":"2024-09-12T22:03:31.442133+0000","last_fullsized":"2024-09-12T22:03:31.442133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726846+0000","last_change":"2024-09-12T22:03:33.465572+0000","last_active":"2024-09-12T22:03:34.726846+0000","last_peered":"2024-09-12T22:03:34.726846+0000","last_clean":"2024-09-12T22:03:34.726846+0000","last_became_active":"2024-09-12T22:03:33.465000+0000","last_became_peered":"2024-09-12T22:03:33.465000+0000","last_unstale":"2024-09-12T22:03:34.726846+0000","last_undegraded":"2024-09-12T22:03:34.726846+0000","last_fullsized":"2024-09-12T22:03:34.726846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:37.418482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727734+0000","last_change":"2024-09-12T22:03:32.458041+0000","last_active":"2024-09-12T22:03:34.727734+0000","last_peered":"2024-09-12T22:03:34.727734+0000","last_clean":"2024-09-12T22:03:34.727734+0000","last_became_active":"2024-09-12T22:03:32.457583+0000","last_became_peered":"2024-09-12T22:03:32.457583+0000","last_unstale":"2024-09-12T22:03:34.727734+0000","last_undegraded":"2024-09-12T22:03:34.727734+0000","last_fullsized":"2024-09-12T22:03:34.727734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:15.688344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.441678+0000","last_change":"2024-09-12T22:03:31.441678+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.441678+0000","last_undegraded":"2024-09-12T22:03:31.441678+0000","last_fullsized":"2024-09-12T22:03:31.441678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440006+0000","last_change":"2024-09-12T22:03:31.440006+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440006+0000","last_undegraded":"2024-09-12T22:03:31.440006+0000","last_fullsized":"2024-09-12T22:03:31.440006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440676+0000","last_change":"2024-09-12T22:03:31.440676+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440676+0000","last_undegraded":"2024-09-12T22:03:31.440676+0000","last_fullsized":"2024-09-12T22:03:31.440676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727868+0000","last_change":"2024-09-12T22:03:33.459649+0000","last_active":"2024-09-12T22:03:34.727868+0000","last_peered":"2024-09-12T22:03:34.727868+0000","last_clean":"2024-09-12T22:03:34.727868+0000","last_became_active":"2024-09-12T22:03:33.458085+0000","last_became_peered":"2024-09-12T22:03:33.458085+0000","last_unstale":"2024-09-12T22:03:34.727868+0000","last_undegraded":"2024-09-12T22:03:34.727868+0000","last_fullsized":"2024-09-12T22:03:34.727868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:56.693491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":218,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443720+0000","last_change":"2024-09-12T22:03:23.315624+0000","last_active":"2024-09-12T22:03:31.443720+0000","last_peered":"2024-09-12T22:03:31.443720+0000","last_clean":"2024-09-12T22:03:31.443720+0000","last_became_active":"2024-09-12T22:03:23.315346+0000","last_became_peered":"2024-09-12T22:03:23.315346+0000","last_unstale":"2024-09-12T22:03:31.443720+0000","last_undegraded":"2024-09-12T22:03:31.443720+0000","last_fullsized":"2024-09-12T22:03:31.443720+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:15.864121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443893+0000","last_change":"2024-09-12T22:03:30.339678+0000","last_active":"2024-09-12T22:03:31.443893+0000","last_peered":"2024-09-12T22:03:31.443893+0000","last_clean":"2024-09-12T22:03:31.443893+0000","last_became_active":"2024-09-12T22:03:28.335855+0000","last_became_peered":"2024-09-12T22:03:28.335855+0000","last_unstale":"2024-09-12T22:03:31.443893+0000","last_undegraded":"2024-09-12T22:03:31.443893+0000","last_fullsized":"2024-09-12T22:03:31.443893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:11.750803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727087+0000","last_change":"2024-09-12T22:03:32.459986+0000","last_active":"2024-09-12T22:03:34.727087+0000","last_peered":"2024-09-12T22:03:34.727087+0000","last_clean":"2024-09-12T22:03:34.727087+0000","last_became_active":"2024-09-12T22:03:32.459353+0000","last_became_peered":"2024-09-12T22:03:32.459353+0000","last_unstale":"2024-09-12T22:03:34.727087+0000","last_undegraded":"2024-09-12T22:03:34.727087+0000","last_fullsized":"2024-09-12T22:03:34.727087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:57.496962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443722+0000","last_change":"2024-09-12T22:03:30.339569+0000","last_active":"2024-09-12T22:03:31.443722+0000","last_peered":"2024-09-12T22:03:31.443722+0000","last_clean":"2024-09-12T22:03:31.443722+0000","last_became_active":"2024-09-12T22:03:28.336643+0000","last_became_peered":"2024-09-12T22:03:28.336643+0000","last_unstale":"2024-09-12T22:03:31.443722+0000","last_undegraded":"2024-09-12T22:03:31.443722+0000","last_fullsized":"2024-09-12T22:03:31.443722+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:56.968092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039518000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727009+0000","last_change":"2024-09-12T22:03:32.454155+0000","last_active":"2024-09-12T22:03:34.727009+0000","last_peered":"2024-09-12T22:03:34.727009+0000","last_clean":"2024-09-12T22:03:34.727009+0000","last_became_active":"2024-09-12T22:03:32.453733+0000","last_became_peered":"2024-09-12T22:03:32.453733+0000","last_unstale":"2024-09-12T22:03:34.727009+0000","last_undegraded":"2024-09-12T22:03:34.727009+0000","last_fullsized":"2024-09-12T22:03:34.727009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:09.186165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727073+0000","last_change":"2024-09-12T22:03:30.343746+0000","last_active":"2024-09-12T22:03:34.727073+0000","last_peered":"2024-09-12T22:03:34.727073+0000","last_clean":"2024-09-12T22:03:34.727073+0000","last_became_active":"2024-09-12T22:03:28.335895+0000","last_became_peered":"2024-09-12T22:03:28.335895+0000","last_unstale":"2024-09-12T22:03:34.727073+0000","last_undegraded":"2024-09-12T22:03:34.727073+0000","last_fullsized":"2024-09-12T22:03:34.727073+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.827420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070116600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.439838+0000","last_change":"2024-09-12T22:03:31.439838+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.439838+0000","last_undegraded":"2024-09-12T22:03:31.439838+0000","last_fullsized":"2024-09-12T22:03:31.439838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727964+0000","last_change":"2024-09-12T22:03:33.458277+0000","last_active":"2024-09-12T22:03:34.727964+0000","last_peered":"2024-09-12T22:03:34.727964+0000","last_clean":"2024-09-12T22:03:34.727964+0000","last_became_active":"2024-09-12T22:03:33.457320+0000","last_became_peered":"2024-09-12T22:03:33.457320+0000","last_unstale":"2024-09-12T22:03:34.727964+0000","last_undegraded":"2024-09-12T22:03:34.727964+0000","last_fullsized":"2024-09-12T22:03:34.727964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:46.703481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.443818+0000","last_change":"2024-09-12T22:03:30.339989+0000","last_active":"2024-09-12T22:03:31.443818+0000","last_peered":"2024-09-12T22:03:31.443818+0000","last_clean":"2024-09-12T22:03:31.443818+0000","last_became_active":"2024-09-12T22:03:28.335760+0000","last_became_peered":"2024-09-12T22:03:28.335760+0000","last_unstale":"2024-09-12T22:03:31.443818+0000","last_undegraded":"2024-09-12T22:03:31.443818+0000","last_fullsized":"2024-09-12T22:03:31.443818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:29.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.441786+0000","last_change":"2024-09-12T22:03:31.441786+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.441786+0000","last_undegraded":"2024-09-12T22:03:31.441786+0000","last_fullsized":"2024-09-12T22:03:31.441786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727602+0000","last_change":"2024-09-12T22:03:33.458311+0000","last_active":"2024-09-12T22:03:34.727602+0000","last_peered":"2024-09-12T22:03:34.727602+0000","last_clean":"2024-09-12T22:03:34.727602+0000","last_became_active":"2024-09-12T22:03:33.456397+0000","last_became_peered":"2024-09-12T22:03:33.456397+0000","last_unstale":"2024-09-12T22:03:34.727602+0000","last_undegraded":"2024-09-12T22:03:34.727602+0000","last_fullsized":"2024-09-12T22:03:34.727602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:51.305559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442101+0000","last_change":"2024-09-12T22:03:31.442101+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442101+0000","last_undegraded":"2024-09-12T22:03:31.442101+0000","last_fullsized":"2024-09-12T22:03:31.442101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727685+0000","last_change":"2024-09-12T22:03:30.343489+0000","last_active":"2024-09-12T22:03:34.727685+0000","last_peered":"2024-09-12T22:03:34.727685+0000","last_clean":"2024-09-12T22:03:34.727685+0000","last_became_active":"2024-09-12T22:03:28.335875+0000","last_became_peered":"2024-09-12T22:03:28.335875+0000","last_unstale":"2024-09-12T22:03:34.727685+0000","last_undegraded":"2024-09-12T22:03:34.727685+0000","last_fullsized":"2024-09-12T22:03:34.727685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:34.561003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042932700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727682+0000","last_change":"2024-09-12T22:03:32.460055+0000","last_active":"2024-09-12T22:03:34.727682+0000","last_peered":"2024-09-12T22:03:34.727682+0000","last_clean":"2024-09-12T22:03:34.727682+0000","last_became_active":"2024-09-12T22:03:32.459276+0000","last_became_peered":"2024-09-12T22:03:32.459276+0000","last_unstale":"2024-09-12T22:03:34.727682+0000","last_undegraded":"2024-09-12T22:03:34.727682+0000","last_fullsized":"2024-09-12T22:03:34.727682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:23.776211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.441335+0000","last_change":"2024-09-12T22:03:30.649265+0000","last_active":"2024-09-12T22:03:31.441335+0000","last_peered":"2024-09-12T22:03:31.441335+0000","last_clean":"2024-09-12T22:03:31.441335+0000","last_became_active":"2024-09-12T22:03:28.337193+0000","last_became_peered":"2024-09-12T22:03:28.337193+0000","last_unstale":"2024-09-12T22:03:31.441335+0000","last_undegraded":"2024-09-12T22:03:31.441335+0000","last_fullsized":"2024-09-12T22:03:31.441335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:43.899511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728256+0000","last_change":"2024-09-12T22:03:32.460426+0000","last_active":"2024-09-12T22:03:34.728256+0000","last_peered":"2024-09-12T22:03:34.728256+0000","last_clean":"2024-09-12T22:03:34.728256+0000","last_became_active":"2024-09-12T22:03:32.460161+0000","last_became_peered":"2024-09-12T22:03:32.460161+0000","last_unstale":"2024-09-12T22:03:34.728256+0000","last_undegraded":"2024-09-12T22:03:34.728256+0000","last_fullsized":"2024-09-12T22:03:34.728256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.472907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728136+0000","last_change":"2024-09-12T22:03:30.343485+0000","last_active":"2024-09-12T22:03:34.728136+0000","last_peered":"2024-09-12T22:03:34.728136+0000","last_clean":"2024-09-12T22:03:34.728136+0000","last_became_active":"2024-09-12T22:03:28.335961+0000","last_became_peered":"2024-09-12T22:03:28.335961+0000","last_unstale":"2024-09-12T22:03:34.728136+0000","last_undegraded":"2024-09-12T22:03:34.728136+0000","last_fullsized":"2024-09-12T22:03:34.728136+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:24.041899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043906199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727163+0000","last_change":"2024-09-12T22:03:33.464709+0000","last_active":"2024-09-12T22:03:34.727163+0000","last_peered":"2024-09-12T22:03:34.727163+0000","last_clean":"2024-09-12T22:03:34.727163+0000","last_became_active":"2024-09-12T22:03:33.464016+0000","last_became_peered":"2024-09-12T22:03:33.464016+0000","last_unstale":"2024-09-12T22:03:34.727163+0000","last_undegraded":"2024-09-12T22:03:34.727163+0000","last_fullsized":"2024-09-12T22:03:34.727163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:07.598247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:35.449232+0000","last_change":"2024-09-12T22:03:32.458014+0000","last_active":"2024-09-12T22:03:35.449232+0000","last_peered":"2024-09-12T22:03:35.449232+0000","last_clean":"2024-09-12T22:03:35.449232+0000","last_became_active":"2024-09-12T22:03:32.457654+0000","last_became_peered":"2024-09-12T22:03:32.457654+0000","last_unstale":"2024-09-12T22:03:35.449232+0000","last_undegraded":"2024-09-12T22:03:35.449232+0000","last_fullsized":"2024-09-12T22:03:35.449232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:08.446521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:03:31.444071+0000","last_change":"2024-09-12T22:03:30.339817+0000","last_active":"2024-09-12T22:03:31.444071+0000","last_peered":"2024-09-12T22:03:31.444071+0000","last_clean":"2024-09-12T22:03:31.444071+0000","last_became_active":"2024-09-12T22:03:28.336599+0000","last_became_peered":"2024-09-12T22:03:28.336599+0000","last_unstale":"2024-09-12T22:03:31.444071+0000","last_undegraded":"2024-09-12T22:03:31.444071+0000","last_fullsized":"2024-09-12T22:03:31.444071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:36.442618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058522100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442886+0000","last_change":"2024-09-12T22:03:31.442886+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442886+0000","last_undegraded":"2024-09-12T22:03:31.442886+0000","last_fullsized":"2024-09-12T22:03:31.442886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726767+0000","last_change":"2024-09-12T22:03:33.458365+0000","last_active":"2024-09-12T22:03:34.726767+0000","last_peered":"2024-09-12T22:03:34.726767+0000","last_clean":"2024-09-12T22:03:34.726767+0000","last_became_active":"2024-09-12T22:03:33.456256+0000","last_became_peered":"2024-09-12T22:03:33.456256+0000","last_unstale":"2024-09-12T22:03:34.726767+0000","last_undegraded":"2024-09-12T22:03:34.726767+0000","last_fullsized":"2024-09-12T22:03:34.726767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:12.145709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.439993+0000","last_change":"2024-09-12T22:03:31.439993+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.439993+0000","last_undegraded":"2024-09-12T22:03:31.439993+0000","last_fullsized":"2024-09-12T22:03:31.439993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.442288+0000","last_change":"2024-09-12T22:03:31.442288+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.442288+0000","last_undegraded":"2024-09-12T22:03:31.442288+0000","last_fullsized":"2024-09-12T22:03:31.442288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726877+0000","last_change":"2024-09-12T22:03:33.465561+0000","last_active":"2024-09-12T22:03:34.726877+0000","last_peered":"2024-09-12T22:03:34.726877+0000","last_clean":"2024-09-12T22:03:34.726877+0000","last_became_active":"2024-09-12T22:03:33.464837+0000","last_became_peered":"2024-09-12T22:03:33.464837+0000","last_unstale":"2024-09-12T22:03:34.726877+0000","last_undegraded":"2024-09-12T22:03:34.726877+0000","last_fullsized":"2024-09-12T22:03:34.726877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:32.859664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728159+0000","last_change":"2024-09-12T22:03:32.458964+0000","last_active":"2024-09-12T22:03:34.728159+0000","last_peered":"2024-09-12T22:03:34.728159+0000","last_clean":"2024-09-12T22:03:34.728159+0000","last_became_active":"2024-09-12T22:03:32.458346+0000","last_became_peered":"2024-09-12T22:03:32.458346+0000","last_unstale":"2024-09-12T22:03:34.728159+0000","last_undegraded":"2024-09-12T22:03:34.728159+0000","last_fullsized":"2024-09-12T22:03:34.728159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:37.178897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726711+0000","last_change":"2024-09-12T22:03:33.458060+0000","last_active":"2024-09-12T22:03:34.726711+0000","last_peered":"2024-09-12T22:03:34.726711+0000","last_clean":"2024-09-12T22:03:34.726711+0000","last_became_active":"2024-09-12T22:03:33.457390+0000","last_became_peered":"2024-09-12T22:03:33.457390+0000","last_unstale":"2024-09-12T22:03:34.726711+0000","last_undegraded":"2024-09-12T22:03:34.726711+0000","last_fullsized":"2024-09-12T22:03:34.726711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:14.711011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727230+0000","last_change":"2024-09-12T22:03:32.460441+0000","last_active":"2024-09-12T22:03:34.727230+0000","last_peered":"2024-09-12T22:03:34.727230+0000","last_clean":"2024-09-12T22:03:34.727230+0000","last_became_active":"2024-09-12T22:03:32.460126+0000","last_became_peered":"2024-09-12T22:03:32.460126+0000","last_unstale":"2024-09-12T22:03:34.727230+0000","last_undegraded":"2024-09-12T22:03:34.727230+0000","last_fullsized":"2024-09-12T22:03:34.727230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:52.150617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727653+0000","last_change":"2024-09-12T22:03:33.466167+0000","last_active":"2024-09-12T22:03:34.727653+0000","last_peered":"2024-09-12T22:03:34.727653+0000","last_clean":"2024-09-12T22:03:34.727653+0000","last_became_active":"2024-09-12T22:03:33.465116+0000","last_became_peered":"2024-09-12T22:03:33.465116+0000","last_unstale":"2024-09-12T22:03:34.727653+0000","last_undegraded":"2024-09-12T22:03:34.727653+0000","last_fullsized":"2024-09-12T22:03:34.727653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:19.683631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726948+0000","last_change":"2024-09-12T22:03:32.454262+0000","last_active":"2024-09-12T22:03:34.726948+0000","last_peered":"2024-09-12T22:03:34.726948+0000","last_clean":"2024-09-12T22:03:34.726948+0000","last_became_active":"2024-09-12T22:03:32.453776+0000","last_became_peered":"2024-09-12T22:03:32.453776+0000","last_unstale":"2024-09-12T22:03:34.726948+0000","last_undegraded":"2024-09-12T22:03:34.726948+0000","last_fullsized":"2024-09-12T22:03:34.726948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:57.091523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440093+0000","last_change":"2024-09-12T22:03:31.440093+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440093+0000","last_undegraded":"2024-09-12T22:03:31.440093+0000","last_fullsized":"2024-09-12T22:03:31.440093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440062+0000","last_change":"2024-09-12T22:03:31.440062+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440062+0000","last_undegraded":"2024-09-12T22:03:31.440062+0000","last_fullsized":"2024-09-12T22:03:31.440062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.443376+0000","last_change":"2024-09-12T22:03:31.443376+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.443376+0000","last_undegraded":"2024-09-12T22:03:31.443376+0000","last_fullsized":"2024-09-12T22:03:31.443376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:03:31.440794+0000","last_change":"2024-09-12T22:03:31.440794+0000","last_active":"2024-09-12T22:03:31.436642+0000","last_peered":"2024-09-12T22:03:31.436642+0000","last_clean":"2024-09-12T22:03:31.436642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:31.440794+0000","last_undegraded":"2024-09-12T22:03:31.440794+0000","last_fullsized":"2024-09-12T22:03:31.440794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727964+0000","last_change":"2024-09-12T22:03:32.460314+0000","last_active":"2024-09-12T22:03:34.727964+0000","last_peered":"2024-09-12T22:03:34.727964+0000","last_clean":"2024-09-12T22:03:34.727964+0000","last_became_active":"2024-09-12T22:03:32.459890+0000","last_became_peered":"2024-09-12T22:03:32.459890+0000","last_unstale":"2024-09-12T22:03:34.727964+0000","last_undegraded":"2024-09-12T22:03:34.727964+0000","last_fullsized":"2024-09-12T22:03:34.727964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:00.774244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:32.438151+0000","last_change":"2024-09-12T22:03:32.438151+0000","last_active":"2024-09-12T22:03:32.438151+0000","last_peered":"2024-09-12T22:03:32.438151+0000","last_clean":"2024-09-12T22:03:32.438151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:32.438151+0000","last_undegraded":"2024-09-12T22:03:32.438151+0000","last_fullsized":"2024-09-12T22:03:32.438151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728024+0000","last_change":"2024-09-12T22:03:32.459293+0000","last_active":"2024-09-12T22:03:34.728024+0000","last_peered":"2024-09-12T22:03:34.728024+0000","last_clean":"2024-09-12T22:03:34.728024+0000","last_became_active":"2024-09-12T22:03:32.458679+0000","last_became_peered":"2024-09-12T22:03:32.458679+0000","last_unstale":"2024-09-12T22:03:34.728024+0000","last_undegraded":"2024-09-12T22:03:34.728024+0000","last_fullsized":"2024-09-12T22:03:34.728024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:21.083182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":741376,"data_stored":637455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36076,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335764,"statfs":{"total":96636764160,"available":96599822336,"internally_reserved":0,"allocated":745472,"data_stored":637474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35536,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336304,"statfs":{"total":96636764160,"available":96600375296,"internally_reserved":0,"allocated":184320,"data_stored":61985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:03:40.833 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:03:41.146 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:41.148 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:03:41.157 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-12T22:03:40.239978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":103628,"kb_used_data":1736,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":283011892,"statfs":{"total":289910292480,"available":289804177408,"internally_reserved":0,"allocated":1777664,"data_stored":1369644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.794451"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949228+0000","last_change":"2024-09-12T22:03:33.459321+0000","last_active":"2024-09-12T22:03:36.949228+0000","last_peered":"2024-09-12T22:03:36.949228+0000","last_clean":"2024-09-12T22:03:36.949228+0000","last_became_active":"2024-09-12T22:03:33.458897+0000","last_became_peered":"2024-09-12T22:03:33.458897+0000","last_unstale":"2024-09-12T22:03:36.949228+0000","last_undegraded":"2024-09-12T22:03:36.949228+0000","last_fullsized":"2024-09-12T22:03:36.949228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:20.716362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948961+0000","last_change":"2024-09-12T22:03:33.463659+0000","last_active":"2024-09-12T22:03:36.948961+0000","last_peered":"2024-09-12T22:03:36.948961+0000","last_clean":"2024-09-12T22:03:36.948961+0000","last_became_active":"2024-09-12T22:03:33.463296+0000","last_became_peered":"2024-09-12T22:03:33.463296+0000","last_unstale":"2024-09-12T22:03:36.948961+0000","last_undegraded":"2024-09-12T22:03:36.948961+0000","last_fullsized":"2024-09-12T22:03:36.948961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:10.270667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458477+0000","last_change":"2024-09-12T22:03:33.462148+0000","last_active":"2024-09-12T22:03:34.458477+0000","last_peered":"2024-09-12T22:03:34.458477+0000","last_clean":"2024-09-12T22:03:34.458477+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:03:34.458477+0000","last_undegraded":"2024-09-12T22:03:34.458477+0000","last_fullsized":"2024-09-12T22:03:34.458477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:36.909948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457933+0000","last_change":"2024-09-12T22:03:33.464418+0000","last_active":"2024-09-12T22:03:34.457933+0000","last_peered":"2024-09-12T22:03:34.457933+0000","last_clean":"2024-09-12T22:03:34.457933+0000","last_became_active":"2024-09-12T22:03:33.463811+0000","last_became_peered":"2024-09-12T22:03:33.463811+0000","last_unstale":"2024-09-12T22:03:34.457933+0000","last_undegraded":"2024-09-12T22:03:34.457933+0000","last_fullsized":"2024-09-12T22:03:34.457933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:48.374991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948625+0000","last_change":"2024-09-12T22:03:33.459995+0000","last_active":"2024-09-12T22:03:36.948625+0000","last_peered":"2024-09-12T22:03:36.948625+0000","last_clean":"2024-09-12T22:03:36.948625+0000","last_became_active":"2024-09-12T22:03:33.459653+0000","last_became_peered":"2024-09-12T22:03:33.459653+0000","last_unstale":"2024-09-12T22:03:36.948625+0000","last_undegraded":"2024-09-12T22:03:36.948625+0000","last_fullsized":"2024-09-12T22:03:36.948625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:15.288581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457487+0000","last_change":"2024-09-12T22:03:33.464646+0000","last_active":"2024-09-12T22:03:34.457487+0000","last_peered":"2024-09-12T22:03:34.457487+0000","last_clean":"2024-09-12T22:03:34.457487+0000","last_became_active":"2024-09-12T22:03:33.463793+0000","last_became_peered":"2024-09-12T22:03:33.463793+0000","last_unstale":"2024-09-12T22:03:34.457487+0000","last_undegraded":"2024-09-12T22:03:34.457487+0000","last_fullsized":"2024-09-12T22:03:34.457487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.153436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457598+0000","last_change":"2024-09-12T22:03:33.463183+0000","last_active":"2024-09-12T22:03:34.457598+0000","last_peered":"2024-09-12T22:03:34.457598+0000","last_clean":"2024-09-12T22:03:34.457598+0000","last_became_active":"2024-09-12T22:03:33.462752+0000","last_became_peered":"2024-09-12T22:03:33.462752+0000","last_unstale":"2024-09-12T22:03:34.457598+0000","last_undegraded":"2024-09-12T22:03:34.457598+0000","last_fullsized":"2024-09-12T22:03:34.457598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:25.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457249+0000","last_change":"2024-09-12T22:03:33.465552+0000","last_active":"2024-09-12T22:03:34.457249+0000","last_peered":"2024-09-12T22:03:34.457249+0000","last_clean":"2024-09-12T22:03:34.457249+0000","last_became_active":"2024-09-12T22:03:33.464745+0000","last_became_peered":"2024-09-12T22:03:33.464745+0000","last_unstale":"2024-09-12T22:03:34.457249+0000","last_undegraded":"2024-09-12T22:03:34.457249+0000","last_fullsized":"2024-09-12T22:03:34.457249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:42.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727634+0000","last_change":"2024-09-12T22:03:33.461075+0000","last_active":"2024-09-12T22:03:34.727634+0000","last_peered":"2024-09-12T22:03:34.727634+0000","last_clean":"2024-09-12T22:03:34.727634+0000","last_became_active":"2024-09-12T22:03:33.459892+0000","last_became_peered":"2024-09-12T22:03:33.459892+0000","last_unstale":"2024-09-12T22:03:34.727634+0000","last_undegraded":"2024-09-12T22:03:34.727634+0000","last_fullsized":"2024-09-12T22:03:34.727634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:25.087808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949026+0000","last_change":"2024-09-12T22:03:33.459292+0000","last_active":"2024-09-12T22:03:36.949026+0000","last_peered":"2024-09-12T22:03:36.949026+0000","last_clean":"2024-09-12T22:03:36.949026+0000","last_became_active":"2024-09-12T22:03:33.458956+0000","last_became_peered":"2024-09-12T22:03:33.458956+0000","last_unstale":"2024-09-12T22:03:36.949026+0000","last_undegraded":"2024-09-12T22:03:36.949026+0000","last_fullsized":"2024-09-12T22:03:36.949026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.153436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458544+0000","last_change":"2024-09-12T22:03:33.464766+0000","last_active":"2024-09-12T22:03:34.458544+0000","last_peered":"2024-09-12T22:03:34.458544+0000","last_clean":"2024-09-12T22:03:34.458544+0000","last_became_active":"2024-09-12T22:03:33.463545+0000","last_became_peered":"2024-09-12T22:03:33.463545+0000","last_unstale":"2024-09-12T22:03:34.458544+0000","last_undegraded":"2024-09-12T22:03:34.458544+0000","last_fullsized":"2024-09-12T22:03:34.458544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:27.861352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948602+0000","last_change":"2024-09-12T22:03:33.465069+0000","last_active":"2024-09-12T22:03:36.948602+0000","last_peered":"2024-09-12T22:03:36.948602+0000","last_clean":"2024-09-12T22:03:36.948602+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:03:36.948602+0000","last_undegraded":"2024-09-12T22:03:36.948602+0000","last_fullsized":"2024-09-12T22:03:36.948602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948404+0000","last_change":"2024-09-12T22:03:33.458519+0000","last_active":"2024-09-12T22:03:36.948404+0000","last_peered":"2024-09-12T22:03:36.948404+0000","last_clean":"2024-09-12T22:03:36.948404+0000","last_became_active":"2024-09-12T22:03:33.458138+0000","last_became_peered":"2024-09-12T22:03:33.458138+0000","last_unstale":"2024-09-12T22:03:36.948404+0000","last_undegraded":"2024-09-12T22:03:36.948404+0000","last_fullsized":"2024-09-12T22:03:36.948404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:18.784928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457635+0000","last_change":"2024-09-12T22:03:33.457584+0000","last_active":"2024-09-12T22:03:34.457635+0000","last_peered":"2024-09-12T22:03:34.457635+0000","last_clean":"2024-09-12T22:03:34.457635+0000","last_became_active":"2024-09-12T22:03:33.456732+0000","last_became_peered":"2024-09-12T22:03:33.456732+0000","last_unstale":"2024-09-12T22:03:34.457635+0000","last_undegraded":"2024-09-12T22:03:34.457635+0000","last_fullsized":"2024-09-12T22:03:34.457635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:20.716362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457850+0000","last_change":"2024-09-12T22:03:33.455903+0000","last_active":"2024-09-12T22:03:34.457850+0000","last_peered":"2024-09-12T22:03:34.457850+0000","last_clean":"2024-09-12T22:03:34.457850+0000","last_became_active":"2024-09-12T22:03:33.455399+0000","last_became_peered":"2024-09-12T22:03:33.455399+0000","last_unstale":"2024-09-12T22:03:34.457850+0000","last_undegraded":"2024-09-12T22:03:34.457850+0000","last_fullsized":"2024-09-12T22:03:34.457850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:06.785269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457337+0000","last_change":"2024-09-12T22:03:33.465252+0000","last_active":"2024-09-12T22:03:34.457337+0000","last_peered":"2024-09-12T22:03:34.457337+0000","last_clean":"2024-09-12T22:03:34.457337+0000","last_became_active":"2024-09-12T22:03:33.464524+0000","last_became_peered":"2024-09-12T22:03:33.464524+0000","last_unstale":"2024-09-12T22:03:34.457337+0000","last_undegraded":"2024-09-12T22:03:34.457337+0000","last_fullsized":"2024-09-12T22:03:34.457337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.406786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728226+0000","last_change":"2024-09-12T22:03:33.457075+0000","last_active":"2024-09-12T22:03:34.728226+0000","last_peered":"2024-09-12T22:03:34.728226+0000","last_clean":"2024-09-12T22:03:34.728226+0000","last_became_active":"2024-09-12T22:03:33.456463+0000","last_became_peered":"2024-09-12T22:03:33.456463+0000","last_unstale":"2024-09-12T22:03:34.728226+0000","last_undegraded":"2024-09-12T22:03:34.728226+0000","last_fullsized":"2024-09-12T22:03:34.728226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:40.945193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949187+0000","last_change":"2024-09-12T22:03:33.463614+0000","last_active":"2024-09-12T22:03:36.949187+0000","last_peered":"2024-09-12T22:03:36.949187+0000","last_clean":"2024-09-12T22:03:36.949187+0000","last_became_active":"2024-09-12T22:03:33.463245+0000","last_became_peered":"2024-09-12T22:03:33.463245+0000","last_unstale":"2024-09-12T22:03:36.949187+0000","last_undegraded":"2024-09-12T22:03:36.949187+0000","last_fullsized":"2024-09-12T22:03:36.949187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:11.422942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727387+0000","last_change":"2024-09-12T22:03:33.457934+0000","last_active":"2024-09-12T22:03:34.727387+0000","last_peered":"2024-09-12T22:03:34.727387+0000","last_clean":"2024-09-12T22:03:34.727387+0000","last_became_active":"2024-09-12T22:03:33.457458+0000","last_became_peered":"2024-09-12T22:03:33.457458+0000","last_unstale":"2024-09-12T22:03:34.727387+0000","last_undegraded":"2024-09-12T22:03:34.727387+0000","last_fullsized":"2024-09-12T22:03:34.727387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:32.748239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458122+0000","last_change":"2024-09-12T22:03:33.464118+0000","last_active":"2024-09-12T22:03:34.458122+0000","last_peered":"2024-09-12T22:03:34.458122+0000","last_clean":"2024-09-12T22:03:34.458122+0000","last_became_active":"2024-09-12T22:03:33.463243+0000","last_became_peered":"2024-09-12T22:03:33.463243+0000","last_unstale":"2024-09-12T22:03:34.458122+0000","last_undegraded":"2024-09-12T22:03:34.458122+0000","last_fullsized":"2024-09-12T22:03:34.458122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:34.450477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457755+0000","last_change":"2024-09-12T22:03:33.465705+0000","last_active":"2024-09-12T22:03:34.457755+0000","last_peered":"2024-09-12T22:03:34.457755+0000","last_clean":"2024-09-12T22:03:34.457755+0000","last_became_active":"2024-09-12T22:03:33.465207+0000","last_became_peered":"2024-09-12T22:03:33.465207+0000","last_unstale":"2024-09-12T22:03:34.457755+0000","last_undegraded":"2024-09-12T22:03:34.457755+0000","last_fullsized":"2024-09-12T22:03:34.457755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.780572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948470+0000","last_change":"2024-09-12T22:03:33.460994+0000","last_active":"2024-09-12T22:03:36.948470+0000","last_peered":"2024-09-12T22:03:36.948470+0000","last_clean":"2024-09-12T22:03:36.948470+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:03:36.948470+0000","last_undegraded":"2024-09-12T22:03:36.948470+0000","last_fullsized":"2024-09-12T22:03:36.948470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:20.363291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726460+0000","last_change":"2024-09-12T22:03:33.466950+0000","last_active":"2024-09-12T22:03:34.726460+0000","last_peered":"2024-09-12T22:03:34.726460+0000","last_clean":"2024-09-12T22:03:34.726460+0000","last_became_active":"2024-09-12T22:03:33.466609+0000","last_became_peered":"2024-09-12T22:03:33.466609+0000","last_unstale":"2024-09-12T22:03:34.726460+0000","last_undegraded":"2024-09-12T22:03:34.726460+0000","last_fullsized":"2024-09-12T22:03:34.726460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:34.396185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948002+0000","last_change":"2024-09-12T22:03:33.460375+0000","last_active":"2024-09-12T22:03:36.948002+0000","last_peered":"2024-09-12T22:03:36.948002+0000","last_clean":"2024-09-12T22:03:36.948002+0000","last_became_active":"2024-09-12T22:03:33.459687+0000","last_became_peered":"2024-09-12T22:03:33.459687+0000","last_unstale":"2024-09-12T22:03:36.948002+0000","last_undegraded":"2024-09-12T22:03:36.948002+0000","last_fullsized":"2024-09-12T22:03:36.948002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:34.897642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949272+0000","last_change":"2024-09-12T22:03:33.456508+0000","last_active":"2024-09-12T22:03:36.949272+0000","last_peered":"2024-09-12T22:03:36.949272+0000","last_clean":"2024-09-12T22:03:36.949272+0000","last_became_active":"2024-09-12T22:03:33.456189+0000","last_became_peered":"2024-09-12T22:03:33.456189+0000","last_unstale":"2024-09-12T22:03:36.949272+0000","last_undegraded":"2024-09-12T22:03:36.949272+0000","last_fullsized":"2024-09-12T22:03:36.949272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.466890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727817+0000","last_change":"2024-09-12T22:03:33.465866+0000","last_active":"2024-09-12T22:03:34.727817+0000","last_peered":"2024-09-12T22:03:34.727817+0000","last_clean":"2024-09-12T22:03:34.727817+0000","last_became_active":"2024-09-12T22:03:33.464254+0000","last_became_peered":"2024-09-12T22:03:33.464254+0000","last_unstale":"2024-09-12T22:03:34.727817+0000","last_undegraded":"2024-09-12T22:03:34.727817+0000","last_fullsized":"2024-09-12T22:03:34.727817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:51.045864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458590+0000","last_change":"2024-09-12T22:03:33.461282+0000","last_active":"2024-09-12T22:03:34.458590+0000","last_peered":"2024-09-12T22:03:34.458590+0000","last_clean":"2024-09-12T22:03:34.458590+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:03:34.458590+0000","last_undegraded":"2024-09-12T22:03:34.458590+0000","last_fullsized":"2024-09-12T22:03:34.458590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:32.302716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948773+0000","last_change":"2024-09-12T22:03:33.467229+0000","last_active":"2024-09-12T22:03:36.948773+0000","last_peered":"2024-09-12T22:03:36.948773+0000","last_clean":"2024-09-12T22:03:36.948773+0000","last_became_active":"2024-09-12T22:03:33.464691+0000","last_became_peered":"2024-09-12T22:03:33.464691+0000","last_unstale":"2024-09-12T22:03:36.948773+0000","last_undegraded":"2024-09-12T22:03:36.948773+0000","last_fullsized":"2024-09-12T22:03:36.948773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.780572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727572+0000","last_change":"2024-09-12T22:03:33.460674+0000","last_active":"2024-09-12T22:03:34.727572+0000","last_peered":"2024-09-12T22:03:34.727572+0000","last_clean":"2024-09-12T22:03:34.727572+0000","last_became_active":"2024-09-12T22:03:33.458902+0000","last_became_peered":"2024-09-12T22:03:33.458902+0000","last_unstale":"2024-09-12T22:03:34.727572+0000","last_undegraded":"2024-09-12T22:03:34.727572+0000","last_fullsized":"2024-09-12T22:03:34.727572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:01.247039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948605+0000","last_change":"2024-09-12T22:03:33.456842+0000","last_active":"2024-09-12T22:03:36.948605+0000","last_peered":"2024-09-12T22:03:36.948605+0000","last_clean":"2024-09-12T22:03:36.948605+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:03:36.948605+0000","last_undegraded":"2024-09-12T22:03:36.948605+0000","last_fullsized":"2024-09-12T22:03:36.948605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:56.383351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726620+0000","last_change":"2024-09-12T22:03:33.459380+0000","last_active":"2024-09-12T22:03:34.726620+0000","last_peered":"2024-09-12T22:03:34.726620+0000","last_clean":"2024-09-12T22:03:34.726620+0000","last_became_active":"2024-09-12T22:03:33.458357+0000","last_became_peered":"2024-09-12T22:03:33.458357+0000","last_unstale":"2024-09-12T22:03:34.726620+0000","last_undegraded":"2024-09-12T22:03:34.726620+0000","last_fullsized":"2024-09-12T22:03:34.726620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:15.811200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457533+0000","last_change":"2024-09-12T22:03:33.463134+0000","last_active":"2024-09-12T22:03:34.457533+0000","last_peered":"2024-09-12T22:03:34.457533+0000","last_clean":"2024-09-12T22:03:34.457533+0000","last_became_active":"2024-09-12T22:03:33.462566+0000","last_became_peered":"2024-09-12T22:03:33.462566+0000","last_unstale":"2024-09-12T22:03:34.457533+0000","last_undegraded":"2024-09-12T22:03:34.457533+0000","last_fullsized":"2024-09-12T22:03:34.457533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:48.428755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948711+0000","last_change":"2024-09-12T22:03:33.460277+0000","last_active":"2024-09-12T22:03:36.948711+0000","last_peered":"2024-09-12T22:03:36.948711+0000","last_clean":"2024-09-12T22:03:36.948711+0000","last_became_active":"2024-09-12T22:03:33.459696+0000","last_became_peered":"2024-09-12T22:03:33.459696+0000","last_unstale":"2024-09-12T22:03:36.948711+0000","last_undegraded":"2024-09-12T22:03:36.948711+0000","last_fullsized":"2024-09-12T22:03:36.948711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:42.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457867+0000","last_change":"2024-09-12T22:03:32.457419+0000","last_active":"2024-09-12T22:03:34.457867+0000","last_peered":"2024-09-12T22:03:34.457867+0000","last_clean":"2024-09-12T22:03:34.457867+0000","last_became_active":"2024-09-12T22:03:32.456846+0000","last_became_peered":"2024-09-12T22:03:32.456846+0000","last_unstale":"2024-09-12T22:03:34.457867+0000","last_undegraded":"2024-09-12T22:03:34.457867+0000","last_fullsized":"2024-09-12T22:03:34.457867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:55.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949001+0000","last_change":"2024-09-12T22:03:33.458607+0000","last_active":"2024-09-12T22:03:36.949001+0000","last_peered":"2024-09-12T22:03:36.949001+0000","last_clean":"2024-09-12T22:03:36.949001+0000","last_became_active":"2024-09-12T22:03:33.457815+0000","last_became_peered":"2024-09-12T22:03:33.457815+0000","last_unstale":"2024-09-12T22:03:36.949001+0000","last_undegraded":"2024-09-12T22:03:36.949001+0000","last_fullsized":"2024-09-12T22:03:36.949001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:48.428755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726921+0000","last_change":"2024-09-12T22:03:32.458436+0000","last_active":"2024-09-12T22:03:34.726921+0000","last_peered":"2024-09-12T22:03:34.726921+0000","last_clean":"2024-09-12T22:03:34.726921+0000","last_became_active":"2024-09-12T22:03:32.457647+0000","last_became_peered":"2024-09-12T22:03:32.457647+0000","last_unstale":"2024-09-12T22:03:34.726921+0000","last_undegraded":"2024-09-12T22:03:34.726921+0000","last_fullsized":"2024-09-12T22:03:34.726921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:57.394698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728072+0000","last_change":"2024-09-12T22:03:33.466388+0000","last_active":"2024-09-12T22:03:34.728072+0000","last_peered":"2024-09-12T22:03:34.728072+0000","last_clean":"2024-09-12T22:03:34.728072+0000","last_became_active":"2024-09-12T22:03:33.464101+0000","last_became_peered":"2024-09-12T22:03:33.464101+0000","last_unstale":"2024-09-12T22:03:34.728072+0000","last_undegraded":"2024-09-12T22:03:34.728072+0000","last_fullsized":"2024-09-12T22:03:34.728072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:39:52.512160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948250+0000","last_change":"2024-09-12T22:03:32.461341+0000","last_active":"2024-09-12T22:03:36.948250+0000","last_peered":"2024-09-12T22:03:36.948250+0000","last_clean":"2024-09-12T22:03:36.948250+0000","last_became_active":"2024-09-12T22:03:32.460840+0000","last_became_peered":"2024-09-12T22:03:32.460840+0000","last_unstale":"2024-09-12T22:03:36.948250+0000","last_undegraded":"2024-09-12T22:03:36.948250+0000","last_fullsized":"2024-09-12T22:03:36.948250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:08.751696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727739+0000","last_change":"2024-09-12T22:03:33.464983+0000","last_active":"2024-09-12T22:03:34.727739+0000","last_peered":"2024-09-12T22:03:34.727739+0000","last_clean":"2024-09-12T22:03:34.727739+0000","last_became_active":"2024-09-12T22:03:33.464497+0000","last_became_peered":"2024-09-12T22:03:33.464497+0000","last_unstale":"2024-09-12T22:03:34.727739+0000","last_undegraded":"2024-09-12T22:03:34.727739+0000","last_fullsized":"2024-09-12T22:03:34.727739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:20.643181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457409+0000","last_change":"2024-09-12T22:03:32.453200+0000","last_active":"2024-09-12T22:03:34.457409+0000","last_peered":"2024-09-12T22:03:34.457409+0000","last_clean":"2024-09-12T22:03:34.457409+0000","last_became_active":"2024-09-12T22:03:32.452937+0000","last_became_peered":"2024-09-12T22:03:32.452937+0000","last_unstale":"2024-09-12T22:03:34.457409+0000","last_undegraded":"2024-09-12T22:03:34.457409+0000","last_fullsized":"2024-09-12T22:03:34.457409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:37.122599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458550+0000","last_change":"2024-09-12T22:03:32.458776+0000","last_active":"2024-09-12T22:03:34.458550+0000","last_peered":"2024-09-12T22:03:34.458550+0000","last_clean":"2024-09-12T22:03:34.458550+0000","last_became_active":"2024-09-12T22:03:32.458223+0000","last_became_peered":"2024-09-12T22:03:32.458223+0000","last_unstale":"2024-09-12T22:03:34.458550+0000","last_undegraded":"2024-09-12T22:03:34.458550+0000","last_fullsized":"2024-09-12T22:03:34.458550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:25.999548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948060+0000","last_change":"2024-09-12T22:03:33.465308+0000","last_active":"2024-09-12T22:03:36.948060+0000","last_peered":"2024-09-12T22:03:36.948060+0000","last_clean":"2024-09-12T22:03:36.948060+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:03:36.948060+0000","last_undegraded":"2024-09-12T22:03:36.948060+0000","last_fullsized":"2024-09-12T22:03:36.948060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:35.733622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949175+0000","last_change":"2024-09-12T22:03:32.461301+0000","last_active":"2024-09-12T22:03:36.949175+0000","last_peered":"2024-09-12T22:03:36.949175+0000","last_clean":"2024-09-12T22:03:36.949175+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:03:36.949175+0000","last_undegraded":"2024-09-12T22:03:36.949175+0000","last_fullsized":"2024-09-12T22:03:36.949175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:39.872272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948189+0000","last_change":"2024-09-12T22:03:33.458592+0000","last_active":"2024-09-12T22:03:36.948189+0000","last_peered":"2024-09-12T22:03:36.948189+0000","last_clean":"2024-09-12T22:03:36.948189+0000","last_became_active":"2024-09-12T22:03:33.458077+0000","last_became_peered":"2024-09-12T22:03:33.458077+0000","last_unstale":"2024-09-12T22:03:36.948189+0000","last_undegraded":"2024-09-12T22:03:36.948189+0000","last_fullsized":"2024-09-12T22:03:36.948189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.333348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458734+0000","last_change":"2024-09-12T22:03:32.459540+0000","last_active":"2024-09-12T22:03:34.458734+0000","last_peered":"2024-09-12T22:03:34.458734+0000","last_clean":"2024-09-12T22:03:34.458734+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:03:34.458734+0000","last_undegraded":"2024-09-12T22:03:34.458734+0000","last_fullsized":"2024-09-12T22:03:34.458734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:22.143242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458131+0000","last_change":"2024-09-12T22:03:33.464832+0000","last_active":"2024-09-12T22:03:34.458131+0000","last_peered":"2024-09-12T22:03:34.458131+0000","last_clean":"2024-09-12T22:03:34.458131+0000","last_became_active":"2024-09-12T22:03:33.463400+0000","last_became_peered":"2024-09-12T22:03:33.463400+0000","last_unstale":"2024-09-12T22:03:34.458131+0000","last_undegraded":"2024-09-12T22:03:34.458131+0000","last_fullsized":"2024-09-12T22:03:34.458131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:11:53.438877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458339+0000","last_change":"2024-09-12T22:03:32.456243+0000","last_active":"2024-09-12T22:03:34.458339+0000","last_peered":"2024-09-12T22:03:34.458339+0000","last_clean":"2024-09-12T22:03:34.458339+0000","last_became_active":"2024-09-12T22:03:32.455840+0000","last_became_peered":"2024-09-12T22:03:32.455840+0000","last_unstale":"2024-09-12T22:03:34.458339+0000","last_undegraded":"2024-09-12T22:03:34.458339+0000","last_fullsized":"2024-09-12T22:03:34.458339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:47.319431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726846+0000","last_change":"2024-09-12T22:03:33.465572+0000","last_active":"2024-09-12T22:03:34.726846+0000","last_peered":"2024-09-12T22:03:34.726846+0000","last_clean":"2024-09-12T22:03:34.726846+0000","last_became_active":"2024-09-12T22:03:33.465000+0000","last_became_peered":"2024-09-12T22:03:33.465000+0000","last_unstale":"2024-09-12T22:03:34.726846+0000","last_undegraded":"2024-09-12T22:03:34.726846+0000","last_fullsized":"2024-09-12T22:03:34.726846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:37.418482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727734+0000","last_change":"2024-09-12T22:03:32.458041+0000","last_active":"2024-09-12T22:03:34.727734+0000","last_peered":"2024-09-12T22:03:34.727734+0000","last_clean":"2024-09-12T22:03:34.727734+0000","last_became_active":"2024-09-12T22:03:32.457583+0000","last_became_peered":"2024-09-12T22:03:32.457583+0000","last_unstale":"2024-09-12T22:03:34.727734+0000","last_undegraded":"2024-09-12T22:03:34.727734+0000","last_fullsized":"2024-09-12T22:03:34.727734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:15.688344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458164+0000","last_change":"2024-09-12T22:03:33.462786+0000","last_active":"2024-09-12T22:03:34.458164+0000","last_peered":"2024-09-12T22:03:34.458164+0000","last_clean":"2024-09-12T22:03:34.458164+0000","last_became_active":"2024-09-12T22:03:33.462488+0000","last_became_peered":"2024-09-12T22:03:33.462488+0000","last_unstale":"2024-09-12T22:03:34.458164+0000","last_undegraded":"2024-09-12T22:03:34.458164+0000","last_fullsized":"2024-09-12T22:03:34.458164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:24.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457903+0000","last_change":"2024-09-12T22:03:32.457448+0000","last_active":"2024-09-12T22:03:34.457903+0000","last_peered":"2024-09-12T22:03:34.457903+0000","last_clean":"2024-09-12T22:03:34.457903+0000","last_became_active":"2024-09-12T22:03:32.457013+0000","last_became_peered":"2024-09-12T22:03:32.457013+0000","last_unstale":"2024-09-12T22:03:34.457903+0000","last_undegraded":"2024-09-12T22:03:34.457903+0000","last_fullsized":"2024-09-12T22:03:34.457903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:27.694073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458699+0000","last_change":"2024-09-12T22:03:33.459084+0000","last_active":"2024-09-12T22:03:34.458699+0000","last_peered":"2024-09-12T22:03:34.458699+0000","last_clean":"2024-09-12T22:03:34.458699+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:03:34.458699+0000","last_undegraded":"2024-09-12T22:03:34.458699+0000","last_fullsized":"2024-09-12T22:03:34.458699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:50.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948293+0000","last_change":"2024-09-12T22:03:32.461417+0000","last_active":"2024-09-12T22:03:36.948293+0000","last_peered":"2024-09-12T22:03:36.948293+0000","last_clean":"2024-09-12T22:03:36.948293+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:03:36.948293+0000","last_undegraded":"2024-09-12T22:03:36.948293+0000","last_fullsized":"2024-09-12T22:03:36.948293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:22.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458431+0000","last_change":"2024-09-12T22:03:33.457927+0000","last_active":"2024-09-12T22:03:34.458431+0000","last_peered":"2024-09-12T22:03:34.458431+0000","last_clean":"2024-09-12T22:03:34.458431+0000","last_became_active":"2024-09-12T22:03:33.457548+0000","last_became_peered":"2024-09-12T22:03:33.457548+0000","last_unstale":"2024-09-12T22:03:34.458431+0000","last_undegraded":"2024-09-12T22:03:34.458431+0000","last_fullsized":"2024-09-12T22:03:34.458431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:17.407499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948139+0000","last_change":"2024-09-12T22:03:32.458122+0000","last_active":"2024-09-12T22:03:36.948139+0000","last_peered":"2024-09-12T22:03:36.948139+0000","last_clean":"2024-09-12T22:03:36.948139+0000","last_became_active":"2024-09-12T22:03:32.457812+0000","last_became_peered":"2024-09-12T22:03:32.457812+0000","last_unstale":"2024-09-12T22:03:36.948139+0000","last_undegraded":"2024-09-12T22:03:36.948139+0000","last_fullsized":"2024-09-12T22:03:36.948139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:33.359519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727868+0000","last_change":"2024-09-12T22:03:33.459649+0000","last_active":"2024-09-12T22:03:34.727868+0000","last_peered":"2024-09-12T22:03:34.727868+0000","last_clean":"2024-09-12T22:03:34.727868+0000","last_became_active":"2024-09-12T22:03:33.458085+0000","last_became_peered":"2024-09-12T22:03:33.458085+0000","last_unstale":"2024-09-12T22:03:34.727868+0000","last_undegraded":"2024-09-12T22:03:34.727868+0000","last_fullsized":"2024-09-12T22:03:34.727868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:56.693491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":224,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457710+0000","last_change":"2024-09-12T22:03:23.315624+0000","last_active":"2024-09-12T22:03:34.457710+0000","last_peered":"2024-09-12T22:03:34.457710+0000","last_clean":"2024-09-12T22:03:34.457710+0000","last_became_active":"2024-09-12T22:03:23.315346+0000","last_became_peered":"2024-09-12T22:03:23.315346+0000","last_unstale":"2024-09-12T22:03:34.457710+0000","last_undegraded":"2024-09-12T22:03:34.457710+0000","last_fullsized":"2024-09-12T22:03:34.457710+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:15.864121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458080+0000","last_change":"2024-09-12T22:03:30.339678+0000","last_active":"2024-09-12T22:03:34.458080+0000","last_peered":"2024-09-12T22:03:34.458080+0000","last_clean":"2024-09-12T22:03:34.458080+0000","last_became_active":"2024-09-12T22:03:28.335855+0000","last_became_peered":"2024-09-12T22:03:28.335855+0000","last_unstale":"2024-09-12T22:03:34.458080+0000","last_undegraded":"2024-09-12T22:03:34.458080+0000","last_fullsized":"2024-09-12T22:03:34.458080+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:11.750803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727087+0000","last_change":"2024-09-12T22:03:32.459986+0000","last_active":"2024-09-12T22:03:34.727087+0000","last_peered":"2024-09-12T22:03:34.727087+0000","last_clean":"2024-09-12T22:03:34.727087+0000","last_became_active":"2024-09-12T22:03:32.459353+0000","last_became_peered":"2024-09-12T22:03:32.459353+0000","last_unstale":"2024-09-12T22:03:34.727087+0000","last_undegraded":"2024-09-12T22:03:34.727087+0000","last_fullsized":"2024-09-12T22:03:34.727087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:57.496962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458787+0000","last_change":"2024-09-12T22:03:33.460477+0000","last_active":"2024-09-12T22:03:34.458787+0000","last_peered":"2024-09-12T22:03:34.458787+0000","last_clean":"2024-09-12T22:03:34.458787+0000","last_became_active":"2024-09-12T22:03:33.459433+0000","last_became_peered":"2024-09-12T22:03:33.459433+0000","last_unstale":"2024-09-12T22:03:34.458787+0000","last_undegraded":"2024-09-12T22:03:34.458787+0000","last_fullsized":"2024-09-12T22:03:34.458787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:15.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457596+0000","last_change":"2024-09-12T22:03:30.339569+0000","last_active":"2024-09-12T22:03:34.457596+0000","last_peered":"2024-09-12T22:03:34.457596+0000","last_clean":"2024-09-12T22:03:34.457596+0000","last_became_active":"2024-09-12T22:03:28.336643+0000","last_became_peered":"2024-09-12T22:03:28.336643+0000","last_unstale":"2024-09-12T22:03:34.457596+0000","last_undegraded":"2024-09-12T22:03:34.457596+0000","last_fullsized":"2024-09-12T22:03:34.457596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:56.968092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039518000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727009+0000","last_change":"2024-09-12T22:03:32.454155+0000","last_active":"2024-09-12T22:03:34.727009+0000","last_peered":"2024-09-12T22:03:34.727009+0000","last_clean":"2024-09-12T22:03:34.727009+0000","last_became_active":"2024-09-12T22:03:32.453733+0000","last_became_peered":"2024-09-12T22:03:32.453733+0000","last_unstale":"2024-09-12T22:03:34.727009+0000","last_undegraded":"2024-09-12T22:03:34.727009+0000","last_fullsized":"2024-09-12T22:03:34.727009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:09.186165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949078+0000","last_change":"2024-09-12T22:03:33.458657+0000","last_active":"2024-09-12T22:03:36.949078+0000","last_peered":"2024-09-12T22:03:36.949078+0000","last_clean":"2024-09-12T22:03:36.949078+0000","last_became_active":"2024-09-12T22:03:33.458295+0000","last_became_peered":"2024-09-12T22:03:33.458295+0000","last_unstale":"2024-09-12T22:03:36.949078+0000","last_undegraded":"2024-09-12T22:03:36.949078+0000","last_fullsized":"2024-09-12T22:03:36.949078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:25.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727073+0000","last_change":"2024-09-12T22:03:30.343746+0000","last_active":"2024-09-12T22:03:34.727073+0000","last_peered":"2024-09-12T22:03:34.727073+0000","last_clean":"2024-09-12T22:03:34.727073+0000","last_became_active":"2024-09-12T22:03:28.335895+0000","last_became_peered":"2024-09-12T22:03:28.335895+0000","last_unstale":"2024-09-12T22:03:34.727073+0000","last_undegraded":"2024-09-12T22:03:34.727073+0000","last_fullsized":"2024-09-12T22:03:34.727073+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.827420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070116600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948158+0000","last_change":"2024-09-12T22:03:32.461331+0000","last_active":"2024-09-12T22:03:36.948158+0000","last_peered":"2024-09-12T22:03:36.948158+0000","last_clean":"2024-09-12T22:03:36.948158+0000","last_became_active":"2024-09-12T22:03:32.460966+0000","last_became_peered":"2024-09-12T22:03:32.460966+0000","last_unstale":"2024-09-12T22:03:36.948158+0000","last_undegraded":"2024-09-12T22:03:36.948158+0000","last_fullsized":"2024-09-12T22:03:36.948158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:18.939990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727964+0000","last_change":"2024-09-12T22:03:33.458277+0000","last_active":"2024-09-12T22:03:34.727964+0000","last_peered":"2024-09-12T22:03:34.727964+0000","last_clean":"2024-09-12T22:03:34.727964+0000","last_became_active":"2024-09-12T22:03:33.457320+0000","last_became_peered":"2024-09-12T22:03:33.457320+0000","last_unstale":"2024-09-12T22:03:34.727964+0000","last_undegraded":"2024-09-12T22:03:34.727964+0000","last_fullsized":"2024-09-12T22:03:34.727964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:46.703481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458209+0000","last_change":"2024-09-12T22:03:30.339989+0000","last_active":"2024-09-12T22:03:34.458209+0000","last_peered":"2024-09-12T22:03:34.458209+0000","last_clean":"2024-09-12T22:03:34.458209+0000","last_became_active":"2024-09-12T22:03:28.335760+0000","last_became_peered":"2024-09-12T22:03:28.335760+0000","last_unstale":"2024-09-12T22:03:34.458209+0000","last_undegraded":"2024-09-12T22:03:34.458209+0000","last_fullsized":"2024-09-12T22:03:34.458209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:29.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458072+0000","last_change":"2024-09-12T22:03:32.456988+0000","last_active":"2024-09-12T22:03:34.458072+0000","last_peered":"2024-09-12T22:03:34.458072+0000","last_clean":"2024-09-12T22:03:34.458072+0000","last_became_active":"2024-09-12T22:03:32.456605+0000","last_became_peered":"2024-09-12T22:03:32.456605+0000","last_unstale":"2024-09-12T22:03:34.458072+0000","last_undegraded":"2024-09-12T22:03:34.458072+0000","last_fullsized":"2024-09-12T22:03:34.458072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:38.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727602+0000","last_change":"2024-09-12T22:03:33.458311+0000","last_active":"2024-09-12T22:03:34.727602+0000","last_peered":"2024-09-12T22:03:34.727602+0000","last_clean":"2024-09-12T22:03:34.727602+0000","last_became_active":"2024-09-12T22:03:33.456397+0000","last_became_peered":"2024-09-12T22:03:33.456397+0000","last_unstale":"2024-09-12T22:03:34.727602+0000","last_undegraded":"2024-09-12T22:03:34.727602+0000","last_fullsized":"2024-09-12T22:03:34.727602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:51.305559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458797+0000","last_change":"2024-09-12T22:03:32.457239+0000","last_active":"2024-09-12T22:03:34.458797+0000","last_peered":"2024-09-12T22:03:34.458797+0000","last_clean":"2024-09-12T22:03:34.458797+0000","last_became_active":"2024-09-12T22:03:32.456807+0000","last_became_peered":"2024-09-12T22:03:32.456807+0000","last_unstale":"2024-09-12T22:03:34.458797+0000","last_undegraded":"2024-09-12T22:03:34.458797+0000","last_fullsized":"2024-09-12T22:03:34.458797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:00.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727685+0000","last_change":"2024-09-12T22:03:30.343489+0000","last_active":"2024-09-12T22:03:34.727685+0000","last_peered":"2024-09-12T22:03:34.727685+0000","last_clean":"2024-09-12T22:03:34.727685+0000","last_became_active":"2024-09-12T22:03:28.335875+0000","last_became_peered":"2024-09-12T22:03:28.335875+0000","last_unstale":"2024-09-12T22:03:34.727685+0000","last_undegraded":"2024-09-12T22:03:34.727685+0000","last_fullsized":"2024-09-12T22:03:34.727685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:34.561003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042932700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948531+0000","last_change":"2024-09-12T22:03:33.460944+0000","last_active":"2024-09-12T22:03:36.948531+0000","last_peered":"2024-09-12T22:03:36.948531+0000","last_clean":"2024-09-12T22:03:36.948531+0000","last_became_active":"2024-09-12T22:03:33.460514+0000","last_became_peered":"2024-09-12T22:03:33.460514+0000","last_unstale":"2024-09-12T22:03:36.948531+0000","last_undegraded":"2024-09-12T22:03:36.948531+0000","last_fullsized":"2024-09-12T22:03:36.948531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:54.744829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727682+0000","last_change":"2024-09-12T22:03:32.460055+0000","last_active":"2024-09-12T22:03:34.727682+0000","last_peered":"2024-09-12T22:03:34.727682+0000","last_clean":"2024-09-12T22:03:34.727682+0000","last_became_active":"2024-09-12T22:03:32.459276+0000","last_became_peered":"2024-09-12T22:03:32.459276+0000","last_unstale":"2024-09-12T22:03:34.727682+0000","last_undegraded":"2024-09-12T22:03:34.727682+0000","last_fullsized":"2024-09-12T22:03:34.727682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:23.776211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949211+0000","last_change":"2024-09-12T22:03:30.649265+0000","last_active":"2024-09-12T22:03:36.949211+0000","last_peered":"2024-09-12T22:03:36.949211+0000","last_clean":"2024-09-12T22:03:36.949211+0000","last_became_active":"2024-09-12T22:03:28.337193+0000","last_became_peered":"2024-09-12T22:03:28.337193+0000","last_unstale":"2024-09-12T22:03:36.949211+0000","last_undegraded":"2024-09-12T22:03:36.949211+0000","last_fullsized":"2024-09-12T22:03:36.949211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:43.899511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948515+0000","last_change":"2024-09-12T22:03:33.464893+0000","last_active":"2024-09-12T22:03:36.948515+0000","last_peered":"2024-09-12T22:03:36.948515+0000","last_clean":"2024-09-12T22:03:36.948515+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:03:36.948515+0000","last_undegraded":"2024-09-12T22:03:36.948515+0000","last_fullsized":"2024-09-12T22:03:36.948515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:47.948673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728256+0000","last_change":"2024-09-12T22:03:32.460426+0000","last_active":"2024-09-12T22:03:34.728256+0000","last_peered":"2024-09-12T22:03:34.728256+0000","last_clean":"2024-09-12T22:03:34.728256+0000","last_became_active":"2024-09-12T22:03:32.460161+0000","last_became_peered":"2024-09-12T22:03:32.460161+0000","last_unstale":"2024-09-12T22:03:34.728256+0000","last_undegraded":"2024-09-12T22:03:34.728256+0000","last_fullsized":"2024-09-12T22:03:34.728256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.472907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728136+0000","last_change":"2024-09-12T22:03:30.343485+0000","last_active":"2024-09-12T22:03:34.728136+0000","last_peered":"2024-09-12T22:03:34.728136+0000","last_clean":"2024-09-12T22:03:34.728136+0000","last_became_active":"2024-09-12T22:03:28.335961+0000","last_became_peered":"2024-09-12T22:03:28.335961+0000","last_unstale":"2024-09-12T22:03:34.728136+0000","last_undegraded":"2024-09-12T22:03:34.728136+0000","last_fullsized":"2024-09-12T22:03:34.728136+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:24.041899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043906199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727163+0000","last_change":"2024-09-12T22:03:33.464709+0000","last_active":"2024-09-12T22:03:34.727163+0000","last_peered":"2024-09-12T22:03:34.727163+0000","last_clean":"2024-09-12T22:03:34.727163+0000","last_became_active":"2024-09-12T22:03:33.464016+0000","last_became_peered":"2024-09-12T22:03:33.464016+0000","last_unstale":"2024-09-12T22:03:34.727163+0000","last_undegraded":"2024-09-12T22:03:34.727163+0000","last_fullsized":"2024-09-12T22:03:34.727163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:07.598247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:35.449232+0000","last_change":"2024-09-12T22:03:32.458014+0000","last_active":"2024-09-12T22:03:35.449232+0000","last_peered":"2024-09-12T22:03:35.449232+0000","last_clean":"2024-09-12T22:03:35.449232+0000","last_became_active":"2024-09-12T22:03:32.457654+0000","last_became_peered":"2024-09-12T22:03:32.457654+0000","last_unstale":"2024-09-12T22:03:35.449232+0000","last_undegraded":"2024-09-12T22:03:35.449232+0000","last_fullsized":"2024-09-12T22:03:35.449232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:08.446521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458629+0000","last_change":"2024-09-12T22:03:30.339817+0000","last_active":"2024-09-12T22:03:34.458629+0000","last_peered":"2024-09-12T22:03:34.458629+0000","last_clean":"2024-09-12T22:03:34.458629+0000","last_became_active":"2024-09-12T22:03:28.336599+0000","last_became_peered":"2024-09-12T22:03:28.336599+0000","last_unstale":"2024-09-12T22:03:34.458629+0000","last_undegraded":"2024-09-12T22:03:34.458629+0000","last_fullsized":"2024-09-12T22:03:34.458629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:36.442618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058522100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948215+0000","last_change":"2024-09-12T22:03:33.456975+0000","last_active":"2024-09-12T22:03:36.948215+0000","last_peered":"2024-09-12T22:03:36.948215+0000","last_clean":"2024-09-12T22:03:36.948215+0000","last_became_active":"2024-09-12T22:03:33.456611+0000","last_became_peered":"2024-09-12T22:03:33.456611+0000","last_unstale":"2024-09-12T22:03:36.948215+0000","last_undegraded":"2024-09-12T22:03:36.948215+0000","last_fullsized":"2024-09-12T22:03:36.948215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:46.309219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457961+0000","last_change":"2024-09-12T22:03:33.455671+0000","last_active":"2024-09-12T22:03:34.457961+0000","last_peered":"2024-09-12T22:03:34.457961+0000","last_clean":"2024-09-12T22:03:34.457961+0000","last_became_active":"2024-09-12T22:03:33.454833+0000","last_became_peered":"2024-09-12T22:03:33.454833+0000","last_unstale":"2024-09-12T22:03:34.457961+0000","last_undegraded":"2024-09-12T22:03:34.457961+0000","last_fullsized":"2024-09-12T22:03:34.457961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:08.773779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458251+0000","last_change":"2024-09-12T22:03:32.458296+0000","last_active":"2024-09-12T22:03:34.458251+0000","last_peered":"2024-09-12T22:03:34.458251+0000","last_clean":"2024-09-12T22:03:34.458251+0000","last_became_active":"2024-09-12T22:03:32.457908+0000","last_became_peered":"2024-09-12T22:03:32.457908+0000","last_unstale":"2024-09-12T22:03:34.458251+0000","last_undegraded":"2024-09-12T22:03:34.458251+0000","last_fullsized":"2024-09-12T22:03:34.458251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:53.758615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726767+0000","last_change":"2024-09-12T22:03:33.458365+0000","last_active":"2024-09-12T22:03:34.726767+0000","last_peered":"2024-09-12T22:03:34.726767+0000","last_clean":"2024-09-12T22:03:34.726767+0000","last_became_active":"2024-09-12T22:03:33.456256+0000","last_became_peered":"2024-09-12T22:03:33.456256+0000","last_unstale":"2024-09-12T22:03:34.726767+0000","last_undegraded":"2024-09-12T22:03:34.726767+0000","last_fullsized":"2024-09-12T22:03:34.726767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:12.145709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949119+0000","last_change":"2024-09-12T22:03:32.461509+0000","last_active":"2024-09-12T22:03:36.949119+0000","last_peered":"2024-09-12T22:03:36.949119+0000","last_clean":"2024-09-12T22:03:36.949119+0000","last_became_active":"2024-09-12T22:03:32.461161+0000","last_became_peered":"2024-09-12T22:03:32.461161+0000","last_unstale":"2024-09-12T22:03:36.949119+0000","last_undegraded":"2024-09-12T22:03:36.949119+0000","last_fullsized":"2024-09-12T22:03:36.949119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:02.888202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458479+0000","last_change":"2024-09-12T22:03:32.457458+0000","last_active":"2024-09-12T22:03:34.458479+0000","last_peered":"2024-09-12T22:03:34.458479+0000","last_clean":"2024-09-12T22:03:34.458479+0000","last_became_active":"2024-09-12T22:03:32.457007+0000","last_became_peered":"2024-09-12T22:03:32.457007+0000","last_unstale":"2024-09-12T22:03:34.458479+0000","last_undegraded":"2024-09-12T22:03:34.458479+0000","last_fullsized":"2024-09-12T22:03:34.458479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:08.474776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726877+0000","last_change":"2024-09-12T22:03:33.465561+0000","last_active":"2024-09-12T22:03:34.726877+0000","last_peered":"2024-09-12T22:03:34.726877+0000","last_clean":"2024-09-12T22:03:34.726877+0000","last_became_active":"2024-09-12T22:03:33.464837+0000","last_became_peered":"2024-09-12T22:03:33.464837+0000","last_unstale":"2024-09-12T22:03:34.726877+0000","last_undegraded":"2024-09-12T22:03:34.726877+0000","last_fullsized":"2024-09-12T22:03:34.726877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:32.859664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728159+0000","last_change":"2024-09-12T22:03:32.458964+0000","last_active":"2024-09-12T22:03:34.728159+0000","last_peered":"2024-09-12T22:03:34.728159+0000","last_clean":"2024-09-12T22:03:34.728159+0000","last_became_active":"2024-09-12T22:03:32.458346+0000","last_became_peered":"2024-09-12T22:03:32.458346+0000","last_unstale":"2024-09-12T22:03:34.728159+0000","last_undegraded":"2024-09-12T22:03:34.728159+0000","last_fullsized":"2024-09-12T22:03:34.728159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:37.178897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726711+0000","last_change":"2024-09-12T22:03:33.458060+0000","last_active":"2024-09-12T22:03:34.726711+0000","last_peered":"2024-09-12T22:03:34.726711+0000","last_clean":"2024-09-12T22:03:34.726711+0000","last_became_active":"2024-09-12T22:03:33.457390+0000","last_became_peered":"2024-09-12T22:03:33.457390+0000","last_unstale":"2024-09-12T22:03:34.726711+0000","last_undegraded":"2024-09-12T22:03:34.726711+0000","last_fullsized":"2024-09-12T22:03:34.726711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:14.711011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949306+0000","last_change":"2024-09-12T22:03:33.460177+0000","last_active":"2024-09-12T22:03:36.949306+0000","last_peered":"2024-09-12T22:03:36.949306+0000","last_clean":"2024-09-12T22:03:36.949306+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:03:36.949306+0000","last_undegraded":"2024-09-12T22:03:36.949306+0000","last_fullsized":"2024-09-12T22:03:36.949306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727230+0000","last_change":"2024-09-12T22:03:32.460441+0000","last_active":"2024-09-12T22:03:34.727230+0000","last_peered":"2024-09-12T22:03:34.727230+0000","last_clean":"2024-09-12T22:03:34.727230+0000","last_became_active":"2024-09-12T22:03:32.460126+0000","last_became_peered":"2024-09-12T22:03:32.460126+0000","last_unstale":"2024-09-12T22:03:34.727230+0000","last_undegraded":"2024-09-12T22:03:34.727230+0000","last_fullsized":"2024-09-12T22:03:34.727230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:52.150617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727653+0000","last_change":"2024-09-12T22:03:33.466167+0000","last_active":"2024-09-12T22:03:34.727653+0000","last_peered":"2024-09-12T22:03:34.727653+0000","last_clean":"2024-09-12T22:03:34.727653+0000","last_became_active":"2024-09-12T22:03:33.465116+0000","last_became_peered":"2024-09-12T22:03:33.465116+0000","last_unstale":"2024-09-12T22:03:34.727653+0000","last_undegraded":"2024-09-12T22:03:34.727653+0000","last_fullsized":"2024-09-12T22:03:34.727653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:19.683631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.726948+0000","last_change":"2024-09-12T22:03:32.454262+0000","last_active":"2024-09-12T22:03:34.726948+0000","last_peered":"2024-09-12T22:03:34.726948+0000","last_clean":"2024-09-12T22:03:34.726948+0000","last_became_active":"2024-09-12T22:03:32.453776+0000","last_became_peered":"2024-09-12T22:03:32.453776+0000","last_unstale":"2024-09-12T22:03:34.726948+0000","last_undegraded":"2024-09-12T22:03:34.726948+0000","last_fullsized":"2024-09-12T22:03:34.726948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:57.091523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948901+0000","last_change":"2024-09-12T22:03:33.465186+0000","last_active":"2024-09-12T22:03:36.948901+0000","last_peered":"2024-09-12T22:03:36.948901+0000","last_clean":"2024-09-12T22:03:36.948901+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:03:36.948901+0000","last_undegraded":"2024-09-12T22:03:36.948901+0000","last_fullsized":"2024-09-12T22:03:36.948901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:29.409225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948624+0000","last_change":"2024-09-12T22:03:32.458132+0000","last_active":"2024-09-12T22:03:36.948624+0000","last_peered":"2024-09-12T22:03:36.948624+0000","last_clean":"2024-09-12T22:03:36.948624+0000","last_became_active":"2024-09-12T22:03:32.457817+0000","last_became_peered":"2024-09-12T22:03:32.457817+0000","last_unstale":"2024-09-12T22:03:36.948624+0000","last_undegraded":"2024-09-12T22:03:36.948624+0000","last_fullsized":"2024-09-12T22:03:36.948624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:47.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948638+0000","last_change":"2024-09-12T22:03:33.460730+0000","last_active":"2024-09-12T22:03:36.948638+0000","last_peered":"2024-09-12T22:03:36.948638+0000","last_clean":"2024-09-12T22:03:36.948638+0000","last_became_active":"2024-09-12T22:03:33.460223+0000","last_became_peered":"2024-09-12T22:03:33.460223+0000","last_unstale":"2024-09-12T22:03:36.948638+0000","last_undegraded":"2024-09-12T22:03:36.948638+0000","last_fullsized":"2024-09-12T22:03:36.948638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.406786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948595+0000","last_change":"2024-09-12T22:03:32.461243+0000","last_active":"2024-09-12T22:03:36.948595+0000","last_peered":"2024-09-12T22:03:36.948595+0000","last_clean":"2024-09-12T22:03:36.948595+0000","last_became_active":"2024-09-12T22:03:32.460760+0000","last_became_peered":"2024-09-12T22:03:32.460760+0000","last_unstale":"2024-09-12T22:03:36.948595+0000","last_undegraded":"2024-09-12T22:03:36.948595+0000","last_fullsized":"2024-09-12T22:03:36.948595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:42.848199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457782+0000","last_change":"2024-09-12T22:03:33.462764+0000","last_active":"2024-09-12T22:03:34.457782+0000","last_peered":"2024-09-12T22:03:34.457782+0000","last_clean":"2024-09-12T22:03:34.457782+0000","last_became_active":"2024-09-12T22:03:33.462360+0000","last_became_peered":"2024-09-12T22:03:33.462360+0000","last_unstale":"2024-09-12T22:03:34.457782+0000","last_undegraded":"2024-09-12T22:03:34.457782+0000","last_fullsized":"2024-09-12T22:03:34.457782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.458198+0000","last_change":"2024-09-12T22:03:32.457280+0000","last_active":"2024-09-12T22:03:34.458198+0000","last_peered":"2024-09-12T22:03:34.458198+0000","last_clean":"2024-09-12T22:03:34.458198+0000","last_became_active":"2024-09-12T22:03:32.456812+0000","last_became_peered":"2024-09-12T22:03:32.456812+0000","last_unstale":"2024-09-12T22:03:34.458198+0000","last_undegraded":"2024-09-12T22:03:34.458198+0000","last_fullsized":"2024-09-12T22:03:34.458198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:46:51.143125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457768+0000","last_change":"2024-09-12T22:03:33.464094+0000","last_active":"2024-09-12T22:03:34.457768+0000","last_peered":"2024-09-12T22:03:34.457768+0000","last_clean":"2024-09-12T22:03:34.457768+0000","last_became_active":"2024-09-12T22:03:33.463380+0000","last_became_peered":"2024-09-12T22:03:33.463380+0000","last_unstale":"2024-09-12T22:03:34.457768+0000","last_undegraded":"2024-09-12T22:03:34.457768+0000","last_fullsized":"2024-09-12T22:03:34.457768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:11.422942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948983+0000","last_change":"2024-09-12T22:03:32.461230+0000","last_active":"2024-09-12T22:03:36.948983+0000","last_peered":"2024-09-12T22:03:36.948983+0000","last_clean":"2024-09-12T22:03:36.948983+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:03:36.948983+0000","last_undegraded":"2024-09-12T22:03:36.948983+0000","last_fullsized":"2024-09-12T22:03:36.948983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:16.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948424+0000","last_change":"2024-09-12T22:03:33.458634+0000","last_active":"2024-09-12T22:03:36.948424+0000","last_peered":"2024-09-12T22:03:36.948424+0000","last_clean":"2024-09-12T22:03:36.948424+0000","last_became_active":"2024-09-12T22:03:33.458096+0000","last_became_peered":"2024-09-12T22:03:33.458096+0000","last_unstale":"2024-09-12T22:03:36.948424+0000","last_undegraded":"2024-09-12T22:03:36.948424+0000","last_fullsized":"2024-09-12T22:03:36.948424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:09.702722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.727964+0000","last_change":"2024-09-12T22:03:32.460314+0000","last_active":"2024-09-12T22:03:34.727964+0000","last_peered":"2024-09-12T22:03:34.727964+0000","last_clean":"2024-09-12T22:03:34.727964+0000","last_became_active":"2024-09-12T22:03:32.459890+0000","last_became_peered":"2024-09-12T22:03:32.459890+0000","last_unstale":"2024-09-12T22:03:34.727964+0000","last_undegraded":"2024-09-12T22:03:34.727964+0000","last_fullsized":"2024-09-12T22:03:34.727964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:00.774244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.457725+0000","last_change":"2024-09-12T22:03:33.464082+0000","last_active":"2024-09-12T22:03:34.457725+0000","last_peered":"2024-09-12T22:03:34.457725+0000","last_clean":"2024-09-12T22:03:34.457725+0000","last_became_active":"2024-09-12T22:03:33.462648+0000","last_became_peered":"2024-09-12T22:03:33.462648+0000","last_unstale":"2024-09-12T22:03:34.457725+0000","last_undegraded":"2024-09-12T22:03:34.457725+0000","last_fullsized":"2024-09-12T22:03:34.457725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.466890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:03:34.728024+0000","last_change":"2024-09-12T22:03:32.459293+0000","last_active":"2024-09-12T22:03:34.728024+0000","last_peered":"2024-09-12T22:03:34.728024+0000","last_clean":"2024-09-12T22:03:34.728024+0000","last_became_active":"2024-09-12T22:03:32.458679+0000","last_became_peered":"2024-09-12T22:03:32.458679+0000","last_unstale":"2024-09-12T22:03:34.728024+0000","last_undegraded":"2024-09-12T22:03:34.728024+0000","last_fullsized":"2024-09-12T22:03:34.728024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:21.083182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":653512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36132,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335708,"statfs":{"total":96636764160,"available":96599764992,"internally_reserved":0,"allocated":802816,"data_stored":654147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35536,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336304,"statfs":{"total":96636764160,"available":96600375296,"internally_reserved":0,"allocated":184320,"data_stored":61985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:03:41.161 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:03:41.161 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T22:03:41.162 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T22:03:41.162 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T22:03:41.162 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T22:03:41.540 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:41.552 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3268290046},{"type":"v1","addr":"172.21.15.43:6801","nonce":3268290046}]},"active_addr":"172.21.15.43:6801/3268290046","active_change":"2024-09-12T22:03:16.231087+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4126,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":3974130387}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":1234714031}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2772935530}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":3719816220}]}]} 2024-09-12T22:03:41.556 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T22:03:41.556 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T22:03:41.557 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:03:41.845 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:41.845 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","created":"2024-09-12T22:03:11.964028+0000","modified":"2024-09-12T22:03:36.944923+0000","last_up_change":"2024-09-12T22:03:21.299348+0000","last_in_change":"2024-09-12T22:03:12.758606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:03:22.281699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:03:26.987767+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:03:31.328134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:03:31.777050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb292153-0043-4981-8743-115f848d2064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6801","nonce":1281227380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6803","nonce":1281227380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6807","nonce":1281227380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6805","nonce":1281227380}]},"public_addr":"172.21.15.47:6801/1281227380","cluster_addr":"172.21.15.47:6803/1281227380","heartbeat_back_addr":"172.21.15.47:6807/1281227380","heartbeat_front_addr":"172.21.15.47:6805/1281227380","state":["exists","up"]},{"osd":1,"uuid":"5f0330a2-15ce-4ffb-a697-da1f930db079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6801","nonce":1334802479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6803","nonce":1334802479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6807","nonce":1334802479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6805","nonce":1334802479}]},"public_addr":"172.21.15.110:6801/1334802479","cluster_addr":"172.21.15.110:6803/1334802479","heartbeat_back_addr":"172.21.15.110:6807/1334802479","heartbeat_front_addr":"172.21.15.110:6805/1334802479","state":["exists","up"]},{"osd":2,"uuid":"ae0b014f-768c-4f57-82c6-3edf9aa9f856","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6801","nonce":3565874056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6803","nonce":3565874056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6807","nonce":3565874056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6805","nonce":3565874056}]},"public_addr":"172.21.15.146:6801/3565874056","cluster_addr":"172.21.15.146:6803/3565874056","heartbeat_back_addr":"172.21.15.146:6807/3565874056","heartbeat_front_addr":"172.21.15.146:6805/3565874056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:18.927187+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.386650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.957366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:03:41.858 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T22:03:41.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:03:42.151 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:42.151 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","created":"2024-09-12T22:03:11.964028+0000","modified":"2024-09-12T22:03:36.944923+0000","last_up_change":"2024-09-12T22:03:21.299348+0000","last_in_change":"2024-09-12T22:03:12.758606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:03:22.281699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:03:26.987767+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:03:31.328134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:03:31.777050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb292153-0043-4981-8743-115f848d2064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6801","nonce":1281227380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6803","nonce":1281227380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6807","nonce":1281227380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6805","nonce":1281227380}]},"public_addr":"172.21.15.47:6801/1281227380","cluster_addr":"172.21.15.47:6803/1281227380","heartbeat_back_addr":"172.21.15.47:6807/1281227380","heartbeat_front_addr":"172.21.15.47:6805/1281227380","state":["exists","up"]},{"osd":1,"uuid":"5f0330a2-15ce-4ffb-a697-da1f930db079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6801","nonce":1334802479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6803","nonce":1334802479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6807","nonce":1334802479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6805","nonce":1334802479}]},"public_addr":"172.21.15.110:6801/1334802479","cluster_addr":"172.21.15.110:6803/1334802479","heartbeat_back_addr":"172.21.15.110:6807/1334802479","heartbeat_front_addr":"172.21.15.110:6805/1334802479","state":["exists","up"]},{"osd":2,"uuid":"ae0b014f-768c-4f57-82c6-3edf9aa9f856","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6801","nonce":3565874056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6803","nonce":3565874056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6807","nonce":3565874056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6805","nonce":3565874056}]},"public_addr":"172.21.15.146:6801/3565874056","cluster_addr":"172.21.15.146:6803/3565874056","heartbeat_back_addr":"172.21.15.146:6807/3565874056","heartbeat_front_addr":"172.21.15.146:6805/3565874056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:18.927187+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.386650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.957366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:03:42.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T22:03:42.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T22:03:42.166 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T22:03:42.309 INFO:teuthology.orchestra.run.smithi043.stdout:38654705671 2024-09-12T22:03:42.309 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:03:42.331 INFO:teuthology.orchestra.run.smithi043.stdout:38654705672 2024-09-12T22:03:42.331 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:03:42.332 INFO:teuthology.orchestra.run.smithi043.stdout:34359738376 2024-09-12T22:03:42.332 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:03:42.626 INFO:teuthology.orchestra.run.smithi043.stdout:38654705670 2024-09-12T22:03:42.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.1 2024-09-12T22:03:42.676 INFO:teuthology.orchestra.run.smithi043.stdout:34359738374 2024-09-12T22:03:42.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738374 for osd.0 2024-09-12T22:03:42.693 INFO:teuthology.orchestra.run.smithi043.stdout:38654705670 2024-09-12T22:03:42.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.2 2024-09-12T22:03:43.641 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:03:43.691 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:03:43.707 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:03:43.955 INFO:teuthology.orchestra.run.smithi043.stdout:38654705670 2024-09-12T22:03:43.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.1 2024-09-12T22:03:44.036 INFO:teuthology.orchestra.run.smithi043.stdout:34359738375 2024-09-12T22:03:44.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.0 2024-09-12T22:03:44.070 INFO:teuthology.orchestra.run.smithi043.stdout:38654705670 2024-09-12T22:03:44.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.2 2024-09-12T22:03:44.972 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:03:45.049 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:03:45.083 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:03:45.286 INFO:teuthology.orchestra.run.smithi043.stdout:38654705672 2024-09-12T22:03:45.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705672 for osd.1 2024-09-12T22:03:45.300 DEBUG:teuthology.parallel:result is None 2024-09-12T22:03:45.357 INFO:teuthology.orchestra.run.smithi043.stdout:34359738376 2024-09-12T22:03:45.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.0 2024-09-12T22:03:45.370 DEBUG:teuthology.parallel:result is None 2024-09-12T22:03:45.388 INFO:teuthology.orchestra.run.smithi043.stdout:38654705672 2024-09-12T22:03:45.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.2 2024-09-12T22:03:45.401 DEBUG:teuthology.parallel:result is None 2024-09-12T22:03:45.401 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:03:45.401 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:03:45.736 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:45.737 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:03:45.747 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T22:03:44.240836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":103636,"kb_used_data":1760,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":283011884,"statfs":{"total":289910292480,"available":289804169216,"internally_reserved":0,"allocated":1802240,"data_stored":1382448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.785339"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949228+0000","last_change":"2024-09-12T22:03:33.459321+0000","last_active":"2024-09-12T22:03:36.949228+0000","last_peered":"2024-09-12T22:03:36.949228+0000","last_clean":"2024-09-12T22:03:36.949228+0000","last_became_active":"2024-09-12T22:03:33.458897+0000","last_became_peered":"2024-09-12T22:03:33.458897+0000","last_unstale":"2024-09-12T22:03:36.949228+0000","last_undegraded":"2024-09-12T22:03:36.949228+0000","last_fullsized":"2024-09-12T22:03:36.949228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:20.716362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948961+0000","last_change":"2024-09-12T22:03:33.463659+0000","last_active":"2024-09-12T22:03:36.948961+0000","last_peered":"2024-09-12T22:03:36.948961+0000","last_clean":"2024-09-12T22:03:36.948961+0000","last_became_active":"2024-09-12T22:03:33.463296+0000","last_became_peered":"2024-09-12T22:03:33.463296+0000","last_unstale":"2024-09-12T22:03:36.948961+0000","last_undegraded":"2024-09-12T22:03:36.948961+0000","last_fullsized":"2024-09-12T22:03:36.948961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:10.270667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120413+0000","last_change":"2024-09-12T22:03:33.462148+0000","last_active":"2024-09-12T22:03:38.120413+0000","last_peered":"2024-09-12T22:03:38.120413+0000","last_clean":"2024-09-12T22:03:38.120413+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:03:38.120413+0000","last_undegraded":"2024-09-12T22:03:38.120413+0000","last_fullsized":"2024-09-12T22:03:38.120413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:36.909948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120215+0000","last_change":"2024-09-12T22:03:33.464418+0000","last_active":"2024-09-12T22:03:38.120215+0000","last_peered":"2024-09-12T22:03:38.120215+0000","last_clean":"2024-09-12T22:03:38.120215+0000","last_became_active":"2024-09-12T22:03:33.463811+0000","last_became_peered":"2024-09-12T22:03:33.463811+0000","last_unstale":"2024-09-12T22:03:38.120215+0000","last_undegraded":"2024-09-12T22:03:38.120215+0000","last_fullsized":"2024-09-12T22:03:38.120215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:48.374991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948625+0000","last_change":"2024-09-12T22:03:33.459995+0000","last_active":"2024-09-12T22:03:36.948625+0000","last_peered":"2024-09-12T22:03:36.948625+0000","last_clean":"2024-09-12T22:03:36.948625+0000","last_became_active":"2024-09-12T22:03:33.459653+0000","last_became_peered":"2024-09-12T22:03:33.459653+0000","last_unstale":"2024-09-12T22:03:36.948625+0000","last_undegraded":"2024-09-12T22:03:36.948625+0000","last_fullsized":"2024-09-12T22:03:36.948625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:15.288581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119840+0000","last_change":"2024-09-12T22:03:33.464646+0000","last_active":"2024-09-12T22:03:38.119840+0000","last_peered":"2024-09-12T22:03:38.119840+0000","last_clean":"2024-09-12T22:03:38.119840+0000","last_became_active":"2024-09-12T22:03:33.463793+0000","last_became_peered":"2024-09-12T22:03:33.463793+0000","last_unstale":"2024-09-12T22:03:38.119840+0000","last_undegraded":"2024-09-12T22:03:38.119840+0000","last_fullsized":"2024-09-12T22:03:38.119840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.153436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119951+0000","last_change":"2024-09-12T22:03:33.463183+0000","last_active":"2024-09-12T22:03:38.119951+0000","last_peered":"2024-09-12T22:03:38.119951+0000","last_clean":"2024-09-12T22:03:38.119951+0000","last_became_active":"2024-09-12T22:03:33.462752+0000","last_became_peered":"2024-09-12T22:03:33.462752+0000","last_unstale":"2024-09-12T22:03:38.119951+0000","last_undegraded":"2024-09-12T22:03:38.119951+0000","last_fullsized":"2024-09-12T22:03:38.119951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:25.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119620+0000","last_change":"2024-09-12T22:03:33.465552+0000","last_active":"2024-09-12T22:03:38.119620+0000","last_peered":"2024-09-12T22:03:38.119620+0000","last_clean":"2024-09-12T22:03:38.119620+0000","last_became_active":"2024-09-12T22:03:33.464745+0000","last_became_peered":"2024-09-12T22:03:33.464745+0000","last_unstale":"2024-09-12T22:03:38.119620+0000","last_undegraded":"2024-09-12T22:03:38.119620+0000","last_fullsized":"2024-09-12T22:03:38.119620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:42.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634348+0000","last_change":"2024-09-12T22:03:33.461075+0000","last_active":"2024-09-12T22:03:37.634348+0000","last_peered":"2024-09-12T22:03:37.634348+0000","last_clean":"2024-09-12T22:03:37.634348+0000","last_became_active":"2024-09-12T22:03:33.459892+0000","last_became_peered":"2024-09-12T22:03:33.459892+0000","last_unstale":"2024-09-12T22:03:37.634348+0000","last_undegraded":"2024-09-12T22:03:37.634348+0000","last_fullsized":"2024-09-12T22:03:37.634348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:25.087808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949026+0000","last_change":"2024-09-12T22:03:33.459292+0000","last_active":"2024-09-12T22:03:36.949026+0000","last_peered":"2024-09-12T22:03:36.949026+0000","last_clean":"2024-09-12T22:03:36.949026+0000","last_became_active":"2024-09-12T22:03:33.458956+0000","last_became_peered":"2024-09-12T22:03:33.458956+0000","last_unstale":"2024-09-12T22:03:36.949026+0000","last_undegraded":"2024-09-12T22:03:36.949026+0000","last_fullsized":"2024-09-12T22:03:36.949026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.153436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120553+0000","last_change":"2024-09-12T22:03:33.464766+0000","last_active":"2024-09-12T22:03:38.120553+0000","last_peered":"2024-09-12T22:03:38.120553+0000","last_clean":"2024-09-12T22:03:38.120553+0000","last_became_active":"2024-09-12T22:03:33.463545+0000","last_became_peered":"2024-09-12T22:03:33.463545+0000","last_unstale":"2024-09-12T22:03:38.120553+0000","last_undegraded":"2024-09-12T22:03:38.120553+0000","last_fullsized":"2024-09-12T22:03:38.120553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:27.861352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948602+0000","last_change":"2024-09-12T22:03:33.465069+0000","last_active":"2024-09-12T22:03:36.948602+0000","last_peered":"2024-09-12T22:03:36.948602+0000","last_clean":"2024-09-12T22:03:36.948602+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:03:36.948602+0000","last_undegraded":"2024-09-12T22:03:36.948602+0000","last_fullsized":"2024-09-12T22:03:36.948602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948404+0000","last_change":"2024-09-12T22:03:33.458519+0000","last_active":"2024-09-12T22:03:36.948404+0000","last_peered":"2024-09-12T22:03:36.948404+0000","last_clean":"2024-09-12T22:03:36.948404+0000","last_became_active":"2024-09-12T22:03:33.458138+0000","last_became_peered":"2024-09-12T22:03:33.458138+0000","last_unstale":"2024-09-12T22:03:36.948404+0000","last_undegraded":"2024-09-12T22:03:36.948404+0000","last_fullsized":"2024-09-12T22:03:36.948404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:18.784928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119916+0000","last_change":"2024-09-12T22:03:33.457584+0000","last_active":"2024-09-12T22:03:38.119916+0000","last_peered":"2024-09-12T22:03:38.119916+0000","last_clean":"2024-09-12T22:03:38.119916+0000","last_became_active":"2024-09-12T22:03:33.456732+0000","last_became_peered":"2024-09-12T22:03:33.456732+0000","last_unstale":"2024-09-12T22:03:38.119916+0000","last_undegraded":"2024-09-12T22:03:38.119916+0000","last_fullsized":"2024-09-12T22:03:38.119916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:20.716362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120012+0000","last_change":"2024-09-12T22:03:33.455903+0000","last_active":"2024-09-12T22:03:38.120012+0000","last_peered":"2024-09-12T22:03:38.120012+0000","last_clean":"2024-09-12T22:03:38.120012+0000","last_became_active":"2024-09-12T22:03:33.455399+0000","last_became_peered":"2024-09-12T22:03:33.455399+0000","last_unstale":"2024-09-12T22:03:38.120012+0000","last_undegraded":"2024-09-12T22:03:38.120012+0000","last_fullsized":"2024-09-12T22:03:38.120012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:06.785269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119637+0000","last_change":"2024-09-12T22:03:33.465252+0000","last_active":"2024-09-12T22:03:38.119637+0000","last_peered":"2024-09-12T22:03:38.119637+0000","last_clean":"2024-09-12T22:03:38.119637+0000","last_became_active":"2024-09-12T22:03:33.464524+0000","last_became_peered":"2024-09-12T22:03:33.464524+0000","last_unstale":"2024-09-12T22:03:38.119637+0000","last_undegraded":"2024-09-12T22:03:38.119637+0000","last_fullsized":"2024-09-12T22:03:38.119637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.406786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634727+0000","last_change":"2024-09-12T22:03:33.457075+0000","last_active":"2024-09-12T22:03:37.634727+0000","last_peered":"2024-09-12T22:03:37.634727+0000","last_clean":"2024-09-12T22:03:37.634727+0000","last_became_active":"2024-09-12T22:03:33.456463+0000","last_became_peered":"2024-09-12T22:03:33.456463+0000","last_unstale":"2024-09-12T22:03:37.634727+0000","last_undegraded":"2024-09-12T22:03:37.634727+0000","last_fullsized":"2024-09-12T22:03:37.634727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:40.945193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949187+0000","last_change":"2024-09-12T22:03:33.463614+0000","last_active":"2024-09-12T22:03:36.949187+0000","last_peered":"2024-09-12T22:03:36.949187+0000","last_clean":"2024-09-12T22:03:36.949187+0000","last_became_active":"2024-09-12T22:03:33.463245+0000","last_became_peered":"2024-09-12T22:03:33.463245+0000","last_unstale":"2024-09-12T22:03:36.949187+0000","last_undegraded":"2024-09-12T22:03:36.949187+0000","last_fullsized":"2024-09-12T22:03:36.949187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:11.422942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634149+0000","last_change":"2024-09-12T22:03:33.457934+0000","last_active":"2024-09-12T22:03:37.634149+0000","last_peered":"2024-09-12T22:03:37.634149+0000","last_clean":"2024-09-12T22:03:37.634149+0000","last_became_active":"2024-09-12T22:03:33.457458+0000","last_became_peered":"2024-09-12T22:03:33.457458+0000","last_unstale":"2024-09-12T22:03:37.634149+0000","last_undegraded":"2024-09-12T22:03:37.634149+0000","last_fullsized":"2024-09-12T22:03:37.634149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:32.748239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120307+0000","last_change":"2024-09-12T22:03:33.464118+0000","last_active":"2024-09-12T22:03:38.120307+0000","last_peered":"2024-09-12T22:03:38.120307+0000","last_clean":"2024-09-12T22:03:38.120307+0000","last_became_active":"2024-09-12T22:03:33.463243+0000","last_became_peered":"2024-09-12T22:03:33.463243+0000","last_unstale":"2024-09-12T22:03:38.120307+0000","last_undegraded":"2024-09-12T22:03:38.120307+0000","last_fullsized":"2024-09-12T22:03:38.120307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:34.450477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120288+0000","last_change":"2024-09-12T22:03:33.465705+0000","last_active":"2024-09-12T22:03:38.120288+0000","last_peered":"2024-09-12T22:03:38.120288+0000","last_clean":"2024-09-12T22:03:38.120288+0000","last_became_active":"2024-09-12T22:03:33.465207+0000","last_became_peered":"2024-09-12T22:03:33.465207+0000","last_unstale":"2024-09-12T22:03:38.120288+0000","last_undegraded":"2024-09-12T22:03:38.120288+0000","last_fullsized":"2024-09-12T22:03:38.120288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.780572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948470+0000","last_change":"2024-09-12T22:03:33.460994+0000","last_active":"2024-09-12T22:03:36.948470+0000","last_peered":"2024-09-12T22:03:36.948470+0000","last_clean":"2024-09-12T22:03:36.948470+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:03:36.948470+0000","last_undegraded":"2024-09-12T22:03:36.948470+0000","last_fullsized":"2024-09-12T22:03:36.948470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:20.363291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633254+0000","last_change":"2024-09-12T22:03:33.466950+0000","last_active":"2024-09-12T22:03:37.633254+0000","last_peered":"2024-09-12T22:03:37.633254+0000","last_clean":"2024-09-12T22:03:37.633254+0000","last_became_active":"2024-09-12T22:03:33.466609+0000","last_became_peered":"2024-09-12T22:03:33.466609+0000","last_unstale":"2024-09-12T22:03:37.633254+0000","last_undegraded":"2024-09-12T22:03:37.633254+0000","last_fullsized":"2024-09-12T22:03:37.633254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:34.396185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948002+0000","last_change":"2024-09-12T22:03:33.460375+0000","last_active":"2024-09-12T22:03:36.948002+0000","last_peered":"2024-09-12T22:03:36.948002+0000","last_clean":"2024-09-12T22:03:36.948002+0000","last_became_active":"2024-09-12T22:03:33.459687+0000","last_became_peered":"2024-09-12T22:03:33.459687+0000","last_unstale":"2024-09-12T22:03:36.948002+0000","last_undegraded":"2024-09-12T22:03:36.948002+0000","last_fullsized":"2024-09-12T22:03:36.948002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:34.897642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949272+0000","last_change":"2024-09-12T22:03:33.456508+0000","last_active":"2024-09-12T22:03:36.949272+0000","last_peered":"2024-09-12T22:03:36.949272+0000","last_clean":"2024-09-12T22:03:36.949272+0000","last_became_active":"2024-09-12T22:03:33.456189+0000","last_became_peered":"2024-09-12T22:03:33.456189+0000","last_unstale":"2024-09-12T22:03:36.949272+0000","last_undegraded":"2024-09-12T22:03:36.949272+0000","last_fullsized":"2024-09-12T22:03:36.949272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.466890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634563+0000","last_change":"2024-09-12T22:03:33.465866+0000","last_active":"2024-09-12T22:03:37.634563+0000","last_peered":"2024-09-12T22:03:37.634563+0000","last_clean":"2024-09-12T22:03:37.634563+0000","last_became_active":"2024-09-12T22:03:33.464254+0000","last_became_peered":"2024-09-12T22:03:33.464254+0000","last_unstale":"2024-09-12T22:03:37.634563+0000","last_undegraded":"2024-09-12T22:03:37.634563+0000","last_fullsized":"2024-09-12T22:03:37.634563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:51.045864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120695+0000","last_change":"2024-09-12T22:03:33.461282+0000","last_active":"2024-09-12T22:03:38.120695+0000","last_peered":"2024-09-12T22:03:38.120695+0000","last_clean":"2024-09-12T22:03:38.120695+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:03:38.120695+0000","last_undegraded":"2024-09-12T22:03:38.120695+0000","last_fullsized":"2024-09-12T22:03:38.120695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:32.302716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948773+0000","last_change":"2024-09-12T22:03:33.467229+0000","last_active":"2024-09-12T22:03:36.948773+0000","last_peered":"2024-09-12T22:03:36.948773+0000","last_clean":"2024-09-12T22:03:36.948773+0000","last_became_active":"2024-09-12T22:03:33.464691+0000","last_became_peered":"2024-09-12T22:03:33.464691+0000","last_unstale":"2024-09-12T22:03:36.948773+0000","last_undegraded":"2024-09-12T22:03:36.948773+0000","last_fullsized":"2024-09-12T22:03:36.948773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.780572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634065+0000","last_change":"2024-09-12T22:03:33.460674+0000","last_active":"2024-09-12T22:03:37.634065+0000","last_peered":"2024-09-12T22:03:37.634065+0000","last_clean":"2024-09-12T22:03:37.634065+0000","last_became_active":"2024-09-12T22:03:33.458902+0000","last_became_peered":"2024-09-12T22:03:33.458902+0000","last_unstale":"2024-09-12T22:03:37.634065+0000","last_undegraded":"2024-09-12T22:03:37.634065+0000","last_fullsized":"2024-09-12T22:03:37.634065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:01.247039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948605+0000","last_change":"2024-09-12T22:03:33.456842+0000","last_active":"2024-09-12T22:03:36.948605+0000","last_peered":"2024-09-12T22:03:36.948605+0000","last_clean":"2024-09-12T22:03:36.948605+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:03:36.948605+0000","last_undegraded":"2024-09-12T22:03:36.948605+0000","last_fullsized":"2024-09-12T22:03:36.948605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:56.383351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633245+0000","last_change":"2024-09-12T22:03:33.459380+0000","last_active":"2024-09-12T22:03:37.633245+0000","last_peered":"2024-09-12T22:03:37.633245+0000","last_clean":"2024-09-12T22:03:37.633245+0000","last_became_active":"2024-09-12T22:03:33.458357+0000","last_became_peered":"2024-09-12T22:03:33.458357+0000","last_unstale":"2024-09-12T22:03:37.633245+0000","last_undegraded":"2024-09-12T22:03:37.633245+0000","last_fullsized":"2024-09-12T22:03:37.633245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:15.811200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119698+0000","last_change":"2024-09-12T22:03:33.463134+0000","last_active":"2024-09-12T22:03:38.119698+0000","last_peered":"2024-09-12T22:03:38.119698+0000","last_clean":"2024-09-12T22:03:38.119698+0000","last_became_active":"2024-09-12T22:03:33.462566+0000","last_became_peered":"2024-09-12T22:03:33.462566+0000","last_unstale":"2024-09-12T22:03:38.119698+0000","last_undegraded":"2024-09-12T22:03:38.119698+0000","last_fullsized":"2024-09-12T22:03:38.119698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:48.428755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948711+0000","last_change":"2024-09-12T22:03:33.460277+0000","last_active":"2024-09-12T22:03:36.948711+0000","last_peered":"2024-09-12T22:03:36.948711+0000","last_clean":"2024-09-12T22:03:36.948711+0000","last_became_active":"2024-09-12T22:03:33.459696+0000","last_became_peered":"2024-09-12T22:03:33.459696+0000","last_unstale":"2024-09-12T22:03:36.948711+0000","last_undegraded":"2024-09-12T22:03:36.948711+0000","last_fullsized":"2024-09-12T22:03:36.948711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:42.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120607+0000","last_change":"2024-09-12T22:03:32.457419+0000","last_active":"2024-09-12T22:03:38.120607+0000","last_peered":"2024-09-12T22:03:38.120607+0000","last_clean":"2024-09-12T22:03:38.120607+0000","last_became_active":"2024-09-12T22:03:32.456846+0000","last_became_peered":"2024-09-12T22:03:32.456846+0000","last_unstale":"2024-09-12T22:03:38.120607+0000","last_undegraded":"2024-09-12T22:03:38.120607+0000","last_fullsized":"2024-09-12T22:03:38.120607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:55.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949001+0000","last_change":"2024-09-12T22:03:33.458607+0000","last_active":"2024-09-12T22:03:36.949001+0000","last_peered":"2024-09-12T22:03:36.949001+0000","last_clean":"2024-09-12T22:03:36.949001+0000","last_became_active":"2024-09-12T22:03:33.457815+0000","last_became_peered":"2024-09-12T22:03:33.457815+0000","last_unstale":"2024-09-12T22:03:36.949001+0000","last_undegraded":"2024-09-12T22:03:36.949001+0000","last_fullsized":"2024-09-12T22:03:36.949001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:48.428755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633671+0000","last_change":"2024-09-12T22:03:32.458436+0000","last_active":"2024-09-12T22:03:37.633671+0000","last_peered":"2024-09-12T22:03:37.633671+0000","last_clean":"2024-09-12T22:03:37.633671+0000","last_became_active":"2024-09-12T22:03:32.457647+0000","last_became_peered":"2024-09-12T22:03:32.457647+0000","last_unstale":"2024-09-12T22:03:37.633671+0000","last_undegraded":"2024-09-12T22:03:37.633671+0000","last_fullsized":"2024-09-12T22:03:37.633671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:57.394698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634795+0000","last_change":"2024-09-12T22:03:33.466388+0000","last_active":"2024-09-12T22:03:37.634795+0000","last_peered":"2024-09-12T22:03:37.634795+0000","last_clean":"2024-09-12T22:03:37.634795+0000","last_became_active":"2024-09-12T22:03:33.464101+0000","last_became_peered":"2024-09-12T22:03:33.464101+0000","last_unstale":"2024-09-12T22:03:37.634795+0000","last_undegraded":"2024-09-12T22:03:37.634795+0000","last_fullsized":"2024-09-12T22:03:37.634795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:39:52.512160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948250+0000","last_change":"2024-09-12T22:03:32.461341+0000","last_active":"2024-09-12T22:03:36.948250+0000","last_peered":"2024-09-12T22:03:36.948250+0000","last_clean":"2024-09-12T22:03:36.948250+0000","last_became_active":"2024-09-12T22:03:32.460840+0000","last_became_peered":"2024-09-12T22:03:32.460840+0000","last_unstale":"2024-09-12T22:03:36.948250+0000","last_undegraded":"2024-09-12T22:03:36.948250+0000","last_fullsized":"2024-09-12T22:03:36.948250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:08.751696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634330+0000","last_change":"2024-09-12T22:03:33.464983+0000","last_active":"2024-09-12T22:03:37.634330+0000","last_peered":"2024-09-12T22:03:37.634330+0000","last_clean":"2024-09-12T22:03:37.634330+0000","last_became_active":"2024-09-12T22:03:33.464497+0000","last_became_peered":"2024-09-12T22:03:33.464497+0000","last_unstale":"2024-09-12T22:03:37.634330+0000","last_undegraded":"2024-09-12T22:03:37.634330+0000","last_fullsized":"2024-09-12T22:03:37.634330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:20.643181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119729+0000","last_change":"2024-09-12T22:03:32.453200+0000","last_active":"2024-09-12T22:03:38.119729+0000","last_peered":"2024-09-12T22:03:38.119729+0000","last_clean":"2024-09-12T22:03:38.119729+0000","last_became_active":"2024-09-12T22:03:32.452937+0000","last_became_peered":"2024-09-12T22:03:32.452937+0000","last_unstale":"2024-09-12T22:03:38.119729+0000","last_undegraded":"2024-09-12T22:03:38.119729+0000","last_fullsized":"2024-09-12T22:03:38.119729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:37.122599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120976+0000","last_change":"2024-09-12T22:03:32.458776+0000","last_active":"2024-09-12T22:03:38.120976+0000","last_peered":"2024-09-12T22:03:38.120976+0000","last_clean":"2024-09-12T22:03:38.120976+0000","last_became_active":"2024-09-12T22:03:32.458223+0000","last_became_peered":"2024-09-12T22:03:32.458223+0000","last_unstale":"2024-09-12T22:03:38.120976+0000","last_undegraded":"2024-09-12T22:03:38.120976+0000","last_fullsized":"2024-09-12T22:03:38.120976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:25.999548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948060+0000","last_change":"2024-09-12T22:03:33.465308+0000","last_active":"2024-09-12T22:03:36.948060+0000","last_peered":"2024-09-12T22:03:36.948060+0000","last_clean":"2024-09-12T22:03:36.948060+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:03:36.948060+0000","last_undegraded":"2024-09-12T22:03:36.948060+0000","last_fullsized":"2024-09-12T22:03:36.948060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:35.733622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949175+0000","last_change":"2024-09-12T22:03:32.461301+0000","last_active":"2024-09-12T22:03:36.949175+0000","last_peered":"2024-09-12T22:03:36.949175+0000","last_clean":"2024-09-12T22:03:36.949175+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:03:36.949175+0000","last_undegraded":"2024-09-12T22:03:36.949175+0000","last_fullsized":"2024-09-12T22:03:36.949175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:39.872272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948189+0000","last_change":"2024-09-12T22:03:33.458592+0000","last_active":"2024-09-12T22:03:36.948189+0000","last_peered":"2024-09-12T22:03:36.948189+0000","last_clean":"2024-09-12T22:03:36.948189+0000","last_became_active":"2024-09-12T22:03:33.458077+0000","last_became_peered":"2024-09-12T22:03:33.458077+0000","last_unstale":"2024-09-12T22:03:36.948189+0000","last_undegraded":"2024-09-12T22:03:36.948189+0000","last_fullsized":"2024-09-12T22:03:36.948189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.333348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121065+0000","last_change":"2024-09-12T22:03:32.459540+0000","last_active":"2024-09-12T22:03:38.121065+0000","last_peered":"2024-09-12T22:03:38.121065+0000","last_clean":"2024-09-12T22:03:38.121065+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:03:38.121065+0000","last_undegraded":"2024-09-12T22:03:38.121065+0000","last_fullsized":"2024-09-12T22:03:38.121065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:22.143242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120192+0000","last_change":"2024-09-12T22:03:33.464832+0000","last_active":"2024-09-12T22:03:38.120192+0000","last_peered":"2024-09-12T22:03:38.120192+0000","last_clean":"2024-09-12T22:03:38.120192+0000","last_became_active":"2024-09-12T22:03:33.463400+0000","last_became_peered":"2024-09-12T22:03:33.463400+0000","last_unstale":"2024-09-12T22:03:38.120192+0000","last_undegraded":"2024-09-12T22:03:38.120192+0000","last_fullsized":"2024-09-12T22:03:38.120192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:11:53.438877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120596+0000","last_change":"2024-09-12T22:03:32.456243+0000","last_active":"2024-09-12T22:03:38.120596+0000","last_peered":"2024-09-12T22:03:38.120596+0000","last_clean":"2024-09-12T22:03:38.120596+0000","last_became_active":"2024-09-12T22:03:32.455840+0000","last_became_peered":"2024-09-12T22:03:32.455840+0000","last_unstale":"2024-09-12T22:03:38.120596+0000","last_undegraded":"2024-09-12T22:03:38.120596+0000","last_fullsized":"2024-09-12T22:03:38.120596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:47.319431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633986+0000","last_change":"2024-09-12T22:03:33.465572+0000","last_active":"2024-09-12T22:03:37.633986+0000","last_peered":"2024-09-12T22:03:37.633986+0000","last_clean":"2024-09-12T22:03:37.633986+0000","last_became_active":"2024-09-12T22:03:33.465000+0000","last_became_peered":"2024-09-12T22:03:33.465000+0000","last_unstale":"2024-09-12T22:03:37.633986+0000","last_undegraded":"2024-09-12T22:03:37.633986+0000","last_fullsized":"2024-09-12T22:03:37.633986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:37.418482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634361+0000","last_change":"2024-09-12T22:03:32.458041+0000","last_active":"2024-09-12T22:03:37.634361+0000","last_peered":"2024-09-12T22:03:37.634361+0000","last_clean":"2024-09-12T22:03:37.634361+0000","last_became_active":"2024-09-12T22:03:32.457583+0000","last_became_peered":"2024-09-12T22:03:32.457583+0000","last_unstale":"2024-09-12T22:03:37.634361+0000","last_undegraded":"2024-09-12T22:03:37.634361+0000","last_fullsized":"2024-09-12T22:03:37.634361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:15.688344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120351+0000","last_change":"2024-09-12T22:03:33.462786+0000","last_active":"2024-09-12T22:03:38.120351+0000","last_peered":"2024-09-12T22:03:38.120351+0000","last_clean":"2024-09-12T22:03:38.120351+0000","last_became_active":"2024-09-12T22:03:33.462488+0000","last_became_peered":"2024-09-12T22:03:33.462488+0000","last_unstale":"2024-09-12T22:03:38.120351+0000","last_undegraded":"2024-09-12T22:03:38.120351+0000","last_fullsized":"2024-09-12T22:03:38.120351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:24.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120200+0000","last_change":"2024-09-12T22:03:32.457448+0000","last_active":"2024-09-12T22:03:38.120200+0000","last_peered":"2024-09-12T22:03:38.120200+0000","last_clean":"2024-09-12T22:03:38.120200+0000","last_became_active":"2024-09-12T22:03:32.457013+0000","last_became_peered":"2024-09-12T22:03:32.457013+0000","last_unstale":"2024-09-12T22:03:38.120200+0000","last_undegraded":"2024-09-12T22:03:38.120200+0000","last_fullsized":"2024-09-12T22:03:38.120200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:27.694073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120791+0000","last_change":"2024-09-12T22:03:33.459084+0000","last_active":"2024-09-12T22:03:38.120791+0000","last_peered":"2024-09-12T22:03:38.120791+0000","last_clean":"2024-09-12T22:03:38.120791+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:03:38.120791+0000","last_undegraded":"2024-09-12T22:03:38.120791+0000","last_fullsized":"2024-09-12T22:03:38.120791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:50.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948293+0000","last_change":"2024-09-12T22:03:32.461417+0000","last_active":"2024-09-12T22:03:36.948293+0000","last_peered":"2024-09-12T22:03:36.948293+0000","last_clean":"2024-09-12T22:03:36.948293+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:03:36.948293+0000","last_undegraded":"2024-09-12T22:03:36.948293+0000","last_fullsized":"2024-09-12T22:03:36.948293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:22.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120631+0000","last_change":"2024-09-12T22:03:33.457927+0000","last_active":"2024-09-12T22:03:38.120631+0000","last_peered":"2024-09-12T22:03:38.120631+0000","last_clean":"2024-09-12T22:03:38.120631+0000","last_became_active":"2024-09-12T22:03:33.457548+0000","last_became_peered":"2024-09-12T22:03:33.457548+0000","last_unstale":"2024-09-12T22:03:38.120631+0000","last_undegraded":"2024-09-12T22:03:38.120631+0000","last_fullsized":"2024-09-12T22:03:38.120631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:17.407499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948139+0000","last_change":"2024-09-12T22:03:32.458122+0000","last_active":"2024-09-12T22:03:36.948139+0000","last_peered":"2024-09-12T22:03:36.948139+0000","last_clean":"2024-09-12T22:03:36.948139+0000","last_became_active":"2024-09-12T22:03:32.457812+0000","last_became_peered":"2024-09-12T22:03:32.457812+0000","last_unstale":"2024-09-12T22:03:36.948139+0000","last_undegraded":"2024-09-12T22:03:36.948139+0000","last_fullsized":"2024-09-12T22:03:36.948139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:33.359519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634486+0000","last_change":"2024-09-12T22:03:33.459649+0000","last_active":"2024-09-12T22:03:37.634486+0000","last_peered":"2024-09-12T22:03:37.634486+0000","last_clean":"2024-09-12T22:03:37.634486+0000","last_became_active":"2024-09-12T22:03:33.458085+0000","last_became_peered":"2024-09-12T22:03:33.458085+0000","last_unstale":"2024-09-12T22:03:37.634486+0000","last_undegraded":"2024-09-12T22:03:37.634486+0000","last_fullsized":"2024-09-12T22:03:37.634486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:56.693491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119963+0000","last_change":"2024-09-12T22:03:23.315624+0000","last_active":"2024-09-12T22:03:38.119963+0000","last_peered":"2024-09-12T22:03:38.119963+0000","last_clean":"2024-09-12T22:03:38.119963+0000","last_became_active":"2024-09-12T22:03:23.315346+0000","last_became_peered":"2024-09-12T22:03:23.315346+0000","last_unstale":"2024-09-12T22:03:38.119963+0000","last_undegraded":"2024-09-12T22:03:38.119963+0000","last_fullsized":"2024-09-12T22:03:38.119963+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:15.864121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":30,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120853+0000","last_change":"2024-09-12T22:03:30.339678+0000","last_active":"2024-09-12T22:03:38.120853+0000","last_peered":"2024-09-12T22:03:38.120853+0000","last_clean":"2024-09-12T22:03:38.120853+0000","last_became_active":"2024-09-12T22:03:28.335855+0000","last_became_peered":"2024-09-12T22:03:28.335855+0000","last_unstale":"2024-09-12T22:03:38.120853+0000","last_undegraded":"2024-09-12T22:03:38.120853+0000","last_fullsized":"2024-09-12T22:03:38.120853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:11.750803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633792+0000","last_change":"2024-09-12T22:03:32.459986+0000","last_active":"2024-09-12T22:03:37.633792+0000","last_peered":"2024-09-12T22:03:37.633792+0000","last_clean":"2024-09-12T22:03:37.633792+0000","last_became_active":"2024-09-12T22:03:32.459353+0000","last_became_peered":"2024-09-12T22:03:32.459353+0000","last_unstale":"2024-09-12T22:03:37.633792+0000","last_undegraded":"2024-09-12T22:03:37.633792+0000","last_fullsized":"2024-09-12T22:03:37.633792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:57.496962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120952+0000","last_change":"2024-09-12T22:03:33.460477+0000","last_active":"2024-09-12T22:03:38.120952+0000","last_peered":"2024-09-12T22:03:38.120952+0000","last_clean":"2024-09-12T22:03:38.120952+0000","last_became_active":"2024-09-12T22:03:33.459433+0000","last_became_peered":"2024-09-12T22:03:33.459433+0000","last_unstale":"2024-09-12T22:03:38.120952+0000","last_undegraded":"2024-09-12T22:03:38.120952+0000","last_fullsized":"2024-09-12T22:03:38.120952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:15.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119960+0000","last_change":"2024-09-12T22:03:30.339569+0000","last_active":"2024-09-12T22:03:38.119960+0000","last_peered":"2024-09-12T22:03:38.119960+0000","last_clean":"2024-09-12T22:03:38.119960+0000","last_became_active":"2024-09-12T22:03:28.336643+0000","last_became_peered":"2024-09-12T22:03:28.336643+0000","last_unstale":"2024-09-12T22:03:38.119960+0000","last_undegraded":"2024-09-12T22:03:38.119960+0000","last_fullsized":"2024-09-12T22:03:38.119960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:56.968092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039518000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633563+0000","last_change":"2024-09-12T22:03:32.454155+0000","last_active":"2024-09-12T22:03:37.633563+0000","last_peered":"2024-09-12T22:03:37.633563+0000","last_clean":"2024-09-12T22:03:37.633563+0000","last_became_active":"2024-09-12T22:03:32.453733+0000","last_became_peered":"2024-09-12T22:03:32.453733+0000","last_unstale":"2024-09-12T22:03:37.633563+0000","last_undegraded":"2024-09-12T22:03:37.633563+0000","last_fullsized":"2024-09-12T22:03:37.633563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:09.186165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949078+0000","last_change":"2024-09-12T22:03:33.458657+0000","last_active":"2024-09-12T22:03:36.949078+0000","last_peered":"2024-09-12T22:03:36.949078+0000","last_clean":"2024-09-12T22:03:36.949078+0000","last_became_active":"2024-09-12T22:03:33.458295+0000","last_became_peered":"2024-09-12T22:03:33.458295+0000","last_unstale":"2024-09-12T22:03:36.949078+0000","last_undegraded":"2024-09-12T22:03:36.949078+0000","last_fullsized":"2024-09-12T22:03:36.949078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:25.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633742+0000","last_change":"2024-09-12T22:03:30.343746+0000","last_active":"2024-09-12T22:03:37.633742+0000","last_peered":"2024-09-12T22:03:37.633742+0000","last_clean":"2024-09-12T22:03:37.633742+0000","last_became_active":"2024-09-12T22:03:28.335895+0000","last_became_peered":"2024-09-12T22:03:28.335895+0000","last_unstale":"2024-09-12T22:03:37.633742+0000","last_undegraded":"2024-09-12T22:03:37.633742+0000","last_fullsized":"2024-09-12T22:03:37.633742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.827420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070116600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948158+0000","last_change":"2024-09-12T22:03:32.461331+0000","last_active":"2024-09-12T22:03:36.948158+0000","last_peered":"2024-09-12T22:03:36.948158+0000","last_clean":"2024-09-12T22:03:36.948158+0000","last_became_active":"2024-09-12T22:03:32.460966+0000","last_became_peered":"2024-09-12T22:03:32.460966+0000","last_unstale":"2024-09-12T22:03:36.948158+0000","last_undegraded":"2024-09-12T22:03:36.948158+0000","last_fullsized":"2024-09-12T22:03:36.948158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:18.939990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634490+0000","last_change":"2024-09-12T22:03:33.458277+0000","last_active":"2024-09-12T22:03:37.634490+0000","last_peered":"2024-09-12T22:03:37.634490+0000","last_clean":"2024-09-12T22:03:37.634490+0000","last_became_active":"2024-09-12T22:03:33.457320+0000","last_became_peered":"2024-09-12T22:03:33.457320+0000","last_unstale":"2024-09-12T22:03:37.634490+0000","last_undegraded":"2024-09-12T22:03:37.634490+0000","last_fullsized":"2024-09-12T22:03:37.634490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:46.703481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120406+0000","last_change":"2024-09-12T22:03:30.339989+0000","last_active":"2024-09-12T22:03:38.120406+0000","last_peered":"2024-09-12T22:03:38.120406+0000","last_clean":"2024-09-12T22:03:38.120406+0000","last_became_active":"2024-09-12T22:03:28.335760+0000","last_became_peered":"2024-09-12T22:03:28.335760+0000","last_unstale":"2024-09-12T22:03:38.120406+0000","last_undegraded":"2024-09-12T22:03:38.120406+0000","last_fullsized":"2024-09-12T22:03:38.120406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:29.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120764+0000","last_change":"2024-09-12T22:03:32.456988+0000","last_active":"2024-09-12T22:03:38.120764+0000","last_peered":"2024-09-12T22:03:38.120764+0000","last_clean":"2024-09-12T22:03:38.120764+0000","last_became_active":"2024-09-12T22:03:32.456605+0000","last_became_peered":"2024-09-12T22:03:32.456605+0000","last_unstale":"2024-09-12T22:03:38.120764+0000","last_undegraded":"2024-09-12T22:03:38.120764+0000","last_fullsized":"2024-09-12T22:03:38.120764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:38.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634007+0000","last_change":"2024-09-12T22:03:33.458311+0000","last_active":"2024-09-12T22:03:37.634007+0000","last_peered":"2024-09-12T22:03:37.634007+0000","last_clean":"2024-09-12T22:03:37.634007+0000","last_became_active":"2024-09-12T22:03:33.456397+0000","last_became_peered":"2024-09-12T22:03:33.456397+0000","last_unstale":"2024-09-12T22:03:37.634007+0000","last_undegraded":"2024-09-12T22:03:37.634007+0000","last_fullsized":"2024-09-12T22:03:37.634007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:51.305559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121103+0000","last_change":"2024-09-12T22:03:32.457239+0000","last_active":"2024-09-12T22:03:38.121103+0000","last_peered":"2024-09-12T22:03:38.121103+0000","last_clean":"2024-09-12T22:03:38.121103+0000","last_became_active":"2024-09-12T22:03:32.456807+0000","last_became_peered":"2024-09-12T22:03:32.456807+0000","last_unstale":"2024-09-12T22:03:38.121103+0000","last_undegraded":"2024-09-12T22:03:38.121103+0000","last_fullsized":"2024-09-12T22:03:38.121103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:00.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634340+0000","last_change":"2024-09-12T22:03:30.343489+0000","last_active":"2024-09-12T22:03:37.634340+0000","last_peered":"2024-09-12T22:03:37.634340+0000","last_clean":"2024-09-12T22:03:37.634340+0000","last_became_active":"2024-09-12T22:03:28.335875+0000","last_became_peered":"2024-09-12T22:03:28.335875+0000","last_unstale":"2024-09-12T22:03:37.634340+0000","last_undegraded":"2024-09-12T22:03:37.634340+0000","last_fullsized":"2024-09-12T22:03:37.634340+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:34.561003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042932700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948531+0000","last_change":"2024-09-12T22:03:33.460944+0000","last_active":"2024-09-12T22:03:36.948531+0000","last_peered":"2024-09-12T22:03:36.948531+0000","last_clean":"2024-09-12T22:03:36.948531+0000","last_became_active":"2024-09-12T22:03:33.460514+0000","last_became_peered":"2024-09-12T22:03:33.460514+0000","last_unstale":"2024-09-12T22:03:36.948531+0000","last_undegraded":"2024-09-12T22:03:36.948531+0000","last_fullsized":"2024-09-12T22:03:36.948531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:54.744829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634252+0000","last_change":"2024-09-12T22:03:32.460055+0000","last_active":"2024-09-12T22:03:37.634252+0000","last_peered":"2024-09-12T22:03:37.634252+0000","last_clean":"2024-09-12T22:03:37.634252+0000","last_became_active":"2024-09-12T22:03:32.459276+0000","last_became_peered":"2024-09-12T22:03:32.459276+0000","last_unstale":"2024-09-12T22:03:37.634252+0000","last_undegraded":"2024-09-12T22:03:37.634252+0000","last_fullsized":"2024-09-12T22:03:37.634252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:23.776211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949211+0000","last_change":"2024-09-12T22:03:30.649265+0000","last_active":"2024-09-12T22:03:36.949211+0000","last_peered":"2024-09-12T22:03:36.949211+0000","last_clean":"2024-09-12T22:03:36.949211+0000","last_became_active":"2024-09-12T22:03:28.337193+0000","last_became_peered":"2024-09-12T22:03:28.337193+0000","last_unstale":"2024-09-12T22:03:36.949211+0000","last_undegraded":"2024-09-12T22:03:36.949211+0000","last_fullsized":"2024-09-12T22:03:36.949211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:43.899511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948515+0000","last_change":"2024-09-12T22:03:33.464893+0000","last_active":"2024-09-12T22:03:36.948515+0000","last_peered":"2024-09-12T22:03:36.948515+0000","last_clean":"2024-09-12T22:03:36.948515+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:03:36.948515+0000","last_undegraded":"2024-09-12T22:03:36.948515+0000","last_fullsized":"2024-09-12T22:03:36.948515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:47.948673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634814+0000","last_change":"2024-09-12T22:03:32.460426+0000","last_active":"2024-09-12T22:03:37.634814+0000","last_peered":"2024-09-12T22:03:37.634814+0000","last_clean":"2024-09-12T22:03:37.634814+0000","last_became_active":"2024-09-12T22:03:32.460161+0000","last_became_peered":"2024-09-12T22:03:32.460161+0000","last_unstale":"2024-09-12T22:03:37.634814+0000","last_undegraded":"2024-09-12T22:03:37.634814+0000","last_fullsized":"2024-09-12T22:03:37.634814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.472907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634952+0000","last_change":"2024-09-12T22:03:30.343485+0000","last_active":"2024-09-12T22:03:37.634952+0000","last_peered":"2024-09-12T22:03:37.634952+0000","last_clean":"2024-09-12T22:03:37.634952+0000","last_became_active":"2024-09-12T22:03:28.335961+0000","last_became_peered":"2024-09-12T22:03:28.335961+0000","last_unstale":"2024-09-12T22:03:37.634952+0000","last_undegraded":"2024-09-12T22:03:37.634952+0000","last_fullsized":"2024-09-12T22:03:37.634952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:24.041899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043906199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633375+0000","last_change":"2024-09-12T22:03:33.464709+0000","last_active":"2024-09-12T22:03:37.633375+0000","last_peered":"2024-09-12T22:03:37.633375+0000","last_clean":"2024-09-12T22:03:37.633375+0000","last_became_active":"2024-09-12T22:03:33.464016+0000","last_became_peered":"2024-09-12T22:03:33.464016+0000","last_unstale":"2024-09-12T22:03:37.633375+0000","last_undegraded":"2024-09-12T22:03:37.633375+0000","last_fullsized":"2024-09-12T22:03:37.633375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:07.598247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634893+0000","last_change":"2024-09-12T22:03:32.458014+0000","last_active":"2024-09-12T22:03:37.634893+0000","last_peered":"2024-09-12T22:03:37.634893+0000","last_clean":"2024-09-12T22:03:37.634893+0000","last_became_active":"2024-09-12T22:03:32.457654+0000","last_became_peered":"2024-09-12T22:03:32.457654+0000","last_unstale":"2024-09-12T22:03:37.634893+0000","last_undegraded":"2024-09-12T22:03:37.634893+0000","last_fullsized":"2024-09-12T22:03:37.634893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:08.446521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121056+0000","last_change":"2024-09-12T22:03:30.339817+0000","last_active":"2024-09-12T22:03:38.121056+0000","last_peered":"2024-09-12T22:03:38.121056+0000","last_clean":"2024-09-12T22:03:38.121056+0000","last_became_active":"2024-09-12T22:03:28.336599+0000","last_became_peered":"2024-09-12T22:03:28.336599+0000","last_unstale":"2024-09-12T22:03:38.121056+0000","last_undegraded":"2024-09-12T22:03:38.121056+0000","last_fullsized":"2024-09-12T22:03:38.121056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:36.442618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058522100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948215+0000","last_change":"2024-09-12T22:03:33.456975+0000","last_active":"2024-09-12T22:03:36.948215+0000","last_peered":"2024-09-12T22:03:36.948215+0000","last_clean":"2024-09-12T22:03:36.948215+0000","last_became_active":"2024-09-12T22:03:33.456611+0000","last_became_peered":"2024-09-12T22:03:33.456611+0000","last_unstale":"2024-09-12T22:03:36.948215+0000","last_undegraded":"2024-09-12T22:03:36.948215+0000","last_fullsized":"2024-09-12T22:03:36.948215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:46.309219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120544+0000","last_change":"2024-09-12T22:03:33.455671+0000","last_active":"2024-09-12T22:03:38.120544+0000","last_peered":"2024-09-12T22:03:38.120544+0000","last_clean":"2024-09-12T22:03:38.120544+0000","last_became_active":"2024-09-12T22:03:33.454833+0000","last_became_peered":"2024-09-12T22:03:33.454833+0000","last_unstale":"2024-09-12T22:03:38.120544+0000","last_undegraded":"2024-09-12T22:03:38.120544+0000","last_fullsized":"2024-09-12T22:03:38.120544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:08.773779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120513+0000","last_change":"2024-09-12T22:03:32.458296+0000","last_active":"2024-09-12T22:03:38.120513+0000","last_peered":"2024-09-12T22:03:38.120513+0000","last_clean":"2024-09-12T22:03:38.120513+0000","last_became_active":"2024-09-12T22:03:32.457908+0000","last_became_peered":"2024-09-12T22:03:32.457908+0000","last_unstale":"2024-09-12T22:03:38.120513+0000","last_undegraded":"2024-09-12T22:03:38.120513+0000","last_fullsized":"2024-09-12T22:03:38.120513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:53.758615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633547+0000","last_change":"2024-09-12T22:03:33.458365+0000","last_active":"2024-09-12T22:03:37.633547+0000","last_peered":"2024-09-12T22:03:37.633547+0000","last_clean":"2024-09-12T22:03:37.633547+0000","last_became_active":"2024-09-12T22:03:33.456256+0000","last_became_peered":"2024-09-12T22:03:33.456256+0000","last_unstale":"2024-09-12T22:03:37.633547+0000","last_undegraded":"2024-09-12T22:03:37.633547+0000","last_fullsized":"2024-09-12T22:03:37.633547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:12.145709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949119+0000","last_change":"2024-09-12T22:03:32.461509+0000","last_active":"2024-09-12T22:03:36.949119+0000","last_peered":"2024-09-12T22:03:36.949119+0000","last_clean":"2024-09-12T22:03:36.949119+0000","last_became_active":"2024-09-12T22:03:32.461161+0000","last_became_peered":"2024-09-12T22:03:32.461161+0000","last_unstale":"2024-09-12T22:03:36.949119+0000","last_undegraded":"2024-09-12T22:03:36.949119+0000","last_fullsized":"2024-09-12T22:03:36.949119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:02.888202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120809+0000","last_change":"2024-09-12T22:03:32.457458+0000","last_active":"2024-09-12T22:03:38.120809+0000","last_peered":"2024-09-12T22:03:38.120809+0000","last_clean":"2024-09-12T22:03:38.120809+0000","last_became_active":"2024-09-12T22:03:32.457007+0000","last_became_peered":"2024-09-12T22:03:32.457007+0000","last_unstale":"2024-09-12T22:03:38.120809+0000","last_undegraded":"2024-09-12T22:03:38.120809+0000","last_fullsized":"2024-09-12T22:03:38.120809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:08.474776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633334+0000","last_change":"2024-09-12T22:03:33.465561+0000","last_active":"2024-09-12T22:03:37.633334+0000","last_peered":"2024-09-12T22:03:37.633334+0000","last_clean":"2024-09-12T22:03:37.633334+0000","last_became_active":"2024-09-12T22:03:33.464837+0000","last_became_peered":"2024-09-12T22:03:33.464837+0000","last_unstale":"2024-09-12T22:03:37.633334+0000","last_undegraded":"2024-09-12T22:03:37.633334+0000","last_fullsized":"2024-09-12T22:03:37.633334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:32.859664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634692+0000","last_change":"2024-09-12T22:03:32.458964+0000","last_active":"2024-09-12T22:03:37.634692+0000","last_peered":"2024-09-12T22:03:37.634692+0000","last_clean":"2024-09-12T22:03:37.634692+0000","last_became_active":"2024-09-12T22:03:32.458346+0000","last_became_peered":"2024-09-12T22:03:32.458346+0000","last_unstale":"2024-09-12T22:03:37.634692+0000","last_undegraded":"2024-09-12T22:03:37.634692+0000","last_fullsized":"2024-09-12T22:03:37.634692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:37.178897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633336+0000","last_change":"2024-09-12T22:03:33.458060+0000","last_active":"2024-09-12T22:03:37.633336+0000","last_peered":"2024-09-12T22:03:37.633336+0000","last_clean":"2024-09-12T22:03:37.633336+0000","last_became_active":"2024-09-12T22:03:33.457390+0000","last_became_peered":"2024-09-12T22:03:33.457390+0000","last_unstale":"2024-09-12T22:03:37.633336+0000","last_undegraded":"2024-09-12T22:03:37.633336+0000","last_fullsized":"2024-09-12T22:03:37.633336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:14.711011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949306+0000","last_change":"2024-09-12T22:03:33.460177+0000","last_active":"2024-09-12T22:03:36.949306+0000","last_peered":"2024-09-12T22:03:36.949306+0000","last_clean":"2024-09-12T22:03:36.949306+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:03:36.949306+0000","last_undegraded":"2024-09-12T22:03:36.949306+0000","last_fullsized":"2024-09-12T22:03:36.949306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633492+0000","last_change":"2024-09-12T22:03:32.460441+0000","last_active":"2024-09-12T22:03:37.633492+0000","last_peered":"2024-09-12T22:03:37.633492+0000","last_clean":"2024-09-12T22:03:37.633492+0000","last_became_active":"2024-09-12T22:03:32.460126+0000","last_became_peered":"2024-09-12T22:03:32.460126+0000","last_unstale":"2024-09-12T22:03:37.633492+0000","last_undegraded":"2024-09-12T22:03:37.633492+0000","last_fullsized":"2024-09-12T22:03:37.633492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:52.150617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634575+0000","last_change":"2024-09-12T22:03:33.466167+0000","last_active":"2024-09-12T22:03:37.634575+0000","last_peered":"2024-09-12T22:03:37.634575+0000","last_clean":"2024-09-12T22:03:37.634575+0000","last_became_active":"2024-09-12T22:03:33.465116+0000","last_became_peered":"2024-09-12T22:03:33.465116+0000","last_unstale":"2024-09-12T22:03:37.634575+0000","last_undegraded":"2024-09-12T22:03:37.634575+0000","last_fullsized":"2024-09-12T22:03:37.634575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:19.683631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633484+0000","last_change":"2024-09-12T22:03:32.454262+0000","last_active":"2024-09-12T22:03:37.633484+0000","last_peered":"2024-09-12T22:03:37.633484+0000","last_clean":"2024-09-12T22:03:37.633484+0000","last_became_active":"2024-09-12T22:03:32.453776+0000","last_became_peered":"2024-09-12T22:03:32.453776+0000","last_unstale":"2024-09-12T22:03:37.633484+0000","last_undegraded":"2024-09-12T22:03:37.633484+0000","last_fullsized":"2024-09-12T22:03:37.633484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:57.091523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948901+0000","last_change":"2024-09-12T22:03:33.465186+0000","last_active":"2024-09-12T22:03:36.948901+0000","last_peered":"2024-09-12T22:03:36.948901+0000","last_clean":"2024-09-12T22:03:36.948901+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:03:36.948901+0000","last_undegraded":"2024-09-12T22:03:36.948901+0000","last_fullsized":"2024-09-12T22:03:36.948901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:29.409225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948624+0000","last_change":"2024-09-12T22:03:32.458132+0000","last_active":"2024-09-12T22:03:36.948624+0000","last_peered":"2024-09-12T22:03:36.948624+0000","last_clean":"2024-09-12T22:03:36.948624+0000","last_became_active":"2024-09-12T22:03:32.457817+0000","last_became_peered":"2024-09-12T22:03:32.457817+0000","last_unstale":"2024-09-12T22:03:36.948624+0000","last_undegraded":"2024-09-12T22:03:36.948624+0000","last_fullsized":"2024-09-12T22:03:36.948624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:47.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948638+0000","last_change":"2024-09-12T22:03:33.460730+0000","last_active":"2024-09-12T22:03:36.948638+0000","last_peered":"2024-09-12T22:03:36.948638+0000","last_clean":"2024-09-12T22:03:36.948638+0000","last_became_active":"2024-09-12T22:03:33.460223+0000","last_became_peered":"2024-09-12T22:03:33.460223+0000","last_unstale":"2024-09-12T22:03:36.948638+0000","last_undegraded":"2024-09-12T22:03:36.948638+0000","last_fullsized":"2024-09-12T22:03:36.948638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.406786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948595+0000","last_change":"2024-09-12T22:03:32.461243+0000","last_active":"2024-09-12T22:03:36.948595+0000","last_peered":"2024-09-12T22:03:36.948595+0000","last_clean":"2024-09-12T22:03:36.948595+0000","last_became_active":"2024-09-12T22:03:32.460760+0000","last_became_peered":"2024-09-12T22:03:32.460760+0000","last_unstale":"2024-09-12T22:03:36.948595+0000","last_undegraded":"2024-09-12T22:03:36.948595+0000","last_fullsized":"2024-09-12T22:03:36.948595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:42.848199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120422+0000","last_change":"2024-09-12T22:03:33.462764+0000","last_active":"2024-09-12T22:03:38.120422+0000","last_peered":"2024-09-12T22:03:38.120422+0000","last_clean":"2024-09-12T22:03:38.120422+0000","last_became_active":"2024-09-12T22:03:33.462360+0000","last_became_peered":"2024-09-12T22:03:33.462360+0000","last_unstale":"2024-09-12T22:03:38.120422+0000","last_undegraded":"2024-09-12T22:03:38.120422+0000","last_fullsized":"2024-09-12T22:03:38.120422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120443+0000","last_change":"2024-09-12T22:03:32.457280+0000","last_active":"2024-09-12T22:03:38.120443+0000","last_peered":"2024-09-12T22:03:38.120443+0000","last_clean":"2024-09-12T22:03:38.120443+0000","last_became_active":"2024-09-12T22:03:32.456812+0000","last_became_peered":"2024-09-12T22:03:32.456812+0000","last_unstale":"2024-09-12T22:03:38.120443+0000","last_undegraded":"2024-09-12T22:03:38.120443+0000","last_fullsized":"2024-09-12T22:03:38.120443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:46:51.143125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120065+0000","last_change":"2024-09-12T22:03:33.464094+0000","last_active":"2024-09-12T22:03:38.120065+0000","last_peered":"2024-09-12T22:03:38.120065+0000","last_clean":"2024-09-12T22:03:38.120065+0000","last_became_active":"2024-09-12T22:03:33.463380+0000","last_became_peered":"2024-09-12T22:03:33.463380+0000","last_unstale":"2024-09-12T22:03:38.120065+0000","last_undegraded":"2024-09-12T22:03:38.120065+0000","last_fullsized":"2024-09-12T22:03:38.120065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:11.422942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948983+0000","last_change":"2024-09-12T22:03:32.461230+0000","last_active":"2024-09-12T22:03:36.948983+0000","last_peered":"2024-09-12T22:03:36.948983+0000","last_clean":"2024-09-12T22:03:36.948983+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:03:36.948983+0000","last_undegraded":"2024-09-12T22:03:36.948983+0000","last_fullsized":"2024-09-12T22:03:36.948983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:16.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948424+0000","last_change":"2024-09-12T22:03:33.458634+0000","last_active":"2024-09-12T22:03:36.948424+0000","last_peered":"2024-09-12T22:03:36.948424+0000","last_clean":"2024-09-12T22:03:36.948424+0000","last_became_active":"2024-09-12T22:03:33.458096+0000","last_became_peered":"2024-09-12T22:03:33.458096+0000","last_unstale":"2024-09-12T22:03:36.948424+0000","last_undegraded":"2024-09-12T22:03:36.948424+0000","last_fullsized":"2024-09-12T22:03:36.948424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:09.702722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634795+0000","last_change":"2024-09-12T22:03:32.460314+0000","last_active":"2024-09-12T22:03:37.634795+0000","last_peered":"2024-09-12T22:03:37.634795+0000","last_clean":"2024-09-12T22:03:37.634795+0000","last_became_active":"2024-09-12T22:03:32.459890+0000","last_became_peered":"2024-09-12T22:03:32.459890+0000","last_unstale":"2024-09-12T22:03:37.634795+0000","last_undegraded":"2024-09-12T22:03:37.634795+0000","last_fullsized":"2024-09-12T22:03:37.634795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:00.774244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119819+0000","last_change":"2024-09-12T22:03:33.464082+0000","last_active":"2024-09-12T22:03:38.119819+0000","last_peered":"2024-09-12T22:03:38.119819+0000","last_clean":"2024-09-12T22:03:38.119819+0000","last_became_active":"2024-09-12T22:03:33.462648+0000","last_became_peered":"2024-09-12T22:03:33.462648+0000","last_unstale":"2024-09-12T22:03:38.119819+0000","last_undegraded":"2024-09-12T22:03:38.119819+0000","last_fullsized":"2024-09-12T22:03:38.119819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.466890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634610+0000","last_change":"2024-09-12T22:03:32.459293+0000","last_active":"2024-09-12T22:03:37.634610+0000","last_peered":"2024-09-12T22:03:37.634610+0000","last_clean":"2024-09-12T22:03:37.634610+0000","last_became_active":"2024-09-12T22:03:32.458679+0000","last_became_peered":"2024-09-12T22:03:32.458679+0000","last_unstale":"2024-09-12T22:03:37.634610+0000","last_undegraded":"2024-09-12T22:03:37.634610+0000","last_fullsized":"2024-09-12T22:03:37.634610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:21.083182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":798720,"data_stored":657780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36140,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335700,"statfs":{"total":96636764160,"available":96599756800,"internally_reserved":0,"allocated":811008,"data_stored":658415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35532,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336308,"statfs":{"total":96636764160,"available":96600379392,"internally_reserved":0,"allocated":192512,"data_stored":66253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:03:45.751 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:03:46.084 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:46.086 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:03:46.095 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T22:03:44.240836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":103636,"kb_used_data":1760,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":283011884,"statfs":{"total":289910292480,"available":289804169216,"internally_reserved":0,"allocated":1802240,"data_stored":1382448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.785339"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949228+0000","last_change":"2024-09-12T22:03:33.459321+0000","last_active":"2024-09-12T22:03:36.949228+0000","last_peered":"2024-09-12T22:03:36.949228+0000","last_clean":"2024-09-12T22:03:36.949228+0000","last_became_active":"2024-09-12T22:03:33.458897+0000","last_became_peered":"2024-09-12T22:03:33.458897+0000","last_unstale":"2024-09-12T22:03:36.949228+0000","last_undegraded":"2024-09-12T22:03:36.949228+0000","last_fullsized":"2024-09-12T22:03:36.949228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:20.716362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948961+0000","last_change":"2024-09-12T22:03:33.463659+0000","last_active":"2024-09-12T22:03:36.948961+0000","last_peered":"2024-09-12T22:03:36.948961+0000","last_clean":"2024-09-12T22:03:36.948961+0000","last_became_active":"2024-09-12T22:03:33.463296+0000","last_became_peered":"2024-09-12T22:03:33.463296+0000","last_unstale":"2024-09-12T22:03:36.948961+0000","last_undegraded":"2024-09-12T22:03:36.948961+0000","last_fullsized":"2024-09-12T22:03:36.948961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:10.270667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120413+0000","last_change":"2024-09-12T22:03:33.462148+0000","last_active":"2024-09-12T22:03:38.120413+0000","last_peered":"2024-09-12T22:03:38.120413+0000","last_clean":"2024-09-12T22:03:38.120413+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:03:38.120413+0000","last_undegraded":"2024-09-12T22:03:38.120413+0000","last_fullsized":"2024-09-12T22:03:38.120413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:36.909948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120215+0000","last_change":"2024-09-12T22:03:33.464418+0000","last_active":"2024-09-12T22:03:38.120215+0000","last_peered":"2024-09-12T22:03:38.120215+0000","last_clean":"2024-09-12T22:03:38.120215+0000","last_became_active":"2024-09-12T22:03:33.463811+0000","last_became_peered":"2024-09-12T22:03:33.463811+0000","last_unstale":"2024-09-12T22:03:38.120215+0000","last_undegraded":"2024-09-12T22:03:38.120215+0000","last_fullsized":"2024-09-12T22:03:38.120215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:48.374991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948625+0000","last_change":"2024-09-12T22:03:33.459995+0000","last_active":"2024-09-12T22:03:36.948625+0000","last_peered":"2024-09-12T22:03:36.948625+0000","last_clean":"2024-09-12T22:03:36.948625+0000","last_became_active":"2024-09-12T22:03:33.459653+0000","last_became_peered":"2024-09-12T22:03:33.459653+0000","last_unstale":"2024-09-12T22:03:36.948625+0000","last_undegraded":"2024-09-12T22:03:36.948625+0000","last_fullsized":"2024-09-12T22:03:36.948625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:15.288581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119840+0000","last_change":"2024-09-12T22:03:33.464646+0000","last_active":"2024-09-12T22:03:38.119840+0000","last_peered":"2024-09-12T22:03:38.119840+0000","last_clean":"2024-09-12T22:03:38.119840+0000","last_became_active":"2024-09-12T22:03:33.463793+0000","last_became_peered":"2024-09-12T22:03:33.463793+0000","last_unstale":"2024-09-12T22:03:38.119840+0000","last_undegraded":"2024-09-12T22:03:38.119840+0000","last_fullsized":"2024-09-12T22:03:38.119840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.153436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119951+0000","last_change":"2024-09-12T22:03:33.463183+0000","last_active":"2024-09-12T22:03:38.119951+0000","last_peered":"2024-09-12T22:03:38.119951+0000","last_clean":"2024-09-12T22:03:38.119951+0000","last_became_active":"2024-09-12T22:03:33.462752+0000","last_became_peered":"2024-09-12T22:03:33.462752+0000","last_unstale":"2024-09-12T22:03:38.119951+0000","last_undegraded":"2024-09-12T22:03:38.119951+0000","last_fullsized":"2024-09-12T22:03:38.119951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:25.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119620+0000","last_change":"2024-09-12T22:03:33.465552+0000","last_active":"2024-09-12T22:03:38.119620+0000","last_peered":"2024-09-12T22:03:38.119620+0000","last_clean":"2024-09-12T22:03:38.119620+0000","last_became_active":"2024-09-12T22:03:33.464745+0000","last_became_peered":"2024-09-12T22:03:33.464745+0000","last_unstale":"2024-09-12T22:03:38.119620+0000","last_undegraded":"2024-09-12T22:03:38.119620+0000","last_fullsized":"2024-09-12T22:03:38.119620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:42.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634348+0000","last_change":"2024-09-12T22:03:33.461075+0000","last_active":"2024-09-12T22:03:37.634348+0000","last_peered":"2024-09-12T22:03:37.634348+0000","last_clean":"2024-09-12T22:03:37.634348+0000","last_became_active":"2024-09-12T22:03:33.459892+0000","last_became_peered":"2024-09-12T22:03:33.459892+0000","last_unstale":"2024-09-12T22:03:37.634348+0000","last_undegraded":"2024-09-12T22:03:37.634348+0000","last_fullsized":"2024-09-12T22:03:37.634348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:25.087808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949026+0000","last_change":"2024-09-12T22:03:33.459292+0000","last_active":"2024-09-12T22:03:36.949026+0000","last_peered":"2024-09-12T22:03:36.949026+0000","last_clean":"2024-09-12T22:03:36.949026+0000","last_became_active":"2024-09-12T22:03:33.458956+0000","last_became_peered":"2024-09-12T22:03:33.458956+0000","last_unstale":"2024-09-12T22:03:36.949026+0000","last_undegraded":"2024-09-12T22:03:36.949026+0000","last_fullsized":"2024-09-12T22:03:36.949026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.153436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120553+0000","last_change":"2024-09-12T22:03:33.464766+0000","last_active":"2024-09-12T22:03:38.120553+0000","last_peered":"2024-09-12T22:03:38.120553+0000","last_clean":"2024-09-12T22:03:38.120553+0000","last_became_active":"2024-09-12T22:03:33.463545+0000","last_became_peered":"2024-09-12T22:03:33.463545+0000","last_unstale":"2024-09-12T22:03:38.120553+0000","last_undegraded":"2024-09-12T22:03:38.120553+0000","last_fullsized":"2024-09-12T22:03:38.120553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:27.861352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948602+0000","last_change":"2024-09-12T22:03:33.465069+0000","last_active":"2024-09-12T22:03:36.948602+0000","last_peered":"2024-09-12T22:03:36.948602+0000","last_clean":"2024-09-12T22:03:36.948602+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:03:36.948602+0000","last_undegraded":"2024-09-12T22:03:36.948602+0000","last_fullsized":"2024-09-12T22:03:36.948602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948404+0000","last_change":"2024-09-12T22:03:33.458519+0000","last_active":"2024-09-12T22:03:36.948404+0000","last_peered":"2024-09-12T22:03:36.948404+0000","last_clean":"2024-09-12T22:03:36.948404+0000","last_became_active":"2024-09-12T22:03:33.458138+0000","last_became_peered":"2024-09-12T22:03:33.458138+0000","last_unstale":"2024-09-12T22:03:36.948404+0000","last_undegraded":"2024-09-12T22:03:36.948404+0000","last_fullsized":"2024-09-12T22:03:36.948404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:18.784928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119916+0000","last_change":"2024-09-12T22:03:33.457584+0000","last_active":"2024-09-12T22:03:38.119916+0000","last_peered":"2024-09-12T22:03:38.119916+0000","last_clean":"2024-09-12T22:03:38.119916+0000","last_became_active":"2024-09-12T22:03:33.456732+0000","last_became_peered":"2024-09-12T22:03:33.456732+0000","last_unstale":"2024-09-12T22:03:38.119916+0000","last_undegraded":"2024-09-12T22:03:38.119916+0000","last_fullsized":"2024-09-12T22:03:38.119916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:20.716362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120012+0000","last_change":"2024-09-12T22:03:33.455903+0000","last_active":"2024-09-12T22:03:38.120012+0000","last_peered":"2024-09-12T22:03:38.120012+0000","last_clean":"2024-09-12T22:03:38.120012+0000","last_became_active":"2024-09-12T22:03:33.455399+0000","last_became_peered":"2024-09-12T22:03:33.455399+0000","last_unstale":"2024-09-12T22:03:38.120012+0000","last_undegraded":"2024-09-12T22:03:38.120012+0000","last_fullsized":"2024-09-12T22:03:38.120012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:06.785269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119637+0000","last_change":"2024-09-12T22:03:33.465252+0000","last_active":"2024-09-12T22:03:38.119637+0000","last_peered":"2024-09-12T22:03:38.119637+0000","last_clean":"2024-09-12T22:03:38.119637+0000","last_became_active":"2024-09-12T22:03:33.464524+0000","last_became_peered":"2024-09-12T22:03:33.464524+0000","last_unstale":"2024-09-12T22:03:38.119637+0000","last_undegraded":"2024-09-12T22:03:38.119637+0000","last_fullsized":"2024-09-12T22:03:38.119637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.406786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634727+0000","last_change":"2024-09-12T22:03:33.457075+0000","last_active":"2024-09-12T22:03:37.634727+0000","last_peered":"2024-09-12T22:03:37.634727+0000","last_clean":"2024-09-12T22:03:37.634727+0000","last_became_active":"2024-09-12T22:03:33.456463+0000","last_became_peered":"2024-09-12T22:03:33.456463+0000","last_unstale":"2024-09-12T22:03:37.634727+0000","last_undegraded":"2024-09-12T22:03:37.634727+0000","last_fullsized":"2024-09-12T22:03:37.634727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:40.945193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949187+0000","last_change":"2024-09-12T22:03:33.463614+0000","last_active":"2024-09-12T22:03:36.949187+0000","last_peered":"2024-09-12T22:03:36.949187+0000","last_clean":"2024-09-12T22:03:36.949187+0000","last_became_active":"2024-09-12T22:03:33.463245+0000","last_became_peered":"2024-09-12T22:03:33.463245+0000","last_unstale":"2024-09-12T22:03:36.949187+0000","last_undegraded":"2024-09-12T22:03:36.949187+0000","last_fullsized":"2024-09-12T22:03:36.949187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:11.422942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634149+0000","last_change":"2024-09-12T22:03:33.457934+0000","last_active":"2024-09-12T22:03:37.634149+0000","last_peered":"2024-09-12T22:03:37.634149+0000","last_clean":"2024-09-12T22:03:37.634149+0000","last_became_active":"2024-09-12T22:03:33.457458+0000","last_became_peered":"2024-09-12T22:03:33.457458+0000","last_unstale":"2024-09-12T22:03:37.634149+0000","last_undegraded":"2024-09-12T22:03:37.634149+0000","last_fullsized":"2024-09-12T22:03:37.634149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:32.748239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120307+0000","last_change":"2024-09-12T22:03:33.464118+0000","last_active":"2024-09-12T22:03:38.120307+0000","last_peered":"2024-09-12T22:03:38.120307+0000","last_clean":"2024-09-12T22:03:38.120307+0000","last_became_active":"2024-09-12T22:03:33.463243+0000","last_became_peered":"2024-09-12T22:03:33.463243+0000","last_unstale":"2024-09-12T22:03:38.120307+0000","last_undegraded":"2024-09-12T22:03:38.120307+0000","last_fullsized":"2024-09-12T22:03:38.120307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:34.450477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120288+0000","last_change":"2024-09-12T22:03:33.465705+0000","last_active":"2024-09-12T22:03:38.120288+0000","last_peered":"2024-09-12T22:03:38.120288+0000","last_clean":"2024-09-12T22:03:38.120288+0000","last_became_active":"2024-09-12T22:03:33.465207+0000","last_became_peered":"2024-09-12T22:03:33.465207+0000","last_unstale":"2024-09-12T22:03:38.120288+0000","last_undegraded":"2024-09-12T22:03:38.120288+0000","last_fullsized":"2024-09-12T22:03:38.120288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.780572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948470+0000","last_change":"2024-09-12T22:03:33.460994+0000","last_active":"2024-09-12T22:03:36.948470+0000","last_peered":"2024-09-12T22:03:36.948470+0000","last_clean":"2024-09-12T22:03:36.948470+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:03:36.948470+0000","last_undegraded":"2024-09-12T22:03:36.948470+0000","last_fullsized":"2024-09-12T22:03:36.948470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:20.363291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633254+0000","last_change":"2024-09-12T22:03:33.466950+0000","last_active":"2024-09-12T22:03:37.633254+0000","last_peered":"2024-09-12T22:03:37.633254+0000","last_clean":"2024-09-12T22:03:37.633254+0000","last_became_active":"2024-09-12T22:03:33.466609+0000","last_became_peered":"2024-09-12T22:03:33.466609+0000","last_unstale":"2024-09-12T22:03:37.633254+0000","last_undegraded":"2024-09-12T22:03:37.633254+0000","last_fullsized":"2024-09-12T22:03:37.633254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:34.396185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948002+0000","last_change":"2024-09-12T22:03:33.460375+0000","last_active":"2024-09-12T22:03:36.948002+0000","last_peered":"2024-09-12T22:03:36.948002+0000","last_clean":"2024-09-12T22:03:36.948002+0000","last_became_active":"2024-09-12T22:03:33.459687+0000","last_became_peered":"2024-09-12T22:03:33.459687+0000","last_unstale":"2024-09-12T22:03:36.948002+0000","last_undegraded":"2024-09-12T22:03:36.948002+0000","last_fullsized":"2024-09-12T22:03:36.948002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:34.897642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949272+0000","last_change":"2024-09-12T22:03:33.456508+0000","last_active":"2024-09-12T22:03:36.949272+0000","last_peered":"2024-09-12T22:03:36.949272+0000","last_clean":"2024-09-12T22:03:36.949272+0000","last_became_active":"2024-09-12T22:03:33.456189+0000","last_became_peered":"2024-09-12T22:03:33.456189+0000","last_unstale":"2024-09-12T22:03:36.949272+0000","last_undegraded":"2024-09-12T22:03:36.949272+0000","last_fullsized":"2024-09-12T22:03:36.949272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.466890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634563+0000","last_change":"2024-09-12T22:03:33.465866+0000","last_active":"2024-09-12T22:03:37.634563+0000","last_peered":"2024-09-12T22:03:37.634563+0000","last_clean":"2024-09-12T22:03:37.634563+0000","last_became_active":"2024-09-12T22:03:33.464254+0000","last_became_peered":"2024-09-12T22:03:33.464254+0000","last_unstale":"2024-09-12T22:03:37.634563+0000","last_undegraded":"2024-09-12T22:03:37.634563+0000","last_fullsized":"2024-09-12T22:03:37.634563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:51.045864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120695+0000","last_change":"2024-09-12T22:03:33.461282+0000","last_active":"2024-09-12T22:03:38.120695+0000","last_peered":"2024-09-12T22:03:38.120695+0000","last_clean":"2024-09-12T22:03:38.120695+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:03:38.120695+0000","last_undegraded":"2024-09-12T22:03:38.120695+0000","last_fullsized":"2024-09-12T22:03:38.120695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:32.302716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948773+0000","last_change":"2024-09-12T22:03:33.467229+0000","last_active":"2024-09-12T22:03:36.948773+0000","last_peered":"2024-09-12T22:03:36.948773+0000","last_clean":"2024-09-12T22:03:36.948773+0000","last_became_active":"2024-09-12T22:03:33.464691+0000","last_became_peered":"2024-09-12T22:03:33.464691+0000","last_unstale":"2024-09-12T22:03:36.948773+0000","last_undegraded":"2024-09-12T22:03:36.948773+0000","last_fullsized":"2024-09-12T22:03:36.948773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.780572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634065+0000","last_change":"2024-09-12T22:03:33.460674+0000","last_active":"2024-09-12T22:03:37.634065+0000","last_peered":"2024-09-12T22:03:37.634065+0000","last_clean":"2024-09-12T22:03:37.634065+0000","last_became_active":"2024-09-12T22:03:33.458902+0000","last_became_peered":"2024-09-12T22:03:33.458902+0000","last_unstale":"2024-09-12T22:03:37.634065+0000","last_undegraded":"2024-09-12T22:03:37.634065+0000","last_fullsized":"2024-09-12T22:03:37.634065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:01.247039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948605+0000","last_change":"2024-09-12T22:03:33.456842+0000","last_active":"2024-09-12T22:03:36.948605+0000","last_peered":"2024-09-12T22:03:36.948605+0000","last_clean":"2024-09-12T22:03:36.948605+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:03:36.948605+0000","last_undegraded":"2024-09-12T22:03:36.948605+0000","last_fullsized":"2024-09-12T22:03:36.948605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:56.383351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633245+0000","last_change":"2024-09-12T22:03:33.459380+0000","last_active":"2024-09-12T22:03:37.633245+0000","last_peered":"2024-09-12T22:03:37.633245+0000","last_clean":"2024-09-12T22:03:37.633245+0000","last_became_active":"2024-09-12T22:03:33.458357+0000","last_became_peered":"2024-09-12T22:03:33.458357+0000","last_unstale":"2024-09-12T22:03:37.633245+0000","last_undegraded":"2024-09-12T22:03:37.633245+0000","last_fullsized":"2024-09-12T22:03:37.633245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:15.811200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119698+0000","last_change":"2024-09-12T22:03:33.463134+0000","last_active":"2024-09-12T22:03:38.119698+0000","last_peered":"2024-09-12T22:03:38.119698+0000","last_clean":"2024-09-12T22:03:38.119698+0000","last_became_active":"2024-09-12T22:03:33.462566+0000","last_became_peered":"2024-09-12T22:03:33.462566+0000","last_unstale":"2024-09-12T22:03:38.119698+0000","last_undegraded":"2024-09-12T22:03:38.119698+0000","last_fullsized":"2024-09-12T22:03:38.119698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:48.428755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948711+0000","last_change":"2024-09-12T22:03:33.460277+0000","last_active":"2024-09-12T22:03:36.948711+0000","last_peered":"2024-09-12T22:03:36.948711+0000","last_clean":"2024-09-12T22:03:36.948711+0000","last_became_active":"2024-09-12T22:03:33.459696+0000","last_became_peered":"2024-09-12T22:03:33.459696+0000","last_unstale":"2024-09-12T22:03:36.948711+0000","last_undegraded":"2024-09-12T22:03:36.948711+0000","last_fullsized":"2024-09-12T22:03:36.948711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:42.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120607+0000","last_change":"2024-09-12T22:03:32.457419+0000","last_active":"2024-09-12T22:03:38.120607+0000","last_peered":"2024-09-12T22:03:38.120607+0000","last_clean":"2024-09-12T22:03:38.120607+0000","last_became_active":"2024-09-12T22:03:32.456846+0000","last_became_peered":"2024-09-12T22:03:32.456846+0000","last_unstale":"2024-09-12T22:03:38.120607+0000","last_undegraded":"2024-09-12T22:03:38.120607+0000","last_fullsized":"2024-09-12T22:03:38.120607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:55.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949001+0000","last_change":"2024-09-12T22:03:33.458607+0000","last_active":"2024-09-12T22:03:36.949001+0000","last_peered":"2024-09-12T22:03:36.949001+0000","last_clean":"2024-09-12T22:03:36.949001+0000","last_became_active":"2024-09-12T22:03:33.457815+0000","last_became_peered":"2024-09-12T22:03:33.457815+0000","last_unstale":"2024-09-12T22:03:36.949001+0000","last_undegraded":"2024-09-12T22:03:36.949001+0000","last_fullsized":"2024-09-12T22:03:36.949001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:48.428755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633671+0000","last_change":"2024-09-12T22:03:32.458436+0000","last_active":"2024-09-12T22:03:37.633671+0000","last_peered":"2024-09-12T22:03:37.633671+0000","last_clean":"2024-09-12T22:03:37.633671+0000","last_became_active":"2024-09-12T22:03:32.457647+0000","last_became_peered":"2024-09-12T22:03:32.457647+0000","last_unstale":"2024-09-12T22:03:37.633671+0000","last_undegraded":"2024-09-12T22:03:37.633671+0000","last_fullsized":"2024-09-12T22:03:37.633671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:57.394698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634795+0000","last_change":"2024-09-12T22:03:33.466388+0000","last_active":"2024-09-12T22:03:37.634795+0000","last_peered":"2024-09-12T22:03:37.634795+0000","last_clean":"2024-09-12T22:03:37.634795+0000","last_became_active":"2024-09-12T22:03:33.464101+0000","last_became_peered":"2024-09-12T22:03:33.464101+0000","last_unstale":"2024-09-12T22:03:37.634795+0000","last_undegraded":"2024-09-12T22:03:37.634795+0000","last_fullsized":"2024-09-12T22:03:37.634795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:39:52.512160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948250+0000","last_change":"2024-09-12T22:03:32.461341+0000","last_active":"2024-09-12T22:03:36.948250+0000","last_peered":"2024-09-12T22:03:36.948250+0000","last_clean":"2024-09-12T22:03:36.948250+0000","last_became_active":"2024-09-12T22:03:32.460840+0000","last_became_peered":"2024-09-12T22:03:32.460840+0000","last_unstale":"2024-09-12T22:03:36.948250+0000","last_undegraded":"2024-09-12T22:03:36.948250+0000","last_fullsized":"2024-09-12T22:03:36.948250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:08.751696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634330+0000","last_change":"2024-09-12T22:03:33.464983+0000","last_active":"2024-09-12T22:03:37.634330+0000","last_peered":"2024-09-12T22:03:37.634330+0000","last_clean":"2024-09-12T22:03:37.634330+0000","last_became_active":"2024-09-12T22:03:33.464497+0000","last_became_peered":"2024-09-12T22:03:33.464497+0000","last_unstale":"2024-09-12T22:03:37.634330+0000","last_undegraded":"2024-09-12T22:03:37.634330+0000","last_fullsized":"2024-09-12T22:03:37.634330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:20.643181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119729+0000","last_change":"2024-09-12T22:03:32.453200+0000","last_active":"2024-09-12T22:03:38.119729+0000","last_peered":"2024-09-12T22:03:38.119729+0000","last_clean":"2024-09-12T22:03:38.119729+0000","last_became_active":"2024-09-12T22:03:32.452937+0000","last_became_peered":"2024-09-12T22:03:32.452937+0000","last_unstale":"2024-09-12T22:03:38.119729+0000","last_undegraded":"2024-09-12T22:03:38.119729+0000","last_fullsized":"2024-09-12T22:03:38.119729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:37.122599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120976+0000","last_change":"2024-09-12T22:03:32.458776+0000","last_active":"2024-09-12T22:03:38.120976+0000","last_peered":"2024-09-12T22:03:38.120976+0000","last_clean":"2024-09-12T22:03:38.120976+0000","last_became_active":"2024-09-12T22:03:32.458223+0000","last_became_peered":"2024-09-12T22:03:32.458223+0000","last_unstale":"2024-09-12T22:03:38.120976+0000","last_undegraded":"2024-09-12T22:03:38.120976+0000","last_fullsized":"2024-09-12T22:03:38.120976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:25.999548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948060+0000","last_change":"2024-09-12T22:03:33.465308+0000","last_active":"2024-09-12T22:03:36.948060+0000","last_peered":"2024-09-12T22:03:36.948060+0000","last_clean":"2024-09-12T22:03:36.948060+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:03:36.948060+0000","last_undegraded":"2024-09-12T22:03:36.948060+0000","last_fullsized":"2024-09-12T22:03:36.948060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:35.733622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949175+0000","last_change":"2024-09-12T22:03:32.461301+0000","last_active":"2024-09-12T22:03:36.949175+0000","last_peered":"2024-09-12T22:03:36.949175+0000","last_clean":"2024-09-12T22:03:36.949175+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:03:36.949175+0000","last_undegraded":"2024-09-12T22:03:36.949175+0000","last_fullsized":"2024-09-12T22:03:36.949175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:39.872272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948189+0000","last_change":"2024-09-12T22:03:33.458592+0000","last_active":"2024-09-12T22:03:36.948189+0000","last_peered":"2024-09-12T22:03:36.948189+0000","last_clean":"2024-09-12T22:03:36.948189+0000","last_became_active":"2024-09-12T22:03:33.458077+0000","last_became_peered":"2024-09-12T22:03:33.458077+0000","last_unstale":"2024-09-12T22:03:36.948189+0000","last_undegraded":"2024-09-12T22:03:36.948189+0000","last_fullsized":"2024-09-12T22:03:36.948189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.333348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121065+0000","last_change":"2024-09-12T22:03:32.459540+0000","last_active":"2024-09-12T22:03:38.121065+0000","last_peered":"2024-09-12T22:03:38.121065+0000","last_clean":"2024-09-12T22:03:38.121065+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:03:38.121065+0000","last_undegraded":"2024-09-12T22:03:38.121065+0000","last_fullsized":"2024-09-12T22:03:38.121065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:22.143242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120192+0000","last_change":"2024-09-12T22:03:33.464832+0000","last_active":"2024-09-12T22:03:38.120192+0000","last_peered":"2024-09-12T22:03:38.120192+0000","last_clean":"2024-09-12T22:03:38.120192+0000","last_became_active":"2024-09-12T22:03:33.463400+0000","last_became_peered":"2024-09-12T22:03:33.463400+0000","last_unstale":"2024-09-12T22:03:38.120192+0000","last_undegraded":"2024-09-12T22:03:38.120192+0000","last_fullsized":"2024-09-12T22:03:38.120192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:11:53.438877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120596+0000","last_change":"2024-09-12T22:03:32.456243+0000","last_active":"2024-09-12T22:03:38.120596+0000","last_peered":"2024-09-12T22:03:38.120596+0000","last_clean":"2024-09-12T22:03:38.120596+0000","last_became_active":"2024-09-12T22:03:32.455840+0000","last_became_peered":"2024-09-12T22:03:32.455840+0000","last_unstale":"2024-09-12T22:03:38.120596+0000","last_undegraded":"2024-09-12T22:03:38.120596+0000","last_fullsized":"2024-09-12T22:03:38.120596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:47.319431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633986+0000","last_change":"2024-09-12T22:03:33.465572+0000","last_active":"2024-09-12T22:03:37.633986+0000","last_peered":"2024-09-12T22:03:37.633986+0000","last_clean":"2024-09-12T22:03:37.633986+0000","last_became_active":"2024-09-12T22:03:33.465000+0000","last_became_peered":"2024-09-12T22:03:33.465000+0000","last_unstale":"2024-09-12T22:03:37.633986+0000","last_undegraded":"2024-09-12T22:03:37.633986+0000","last_fullsized":"2024-09-12T22:03:37.633986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:37.418482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634361+0000","last_change":"2024-09-12T22:03:32.458041+0000","last_active":"2024-09-12T22:03:37.634361+0000","last_peered":"2024-09-12T22:03:37.634361+0000","last_clean":"2024-09-12T22:03:37.634361+0000","last_became_active":"2024-09-12T22:03:32.457583+0000","last_became_peered":"2024-09-12T22:03:32.457583+0000","last_unstale":"2024-09-12T22:03:37.634361+0000","last_undegraded":"2024-09-12T22:03:37.634361+0000","last_fullsized":"2024-09-12T22:03:37.634361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:15.688344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120351+0000","last_change":"2024-09-12T22:03:33.462786+0000","last_active":"2024-09-12T22:03:38.120351+0000","last_peered":"2024-09-12T22:03:38.120351+0000","last_clean":"2024-09-12T22:03:38.120351+0000","last_became_active":"2024-09-12T22:03:33.462488+0000","last_became_peered":"2024-09-12T22:03:33.462488+0000","last_unstale":"2024-09-12T22:03:38.120351+0000","last_undegraded":"2024-09-12T22:03:38.120351+0000","last_fullsized":"2024-09-12T22:03:38.120351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:24.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120200+0000","last_change":"2024-09-12T22:03:32.457448+0000","last_active":"2024-09-12T22:03:38.120200+0000","last_peered":"2024-09-12T22:03:38.120200+0000","last_clean":"2024-09-12T22:03:38.120200+0000","last_became_active":"2024-09-12T22:03:32.457013+0000","last_became_peered":"2024-09-12T22:03:32.457013+0000","last_unstale":"2024-09-12T22:03:38.120200+0000","last_undegraded":"2024-09-12T22:03:38.120200+0000","last_fullsized":"2024-09-12T22:03:38.120200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:27.694073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120791+0000","last_change":"2024-09-12T22:03:33.459084+0000","last_active":"2024-09-12T22:03:38.120791+0000","last_peered":"2024-09-12T22:03:38.120791+0000","last_clean":"2024-09-12T22:03:38.120791+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:03:38.120791+0000","last_undegraded":"2024-09-12T22:03:38.120791+0000","last_fullsized":"2024-09-12T22:03:38.120791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:50.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948293+0000","last_change":"2024-09-12T22:03:32.461417+0000","last_active":"2024-09-12T22:03:36.948293+0000","last_peered":"2024-09-12T22:03:36.948293+0000","last_clean":"2024-09-12T22:03:36.948293+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:03:36.948293+0000","last_undegraded":"2024-09-12T22:03:36.948293+0000","last_fullsized":"2024-09-12T22:03:36.948293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:22.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120631+0000","last_change":"2024-09-12T22:03:33.457927+0000","last_active":"2024-09-12T22:03:38.120631+0000","last_peered":"2024-09-12T22:03:38.120631+0000","last_clean":"2024-09-12T22:03:38.120631+0000","last_became_active":"2024-09-12T22:03:33.457548+0000","last_became_peered":"2024-09-12T22:03:33.457548+0000","last_unstale":"2024-09-12T22:03:38.120631+0000","last_undegraded":"2024-09-12T22:03:38.120631+0000","last_fullsized":"2024-09-12T22:03:38.120631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:17.407499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948139+0000","last_change":"2024-09-12T22:03:32.458122+0000","last_active":"2024-09-12T22:03:36.948139+0000","last_peered":"2024-09-12T22:03:36.948139+0000","last_clean":"2024-09-12T22:03:36.948139+0000","last_became_active":"2024-09-12T22:03:32.457812+0000","last_became_peered":"2024-09-12T22:03:32.457812+0000","last_unstale":"2024-09-12T22:03:36.948139+0000","last_undegraded":"2024-09-12T22:03:36.948139+0000","last_fullsized":"2024-09-12T22:03:36.948139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:33.359519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634486+0000","last_change":"2024-09-12T22:03:33.459649+0000","last_active":"2024-09-12T22:03:37.634486+0000","last_peered":"2024-09-12T22:03:37.634486+0000","last_clean":"2024-09-12T22:03:37.634486+0000","last_became_active":"2024-09-12T22:03:33.458085+0000","last_became_peered":"2024-09-12T22:03:33.458085+0000","last_unstale":"2024-09-12T22:03:37.634486+0000","last_undegraded":"2024-09-12T22:03:37.634486+0000","last_fullsized":"2024-09-12T22:03:37.634486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:56.693491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119963+0000","last_change":"2024-09-12T22:03:23.315624+0000","last_active":"2024-09-12T22:03:38.119963+0000","last_peered":"2024-09-12T22:03:38.119963+0000","last_clean":"2024-09-12T22:03:38.119963+0000","last_became_active":"2024-09-12T22:03:23.315346+0000","last_became_peered":"2024-09-12T22:03:23.315346+0000","last_unstale":"2024-09-12T22:03:38.119963+0000","last_undegraded":"2024-09-12T22:03:38.119963+0000","last_fullsized":"2024-09-12T22:03:38.119963+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:15.864121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":30,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120853+0000","last_change":"2024-09-12T22:03:30.339678+0000","last_active":"2024-09-12T22:03:38.120853+0000","last_peered":"2024-09-12T22:03:38.120853+0000","last_clean":"2024-09-12T22:03:38.120853+0000","last_became_active":"2024-09-12T22:03:28.335855+0000","last_became_peered":"2024-09-12T22:03:28.335855+0000","last_unstale":"2024-09-12T22:03:38.120853+0000","last_undegraded":"2024-09-12T22:03:38.120853+0000","last_fullsized":"2024-09-12T22:03:38.120853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:11.750803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633792+0000","last_change":"2024-09-12T22:03:32.459986+0000","last_active":"2024-09-12T22:03:37.633792+0000","last_peered":"2024-09-12T22:03:37.633792+0000","last_clean":"2024-09-12T22:03:37.633792+0000","last_became_active":"2024-09-12T22:03:32.459353+0000","last_became_peered":"2024-09-12T22:03:32.459353+0000","last_unstale":"2024-09-12T22:03:37.633792+0000","last_undegraded":"2024-09-12T22:03:37.633792+0000","last_fullsized":"2024-09-12T22:03:37.633792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:57.496962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120952+0000","last_change":"2024-09-12T22:03:33.460477+0000","last_active":"2024-09-12T22:03:38.120952+0000","last_peered":"2024-09-12T22:03:38.120952+0000","last_clean":"2024-09-12T22:03:38.120952+0000","last_became_active":"2024-09-12T22:03:33.459433+0000","last_became_peered":"2024-09-12T22:03:33.459433+0000","last_unstale":"2024-09-12T22:03:38.120952+0000","last_undegraded":"2024-09-12T22:03:38.120952+0000","last_fullsized":"2024-09-12T22:03:38.120952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:15.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119960+0000","last_change":"2024-09-12T22:03:30.339569+0000","last_active":"2024-09-12T22:03:38.119960+0000","last_peered":"2024-09-12T22:03:38.119960+0000","last_clean":"2024-09-12T22:03:38.119960+0000","last_became_active":"2024-09-12T22:03:28.336643+0000","last_became_peered":"2024-09-12T22:03:28.336643+0000","last_unstale":"2024-09-12T22:03:38.119960+0000","last_undegraded":"2024-09-12T22:03:38.119960+0000","last_fullsized":"2024-09-12T22:03:38.119960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:56.968092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039518000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633563+0000","last_change":"2024-09-12T22:03:32.454155+0000","last_active":"2024-09-12T22:03:37.633563+0000","last_peered":"2024-09-12T22:03:37.633563+0000","last_clean":"2024-09-12T22:03:37.633563+0000","last_became_active":"2024-09-12T22:03:32.453733+0000","last_became_peered":"2024-09-12T22:03:32.453733+0000","last_unstale":"2024-09-12T22:03:37.633563+0000","last_undegraded":"2024-09-12T22:03:37.633563+0000","last_fullsized":"2024-09-12T22:03:37.633563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:09.186165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949078+0000","last_change":"2024-09-12T22:03:33.458657+0000","last_active":"2024-09-12T22:03:36.949078+0000","last_peered":"2024-09-12T22:03:36.949078+0000","last_clean":"2024-09-12T22:03:36.949078+0000","last_became_active":"2024-09-12T22:03:33.458295+0000","last_became_peered":"2024-09-12T22:03:33.458295+0000","last_unstale":"2024-09-12T22:03:36.949078+0000","last_undegraded":"2024-09-12T22:03:36.949078+0000","last_fullsized":"2024-09-12T22:03:36.949078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:25.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633742+0000","last_change":"2024-09-12T22:03:30.343746+0000","last_active":"2024-09-12T22:03:37.633742+0000","last_peered":"2024-09-12T22:03:37.633742+0000","last_clean":"2024-09-12T22:03:37.633742+0000","last_became_active":"2024-09-12T22:03:28.335895+0000","last_became_peered":"2024-09-12T22:03:28.335895+0000","last_unstale":"2024-09-12T22:03:37.633742+0000","last_undegraded":"2024-09-12T22:03:37.633742+0000","last_fullsized":"2024-09-12T22:03:37.633742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.827420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070116600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948158+0000","last_change":"2024-09-12T22:03:32.461331+0000","last_active":"2024-09-12T22:03:36.948158+0000","last_peered":"2024-09-12T22:03:36.948158+0000","last_clean":"2024-09-12T22:03:36.948158+0000","last_became_active":"2024-09-12T22:03:32.460966+0000","last_became_peered":"2024-09-12T22:03:32.460966+0000","last_unstale":"2024-09-12T22:03:36.948158+0000","last_undegraded":"2024-09-12T22:03:36.948158+0000","last_fullsized":"2024-09-12T22:03:36.948158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:18.939990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634490+0000","last_change":"2024-09-12T22:03:33.458277+0000","last_active":"2024-09-12T22:03:37.634490+0000","last_peered":"2024-09-12T22:03:37.634490+0000","last_clean":"2024-09-12T22:03:37.634490+0000","last_became_active":"2024-09-12T22:03:33.457320+0000","last_became_peered":"2024-09-12T22:03:33.457320+0000","last_unstale":"2024-09-12T22:03:37.634490+0000","last_undegraded":"2024-09-12T22:03:37.634490+0000","last_fullsized":"2024-09-12T22:03:37.634490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:46.703481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120406+0000","last_change":"2024-09-12T22:03:30.339989+0000","last_active":"2024-09-12T22:03:38.120406+0000","last_peered":"2024-09-12T22:03:38.120406+0000","last_clean":"2024-09-12T22:03:38.120406+0000","last_became_active":"2024-09-12T22:03:28.335760+0000","last_became_peered":"2024-09-12T22:03:28.335760+0000","last_unstale":"2024-09-12T22:03:38.120406+0000","last_undegraded":"2024-09-12T22:03:38.120406+0000","last_fullsized":"2024-09-12T22:03:38.120406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:29.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120764+0000","last_change":"2024-09-12T22:03:32.456988+0000","last_active":"2024-09-12T22:03:38.120764+0000","last_peered":"2024-09-12T22:03:38.120764+0000","last_clean":"2024-09-12T22:03:38.120764+0000","last_became_active":"2024-09-12T22:03:32.456605+0000","last_became_peered":"2024-09-12T22:03:32.456605+0000","last_unstale":"2024-09-12T22:03:38.120764+0000","last_undegraded":"2024-09-12T22:03:38.120764+0000","last_fullsized":"2024-09-12T22:03:38.120764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:38.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634007+0000","last_change":"2024-09-12T22:03:33.458311+0000","last_active":"2024-09-12T22:03:37.634007+0000","last_peered":"2024-09-12T22:03:37.634007+0000","last_clean":"2024-09-12T22:03:37.634007+0000","last_became_active":"2024-09-12T22:03:33.456397+0000","last_became_peered":"2024-09-12T22:03:33.456397+0000","last_unstale":"2024-09-12T22:03:37.634007+0000","last_undegraded":"2024-09-12T22:03:37.634007+0000","last_fullsized":"2024-09-12T22:03:37.634007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:51.305559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121103+0000","last_change":"2024-09-12T22:03:32.457239+0000","last_active":"2024-09-12T22:03:38.121103+0000","last_peered":"2024-09-12T22:03:38.121103+0000","last_clean":"2024-09-12T22:03:38.121103+0000","last_became_active":"2024-09-12T22:03:32.456807+0000","last_became_peered":"2024-09-12T22:03:32.456807+0000","last_unstale":"2024-09-12T22:03:38.121103+0000","last_undegraded":"2024-09-12T22:03:38.121103+0000","last_fullsized":"2024-09-12T22:03:38.121103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:00.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634340+0000","last_change":"2024-09-12T22:03:30.343489+0000","last_active":"2024-09-12T22:03:37.634340+0000","last_peered":"2024-09-12T22:03:37.634340+0000","last_clean":"2024-09-12T22:03:37.634340+0000","last_became_active":"2024-09-12T22:03:28.335875+0000","last_became_peered":"2024-09-12T22:03:28.335875+0000","last_unstale":"2024-09-12T22:03:37.634340+0000","last_undegraded":"2024-09-12T22:03:37.634340+0000","last_fullsized":"2024-09-12T22:03:37.634340+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:34.561003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042932700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948531+0000","last_change":"2024-09-12T22:03:33.460944+0000","last_active":"2024-09-12T22:03:36.948531+0000","last_peered":"2024-09-12T22:03:36.948531+0000","last_clean":"2024-09-12T22:03:36.948531+0000","last_became_active":"2024-09-12T22:03:33.460514+0000","last_became_peered":"2024-09-12T22:03:33.460514+0000","last_unstale":"2024-09-12T22:03:36.948531+0000","last_undegraded":"2024-09-12T22:03:36.948531+0000","last_fullsized":"2024-09-12T22:03:36.948531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:54.744829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634252+0000","last_change":"2024-09-12T22:03:32.460055+0000","last_active":"2024-09-12T22:03:37.634252+0000","last_peered":"2024-09-12T22:03:37.634252+0000","last_clean":"2024-09-12T22:03:37.634252+0000","last_became_active":"2024-09-12T22:03:32.459276+0000","last_became_peered":"2024-09-12T22:03:32.459276+0000","last_unstale":"2024-09-12T22:03:37.634252+0000","last_undegraded":"2024-09-12T22:03:37.634252+0000","last_fullsized":"2024-09-12T22:03:37.634252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:23.776211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949211+0000","last_change":"2024-09-12T22:03:30.649265+0000","last_active":"2024-09-12T22:03:36.949211+0000","last_peered":"2024-09-12T22:03:36.949211+0000","last_clean":"2024-09-12T22:03:36.949211+0000","last_became_active":"2024-09-12T22:03:28.337193+0000","last_became_peered":"2024-09-12T22:03:28.337193+0000","last_unstale":"2024-09-12T22:03:36.949211+0000","last_undegraded":"2024-09-12T22:03:36.949211+0000","last_fullsized":"2024-09-12T22:03:36.949211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:43.899511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948515+0000","last_change":"2024-09-12T22:03:33.464893+0000","last_active":"2024-09-12T22:03:36.948515+0000","last_peered":"2024-09-12T22:03:36.948515+0000","last_clean":"2024-09-12T22:03:36.948515+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:03:36.948515+0000","last_undegraded":"2024-09-12T22:03:36.948515+0000","last_fullsized":"2024-09-12T22:03:36.948515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:47.948673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634814+0000","last_change":"2024-09-12T22:03:32.460426+0000","last_active":"2024-09-12T22:03:37.634814+0000","last_peered":"2024-09-12T22:03:37.634814+0000","last_clean":"2024-09-12T22:03:37.634814+0000","last_became_active":"2024-09-12T22:03:32.460161+0000","last_became_peered":"2024-09-12T22:03:32.460161+0000","last_unstale":"2024-09-12T22:03:37.634814+0000","last_undegraded":"2024-09-12T22:03:37.634814+0000","last_fullsized":"2024-09-12T22:03:37.634814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.472907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634952+0000","last_change":"2024-09-12T22:03:30.343485+0000","last_active":"2024-09-12T22:03:37.634952+0000","last_peered":"2024-09-12T22:03:37.634952+0000","last_clean":"2024-09-12T22:03:37.634952+0000","last_became_active":"2024-09-12T22:03:28.335961+0000","last_became_peered":"2024-09-12T22:03:28.335961+0000","last_unstale":"2024-09-12T22:03:37.634952+0000","last_undegraded":"2024-09-12T22:03:37.634952+0000","last_fullsized":"2024-09-12T22:03:37.634952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:24.041899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043906199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633375+0000","last_change":"2024-09-12T22:03:33.464709+0000","last_active":"2024-09-12T22:03:37.633375+0000","last_peered":"2024-09-12T22:03:37.633375+0000","last_clean":"2024-09-12T22:03:37.633375+0000","last_became_active":"2024-09-12T22:03:33.464016+0000","last_became_peered":"2024-09-12T22:03:33.464016+0000","last_unstale":"2024-09-12T22:03:37.633375+0000","last_undegraded":"2024-09-12T22:03:37.633375+0000","last_fullsized":"2024-09-12T22:03:37.633375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:07.598247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634893+0000","last_change":"2024-09-12T22:03:32.458014+0000","last_active":"2024-09-12T22:03:37.634893+0000","last_peered":"2024-09-12T22:03:37.634893+0000","last_clean":"2024-09-12T22:03:37.634893+0000","last_became_active":"2024-09-12T22:03:32.457654+0000","last_became_peered":"2024-09-12T22:03:32.457654+0000","last_unstale":"2024-09-12T22:03:37.634893+0000","last_undegraded":"2024-09-12T22:03:37.634893+0000","last_fullsized":"2024-09-12T22:03:37.634893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:08.446521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121056+0000","last_change":"2024-09-12T22:03:30.339817+0000","last_active":"2024-09-12T22:03:38.121056+0000","last_peered":"2024-09-12T22:03:38.121056+0000","last_clean":"2024-09-12T22:03:38.121056+0000","last_became_active":"2024-09-12T22:03:28.336599+0000","last_became_peered":"2024-09-12T22:03:28.336599+0000","last_unstale":"2024-09-12T22:03:38.121056+0000","last_undegraded":"2024-09-12T22:03:38.121056+0000","last_fullsized":"2024-09-12T22:03:38.121056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:36.442618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058522100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948215+0000","last_change":"2024-09-12T22:03:33.456975+0000","last_active":"2024-09-12T22:03:36.948215+0000","last_peered":"2024-09-12T22:03:36.948215+0000","last_clean":"2024-09-12T22:03:36.948215+0000","last_became_active":"2024-09-12T22:03:33.456611+0000","last_became_peered":"2024-09-12T22:03:33.456611+0000","last_unstale":"2024-09-12T22:03:36.948215+0000","last_undegraded":"2024-09-12T22:03:36.948215+0000","last_fullsized":"2024-09-12T22:03:36.948215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:46.309219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120544+0000","last_change":"2024-09-12T22:03:33.455671+0000","last_active":"2024-09-12T22:03:38.120544+0000","last_peered":"2024-09-12T22:03:38.120544+0000","last_clean":"2024-09-12T22:03:38.120544+0000","last_became_active":"2024-09-12T22:03:33.454833+0000","last_became_peered":"2024-09-12T22:03:33.454833+0000","last_unstale":"2024-09-12T22:03:38.120544+0000","last_undegraded":"2024-09-12T22:03:38.120544+0000","last_fullsized":"2024-09-12T22:03:38.120544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:08.773779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120513+0000","last_change":"2024-09-12T22:03:32.458296+0000","last_active":"2024-09-12T22:03:38.120513+0000","last_peered":"2024-09-12T22:03:38.120513+0000","last_clean":"2024-09-12T22:03:38.120513+0000","last_became_active":"2024-09-12T22:03:32.457908+0000","last_became_peered":"2024-09-12T22:03:32.457908+0000","last_unstale":"2024-09-12T22:03:38.120513+0000","last_undegraded":"2024-09-12T22:03:38.120513+0000","last_fullsized":"2024-09-12T22:03:38.120513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:53.758615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633547+0000","last_change":"2024-09-12T22:03:33.458365+0000","last_active":"2024-09-12T22:03:37.633547+0000","last_peered":"2024-09-12T22:03:37.633547+0000","last_clean":"2024-09-12T22:03:37.633547+0000","last_became_active":"2024-09-12T22:03:33.456256+0000","last_became_peered":"2024-09-12T22:03:33.456256+0000","last_unstale":"2024-09-12T22:03:37.633547+0000","last_undegraded":"2024-09-12T22:03:37.633547+0000","last_fullsized":"2024-09-12T22:03:37.633547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:12.145709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949119+0000","last_change":"2024-09-12T22:03:32.461509+0000","last_active":"2024-09-12T22:03:36.949119+0000","last_peered":"2024-09-12T22:03:36.949119+0000","last_clean":"2024-09-12T22:03:36.949119+0000","last_became_active":"2024-09-12T22:03:32.461161+0000","last_became_peered":"2024-09-12T22:03:32.461161+0000","last_unstale":"2024-09-12T22:03:36.949119+0000","last_undegraded":"2024-09-12T22:03:36.949119+0000","last_fullsized":"2024-09-12T22:03:36.949119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:02.888202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120809+0000","last_change":"2024-09-12T22:03:32.457458+0000","last_active":"2024-09-12T22:03:38.120809+0000","last_peered":"2024-09-12T22:03:38.120809+0000","last_clean":"2024-09-12T22:03:38.120809+0000","last_became_active":"2024-09-12T22:03:32.457007+0000","last_became_peered":"2024-09-12T22:03:32.457007+0000","last_unstale":"2024-09-12T22:03:38.120809+0000","last_undegraded":"2024-09-12T22:03:38.120809+0000","last_fullsized":"2024-09-12T22:03:38.120809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:08.474776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633334+0000","last_change":"2024-09-12T22:03:33.465561+0000","last_active":"2024-09-12T22:03:37.633334+0000","last_peered":"2024-09-12T22:03:37.633334+0000","last_clean":"2024-09-12T22:03:37.633334+0000","last_became_active":"2024-09-12T22:03:33.464837+0000","last_became_peered":"2024-09-12T22:03:33.464837+0000","last_unstale":"2024-09-12T22:03:37.633334+0000","last_undegraded":"2024-09-12T22:03:37.633334+0000","last_fullsized":"2024-09-12T22:03:37.633334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:32.859664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634692+0000","last_change":"2024-09-12T22:03:32.458964+0000","last_active":"2024-09-12T22:03:37.634692+0000","last_peered":"2024-09-12T22:03:37.634692+0000","last_clean":"2024-09-12T22:03:37.634692+0000","last_became_active":"2024-09-12T22:03:32.458346+0000","last_became_peered":"2024-09-12T22:03:32.458346+0000","last_unstale":"2024-09-12T22:03:37.634692+0000","last_undegraded":"2024-09-12T22:03:37.634692+0000","last_fullsized":"2024-09-12T22:03:37.634692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:37.178897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633336+0000","last_change":"2024-09-12T22:03:33.458060+0000","last_active":"2024-09-12T22:03:37.633336+0000","last_peered":"2024-09-12T22:03:37.633336+0000","last_clean":"2024-09-12T22:03:37.633336+0000","last_became_active":"2024-09-12T22:03:33.457390+0000","last_became_peered":"2024-09-12T22:03:33.457390+0000","last_unstale":"2024-09-12T22:03:37.633336+0000","last_undegraded":"2024-09-12T22:03:37.633336+0000","last_fullsized":"2024-09-12T22:03:37.633336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:14.711011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949306+0000","last_change":"2024-09-12T22:03:33.460177+0000","last_active":"2024-09-12T22:03:36.949306+0000","last_peered":"2024-09-12T22:03:36.949306+0000","last_clean":"2024-09-12T22:03:36.949306+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:03:36.949306+0000","last_undegraded":"2024-09-12T22:03:36.949306+0000","last_fullsized":"2024-09-12T22:03:36.949306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633492+0000","last_change":"2024-09-12T22:03:32.460441+0000","last_active":"2024-09-12T22:03:37.633492+0000","last_peered":"2024-09-12T22:03:37.633492+0000","last_clean":"2024-09-12T22:03:37.633492+0000","last_became_active":"2024-09-12T22:03:32.460126+0000","last_became_peered":"2024-09-12T22:03:32.460126+0000","last_unstale":"2024-09-12T22:03:37.633492+0000","last_undegraded":"2024-09-12T22:03:37.633492+0000","last_fullsized":"2024-09-12T22:03:37.633492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:52.150617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634575+0000","last_change":"2024-09-12T22:03:33.466167+0000","last_active":"2024-09-12T22:03:37.634575+0000","last_peered":"2024-09-12T22:03:37.634575+0000","last_clean":"2024-09-12T22:03:37.634575+0000","last_became_active":"2024-09-12T22:03:33.465116+0000","last_became_peered":"2024-09-12T22:03:33.465116+0000","last_unstale":"2024-09-12T22:03:37.634575+0000","last_undegraded":"2024-09-12T22:03:37.634575+0000","last_fullsized":"2024-09-12T22:03:37.634575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:19.683631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633484+0000","last_change":"2024-09-12T22:03:32.454262+0000","last_active":"2024-09-12T22:03:37.633484+0000","last_peered":"2024-09-12T22:03:37.633484+0000","last_clean":"2024-09-12T22:03:37.633484+0000","last_became_active":"2024-09-12T22:03:32.453776+0000","last_became_peered":"2024-09-12T22:03:32.453776+0000","last_unstale":"2024-09-12T22:03:37.633484+0000","last_undegraded":"2024-09-12T22:03:37.633484+0000","last_fullsized":"2024-09-12T22:03:37.633484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:57.091523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948901+0000","last_change":"2024-09-12T22:03:33.465186+0000","last_active":"2024-09-12T22:03:36.948901+0000","last_peered":"2024-09-12T22:03:36.948901+0000","last_clean":"2024-09-12T22:03:36.948901+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:03:36.948901+0000","last_undegraded":"2024-09-12T22:03:36.948901+0000","last_fullsized":"2024-09-12T22:03:36.948901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:29.409225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948624+0000","last_change":"2024-09-12T22:03:32.458132+0000","last_active":"2024-09-12T22:03:36.948624+0000","last_peered":"2024-09-12T22:03:36.948624+0000","last_clean":"2024-09-12T22:03:36.948624+0000","last_became_active":"2024-09-12T22:03:32.457817+0000","last_became_peered":"2024-09-12T22:03:32.457817+0000","last_unstale":"2024-09-12T22:03:36.948624+0000","last_undegraded":"2024-09-12T22:03:36.948624+0000","last_fullsized":"2024-09-12T22:03:36.948624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:47.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948638+0000","last_change":"2024-09-12T22:03:33.460730+0000","last_active":"2024-09-12T22:03:36.948638+0000","last_peered":"2024-09-12T22:03:36.948638+0000","last_clean":"2024-09-12T22:03:36.948638+0000","last_became_active":"2024-09-12T22:03:33.460223+0000","last_became_peered":"2024-09-12T22:03:33.460223+0000","last_unstale":"2024-09-12T22:03:36.948638+0000","last_undegraded":"2024-09-12T22:03:36.948638+0000","last_fullsized":"2024-09-12T22:03:36.948638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.406786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948595+0000","last_change":"2024-09-12T22:03:32.461243+0000","last_active":"2024-09-12T22:03:36.948595+0000","last_peered":"2024-09-12T22:03:36.948595+0000","last_clean":"2024-09-12T22:03:36.948595+0000","last_became_active":"2024-09-12T22:03:32.460760+0000","last_became_peered":"2024-09-12T22:03:32.460760+0000","last_unstale":"2024-09-12T22:03:36.948595+0000","last_undegraded":"2024-09-12T22:03:36.948595+0000","last_fullsized":"2024-09-12T22:03:36.948595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:42.848199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120422+0000","last_change":"2024-09-12T22:03:33.462764+0000","last_active":"2024-09-12T22:03:38.120422+0000","last_peered":"2024-09-12T22:03:38.120422+0000","last_clean":"2024-09-12T22:03:38.120422+0000","last_became_active":"2024-09-12T22:03:33.462360+0000","last_became_peered":"2024-09-12T22:03:33.462360+0000","last_unstale":"2024-09-12T22:03:38.120422+0000","last_undegraded":"2024-09-12T22:03:38.120422+0000","last_fullsized":"2024-09-12T22:03:38.120422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120443+0000","last_change":"2024-09-12T22:03:32.457280+0000","last_active":"2024-09-12T22:03:38.120443+0000","last_peered":"2024-09-12T22:03:38.120443+0000","last_clean":"2024-09-12T22:03:38.120443+0000","last_became_active":"2024-09-12T22:03:32.456812+0000","last_became_peered":"2024-09-12T22:03:32.456812+0000","last_unstale":"2024-09-12T22:03:38.120443+0000","last_undegraded":"2024-09-12T22:03:38.120443+0000","last_fullsized":"2024-09-12T22:03:38.120443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:46:51.143125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120065+0000","last_change":"2024-09-12T22:03:33.464094+0000","last_active":"2024-09-12T22:03:38.120065+0000","last_peered":"2024-09-12T22:03:38.120065+0000","last_clean":"2024-09-12T22:03:38.120065+0000","last_became_active":"2024-09-12T22:03:33.463380+0000","last_became_peered":"2024-09-12T22:03:33.463380+0000","last_unstale":"2024-09-12T22:03:38.120065+0000","last_undegraded":"2024-09-12T22:03:38.120065+0000","last_fullsized":"2024-09-12T22:03:38.120065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:11.422942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948983+0000","last_change":"2024-09-12T22:03:32.461230+0000","last_active":"2024-09-12T22:03:36.948983+0000","last_peered":"2024-09-12T22:03:36.948983+0000","last_clean":"2024-09-12T22:03:36.948983+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:03:36.948983+0000","last_undegraded":"2024-09-12T22:03:36.948983+0000","last_fullsized":"2024-09-12T22:03:36.948983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:16.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948424+0000","last_change":"2024-09-12T22:03:33.458634+0000","last_active":"2024-09-12T22:03:36.948424+0000","last_peered":"2024-09-12T22:03:36.948424+0000","last_clean":"2024-09-12T22:03:36.948424+0000","last_became_active":"2024-09-12T22:03:33.458096+0000","last_became_peered":"2024-09-12T22:03:33.458096+0000","last_unstale":"2024-09-12T22:03:36.948424+0000","last_undegraded":"2024-09-12T22:03:36.948424+0000","last_fullsized":"2024-09-12T22:03:36.948424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:09.702722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634795+0000","last_change":"2024-09-12T22:03:32.460314+0000","last_active":"2024-09-12T22:03:37.634795+0000","last_peered":"2024-09-12T22:03:37.634795+0000","last_clean":"2024-09-12T22:03:37.634795+0000","last_became_active":"2024-09-12T22:03:32.459890+0000","last_became_peered":"2024-09-12T22:03:32.459890+0000","last_unstale":"2024-09-12T22:03:37.634795+0000","last_undegraded":"2024-09-12T22:03:37.634795+0000","last_fullsized":"2024-09-12T22:03:37.634795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:00.774244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119819+0000","last_change":"2024-09-12T22:03:33.464082+0000","last_active":"2024-09-12T22:03:38.119819+0000","last_peered":"2024-09-12T22:03:38.119819+0000","last_clean":"2024-09-12T22:03:38.119819+0000","last_became_active":"2024-09-12T22:03:33.462648+0000","last_became_peered":"2024-09-12T22:03:33.462648+0000","last_unstale":"2024-09-12T22:03:38.119819+0000","last_undegraded":"2024-09-12T22:03:38.119819+0000","last_fullsized":"2024-09-12T22:03:38.119819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.466890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634610+0000","last_change":"2024-09-12T22:03:32.459293+0000","last_active":"2024-09-12T22:03:37.634610+0000","last_peered":"2024-09-12T22:03:37.634610+0000","last_clean":"2024-09-12T22:03:37.634610+0000","last_became_active":"2024-09-12T22:03:32.458679+0000","last_became_peered":"2024-09-12T22:03:32.458679+0000","last_unstale":"2024-09-12T22:03:37.634610+0000","last_undegraded":"2024-09-12T22:03:37.634610+0000","last_fullsized":"2024-09-12T22:03:37.634610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:21.083182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":798720,"data_stored":657780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36140,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335700,"statfs":{"total":96636764160,"available":96599756800,"internally_reserved":0,"allocated":811008,"data_stored":658415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35532,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336308,"statfs":{"total":96636764160,"available":96600379392,"internally_reserved":0,"allocated":192512,"data_stored":66253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:03:46.099 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:03:46.100 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T22:03:46.100 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T22:03:46.100 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T22:03:46.464 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:46.464 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T22:03:46.477 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T22:03:46.477 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:03:46.802 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:46.802 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"btime":"2024-09-12T22:03:35:455062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:03:32.797994+0000","modified":"2024-09-12T22:03:34.799743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.43:6803/129948218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":129948218},{"type":"v1","addr":"172.21.15.43:6803","nonce":129948218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-09-12T22:03:46.802 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 5 2024-09-12T22:03:46.815 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:03:47.146 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:47.146 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"btime":"2024-09-12T22:03:35:455062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:03:32.797994+0000","modified":"2024-09-12T22:03:34.799743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.43:6803/129948218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":129948218},{"type":"v1","addr":"172.21.15.43:6803","nonce":129948218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-09-12T22:03:47.147 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 5 2024-09-12T22:03:47.159 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:03:47.448 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:47.448 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","created":"2024-09-12T22:03:11.964028+0000","modified":"2024-09-12T22:03:36.944923+0000","last_up_change":"2024-09-12T22:03:21.299348+0000","last_in_change":"2024-09-12T22:03:12.758606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:03:22.281699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:03:26.987767+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:03:31.328134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:03:31.777050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb292153-0043-4981-8743-115f848d2064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6801","nonce":1281227380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6803","nonce":1281227380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6807","nonce":1281227380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1281227380},{"type":"v1","addr":"172.21.15.47:6805","nonce":1281227380}]},"public_addr":"172.21.15.47:6801/1281227380","cluster_addr":"172.21.15.47:6803/1281227380","heartbeat_back_addr":"172.21.15.47:6807/1281227380","heartbeat_front_addr":"172.21.15.47:6805/1281227380","state":["exists","up"]},{"osd":1,"uuid":"5f0330a2-15ce-4ffb-a697-da1f930db079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6801","nonce":1334802479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6803","nonce":1334802479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6807","nonce":1334802479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6805","nonce":1334802479}]},"public_addr":"172.21.15.110:6801/1334802479","cluster_addr":"172.21.15.110:6803/1334802479","heartbeat_back_addr":"172.21.15.110:6807/1334802479","heartbeat_front_addr":"172.21.15.110:6805/1334802479","state":["exists","up"]},{"osd":2,"uuid":"ae0b014f-768c-4f57-82c6-3edf9aa9f856","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6801","nonce":3565874056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6803","nonce":3565874056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6807","nonce":3565874056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6805","nonce":3565874056}]},"public_addr":"172.21.15.146:6801/3565874056","cluster_addr":"172.21.15.146:6803/3565874056","heartbeat_back_addr":"172.21.15.146:6807/3565874056","heartbeat_front_addr":"172.21.15.146:6805/3565874056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:18.927187+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.386650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.957366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:03:47.461 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:03:47.787 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:47.787 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"btime":"2024-09-12T22:03:35:455062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:03:32.797994+0000","modified":"2024-09-12T22:03:34.799743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.43:6803/129948218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":129948218},{"type":"v1","addr":"172.21.15.43:6803","nonce":129948218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-09-12T22:03:47.787 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 5 2024-09-12T22:03:47.900 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T22:03:32.797994+0000', 'modified': '2024-09-12T22:03:34.799743+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4202}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4202': {'gid': 4202, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.43:6803/129948218', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6802', 'nonce': 129948218}, {'type': 'v1', 'addr': '172.21.15.43:6803', 'nonce': 129948218}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4202, 'qdb_cluster': [4202]} 2024-09-12T22:03:47.900 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T22:03:47.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T22:03:48.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T22:03:48.016+0000 7f7c3effd640 0 client.4421 ms_handle_reset on v2:172.21.15.43:6802/129948218 2024-09-12T22:03:48.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T22:03:48.038+0000 7f7c3effd640 0 client.4420 ms_handle_reset on v2:172.21.15.43:6802/129948218 2024-09-12T22:03:48.040 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T22:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7", 2024-09-12T22:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-09-12T22:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4202, 2024-09-12T22:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-09-12T22:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-09-12T22:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-09-12T22:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 14.594380778, 2024-09-12T22:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 5, 2024-09-12T22:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 21, 2024-09-12T22:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 20, 2024-09-12T22:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 17.606682139 2024-09-12T22:03:48.042 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T22:03:48.052 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-12T22:03:48.066 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-12T22:03:48.066 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}} 2024-09-12T22:03:48.066 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-12T22:03:48.066 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-09-12T22:03:48.067 DEBUG:teuthology.orchestra.run.smithi043:> sync 2024-09-12T22:03:48.217 DEBUG:teuthology.orchestra.run.smithi047:> sync 2024-09-12T22:03:48.286 DEBUG:teuthology.orchestra.run.smithi110:> sync 2024-09-12T22:03:48.402 DEBUG:teuthology.orchestra.run.smithi146:> sync 2024-09-12T22:03:48.553 DEBUG:tasks.thrashosds:checking console status of smithi043 2024-09-12T22:03:48.553 DEBUG:teuthology.orchestra.console.smithi043:Waiting for login prompt 2024-09-12T22:03:48.553 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi043 2024-09-12T22:03:48.709 DEBUG:teuthology.orchestra.console.smithi043:expect before: [Enter `^Ec?' for help] 2024-09-12T22:03:48.710 DEBUG:teuthology.orchestra.console.smithi043:expect after: smithi043 login: 2024-09-12T22:03:48.762 DEBUG:teuthology.orchestra.console.smithi043:console disconnect output: [Enter `^Ec?' for help] smithi043 login: [disconnect] 2024-09-12T22:03:48.863 DEBUG:tasks.thrashosds:checking console status of smithi047 2024-09-12T22:03:48.863 DEBUG:teuthology.orchestra.console.smithi047:Waiting for login prompt 2024-09-12T22:03:48.863 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi047 2024-09-12T22:03:48.969 DEBUG:teuthology.orchestra.console.smithi047:expect before: [Enter `^Ec?' for help] 2024-09-12T22:03:48.970 DEBUG:teuthology.orchestra.console.smithi047:expect after: smithi047 login: 2024-09-12T22:03:49.022 DEBUG:teuthology.orchestra.console.smithi047:console disconnect output: [Enter `^Ec?' for help] smithi047 login: [disconnect] 2024-09-12T22:03:49.123 DEBUG:tasks.thrashosds:checking console status of smithi110 2024-09-12T22:03:49.123 DEBUG:teuthology.orchestra.console.smithi110:Waiting for login prompt 2024-09-12T22:03:49.123 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi110 2024-09-12T22:03:49.234 DEBUG:teuthology.orchestra.console.smithi110:expect before: [Enter `^Ec?' for help] 2024-09-12T22:03:49.234 DEBUG:teuthology.orchestra.console.smithi110:expect after: smithi110 login: 2024-09-12T22:03:49.286 DEBUG:teuthology.orchestra.console.smithi110:console disconnect output: [Enter `^Ec?' for help] smithi110 login: [disconnect] 2024-09-12T22:03:49.387 DEBUG:tasks.thrashosds:checking console status of smithi146 2024-09-12T22:03:49.387 DEBUG:teuthology.orchestra.console.smithi146:Waiting for login prompt 2024-09-12T22:03:49.387 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi146 2024-09-12T22:03:49.522 DEBUG:teuthology.orchestra.console.smithi146:expect before: [Enter `^Ec?' for help] 2024-09-12T22:03:49.522 DEBUG:teuthology.orchestra.console.smithi146:expect after: smithi146 login: 2024-09-12T22:03:49.574 DEBUG:teuthology.orchestra.console.smithi146:console disconnect output: [Enter `^Ec?' for help] smithi146 login: [disconnect] 2024-09-12T22:03:49.675 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-12T22:03:50.000 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-12T22:03:50.000 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:03:50.001 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:03:50.296 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:50.298 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:03:50.306 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-12T22:03:50.242251+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":103636,"kb_used_data":1760,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":283011884,"statfs":{"total":289910292480,"available":289804169216,"internally_reserved":0,"allocated":1802240,"data_stored":1382448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002932"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949228+0000","last_change":"2024-09-12T22:03:33.459321+0000","last_active":"2024-09-12T22:03:36.949228+0000","last_peered":"2024-09-12T22:03:36.949228+0000","last_clean":"2024-09-12T22:03:36.949228+0000","last_became_active":"2024-09-12T22:03:33.458897+0000","last_became_peered":"2024-09-12T22:03:33.458897+0000","last_unstale":"2024-09-12T22:03:36.949228+0000","last_undegraded":"2024-09-12T22:03:36.949228+0000","last_fullsized":"2024-09-12T22:03:36.949228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:20.716362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948961+0000","last_change":"2024-09-12T22:03:33.463659+0000","last_active":"2024-09-12T22:03:36.948961+0000","last_peered":"2024-09-12T22:03:36.948961+0000","last_clean":"2024-09-12T22:03:36.948961+0000","last_became_active":"2024-09-12T22:03:33.463296+0000","last_became_peered":"2024-09-12T22:03:33.463296+0000","last_unstale":"2024-09-12T22:03:36.948961+0000","last_undegraded":"2024-09-12T22:03:36.948961+0000","last_fullsized":"2024-09-12T22:03:36.948961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:10.270667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120413+0000","last_change":"2024-09-12T22:03:33.462148+0000","last_active":"2024-09-12T22:03:38.120413+0000","last_peered":"2024-09-12T22:03:38.120413+0000","last_clean":"2024-09-12T22:03:38.120413+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:03:38.120413+0000","last_undegraded":"2024-09-12T22:03:38.120413+0000","last_fullsized":"2024-09-12T22:03:38.120413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:36.909948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120215+0000","last_change":"2024-09-12T22:03:33.464418+0000","last_active":"2024-09-12T22:03:38.120215+0000","last_peered":"2024-09-12T22:03:38.120215+0000","last_clean":"2024-09-12T22:03:38.120215+0000","last_became_active":"2024-09-12T22:03:33.463811+0000","last_became_peered":"2024-09-12T22:03:33.463811+0000","last_unstale":"2024-09-12T22:03:38.120215+0000","last_undegraded":"2024-09-12T22:03:38.120215+0000","last_fullsized":"2024-09-12T22:03:38.120215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:48.374991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948625+0000","last_change":"2024-09-12T22:03:33.459995+0000","last_active":"2024-09-12T22:03:36.948625+0000","last_peered":"2024-09-12T22:03:36.948625+0000","last_clean":"2024-09-12T22:03:36.948625+0000","last_became_active":"2024-09-12T22:03:33.459653+0000","last_became_peered":"2024-09-12T22:03:33.459653+0000","last_unstale":"2024-09-12T22:03:36.948625+0000","last_undegraded":"2024-09-12T22:03:36.948625+0000","last_fullsized":"2024-09-12T22:03:36.948625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:15.288581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119840+0000","last_change":"2024-09-12T22:03:33.464646+0000","last_active":"2024-09-12T22:03:38.119840+0000","last_peered":"2024-09-12T22:03:38.119840+0000","last_clean":"2024-09-12T22:03:38.119840+0000","last_became_active":"2024-09-12T22:03:33.463793+0000","last_became_peered":"2024-09-12T22:03:33.463793+0000","last_unstale":"2024-09-12T22:03:38.119840+0000","last_undegraded":"2024-09-12T22:03:38.119840+0000","last_fullsized":"2024-09-12T22:03:38.119840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.153436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119951+0000","last_change":"2024-09-12T22:03:33.463183+0000","last_active":"2024-09-12T22:03:38.119951+0000","last_peered":"2024-09-12T22:03:38.119951+0000","last_clean":"2024-09-12T22:03:38.119951+0000","last_became_active":"2024-09-12T22:03:33.462752+0000","last_became_peered":"2024-09-12T22:03:33.462752+0000","last_unstale":"2024-09-12T22:03:38.119951+0000","last_undegraded":"2024-09-12T22:03:38.119951+0000","last_fullsized":"2024-09-12T22:03:38.119951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:25.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119620+0000","last_change":"2024-09-12T22:03:33.465552+0000","last_active":"2024-09-12T22:03:38.119620+0000","last_peered":"2024-09-12T22:03:38.119620+0000","last_clean":"2024-09-12T22:03:38.119620+0000","last_became_active":"2024-09-12T22:03:33.464745+0000","last_became_peered":"2024-09-12T22:03:33.464745+0000","last_unstale":"2024-09-12T22:03:38.119620+0000","last_undegraded":"2024-09-12T22:03:38.119620+0000","last_fullsized":"2024-09-12T22:03:38.119620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:42.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634348+0000","last_change":"2024-09-12T22:03:33.461075+0000","last_active":"2024-09-12T22:03:37.634348+0000","last_peered":"2024-09-12T22:03:37.634348+0000","last_clean":"2024-09-12T22:03:37.634348+0000","last_became_active":"2024-09-12T22:03:33.459892+0000","last_became_peered":"2024-09-12T22:03:33.459892+0000","last_unstale":"2024-09-12T22:03:37.634348+0000","last_undegraded":"2024-09-12T22:03:37.634348+0000","last_fullsized":"2024-09-12T22:03:37.634348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:25.087808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949026+0000","last_change":"2024-09-12T22:03:33.459292+0000","last_active":"2024-09-12T22:03:36.949026+0000","last_peered":"2024-09-12T22:03:36.949026+0000","last_clean":"2024-09-12T22:03:36.949026+0000","last_became_active":"2024-09-12T22:03:33.458956+0000","last_became_peered":"2024-09-12T22:03:33.458956+0000","last_unstale":"2024-09-12T22:03:36.949026+0000","last_undegraded":"2024-09-12T22:03:36.949026+0000","last_fullsized":"2024-09-12T22:03:36.949026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.153436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120553+0000","last_change":"2024-09-12T22:03:33.464766+0000","last_active":"2024-09-12T22:03:38.120553+0000","last_peered":"2024-09-12T22:03:38.120553+0000","last_clean":"2024-09-12T22:03:38.120553+0000","last_became_active":"2024-09-12T22:03:33.463545+0000","last_became_peered":"2024-09-12T22:03:33.463545+0000","last_unstale":"2024-09-12T22:03:38.120553+0000","last_undegraded":"2024-09-12T22:03:38.120553+0000","last_fullsized":"2024-09-12T22:03:38.120553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:27.861352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948602+0000","last_change":"2024-09-12T22:03:33.465069+0000","last_active":"2024-09-12T22:03:36.948602+0000","last_peered":"2024-09-12T22:03:36.948602+0000","last_clean":"2024-09-12T22:03:36.948602+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:03:36.948602+0000","last_undegraded":"2024-09-12T22:03:36.948602+0000","last_fullsized":"2024-09-12T22:03:36.948602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948404+0000","last_change":"2024-09-12T22:03:33.458519+0000","last_active":"2024-09-12T22:03:36.948404+0000","last_peered":"2024-09-12T22:03:36.948404+0000","last_clean":"2024-09-12T22:03:36.948404+0000","last_became_active":"2024-09-12T22:03:33.458138+0000","last_became_peered":"2024-09-12T22:03:33.458138+0000","last_unstale":"2024-09-12T22:03:36.948404+0000","last_undegraded":"2024-09-12T22:03:36.948404+0000","last_fullsized":"2024-09-12T22:03:36.948404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:18.784928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119916+0000","last_change":"2024-09-12T22:03:33.457584+0000","last_active":"2024-09-12T22:03:38.119916+0000","last_peered":"2024-09-12T22:03:38.119916+0000","last_clean":"2024-09-12T22:03:38.119916+0000","last_became_active":"2024-09-12T22:03:33.456732+0000","last_became_peered":"2024-09-12T22:03:33.456732+0000","last_unstale":"2024-09-12T22:03:38.119916+0000","last_undegraded":"2024-09-12T22:03:38.119916+0000","last_fullsized":"2024-09-12T22:03:38.119916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:20.716362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120012+0000","last_change":"2024-09-12T22:03:33.455903+0000","last_active":"2024-09-12T22:03:38.120012+0000","last_peered":"2024-09-12T22:03:38.120012+0000","last_clean":"2024-09-12T22:03:38.120012+0000","last_became_active":"2024-09-12T22:03:33.455399+0000","last_became_peered":"2024-09-12T22:03:33.455399+0000","last_unstale":"2024-09-12T22:03:38.120012+0000","last_undegraded":"2024-09-12T22:03:38.120012+0000","last_fullsized":"2024-09-12T22:03:38.120012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:06.785269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119637+0000","last_change":"2024-09-12T22:03:33.465252+0000","last_active":"2024-09-12T22:03:38.119637+0000","last_peered":"2024-09-12T22:03:38.119637+0000","last_clean":"2024-09-12T22:03:38.119637+0000","last_became_active":"2024-09-12T22:03:33.464524+0000","last_became_peered":"2024-09-12T22:03:33.464524+0000","last_unstale":"2024-09-12T22:03:38.119637+0000","last_undegraded":"2024-09-12T22:03:38.119637+0000","last_fullsized":"2024-09-12T22:03:38.119637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.406786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634727+0000","last_change":"2024-09-12T22:03:33.457075+0000","last_active":"2024-09-12T22:03:37.634727+0000","last_peered":"2024-09-12T22:03:37.634727+0000","last_clean":"2024-09-12T22:03:37.634727+0000","last_became_active":"2024-09-12T22:03:33.456463+0000","last_became_peered":"2024-09-12T22:03:33.456463+0000","last_unstale":"2024-09-12T22:03:37.634727+0000","last_undegraded":"2024-09-12T22:03:37.634727+0000","last_fullsized":"2024-09-12T22:03:37.634727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:40.945193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949187+0000","last_change":"2024-09-12T22:03:33.463614+0000","last_active":"2024-09-12T22:03:36.949187+0000","last_peered":"2024-09-12T22:03:36.949187+0000","last_clean":"2024-09-12T22:03:36.949187+0000","last_became_active":"2024-09-12T22:03:33.463245+0000","last_became_peered":"2024-09-12T22:03:33.463245+0000","last_unstale":"2024-09-12T22:03:36.949187+0000","last_undegraded":"2024-09-12T22:03:36.949187+0000","last_fullsized":"2024-09-12T22:03:36.949187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:11.422942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634149+0000","last_change":"2024-09-12T22:03:33.457934+0000","last_active":"2024-09-12T22:03:37.634149+0000","last_peered":"2024-09-12T22:03:37.634149+0000","last_clean":"2024-09-12T22:03:37.634149+0000","last_became_active":"2024-09-12T22:03:33.457458+0000","last_became_peered":"2024-09-12T22:03:33.457458+0000","last_unstale":"2024-09-12T22:03:37.634149+0000","last_undegraded":"2024-09-12T22:03:37.634149+0000","last_fullsized":"2024-09-12T22:03:37.634149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:32.748239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120307+0000","last_change":"2024-09-12T22:03:33.464118+0000","last_active":"2024-09-12T22:03:38.120307+0000","last_peered":"2024-09-12T22:03:38.120307+0000","last_clean":"2024-09-12T22:03:38.120307+0000","last_became_active":"2024-09-12T22:03:33.463243+0000","last_became_peered":"2024-09-12T22:03:33.463243+0000","last_unstale":"2024-09-12T22:03:38.120307+0000","last_undegraded":"2024-09-12T22:03:38.120307+0000","last_fullsized":"2024-09-12T22:03:38.120307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:34.450477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120288+0000","last_change":"2024-09-12T22:03:33.465705+0000","last_active":"2024-09-12T22:03:38.120288+0000","last_peered":"2024-09-12T22:03:38.120288+0000","last_clean":"2024-09-12T22:03:38.120288+0000","last_became_active":"2024-09-12T22:03:33.465207+0000","last_became_peered":"2024-09-12T22:03:33.465207+0000","last_unstale":"2024-09-12T22:03:38.120288+0000","last_undegraded":"2024-09-12T22:03:38.120288+0000","last_fullsized":"2024-09-12T22:03:38.120288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.780572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948470+0000","last_change":"2024-09-12T22:03:33.460994+0000","last_active":"2024-09-12T22:03:36.948470+0000","last_peered":"2024-09-12T22:03:36.948470+0000","last_clean":"2024-09-12T22:03:36.948470+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:03:36.948470+0000","last_undegraded":"2024-09-12T22:03:36.948470+0000","last_fullsized":"2024-09-12T22:03:36.948470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:20.363291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633254+0000","last_change":"2024-09-12T22:03:33.466950+0000","last_active":"2024-09-12T22:03:37.633254+0000","last_peered":"2024-09-12T22:03:37.633254+0000","last_clean":"2024-09-12T22:03:37.633254+0000","last_became_active":"2024-09-12T22:03:33.466609+0000","last_became_peered":"2024-09-12T22:03:33.466609+0000","last_unstale":"2024-09-12T22:03:37.633254+0000","last_undegraded":"2024-09-12T22:03:37.633254+0000","last_fullsized":"2024-09-12T22:03:37.633254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:34.396185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948002+0000","last_change":"2024-09-12T22:03:33.460375+0000","last_active":"2024-09-12T22:03:36.948002+0000","last_peered":"2024-09-12T22:03:36.948002+0000","last_clean":"2024-09-12T22:03:36.948002+0000","last_became_active":"2024-09-12T22:03:33.459687+0000","last_became_peered":"2024-09-12T22:03:33.459687+0000","last_unstale":"2024-09-12T22:03:36.948002+0000","last_undegraded":"2024-09-12T22:03:36.948002+0000","last_fullsized":"2024-09-12T22:03:36.948002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:34.897642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949272+0000","last_change":"2024-09-12T22:03:33.456508+0000","last_active":"2024-09-12T22:03:36.949272+0000","last_peered":"2024-09-12T22:03:36.949272+0000","last_clean":"2024-09-12T22:03:36.949272+0000","last_became_active":"2024-09-12T22:03:33.456189+0000","last_became_peered":"2024-09-12T22:03:33.456189+0000","last_unstale":"2024-09-12T22:03:36.949272+0000","last_undegraded":"2024-09-12T22:03:36.949272+0000","last_fullsized":"2024-09-12T22:03:36.949272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.466890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634563+0000","last_change":"2024-09-12T22:03:33.465866+0000","last_active":"2024-09-12T22:03:37.634563+0000","last_peered":"2024-09-12T22:03:37.634563+0000","last_clean":"2024-09-12T22:03:37.634563+0000","last_became_active":"2024-09-12T22:03:33.464254+0000","last_became_peered":"2024-09-12T22:03:33.464254+0000","last_unstale":"2024-09-12T22:03:37.634563+0000","last_undegraded":"2024-09-12T22:03:37.634563+0000","last_fullsized":"2024-09-12T22:03:37.634563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:51.045864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120695+0000","last_change":"2024-09-12T22:03:33.461282+0000","last_active":"2024-09-12T22:03:38.120695+0000","last_peered":"2024-09-12T22:03:38.120695+0000","last_clean":"2024-09-12T22:03:38.120695+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:03:38.120695+0000","last_undegraded":"2024-09-12T22:03:38.120695+0000","last_fullsized":"2024-09-12T22:03:38.120695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:32.302716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948773+0000","last_change":"2024-09-12T22:03:33.467229+0000","last_active":"2024-09-12T22:03:36.948773+0000","last_peered":"2024-09-12T22:03:36.948773+0000","last_clean":"2024-09-12T22:03:36.948773+0000","last_became_active":"2024-09-12T22:03:33.464691+0000","last_became_peered":"2024-09-12T22:03:33.464691+0000","last_unstale":"2024-09-12T22:03:36.948773+0000","last_undegraded":"2024-09-12T22:03:36.948773+0000","last_fullsized":"2024-09-12T22:03:36.948773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.780572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634065+0000","last_change":"2024-09-12T22:03:33.460674+0000","last_active":"2024-09-12T22:03:37.634065+0000","last_peered":"2024-09-12T22:03:37.634065+0000","last_clean":"2024-09-12T22:03:37.634065+0000","last_became_active":"2024-09-12T22:03:33.458902+0000","last_became_peered":"2024-09-12T22:03:33.458902+0000","last_unstale":"2024-09-12T22:03:37.634065+0000","last_undegraded":"2024-09-12T22:03:37.634065+0000","last_fullsized":"2024-09-12T22:03:37.634065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:01.247039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948605+0000","last_change":"2024-09-12T22:03:33.456842+0000","last_active":"2024-09-12T22:03:36.948605+0000","last_peered":"2024-09-12T22:03:36.948605+0000","last_clean":"2024-09-12T22:03:36.948605+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:03:36.948605+0000","last_undegraded":"2024-09-12T22:03:36.948605+0000","last_fullsized":"2024-09-12T22:03:36.948605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:56.383351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633245+0000","last_change":"2024-09-12T22:03:33.459380+0000","last_active":"2024-09-12T22:03:37.633245+0000","last_peered":"2024-09-12T22:03:37.633245+0000","last_clean":"2024-09-12T22:03:37.633245+0000","last_became_active":"2024-09-12T22:03:33.458357+0000","last_became_peered":"2024-09-12T22:03:33.458357+0000","last_unstale":"2024-09-12T22:03:37.633245+0000","last_undegraded":"2024-09-12T22:03:37.633245+0000","last_fullsized":"2024-09-12T22:03:37.633245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:15.811200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119698+0000","last_change":"2024-09-12T22:03:33.463134+0000","last_active":"2024-09-12T22:03:38.119698+0000","last_peered":"2024-09-12T22:03:38.119698+0000","last_clean":"2024-09-12T22:03:38.119698+0000","last_became_active":"2024-09-12T22:03:33.462566+0000","last_became_peered":"2024-09-12T22:03:33.462566+0000","last_unstale":"2024-09-12T22:03:38.119698+0000","last_undegraded":"2024-09-12T22:03:38.119698+0000","last_fullsized":"2024-09-12T22:03:38.119698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:48.428755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948711+0000","last_change":"2024-09-12T22:03:33.460277+0000","last_active":"2024-09-12T22:03:36.948711+0000","last_peered":"2024-09-12T22:03:36.948711+0000","last_clean":"2024-09-12T22:03:36.948711+0000","last_became_active":"2024-09-12T22:03:33.459696+0000","last_became_peered":"2024-09-12T22:03:33.459696+0000","last_unstale":"2024-09-12T22:03:36.948711+0000","last_undegraded":"2024-09-12T22:03:36.948711+0000","last_fullsized":"2024-09-12T22:03:36.948711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:42.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120607+0000","last_change":"2024-09-12T22:03:32.457419+0000","last_active":"2024-09-12T22:03:38.120607+0000","last_peered":"2024-09-12T22:03:38.120607+0000","last_clean":"2024-09-12T22:03:38.120607+0000","last_became_active":"2024-09-12T22:03:32.456846+0000","last_became_peered":"2024-09-12T22:03:32.456846+0000","last_unstale":"2024-09-12T22:03:38.120607+0000","last_undegraded":"2024-09-12T22:03:38.120607+0000","last_fullsized":"2024-09-12T22:03:38.120607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:55.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949001+0000","last_change":"2024-09-12T22:03:33.458607+0000","last_active":"2024-09-12T22:03:36.949001+0000","last_peered":"2024-09-12T22:03:36.949001+0000","last_clean":"2024-09-12T22:03:36.949001+0000","last_became_active":"2024-09-12T22:03:33.457815+0000","last_became_peered":"2024-09-12T22:03:33.457815+0000","last_unstale":"2024-09-12T22:03:36.949001+0000","last_undegraded":"2024-09-12T22:03:36.949001+0000","last_fullsized":"2024-09-12T22:03:36.949001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:48.428755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633671+0000","last_change":"2024-09-12T22:03:32.458436+0000","last_active":"2024-09-12T22:03:37.633671+0000","last_peered":"2024-09-12T22:03:37.633671+0000","last_clean":"2024-09-12T22:03:37.633671+0000","last_became_active":"2024-09-12T22:03:32.457647+0000","last_became_peered":"2024-09-12T22:03:32.457647+0000","last_unstale":"2024-09-12T22:03:37.633671+0000","last_undegraded":"2024-09-12T22:03:37.633671+0000","last_fullsized":"2024-09-12T22:03:37.633671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:57.394698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634795+0000","last_change":"2024-09-12T22:03:33.466388+0000","last_active":"2024-09-12T22:03:37.634795+0000","last_peered":"2024-09-12T22:03:37.634795+0000","last_clean":"2024-09-12T22:03:37.634795+0000","last_became_active":"2024-09-12T22:03:33.464101+0000","last_became_peered":"2024-09-12T22:03:33.464101+0000","last_unstale":"2024-09-12T22:03:37.634795+0000","last_undegraded":"2024-09-12T22:03:37.634795+0000","last_fullsized":"2024-09-12T22:03:37.634795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:39:52.512160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948250+0000","last_change":"2024-09-12T22:03:32.461341+0000","last_active":"2024-09-12T22:03:36.948250+0000","last_peered":"2024-09-12T22:03:36.948250+0000","last_clean":"2024-09-12T22:03:36.948250+0000","last_became_active":"2024-09-12T22:03:32.460840+0000","last_became_peered":"2024-09-12T22:03:32.460840+0000","last_unstale":"2024-09-12T22:03:36.948250+0000","last_undegraded":"2024-09-12T22:03:36.948250+0000","last_fullsized":"2024-09-12T22:03:36.948250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:08.751696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634330+0000","last_change":"2024-09-12T22:03:33.464983+0000","last_active":"2024-09-12T22:03:37.634330+0000","last_peered":"2024-09-12T22:03:37.634330+0000","last_clean":"2024-09-12T22:03:37.634330+0000","last_became_active":"2024-09-12T22:03:33.464497+0000","last_became_peered":"2024-09-12T22:03:33.464497+0000","last_unstale":"2024-09-12T22:03:37.634330+0000","last_undegraded":"2024-09-12T22:03:37.634330+0000","last_fullsized":"2024-09-12T22:03:37.634330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:20.643181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119729+0000","last_change":"2024-09-12T22:03:32.453200+0000","last_active":"2024-09-12T22:03:38.119729+0000","last_peered":"2024-09-12T22:03:38.119729+0000","last_clean":"2024-09-12T22:03:38.119729+0000","last_became_active":"2024-09-12T22:03:32.452937+0000","last_became_peered":"2024-09-12T22:03:32.452937+0000","last_unstale":"2024-09-12T22:03:38.119729+0000","last_undegraded":"2024-09-12T22:03:38.119729+0000","last_fullsized":"2024-09-12T22:03:38.119729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:37.122599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120976+0000","last_change":"2024-09-12T22:03:32.458776+0000","last_active":"2024-09-12T22:03:38.120976+0000","last_peered":"2024-09-12T22:03:38.120976+0000","last_clean":"2024-09-12T22:03:38.120976+0000","last_became_active":"2024-09-12T22:03:32.458223+0000","last_became_peered":"2024-09-12T22:03:32.458223+0000","last_unstale":"2024-09-12T22:03:38.120976+0000","last_undegraded":"2024-09-12T22:03:38.120976+0000","last_fullsized":"2024-09-12T22:03:38.120976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:25.999548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948060+0000","last_change":"2024-09-12T22:03:33.465308+0000","last_active":"2024-09-12T22:03:36.948060+0000","last_peered":"2024-09-12T22:03:36.948060+0000","last_clean":"2024-09-12T22:03:36.948060+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:03:36.948060+0000","last_undegraded":"2024-09-12T22:03:36.948060+0000","last_fullsized":"2024-09-12T22:03:36.948060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:35.733622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949175+0000","last_change":"2024-09-12T22:03:32.461301+0000","last_active":"2024-09-12T22:03:36.949175+0000","last_peered":"2024-09-12T22:03:36.949175+0000","last_clean":"2024-09-12T22:03:36.949175+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:03:36.949175+0000","last_undegraded":"2024-09-12T22:03:36.949175+0000","last_fullsized":"2024-09-12T22:03:36.949175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:39.872272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948189+0000","last_change":"2024-09-12T22:03:33.458592+0000","last_active":"2024-09-12T22:03:36.948189+0000","last_peered":"2024-09-12T22:03:36.948189+0000","last_clean":"2024-09-12T22:03:36.948189+0000","last_became_active":"2024-09-12T22:03:33.458077+0000","last_became_peered":"2024-09-12T22:03:33.458077+0000","last_unstale":"2024-09-12T22:03:36.948189+0000","last_undegraded":"2024-09-12T22:03:36.948189+0000","last_fullsized":"2024-09-12T22:03:36.948189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.333348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121065+0000","last_change":"2024-09-12T22:03:32.459540+0000","last_active":"2024-09-12T22:03:38.121065+0000","last_peered":"2024-09-12T22:03:38.121065+0000","last_clean":"2024-09-12T22:03:38.121065+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:03:38.121065+0000","last_undegraded":"2024-09-12T22:03:38.121065+0000","last_fullsized":"2024-09-12T22:03:38.121065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:22.143242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120192+0000","last_change":"2024-09-12T22:03:33.464832+0000","last_active":"2024-09-12T22:03:38.120192+0000","last_peered":"2024-09-12T22:03:38.120192+0000","last_clean":"2024-09-12T22:03:38.120192+0000","last_became_active":"2024-09-12T22:03:33.463400+0000","last_became_peered":"2024-09-12T22:03:33.463400+0000","last_unstale":"2024-09-12T22:03:38.120192+0000","last_undegraded":"2024-09-12T22:03:38.120192+0000","last_fullsized":"2024-09-12T22:03:38.120192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:11:53.438877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120596+0000","last_change":"2024-09-12T22:03:32.456243+0000","last_active":"2024-09-12T22:03:38.120596+0000","last_peered":"2024-09-12T22:03:38.120596+0000","last_clean":"2024-09-12T22:03:38.120596+0000","last_became_active":"2024-09-12T22:03:32.455840+0000","last_became_peered":"2024-09-12T22:03:32.455840+0000","last_unstale":"2024-09-12T22:03:38.120596+0000","last_undegraded":"2024-09-12T22:03:38.120596+0000","last_fullsized":"2024-09-12T22:03:38.120596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:47.319431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633986+0000","last_change":"2024-09-12T22:03:33.465572+0000","last_active":"2024-09-12T22:03:37.633986+0000","last_peered":"2024-09-12T22:03:37.633986+0000","last_clean":"2024-09-12T22:03:37.633986+0000","last_became_active":"2024-09-12T22:03:33.465000+0000","last_became_peered":"2024-09-12T22:03:33.465000+0000","last_unstale":"2024-09-12T22:03:37.633986+0000","last_undegraded":"2024-09-12T22:03:37.633986+0000","last_fullsized":"2024-09-12T22:03:37.633986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:37.418482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634361+0000","last_change":"2024-09-12T22:03:32.458041+0000","last_active":"2024-09-12T22:03:37.634361+0000","last_peered":"2024-09-12T22:03:37.634361+0000","last_clean":"2024-09-12T22:03:37.634361+0000","last_became_active":"2024-09-12T22:03:32.457583+0000","last_became_peered":"2024-09-12T22:03:32.457583+0000","last_unstale":"2024-09-12T22:03:37.634361+0000","last_undegraded":"2024-09-12T22:03:37.634361+0000","last_fullsized":"2024-09-12T22:03:37.634361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:15.688344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120351+0000","last_change":"2024-09-12T22:03:33.462786+0000","last_active":"2024-09-12T22:03:38.120351+0000","last_peered":"2024-09-12T22:03:38.120351+0000","last_clean":"2024-09-12T22:03:38.120351+0000","last_became_active":"2024-09-12T22:03:33.462488+0000","last_became_peered":"2024-09-12T22:03:33.462488+0000","last_unstale":"2024-09-12T22:03:38.120351+0000","last_undegraded":"2024-09-12T22:03:38.120351+0000","last_fullsized":"2024-09-12T22:03:38.120351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:24.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120200+0000","last_change":"2024-09-12T22:03:32.457448+0000","last_active":"2024-09-12T22:03:38.120200+0000","last_peered":"2024-09-12T22:03:38.120200+0000","last_clean":"2024-09-12T22:03:38.120200+0000","last_became_active":"2024-09-12T22:03:32.457013+0000","last_became_peered":"2024-09-12T22:03:32.457013+0000","last_unstale":"2024-09-12T22:03:38.120200+0000","last_undegraded":"2024-09-12T22:03:38.120200+0000","last_fullsized":"2024-09-12T22:03:38.120200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:27.694073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120791+0000","last_change":"2024-09-12T22:03:33.459084+0000","last_active":"2024-09-12T22:03:38.120791+0000","last_peered":"2024-09-12T22:03:38.120791+0000","last_clean":"2024-09-12T22:03:38.120791+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:03:38.120791+0000","last_undegraded":"2024-09-12T22:03:38.120791+0000","last_fullsized":"2024-09-12T22:03:38.120791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:50.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948293+0000","last_change":"2024-09-12T22:03:32.461417+0000","last_active":"2024-09-12T22:03:36.948293+0000","last_peered":"2024-09-12T22:03:36.948293+0000","last_clean":"2024-09-12T22:03:36.948293+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:03:36.948293+0000","last_undegraded":"2024-09-12T22:03:36.948293+0000","last_fullsized":"2024-09-12T22:03:36.948293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:22.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120631+0000","last_change":"2024-09-12T22:03:33.457927+0000","last_active":"2024-09-12T22:03:38.120631+0000","last_peered":"2024-09-12T22:03:38.120631+0000","last_clean":"2024-09-12T22:03:38.120631+0000","last_became_active":"2024-09-12T22:03:33.457548+0000","last_became_peered":"2024-09-12T22:03:33.457548+0000","last_unstale":"2024-09-12T22:03:38.120631+0000","last_undegraded":"2024-09-12T22:03:38.120631+0000","last_fullsized":"2024-09-12T22:03:38.120631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:17.407499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948139+0000","last_change":"2024-09-12T22:03:32.458122+0000","last_active":"2024-09-12T22:03:36.948139+0000","last_peered":"2024-09-12T22:03:36.948139+0000","last_clean":"2024-09-12T22:03:36.948139+0000","last_became_active":"2024-09-12T22:03:32.457812+0000","last_became_peered":"2024-09-12T22:03:32.457812+0000","last_unstale":"2024-09-12T22:03:36.948139+0000","last_undegraded":"2024-09-12T22:03:36.948139+0000","last_fullsized":"2024-09-12T22:03:36.948139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:33.359519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634486+0000","last_change":"2024-09-12T22:03:33.459649+0000","last_active":"2024-09-12T22:03:37.634486+0000","last_peered":"2024-09-12T22:03:37.634486+0000","last_clean":"2024-09-12T22:03:37.634486+0000","last_became_active":"2024-09-12T22:03:33.458085+0000","last_became_peered":"2024-09-12T22:03:33.458085+0000","last_unstale":"2024-09-12T22:03:37.634486+0000","last_undegraded":"2024-09-12T22:03:37.634486+0000","last_fullsized":"2024-09-12T22:03:37.634486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:56.693491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119963+0000","last_change":"2024-09-12T22:03:23.315624+0000","last_active":"2024-09-12T22:03:38.119963+0000","last_peered":"2024-09-12T22:03:38.119963+0000","last_clean":"2024-09-12T22:03:38.119963+0000","last_became_active":"2024-09-12T22:03:23.315346+0000","last_became_peered":"2024-09-12T22:03:23.315346+0000","last_unstale":"2024-09-12T22:03:38.119963+0000","last_undegraded":"2024-09-12T22:03:38.119963+0000","last_fullsized":"2024-09-12T22:03:38.119963+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:15.864121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":30,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120853+0000","last_change":"2024-09-12T22:03:30.339678+0000","last_active":"2024-09-12T22:03:38.120853+0000","last_peered":"2024-09-12T22:03:38.120853+0000","last_clean":"2024-09-12T22:03:38.120853+0000","last_became_active":"2024-09-12T22:03:28.335855+0000","last_became_peered":"2024-09-12T22:03:28.335855+0000","last_unstale":"2024-09-12T22:03:38.120853+0000","last_undegraded":"2024-09-12T22:03:38.120853+0000","last_fullsized":"2024-09-12T22:03:38.120853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:11.750803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633792+0000","last_change":"2024-09-12T22:03:32.459986+0000","last_active":"2024-09-12T22:03:37.633792+0000","last_peered":"2024-09-12T22:03:37.633792+0000","last_clean":"2024-09-12T22:03:37.633792+0000","last_became_active":"2024-09-12T22:03:32.459353+0000","last_became_peered":"2024-09-12T22:03:32.459353+0000","last_unstale":"2024-09-12T22:03:37.633792+0000","last_undegraded":"2024-09-12T22:03:37.633792+0000","last_fullsized":"2024-09-12T22:03:37.633792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:57.496962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120952+0000","last_change":"2024-09-12T22:03:33.460477+0000","last_active":"2024-09-12T22:03:38.120952+0000","last_peered":"2024-09-12T22:03:38.120952+0000","last_clean":"2024-09-12T22:03:38.120952+0000","last_became_active":"2024-09-12T22:03:33.459433+0000","last_became_peered":"2024-09-12T22:03:33.459433+0000","last_unstale":"2024-09-12T22:03:38.120952+0000","last_undegraded":"2024-09-12T22:03:38.120952+0000","last_fullsized":"2024-09-12T22:03:38.120952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:15.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119960+0000","last_change":"2024-09-12T22:03:30.339569+0000","last_active":"2024-09-12T22:03:38.119960+0000","last_peered":"2024-09-12T22:03:38.119960+0000","last_clean":"2024-09-12T22:03:38.119960+0000","last_became_active":"2024-09-12T22:03:28.336643+0000","last_became_peered":"2024-09-12T22:03:28.336643+0000","last_unstale":"2024-09-12T22:03:38.119960+0000","last_undegraded":"2024-09-12T22:03:38.119960+0000","last_fullsized":"2024-09-12T22:03:38.119960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:56.968092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039518000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633563+0000","last_change":"2024-09-12T22:03:32.454155+0000","last_active":"2024-09-12T22:03:37.633563+0000","last_peered":"2024-09-12T22:03:37.633563+0000","last_clean":"2024-09-12T22:03:37.633563+0000","last_became_active":"2024-09-12T22:03:32.453733+0000","last_became_peered":"2024-09-12T22:03:32.453733+0000","last_unstale":"2024-09-12T22:03:37.633563+0000","last_undegraded":"2024-09-12T22:03:37.633563+0000","last_fullsized":"2024-09-12T22:03:37.633563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:09.186165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949078+0000","last_change":"2024-09-12T22:03:33.458657+0000","last_active":"2024-09-12T22:03:36.949078+0000","last_peered":"2024-09-12T22:03:36.949078+0000","last_clean":"2024-09-12T22:03:36.949078+0000","last_became_active":"2024-09-12T22:03:33.458295+0000","last_became_peered":"2024-09-12T22:03:33.458295+0000","last_unstale":"2024-09-12T22:03:36.949078+0000","last_undegraded":"2024-09-12T22:03:36.949078+0000","last_fullsized":"2024-09-12T22:03:36.949078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:25.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633742+0000","last_change":"2024-09-12T22:03:30.343746+0000","last_active":"2024-09-12T22:03:37.633742+0000","last_peered":"2024-09-12T22:03:37.633742+0000","last_clean":"2024-09-12T22:03:37.633742+0000","last_became_active":"2024-09-12T22:03:28.335895+0000","last_became_peered":"2024-09-12T22:03:28.335895+0000","last_unstale":"2024-09-12T22:03:37.633742+0000","last_undegraded":"2024-09-12T22:03:37.633742+0000","last_fullsized":"2024-09-12T22:03:37.633742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.827420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070116600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948158+0000","last_change":"2024-09-12T22:03:32.461331+0000","last_active":"2024-09-12T22:03:36.948158+0000","last_peered":"2024-09-12T22:03:36.948158+0000","last_clean":"2024-09-12T22:03:36.948158+0000","last_became_active":"2024-09-12T22:03:32.460966+0000","last_became_peered":"2024-09-12T22:03:32.460966+0000","last_unstale":"2024-09-12T22:03:36.948158+0000","last_undegraded":"2024-09-12T22:03:36.948158+0000","last_fullsized":"2024-09-12T22:03:36.948158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:18.939990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634490+0000","last_change":"2024-09-12T22:03:33.458277+0000","last_active":"2024-09-12T22:03:37.634490+0000","last_peered":"2024-09-12T22:03:37.634490+0000","last_clean":"2024-09-12T22:03:37.634490+0000","last_became_active":"2024-09-12T22:03:33.457320+0000","last_became_peered":"2024-09-12T22:03:33.457320+0000","last_unstale":"2024-09-12T22:03:37.634490+0000","last_undegraded":"2024-09-12T22:03:37.634490+0000","last_fullsized":"2024-09-12T22:03:37.634490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:46.703481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120406+0000","last_change":"2024-09-12T22:03:30.339989+0000","last_active":"2024-09-12T22:03:38.120406+0000","last_peered":"2024-09-12T22:03:38.120406+0000","last_clean":"2024-09-12T22:03:38.120406+0000","last_became_active":"2024-09-12T22:03:28.335760+0000","last_became_peered":"2024-09-12T22:03:28.335760+0000","last_unstale":"2024-09-12T22:03:38.120406+0000","last_undegraded":"2024-09-12T22:03:38.120406+0000","last_fullsized":"2024-09-12T22:03:38.120406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:29.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120764+0000","last_change":"2024-09-12T22:03:32.456988+0000","last_active":"2024-09-12T22:03:38.120764+0000","last_peered":"2024-09-12T22:03:38.120764+0000","last_clean":"2024-09-12T22:03:38.120764+0000","last_became_active":"2024-09-12T22:03:32.456605+0000","last_became_peered":"2024-09-12T22:03:32.456605+0000","last_unstale":"2024-09-12T22:03:38.120764+0000","last_undegraded":"2024-09-12T22:03:38.120764+0000","last_fullsized":"2024-09-12T22:03:38.120764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:38.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634007+0000","last_change":"2024-09-12T22:03:33.458311+0000","last_active":"2024-09-12T22:03:37.634007+0000","last_peered":"2024-09-12T22:03:37.634007+0000","last_clean":"2024-09-12T22:03:37.634007+0000","last_became_active":"2024-09-12T22:03:33.456397+0000","last_became_peered":"2024-09-12T22:03:33.456397+0000","last_unstale":"2024-09-12T22:03:37.634007+0000","last_undegraded":"2024-09-12T22:03:37.634007+0000","last_fullsized":"2024-09-12T22:03:37.634007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:51.305559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121103+0000","last_change":"2024-09-12T22:03:32.457239+0000","last_active":"2024-09-12T22:03:38.121103+0000","last_peered":"2024-09-12T22:03:38.121103+0000","last_clean":"2024-09-12T22:03:38.121103+0000","last_became_active":"2024-09-12T22:03:32.456807+0000","last_became_peered":"2024-09-12T22:03:32.456807+0000","last_unstale":"2024-09-12T22:03:38.121103+0000","last_undegraded":"2024-09-12T22:03:38.121103+0000","last_fullsized":"2024-09-12T22:03:38.121103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:00.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634340+0000","last_change":"2024-09-12T22:03:30.343489+0000","last_active":"2024-09-12T22:03:37.634340+0000","last_peered":"2024-09-12T22:03:37.634340+0000","last_clean":"2024-09-12T22:03:37.634340+0000","last_became_active":"2024-09-12T22:03:28.335875+0000","last_became_peered":"2024-09-12T22:03:28.335875+0000","last_unstale":"2024-09-12T22:03:37.634340+0000","last_undegraded":"2024-09-12T22:03:37.634340+0000","last_fullsized":"2024-09-12T22:03:37.634340+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:34.561003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042932700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948531+0000","last_change":"2024-09-12T22:03:33.460944+0000","last_active":"2024-09-12T22:03:36.948531+0000","last_peered":"2024-09-12T22:03:36.948531+0000","last_clean":"2024-09-12T22:03:36.948531+0000","last_became_active":"2024-09-12T22:03:33.460514+0000","last_became_peered":"2024-09-12T22:03:33.460514+0000","last_unstale":"2024-09-12T22:03:36.948531+0000","last_undegraded":"2024-09-12T22:03:36.948531+0000","last_fullsized":"2024-09-12T22:03:36.948531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:54.744829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634252+0000","last_change":"2024-09-12T22:03:32.460055+0000","last_active":"2024-09-12T22:03:37.634252+0000","last_peered":"2024-09-12T22:03:37.634252+0000","last_clean":"2024-09-12T22:03:37.634252+0000","last_became_active":"2024-09-12T22:03:32.459276+0000","last_became_peered":"2024-09-12T22:03:32.459276+0000","last_unstale":"2024-09-12T22:03:37.634252+0000","last_undegraded":"2024-09-12T22:03:37.634252+0000","last_fullsized":"2024-09-12T22:03:37.634252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:23.776211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949211+0000","last_change":"2024-09-12T22:03:30.649265+0000","last_active":"2024-09-12T22:03:36.949211+0000","last_peered":"2024-09-12T22:03:36.949211+0000","last_clean":"2024-09-12T22:03:36.949211+0000","last_became_active":"2024-09-12T22:03:28.337193+0000","last_became_peered":"2024-09-12T22:03:28.337193+0000","last_unstale":"2024-09-12T22:03:36.949211+0000","last_undegraded":"2024-09-12T22:03:36.949211+0000","last_fullsized":"2024-09-12T22:03:36.949211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:43.899511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948515+0000","last_change":"2024-09-12T22:03:33.464893+0000","last_active":"2024-09-12T22:03:36.948515+0000","last_peered":"2024-09-12T22:03:36.948515+0000","last_clean":"2024-09-12T22:03:36.948515+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:03:36.948515+0000","last_undegraded":"2024-09-12T22:03:36.948515+0000","last_fullsized":"2024-09-12T22:03:36.948515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:47.948673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634814+0000","last_change":"2024-09-12T22:03:32.460426+0000","last_active":"2024-09-12T22:03:37.634814+0000","last_peered":"2024-09-12T22:03:37.634814+0000","last_clean":"2024-09-12T22:03:37.634814+0000","last_became_active":"2024-09-12T22:03:32.460161+0000","last_became_peered":"2024-09-12T22:03:32.460161+0000","last_unstale":"2024-09-12T22:03:37.634814+0000","last_undegraded":"2024-09-12T22:03:37.634814+0000","last_fullsized":"2024-09-12T22:03:37.634814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.472907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634952+0000","last_change":"2024-09-12T22:03:30.343485+0000","last_active":"2024-09-12T22:03:37.634952+0000","last_peered":"2024-09-12T22:03:37.634952+0000","last_clean":"2024-09-12T22:03:37.634952+0000","last_became_active":"2024-09-12T22:03:28.335961+0000","last_became_peered":"2024-09-12T22:03:28.335961+0000","last_unstale":"2024-09-12T22:03:37.634952+0000","last_undegraded":"2024-09-12T22:03:37.634952+0000","last_fullsized":"2024-09-12T22:03:37.634952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:24.041899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043906199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633375+0000","last_change":"2024-09-12T22:03:33.464709+0000","last_active":"2024-09-12T22:03:37.633375+0000","last_peered":"2024-09-12T22:03:37.633375+0000","last_clean":"2024-09-12T22:03:37.633375+0000","last_became_active":"2024-09-12T22:03:33.464016+0000","last_became_peered":"2024-09-12T22:03:33.464016+0000","last_unstale":"2024-09-12T22:03:37.633375+0000","last_undegraded":"2024-09-12T22:03:37.633375+0000","last_fullsized":"2024-09-12T22:03:37.633375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:07.598247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634893+0000","last_change":"2024-09-12T22:03:32.458014+0000","last_active":"2024-09-12T22:03:37.634893+0000","last_peered":"2024-09-12T22:03:37.634893+0000","last_clean":"2024-09-12T22:03:37.634893+0000","last_became_active":"2024-09-12T22:03:32.457654+0000","last_became_peered":"2024-09-12T22:03:32.457654+0000","last_unstale":"2024-09-12T22:03:37.634893+0000","last_undegraded":"2024-09-12T22:03:37.634893+0000","last_fullsized":"2024-09-12T22:03:37.634893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:08.446521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121056+0000","last_change":"2024-09-12T22:03:30.339817+0000","last_active":"2024-09-12T22:03:38.121056+0000","last_peered":"2024-09-12T22:03:38.121056+0000","last_clean":"2024-09-12T22:03:38.121056+0000","last_became_active":"2024-09-12T22:03:28.336599+0000","last_became_peered":"2024-09-12T22:03:28.336599+0000","last_unstale":"2024-09-12T22:03:38.121056+0000","last_undegraded":"2024-09-12T22:03:38.121056+0000","last_fullsized":"2024-09-12T22:03:38.121056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:36.442618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058522100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948215+0000","last_change":"2024-09-12T22:03:33.456975+0000","last_active":"2024-09-12T22:03:36.948215+0000","last_peered":"2024-09-12T22:03:36.948215+0000","last_clean":"2024-09-12T22:03:36.948215+0000","last_became_active":"2024-09-12T22:03:33.456611+0000","last_became_peered":"2024-09-12T22:03:33.456611+0000","last_unstale":"2024-09-12T22:03:36.948215+0000","last_undegraded":"2024-09-12T22:03:36.948215+0000","last_fullsized":"2024-09-12T22:03:36.948215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:46.309219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120544+0000","last_change":"2024-09-12T22:03:33.455671+0000","last_active":"2024-09-12T22:03:38.120544+0000","last_peered":"2024-09-12T22:03:38.120544+0000","last_clean":"2024-09-12T22:03:38.120544+0000","last_became_active":"2024-09-12T22:03:33.454833+0000","last_became_peered":"2024-09-12T22:03:33.454833+0000","last_unstale":"2024-09-12T22:03:38.120544+0000","last_undegraded":"2024-09-12T22:03:38.120544+0000","last_fullsized":"2024-09-12T22:03:38.120544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:08.773779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120513+0000","last_change":"2024-09-12T22:03:32.458296+0000","last_active":"2024-09-12T22:03:38.120513+0000","last_peered":"2024-09-12T22:03:38.120513+0000","last_clean":"2024-09-12T22:03:38.120513+0000","last_became_active":"2024-09-12T22:03:32.457908+0000","last_became_peered":"2024-09-12T22:03:32.457908+0000","last_unstale":"2024-09-12T22:03:38.120513+0000","last_undegraded":"2024-09-12T22:03:38.120513+0000","last_fullsized":"2024-09-12T22:03:38.120513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:53.758615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633547+0000","last_change":"2024-09-12T22:03:33.458365+0000","last_active":"2024-09-12T22:03:37.633547+0000","last_peered":"2024-09-12T22:03:37.633547+0000","last_clean":"2024-09-12T22:03:37.633547+0000","last_became_active":"2024-09-12T22:03:33.456256+0000","last_became_peered":"2024-09-12T22:03:33.456256+0000","last_unstale":"2024-09-12T22:03:37.633547+0000","last_undegraded":"2024-09-12T22:03:37.633547+0000","last_fullsized":"2024-09-12T22:03:37.633547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:12.145709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949119+0000","last_change":"2024-09-12T22:03:32.461509+0000","last_active":"2024-09-12T22:03:36.949119+0000","last_peered":"2024-09-12T22:03:36.949119+0000","last_clean":"2024-09-12T22:03:36.949119+0000","last_became_active":"2024-09-12T22:03:32.461161+0000","last_became_peered":"2024-09-12T22:03:32.461161+0000","last_unstale":"2024-09-12T22:03:36.949119+0000","last_undegraded":"2024-09-12T22:03:36.949119+0000","last_fullsized":"2024-09-12T22:03:36.949119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:02.888202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120809+0000","last_change":"2024-09-12T22:03:32.457458+0000","last_active":"2024-09-12T22:03:38.120809+0000","last_peered":"2024-09-12T22:03:38.120809+0000","last_clean":"2024-09-12T22:03:38.120809+0000","last_became_active":"2024-09-12T22:03:32.457007+0000","last_became_peered":"2024-09-12T22:03:32.457007+0000","last_unstale":"2024-09-12T22:03:38.120809+0000","last_undegraded":"2024-09-12T22:03:38.120809+0000","last_fullsized":"2024-09-12T22:03:38.120809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:08.474776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633334+0000","last_change":"2024-09-12T22:03:33.465561+0000","last_active":"2024-09-12T22:03:37.633334+0000","last_peered":"2024-09-12T22:03:37.633334+0000","last_clean":"2024-09-12T22:03:37.633334+0000","last_became_active":"2024-09-12T22:03:33.464837+0000","last_became_peered":"2024-09-12T22:03:33.464837+0000","last_unstale":"2024-09-12T22:03:37.633334+0000","last_undegraded":"2024-09-12T22:03:37.633334+0000","last_fullsized":"2024-09-12T22:03:37.633334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:32.859664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634692+0000","last_change":"2024-09-12T22:03:32.458964+0000","last_active":"2024-09-12T22:03:37.634692+0000","last_peered":"2024-09-12T22:03:37.634692+0000","last_clean":"2024-09-12T22:03:37.634692+0000","last_became_active":"2024-09-12T22:03:32.458346+0000","last_became_peered":"2024-09-12T22:03:32.458346+0000","last_unstale":"2024-09-12T22:03:37.634692+0000","last_undegraded":"2024-09-12T22:03:37.634692+0000","last_fullsized":"2024-09-12T22:03:37.634692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:37.178897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633336+0000","last_change":"2024-09-12T22:03:33.458060+0000","last_active":"2024-09-12T22:03:37.633336+0000","last_peered":"2024-09-12T22:03:37.633336+0000","last_clean":"2024-09-12T22:03:37.633336+0000","last_became_active":"2024-09-12T22:03:33.457390+0000","last_became_peered":"2024-09-12T22:03:33.457390+0000","last_unstale":"2024-09-12T22:03:37.633336+0000","last_undegraded":"2024-09-12T22:03:37.633336+0000","last_fullsized":"2024-09-12T22:03:37.633336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:14.711011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949306+0000","last_change":"2024-09-12T22:03:33.460177+0000","last_active":"2024-09-12T22:03:36.949306+0000","last_peered":"2024-09-12T22:03:36.949306+0000","last_clean":"2024-09-12T22:03:36.949306+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:03:36.949306+0000","last_undegraded":"2024-09-12T22:03:36.949306+0000","last_fullsized":"2024-09-12T22:03:36.949306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633492+0000","last_change":"2024-09-12T22:03:32.460441+0000","last_active":"2024-09-12T22:03:37.633492+0000","last_peered":"2024-09-12T22:03:37.633492+0000","last_clean":"2024-09-12T22:03:37.633492+0000","last_became_active":"2024-09-12T22:03:32.460126+0000","last_became_peered":"2024-09-12T22:03:32.460126+0000","last_unstale":"2024-09-12T22:03:37.633492+0000","last_undegraded":"2024-09-12T22:03:37.633492+0000","last_fullsized":"2024-09-12T22:03:37.633492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:52.150617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634575+0000","last_change":"2024-09-12T22:03:33.466167+0000","last_active":"2024-09-12T22:03:37.634575+0000","last_peered":"2024-09-12T22:03:37.634575+0000","last_clean":"2024-09-12T22:03:37.634575+0000","last_became_active":"2024-09-12T22:03:33.465116+0000","last_became_peered":"2024-09-12T22:03:33.465116+0000","last_unstale":"2024-09-12T22:03:37.634575+0000","last_undegraded":"2024-09-12T22:03:37.634575+0000","last_fullsized":"2024-09-12T22:03:37.634575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:19.683631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633484+0000","last_change":"2024-09-12T22:03:32.454262+0000","last_active":"2024-09-12T22:03:37.633484+0000","last_peered":"2024-09-12T22:03:37.633484+0000","last_clean":"2024-09-12T22:03:37.633484+0000","last_became_active":"2024-09-12T22:03:32.453776+0000","last_became_peered":"2024-09-12T22:03:32.453776+0000","last_unstale":"2024-09-12T22:03:37.633484+0000","last_undegraded":"2024-09-12T22:03:37.633484+0000","last_fullsized":"2024-09-12T22:03:37.633484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:57.091523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948901+0000","last_change":"2024-09-12T22:03:33.465186+0000","last_active":"2024-09-12T22:03:36.948901+0000","last_peered":"2024-09-12T22:03:36.948901+0000","last_clean":"2024-09-12T22:03:36.948901+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:03:36.948901+0000","last_undegraded":"2024-09-12T22:03:36.948901+0000","last_fullsized":"2024-09-12T22:03:36.948901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:29.409225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948624+0000","last_change":"2024-09-12T22:03:32.458132+0000","last_active":"2024-09-12T22:03:36.948624+0000","last_peered":"2024-09-12T22:03:36.948624+0000","last_clean":"2024-09-12T22:03:36.948624+0000","last_became_active":"2024-09-12T22:03:32.457817+0000","last_became_peered":"2024-09-12T22:03:32.457817+0000","last_unstale":"2024-09-12T22:03:36.948624+0000","last_undegraded":"2024-09-12T22:03:36.948624+0000","last_fullsized":"2024-09-12T22:03:36.948624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:47.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948638+0000","last_change":"2024-09-12T22:03:33.460730+0000","last_active":"2024-09-12T22:03:36.948638+0000","last_peered":"2024-09-12T22:03:36.948638+0000","last_clean":"2024-09-12T22:03:36.948638+0000","last_became_active":"2024-09-12T22:03:33.460223+0000","last_became_peered":"2024-09-12T22:03:33.460223+0000","last_unstale":"2024-09-12T22:03:36.948638+0000","last_undegraded":"2024-09-12T22:03:36.948638+0000","last_fullsized":"2024-09-12T22:03:36.948638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.406786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948595+0000","last_change":"2024-09-12T22:03:32.461243+0000","last_active":"2024-09-12T22:03:36.948595+0000","last_peered":"2024-09-12T22:03:36.948595+0000","last_clean":"2024-09-12T22:03:36.948595+0000","last_became_active":"2024-09-12T22:03:32.460760+0000","last_became_peered":"2024-09-12T22:03:32.460760+0000","last_unstale":"2024-09-12T22:03:36.948595+0000","last_undegraded":"2024-09-12T22:03:36.948595+0000","last_fullsized":"2024-09-12T22:03:36.948595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:42.848199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120422+0000","last_change":"2024-09-12T22:03:33.462764+0000","last_active":"2024-09-12T22:03:38.120422+0000","last_peered":"2024-09-12T22:03:38.120422+0000","last_clean":"2024-09-12T22:03:38.120422+0000","last_became_active":"2024-09-12T22:03:33.462360+0000","last_became_peered":"2024-09-12T22:03:33.462360+0000","last_unstale":"2024-09-12T22:03:38.120422+0000","last_undegraded":"2024-09-12T22:03:38.120422+0000","last_fullsized":"2024-09-12T22:03:38.120422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120443+0000","last_change":"2024-09-12T22:03:32.457280+0000","last_active":"2024-09-12T22:03:38.120443+0000","last_peered":"2024-09-12T22:03:38.120443+0000","last_clean":"2024-09-12T22:03:38.120443+0000","last_became_active":"2024-09-12T22:03:32.456812+0000","last_became_peered":"2024-09-12T22:03:32.456812+0000","last_unstale":"2024-09-12T22:03:38.120443+0000","last_undegraded":"2024-09-12T22:03:38.120443+0000","last_fullsized":"2024-09-12T22:03:38.120443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:46:51.143125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120065+0000","last_change":"2024-09-12T22:03:33.464094+0000","last_active":"2024-09-12T22:03:38.120065+0000","last_peered":"2024-09-12T22:03:38.120065+0000","last_clean":"2024-09-12T22:03:38.120065+0000","last_became_active":"2024-09-12T22:03:33.463380+0000","last_became_peered":"2024-09-12T22:03:33.463380+0000","last_unstale":"2024-09-12T22:03:38.120065+0000","last_undegraded":"2024-09-12T22:03:38.120065+0000","last_fullsized":"2024-09-12T22:03:38.120065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:11.422942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948983+0000","last_change":"2024-09-12T22:03:32.461230+0000","last_active":"2024-09-12T22:03:36.948983+0000","last_peered":"2024-09-12T22:03:36.948983+0000","last_clean":"2024-09-12T22:03:36.948983+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:03:36.948983+0000","last_undegraded":"2024-09-12T22:03:36.948983+0000","last_fullsized":"2024-09-12T22:03:36.948983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:16.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948424+0000","last_change":"2024-09-12T22:03:33.458634+0000","last_active":"2024-09-12T22:03:36.948424+0000","last_peered":"2024-09-12T22:03:36.948424+0000","last_clean":"2024-09-12T22:03:36.948424+0000","last_became_active":"2024-09-12T22:03:33.458096+0000","last_became_peered":"2024-09-12T22:03:33.458096+0000","last_unstale":"2024-09-12T22:03:36.948424+0000","last_undegraded":"2024-09-12T22:03:36.948424+0000","last_fullsized":"2024-09-12T22:03:36.948424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:09.702722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634795+0000","last_change":"2024-09-12T22:03:32.460314+0000","last_active":"2024-09-12T22:03:37.634795+0000","last_peered":"2024-09-12T22:03:37.634795+0000","last_clean":"2024-09-12T22:03:37.634795+0000","last_became_active":"2024-09-12T22:03:32.459890+0000","last_became_peered":"2024-09-12T22:03:32.459890+0000","last_unstale":"2024-09-12T22:03:37.634795+0000","last_undegraded":"2024-09-12T22:03:37.634795+0000","last_fullsized":"2024-09-12T22:03:37.634795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:00.774244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119819+0000","last_change":"2024-09-12T22:03:33.464082+0000","last_active":"2024-09-12T22:03:38.119819+0000","last_peered":"2024-09-12T22:03:38.119819+0000","last_clean":"2024-09-12T22:03:38.119819+0000","last_became_active":"2024-09-12T22:03:33.462648+0000","last_became_peered":"2024-09-12T22:03:33.462648+0000","last_unstale":"2024-09-12T22:03:38.119819+0000","last_undegraded":"2024-09-12T22:03:38.119819+0000","last_fullsized":"2024-09-12T22:03:38.119819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.466890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634610+0000","last_change":"2024-09-12T22:03:32.459293+0000","last_active":"2024-09-12T22:03:37.634610+0000","last_peered":"2024-09-12T22:03:37.634610+0000","last_clean":"2024-09-12T22:03:37.634610+0000","last_became_active":"2024-09-12T22:03:32.458679+0000","last_became_peered":"2024-09-12T22:03:32.458679+0000","last_unstale":"2024-09-12T22:03:37.634610+0000","last_undegraded":"2024-09-12T22:03:37.634610+0000","last_fullsized":"2024-09-12T22:03:37.634610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:21.083182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":798720,"data_stored":657780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36140,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335700,"statfs":{"total":96636764160,"available":96599756800,"internally_reserved":0,"allocated":811008,"data_stored":658415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35532,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336308,"statfs":{"total":96636764160,"available":96600379392,"internally_reserved":0,"allocated":192512,"data_stored":66253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:03:50.311 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:03:50.641 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:50.642 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:03:50.651 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-12T22:03:50.242251+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":103636,"kb_used_data":1760,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":283011884,"statfs":{"total":289910292480,"available":289804169216,"internally_reserved":0,"allocated":1802240,"data_stored":1382448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002932"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949228+0000","last_change":"2024-09-12T22:03:33.459321+0000","last_active":"2024-09-12T22:03:36.949228+0000","last_peered":"2024-09-12T22:03:36.949228+0000","last_clean":"2024-09-12T22:03:36.949228+0000","last_became_active":"2024-09-12T22:03:33.458897+0000","last_became_peered":"2024-09-12T22:03:33.458897+0000","last_unstale":"2024-09-12T22:03:36.949228+0000","last_undegraded":"2024-09-12T22:03:36.949228+0000","last_fullsized":"2024-09-12T22:03:36.949228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:20.716362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948961+0000","last_change":"2024-09-12T22:03:33.463659+0000","last_active":"2024-09-12T22:03:36.948961+0000","last_peered":"2024-09-12T22:03:36.948961+0000","last_clean":"2024-09-12T22:03:36.948961+0000","last_became_active":"2024-09-12T22:03:33.463296+0000","last_became_peered":"2024-09-12T22:03:33.463296+0000","last_unstale":"2024-09-12T22:03:36.948961+0000","last_undegraded":"2024-09-12T22:03:36.948961+0000","last_fullsized":"2024-09-12T22:03:36.948961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:10.270667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120413+0000","last_change":"2024-09-12T22:03:33.462148+0000","last_active":"2024-09-12T22:03:38.120413+0000","last_peered":"2024-09-12T22:03:38.120413+0000","last_clean":"2024-09-12T22:03:38.120413+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:03:38.120413+0000","last_undegraded":"2024-09-12T22:03:38.120413+0000","last_fullsized":"2024-09-12T22:03:38.120413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:36.909948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120215+0000","last_change":"2024-09-12T22:03:33.464418+0000","last_active":"2024-09-12T22:03:38.120215+0000","last_peered":"2024-09-12T22:03:38.120215+0000","last_clean":"2024-09-12T22:03:38.120215+0000","last_became_active":"2024-09-12T22:03:33.463811+0000","last_became_peered":"2024-09-12T22:03:33.463811+0000","last_unstale":"2024-09-12T22:03:38.120215+0000","last_undegraded":"2024-09-12T22:03:38.120215+0000","last_fullsized":"2024-09-12T22:03:38.120215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:48.374991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948625+0000","last_change":"2024-09-12T22:03:33.459995+0000","last_active":"2024-09-12T22:03:36.948625+0000","last_peered":"2024-09-12T22:03:36.948625+0000","last_clean":"2024-09-12T22:03:36.948625+0000","last_became_active":"2024-09-12T22:03:33.459653+0000","last_became_peered":"2024-09-12T22:03:33.459653+0000","last_unstale":"2024-09-12T22:03:36.948625+0000","last_undegraded":"2024-09-12T22:03:36.948625+0000","last_fullsized":"2024-09-12T22:03:36.948625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:15.288581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119840+0000","last_change":"2024-09-12T22:03:33.464646+0000","last_active":"2024-09-12T22:03:38.119840+0000","last_peered":"2024-09-12T22:03:38.119840+0000","last_clean":"2024-09-12T22:03:38.119840+0000","last_became_active":"2024-09-12T22:03:33.463793+0000","last_became_peered":"2024-09-12T22:03:33.463793+0000","last_unstale":"2024-09-12T22:03:38.119840+0000","last_undegraded":"2024-09-12T22:03:38.119840+0000","last_fullsized":"2024-09-12T22:03:38.119840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.153436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119951+0000","last_change":"2024-09-12T22:03:33.463183+0000","last_active":"2024-09-12T22:03:38.119951+0000","last_peered":"2024-09-12T22:03:38.119951+0000","last_clean":"2024-09-12T22:03:38.119951+0000","last_became_active":"2024-09-12T22:03:33.462752+0000","last_became_peered":"2024-09-12T22:03:33.462752+0000","last_unstale":"2024-09-12T22:03:38.119951+0000","last_undegraded":"2024-09-12T22:03:38.119951+0000","last_fullsized":"2024-09-12T22:03:38.119951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:25.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119620+0000","last_change":"2024-09-12T22:03:33.465552+0000","last_active":"2024-09-12T22:03:38.119620+0000","last_peered":"2024-09-12T22:03:38.119620+0000","last_clean":"2024-09-12T22:03:38.119620+0000","last_became_active":"2024-09-12T22:03:33.464745+0000","last_became_peered":"2024-09-12T22:03:33.464745+0000","last_unstale":"2024-09-12T22:03:38.119620+0000","last_undegraded":"2024-09-12T22:03:38.119620+0000","last_fullsized":"2024-09-12T22:03:38.119620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:42.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634348+0000","last_change":"2024-09-12T22:03:33.461075+0000","last_active":"2024-09-12T22:03:37.634348+0000","last_peered":"2024-09-12T22:03:37.634348+0000","last_clean":"2024-09-12T22:03:37.634348+0000","last_became_active":"2024-09-12T22:03:33.459892+0000","last_became_peered":"2024-09-12T22:03:33.459892+0000","last_unstale":"2024-09-12T22:03:37.634348+0000","last_undegraded":"2024-09-12T22:03:37.634348+0000","last_fullsized":"2024-09-12T22:03:37.634348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:25.087808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949026+0000","last_change":"2024-09-12T22:03:33.459292+0000","last_active":"2024-09-12T22:03:36.949026+0000","last_peered":"2024-09-12T22:03:36.949026+0000","last_clean":"2024-09-12T22:03:36.949026+0000","last_became_active":"2024-09-12T22:03:33.458956+0000","last_became_peered":"2024-09-12T22:03:33.458956+0000","last_unstale":"2024-09-12T22:03:36.949026+0000","last_undegraded":"2024-09-12T22:03:36.949026+0000","last_fullsized":"2024-09-12T22:03:36.949026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.153436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120553+0000","last_change":"2024-09-12T22:03:33.464766+0000","last_active":"2024-09-12T22:03:38.120553+0000","last_peered":"2024-09-12T22:03:38.120553+0000","last_clean":"2024-09-12T22:03:38.120553+0000","last_became_active":"2024-09-12T22:03:33.463545+0000","last_became_peered":"2024-09-12T22:03:33.463545+0000","last_unstale":"2024-09-12T22:03:38.120553+0000","last_undegraded":"2024-09-12T22:03:38.120553+0000","last_fullsized":"2024-09-12T22:03:38.120553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:27.861352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948602+0000","last_change":"2024-09-12T22:03:33.465069+0000","last_active":"2024-09-12T22:03:36.948602+0000","last_peered":"2024-09-12T22:03:36.948602+0000","last_clean":"2024-09-12T22:03:36.948602+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:03:36.948602+0000","last_undegraded":"2024-09-12T22:03:36.948602+0000","last_fullsized":"2024-09-12T22:03:36.948602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948404+0000","last_change":"2024-09-12T22:03:33.458519+0000","last_active":"2024-09-12T22:03:36.948404+0000","last_peered":"2024-09-12T22:03:36.948404+0000","last_clean":"2024-09-12T22:03:36.948404+0000","last_became_active":"2024-09-12T22:03:33.458138+0000","last_became_peered":"2024-09-12T22:03:33.458138+0000","last_unstale":"2024-09-12T22:03:36.948404+0000","last_undegraded":"2024-09-12T22:03:36.948404+0000","last_fullsized":"2024-09-12T22:03:36.948404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:18.784928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119916+0000","last_change":"2024-09-12T22:03:33.457584+0000","last_active":"2024-09-12T22:03:38.119916+0000","last_peered":"2024-09-12T22:03:38.119916+0000","last_clean":"2024-09-12T22:03:38.119916+0000","last_became_active":"2024-09-12T22:03:33.456732+0000","last_became_peered":"2024-09-12T22:03:33.456732+0000","last_unstale":"2024-09-12T22:03:38.119916+0000","last_undegraded":"2024-09-12T22:03:38.119916+0000","last_fullsized":"2024-09-12T22:03:38.119916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:20.716362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120012+0000","last_change":"2024-09-12T22:03:33.455903+0000","last_active":"2024-09-12T22:03:38.120012+0000","last_peered":"2024-09-12T22:03:38.120012+0000","last_clean":"2024-09-12T22:03:38.120012+0000","last_became_active":"2024-09-12T22:03:33.455399+0000","last_became_peered":"2024-09-12T22:03:33.455399+0000","last_unstale":"2024-09-12T22:03:38.120012+0000","last_undegraded":"2024-09-12T22:03:38.120012+0000","last_fullsized":"2024-09-12T22:03:38.120012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:06.785269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119637+0000","last_change":"2024-09-12T22:03:33.465252+0000","last_active":"2024-09-12T22:03:38.119637+0000","last_peered":"2024-09-12T22:03:38.119637+0000","last_clean":"2024-09-12T22:03:38.119637+0000","last_became_active":"2024-09-12T22:03:33.464524+0000","last_became_peered":"2024-09-12T22:03:33.464524+0000","last_unstale":"2024-09-12T22:03:38.119637+0000","last_undegraded":"2024-09-12T22:03:38.119637+0000","last_fullsized":"2024-09-12T22:03:38.119637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.406786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634727+0000","last_change":"2024-09-12T22:03:33.457075+0000","last_active":"2024-09-12T22:03:37.634727+0000","last_peered":"2024-09-12T22:03:37.634727+0000","last_clean":"2024-09-12T22:03:37.634727+0000","last_became_active":"2024-09-12T22:03:33.456463+0000","last_became_peered":"2024-09-12T22:03:33.456463+0000","last_unstale":"2024-09-12T22:03:37.634727+0000","last_undegraded":"2024-09-12T22:03:37.634727+0000","last_fullsized":"2024-09-12T22:03:37.634727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:40.945193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949187+0000","last_change":"2024-09-12T22:03:33.463614+0000","last_active":"2024-09-12T22:03:36.949187+0000","last_peered":"2024-09-12T22:03:36.949187+0000","last_clean":"2024-09-12T22:03:36.949187+0000","last_became_active":"2024-09-12T22:03:33.463245+0000","last_became_peered":"2024-09-12T22:03:33.463245+0000","last_unstale":"2024-09-12T22:03:36.949187+0000","last_undegraded":"2024-09-12T22:03:36.949187+0000","last_fullsized":"2024-09-12T22:03:36.949187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:11.422942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634149+0000","last_change":"2024-09-12T22:03:33.457934+0000","last_active":"2024-09-12T22:03:37.634149+0000","last_peered":"2024-09-12T22:03:37.634149+0000","last_clean":"2024-09-12T22:03:37.634149+0000","last_became_active":"2024-09-12T22:03:33.457458+0000","last_became_peered":"2024-09-12T22:03:33.457458+0000","last_unstale":"2024-09-12T22:03:37.634149+0000","last_undegraded":"2024-09-12T22:03:37.634149+0000","last_fullsized":"2024-09-12T22:03:37.634149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:32.748239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120307+0000","last_change":"2024-09-12T22:03:33.464118+0000","last_active":"2024-09-12T22:03:38.120307+0000","last_peered":"2024-09-12T22:03:38.120307+0000","last_clean":"2024-09-12T22:03:38.120307+0000","last_became_active":"2024-09-12T22:03:33.463243+0000","last_became_peered":"2024-09-12T22:03:33.463243+0000","last_unstale":"2024-09-12T22:03:38.120307+0000","last_undegraded":"2024-09-12T22:03:38.120307+0000","last_fullsized":"2024-09-12T22:03:38.120307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:34.450477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120288+0000","last_change":"2024-09-12T22:03:33.465705+0000","last_active":"2024-09-12T22:03:38.120288+0000","last_peered":"2024-09-12T22:03:38.120288+0000","last_clean":"2024-09-12T22:03:38.120288+0000","last_became_active":"2024-09-12T22:03:33.465207+0000","last_became_peered":"2024-09-12T22:03:33.465207+0000","last_unstale":"2024-09-12T22:03:38.120288+0000","last_undegraded":"2024-09-12T22:03:38.120288+0000","last_fullsized":"2024-09-12T22:03:38.120288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.780572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948470+0000","last_change":"2024-09-12T22:03:33.460994+0000","last_active":"2024-09-12T22:03:36.948470+0000","last_peered":"2024-09-12T22:03:36.948470+0000","last_clean":"2024-09-12T22:03:36.948470+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:03:36.948470+0000","last_undegraded":"2024-09-12T22:03:36.948470+0000","last_fullsized":"2024-09-12T22:03:36.948470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:20.363291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633254+0000","last_change":"2024-09-12T22:03:33.466950+0000","last_active":"2024-09-12T22:03:37.633254+0000","last_peered":"2024-09-12T22:03:37.633254+0000","last_clean":"2024-09-12T22:03:37.633254+0000","last_became_active":"2024-09-12T22:03:33.466609+0000","last_became_peered":"2024-09-12T22:03:33.466609+0000","last_unstale":"2024-09-12T22:03:37.633254+0000","last_undegraded":"2024-09-12T22:03:37.633254+0000","last_fullsized":"2024-09-12T22:03:37.633254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:34.396185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948002+0000","last_change":"2024-09-12T22:03:33.460375+0000","last_active":"2024-09-12T22:03:36.948002+0000","last_peered":"2024-09-12T22:03:36.948002+0000","last_clean":"2024-09-12T22:03:36.948002+0000","last_became_active":"2024-09-12T22:03:33.459687+0000","last_became_peered":"2024-09-12T22:03:33.459687+0000","last_unstale":"2024-09-12T22:03:36.948002+0000","last_undegraded":"2024-09-12T22:03:36.948002+0000","last_fullsized":"2024-09-12T22:03:36.948002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:34.897642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949272+0000","last_change":"2024-09-12T22:03:33.456508+0000","last_active":"2024-09-12T22:03:36.949272+0000","last_peered":"2024-09-12T22:03:36.949272+0000","last_clean":"2024-09-12T22:03:36.949272+0000","last_became_active":"2024-09-12T22:03:33.456189+0000","last_became_peered":"2024-09-12T22:03:33.456189+0000","last_unstale":"2024-09-12T22:03:36.949272+0000","last_undegraded":"2024-09-12T22:03:36.949272+0000","last_fullsized":"2024-09-12T22:03:36.949272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.466890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634563+0000","last_change":"2024-09-12T22:03:33.465866+0000","last_active":"2024-09-12T22:03:37.634563+0000","last_peered":"2024-09-12T22:03:37.634563+0000","last_clean":"2024-09-12T22:03:37.634563+0000","last_became_active":"2024-09-12T22:03:33.464254+0000","last_became_peered":"2024-09-12T22:03:33.464254+0000","last_unstale":"2024-09-12T22:03:37.634563+0000","last_undegraded":"2024-09-12T22:03:37.634563+0000","last_fullsized":"2024-09-12T22:03:37.634563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:51.045864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120695+0000","last_change":"2024-09-12T22:03:33.461282+0000","last_active":"2024-09-12T22:03:38.120695+0000","last_peered":"2024-09-12T22:03:38.120695+0000","last_clean":"2024-09-12T22:03:38.120695+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:03:38.120695+0000","last_undegraded":"2024-09-12T22:03:38.120695+0000","last_fullsized":"2024-09-12T22:03:38.120695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:32.302716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948773+0000","last_change":"2024-09-12T22:03:33.467229+0000","last_active":"2024-09-12T22:03:36.948773+0000","last_peered":"2024-09-12T22:03:36.948773+0000","last_clean":"2024-09-12T22:03:36.948773+0000","last_became_active":"2024-09-12T22:03:33.464691+0000","last_became_peered":"2024-09-12T22:03:33.464691+0000","last_unstale":"2024-09-12T22:03:36.948773+0000","last_undegraded":"2024-09-12T22:03:36.948773+0000","last_fullsized":"2024-09-12T22:03:36.948773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.780572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634065+0000","last_change":"2024-09-12T22:03:33.460674+0000","last_active":"2024-09-12T22:03:37.634065+0000","last_peered":"2024-09-12T22:03:37.634065+0000","last_clean":"2024-09-12T22:03:37.634065+0000","last_became_active":"2024-09-12T22:03:33.458902+0000","last_became_peered":"2024-09-12T22:03:33.458902+0000","last_unstale":"2024-09-12T22:03:37.634065+0000","last_undegraded":"2024-09-12T22:03:37.634065+0000","last_fullsized":"2024-09-12T22:03:37.634065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:01.247039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948605+0000","last_change":"2024-09-12T22:03:33.456842+0000","last_active":"2024-09-12T22:03:36.948605+0000","last_peered":"2024-09-12T22:03:36.948605+0000","last_clean":"2024-09-12T22:03:36.948605+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:03:36.948605+0000","last_undegraded":"2024-09-12T22:03:36.948605+0000","last_fullsized":"2024-09-12T22:03:36.948605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:56.383351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633245+0000","last_change":"2024-09-12T22:03:33.459380+0000","last_active":"2024-09-12T22:03:37.633245+0000","last_peered":"2024-09-12T22:03:37.633245+0000","last_clean":"2024-09-12T22:03:37.633245+0000","last_became_active":"2024-09-12T22:03:33.458357+0000","last_became_peered":"2024-09-12T22:03:33.458357+0000","last_unstale":"2024-09-12T22:03:37.633245+0000","last_undegraded":"2024-09-12T22:03:37.633245+0000","last_fullsized":"2024-09-12T22:03:37.633245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:15.811200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119698+0000","last_change":"2024-09-12T22:03:33.463134+0000","last_active":"2024-09-12T22:03:38.119698+0000","last_peered":"2024-09-12T22:03:38.119698+0000","last_clean":"2024-09-12T22:03:38.119698+0000","last_became_active":"2024-09-12T22:03:33.462566+0000","last_became_peered":"2024-09-12T22:03:33.462566+0000","last_unstale":"2024-09-12T22:03:38.119698+0000","last_undegraded":"2024-09-12T22:03:38.119698+0000","last_fullsized":"2024-09-12T22:03:38.119698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:48.428755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948711+0000","last_change":"2024-09-12T22:03:33.460277+0000","last_active":"2024-09-12T22:03:36.948711+0000","last_peered":"2024-09-12T22:03:36.948711+0000","last_clean":"2024-09-12T22:03:36.948711+0000","last_became_active":"2024-09-12T22:03:33.459696+0000","last_became_peered":"2024-09-12T22:03:33.459696+0000","last_unstale":"2024-09-12T22:03:36.948711+0000","last_undegraded":"2024-09-12T22:03:36.948711+0000","last_fullsized":"2024-09-12T22:03:36.948711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:42.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120607+0000","last_change":"2024-09-12T22:03:32.457419+0000","last_active":"2024-09-12T22:03:38.120607+0000","last_peered":"2024-09-12T22:03:38.120607+0000","last_clean":"2024-09-12T22:03:38.120607+0000","last_became_active":"2024-09-12T22:03:32.456846+0000","last_became_peered":"2024-09-12T22:03:32.456846+0000","last_unstale":"2024-09-12T22:03:38.120607+0000","last_undegraded":"2024-09-12T22:03:38.120607+0000","last_fullsized":"2024-09-12T22:03:38.120607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:55.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949001+0000","last_change":"2024-09-12T22:03:33.458607+0000","last_active":"2024-09-12T22:03:36.949001+0000","last_peered":"2024-09-12T22:03:36.949001+0000","last_clean":"2024-09-12T22:03:36.949001+0000","last_became_active":"2024-09-12T22:03:33.457815+0000","last_became_peered":"2024-09-12T22:03:33.457815+0000","last_unstale":"2024-09-12T22:03:36.949001+0000","last_undegraded":"2024-09-12T22:03:36.949001+0000","last_fullsized":"2024-09-12T22:03:36.949001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:48.428755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633671+0000","last_change":"2024-09-12T22:03:32.458436+0000","last_active":"2024-09-12T22:03:37.633671+0000","last_peered":"2024-09-12T22:03:37.633671+0000","last_clean":"2024-09-12T22:03:37.633671+0000","last_became_active":"2024-09-12T22:03:32.457647+0000","last_became_peered":"2024-09-12T22:03:32.457647+0000","last_unstale":"2024-09-12T22:03:37.633671+0000","last_undegraded":"2024-09-12T22:03:37.633671+0000","last_fullsized":"2024-09-12T22:03:37.633671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:57.394698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634795+0000","last_change":"2024-09-12T22:03:33.466388+0000","last_active":"2024-09-12T22:03:37.634795+0000","last_peered":"2024-09-12T22:03:37.634795+0000","last_clean":"2024-09-12T22:03:37.634795+0000","last_became_active":"2024-09-12T22:03:33.464101+0000","last_became_peered":"2024-09-12T22:03:33.464101+0000","last_unstale":"2024-09-12T22:03:37.634795+0000","last_undegraded":"2024-09-12T22:03:37.634795+0000","last_fullsized":"2024-09-12T22:03:37.634795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:39:52.512160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948250+0000","last_change":"2024-09-12T22:03:32.461341+0000","last_active":"2024-09-12T22:03:36.948250+0000","last_peered":"2024-09-12T22:03:36.948250+0000","last_clean":"2024-09-12T22:03:36.948250+0000","last_became_active":"2024-09-12T22:03:32.460840+0000","last_became_peered":"2024-09-12T22:03:32.460840+0000","last_unstale":"2024-09-12T22:03:36.948250+0000","last_undegraded":"2024-09-12T22:03:36.948250+0000","last_fullsized":"2024-09-12T22:03:36.948250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:08.751696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634330+0000","last_change":"2024-09-12T22:03:33.464983+0000","last_active":"2024-09-12T22:03:37.634330+0000","last_peered":"2024-09-12T22:03:37.634330+0000","last_clean":"2024-09-12T22:03:37.634330+0000","last_became_active":"2024-09-12T22:03:33.464497+0000","last_became_peered":"2024-09-12T22:03:33.464497+0000","last_unstale":"2024-09-12T22:03:37.634330+0000","last_undegraded":"2024-09-12T22:03:37.634330+0000","last_fullsized":"2024-09-12T22:03:37.634330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:20.643181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119729+0000","last_change":"2024-09-12T22:03:32.453200+0000","last_active":"2024-09-12T22:03:38.119729+0000","last_peered":"2024-09-12T22:03:38.119729+0000","last_clean":"2024-09-12T22:03:38.119729+0000","last_became_active":"2024-09-12T22:03:32.452937+0000","last_became_peered":"2024-09-12T22:03:32.452937+0000","last_unstale":"2024-09-12T22:03:38.119729+0000","last_undegraded":"2024-09-12T22:03:38.119729+0000","last_fullsized":"2024-09-12T22:03:38.119729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:37.122599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120976+0000","last_change":"2024-09-12T22:03:32.458776+0000","last_active":"2024-09-12T22:03:38.120976+0000","last_peered":"2024-09-12T22:03:38.120976+0000","last_clean":"2024-09-12T22:03:38.120976+0000","last_became_active":"2024-09-12T22:03:32.458223+0000","last_became_peered":"2024-09-12T22:03:32.458223+0000","last_unstale":"2024-09-12T22:03:38.120976+0000","last_undegraded":"2024-09-12T22:03:38.120976+0000","last_fullsized":"2024-09-12T22:03:38.120976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:25.999548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948060+0000","last_change":"2024-09-12T22:03:33.465308+0000","last_active":"2024-09-12T22:03:36.948060+0000","last_peered":"2024-09-12T22:03:36.948060+0000","last_clean":"2024-09-12T22:03:36.948060+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:03:36.948060+0000","last_undegraded":"2024-09-12T22:03:36.948060+0000","last_fullsized":"2024-09-12T22:03:36.948060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:35.733622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949175+0000","last_change":"2024-09-12T22:03:32.461301+0000","last_active":"2024-09-12T22:03:36.949175+0000","last_peered":"2024-09-12T22:03:36.949175+0000","last_clean":"2024-09-12T22:03:36.949175+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:03:36.949175+0000","last_undegraded":"2024-09-12T22:03:36.949175+0000","last_fullsized":"2024-09-12T22:03:36.949175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:39.872272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948189+0000","last_change":"2024-09-12T22:03:33.458592+0000","last_active":"2024-09-12T22:03:36.948189+0000","last_peered":"2024-09-12T22:03:36.948189+0000","last_clean":"2024-09-12T22:03:36.948189+0000","last_became_active":"2024-09-12T22:03:33.458077+0000","last_became_peered":"2024-09-12T22:03:33.458077+0000","last_unstale":"2024-09-12T22:03:36.948189+0000","last_undegraded":"2024-09-12T22:03:36.948189+0000","last_fullsized":"2024-09-12T22:03:36.948189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.333348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121065+0000","last_change":"2024-09-12T22:03:32.459540+0000","last_active":"2024-09-12T22:03:38.121065+0000","last_peered":"2024-09-12T22:03:38.121065+0000","last_clean":"2024-09-12T22:03:38.121065+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:03:38.121065+0000","last_undegraded":"2024-09-12T22:03:38.121065+0000","last_fullsized":"2024-09-12T22:03:38.121065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:22.143242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120192+0000","last_change":"2024-09-12T22:03:33.464832+0000","last_active":"2024-09-12T22:03:38.120192+0000","last_peered":"2024-09-12T22:03:38.120192+0000","last_clean":"2024-09-12T22:03:38.120192+0000","last_became_active":"2024-09-12T22:03:33.463400+0000","last_became_peered":"2024-09-12T22:03:33.463400+0000","last_unstale":"2024-09-12T22:03:38.120192+0000","last_undegraded":"2024-09-12T22:03:38.120192+0000","last_fullsized":"2024-09-12T22:03:38.120192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:11:53.438877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120596+0000","last_change":"2024-09-12T22:03:32.456243+0000","last_active":"2024-09-12T22:03:38.120596+0000","last_peered":"2024-09-12T22:03:38.120596+0000","last_clean":"2024-09-12T22:03:38.120596+0000","last_became_active":"2024-09-12T22:03:32.455840+0000","last_became_peered":"2024-09-12T22:03:32.455840+0000","last_unstale":"2024-09-12T22:03:38.120596+0000","last_undegraded":"2024-09-12T22:03:38.120596+0000","last_fullsized":"2024-09-12T22:03:38.120596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:47.319431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633986+0000","last_change":"2024-09-12T22:03:33.465572+0000","last_active":"2024-09-12T22:03:37.633986+0000","last_peered":"2024-09-12T22:03:37.633986+0000","last_clean":"2024-09-12T22:03:37.633986+0000","last_became_active":"2024-09-12T22:03:33.465000+0000","last_became_peered":"2024-09-12T22:03:33.465000+0000","last_unstale":"2024-09-12T22:03:37.633986+0000","last_undegraded":"2024-09-12T22:03:37.633986+0000","last_fullsized":"2024-09-12T22:03:37.633986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:37.418482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634361+0000","last_change":"2024-09-12T22:03:32.458041+0000","last_active":"2024-09-12T22:03:37.634361+0000","last_peered":"2024-09-12T22:03:37.634361+0000","last_clean":"2024-09-12T22:03:37.634361+0000","last_became_active":"2024-09-12T22:03:32.457583+0000","last_became_peered":"2024-09-12T22:03:32.457583+0000","last_unstale":"2024-09-12T22:03:37.634361+0000","last_undegraded":"2024-09-12T22:03:37.634361+0000","last_fullsized":"2024-09-12T22:03:37.634361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:15.688344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120351+0000","last_change":"2024-09-12T22:03:33.462786+0000","last_active":"2024-09-12T22:03:38.120351+0000","last_peered":"2024-09-12T22:03:38.120351+0000","last_clean":"2024-09-12T22:03:38.120351+0000","last_became_active":"2024-09-12T22:03:33.462488+0000","last_became_peered":"2024-09-12T22:03:33.462488+0000","last_unstale":"2024-09-12T22:03:38.120351+0000","last_undegraded":"2024-09-12T22:03:38.120351+0000","last_fullsized":"2024-09-12T22:03:38.120351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:24.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120200+0000","last_change":"2024-09-12T22:03:32.457448+0000","last_active":"2024-09-12T22:03:38.120200+0000","last_peered":"2024-09-12T22:03:38.120200+0000","last_clean":"2024-09-12T22:03:38.120200+0000","last_became_active":"2024-09-12T22:03:32.457013+0000","last_became_peered":"2024-09-12T22:03:32.457013+0000","last_unstale":"2024-09-12T22:03:38.120200+0000","last_undegraded":"2024-09-12T22:03:38.120200+0000","last_fullsized":"2024-09-12T22:03:38.120200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:27.694073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120791+0000","last_change":"2024-09-12T22:03:33.459084+0000","last_active":"2024-09-12T22:03:38.120791+0000","last_peered":"2024-09-12T22:03:38.120791+0000","last_clean":"2024-09-12T22:03:38.120791+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:03:38.120791+0000","last_undegraded":"2024-09-12T22:03:38.120791+0000","last_fullsized":"2024-09-12T22:03:38.120791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:50.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948293+0000","last_change":"2024-09-12T22:03:32.461417+0000","last_active":"2024-09-12T22:03:36.948293+0000","last_peered":"2024-09-12T22:03:36.948293+0000","last_clean":"2024-09-12T22:03:36.948293+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:03:36.948293+0000","last_undegraded":"2024-09-12T22:03:36.948293+0000","last_fullsized":"2024-09-12T22:03:36.948293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:22.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120631+0000","last_change":"2024-09-12T22:03:33.457927+0000","last_active":"2024-09-12T22:03:38.120631+0000","last_peered":"2024-09-12T22:03:38.120631+0000","last_clean":"2024-09-12T22:03:38.120631+0000","last_became_active":"2024-09-12T22:03:33.457548+0000","last_became_peered":"2024-09-12T22:03:33.457548+0000","last_unstale":"2024-09-12T22:03:38.120631+0000","last_undegraded":"2024-09-12T22:03:38.120631+0000","last_fullsized":"2024-09-12T22:03:38.120631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:17.407499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948139+0000","last_change":"2024-09-12T22:03:32.458122+0000","last_active":"2024-09-12T22:03:36.948139+0000","last_peered":"2024-09-12T22:03:36.948139+0000","last_clean":"2024-09-12T22:03:36.948139+0000","last_became_active":"2024-09-12T22:03:32.457812+0000","last_became_peered":"2024-09-12T22:03:32.457812+0000","last_unstale":"2024-09-12T22:03:36.948139+0000","last_undegraded":"2024-09-12T22:03:36.948139+0000","last_fullsized":"2024-09-12T22:03:36.948139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:33.359519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634486+0000","last_change":"2024-09-12T22:03:33.459649+0000","last_active":"2024-09-12T22:03:37.634486+0000","last_peered":"2024-09-12T22:03:37.634486+0000","last_clean":"2024-09-12T22:03:37.634486+0000","last_became_active":"2024-09-12T22:03:33.458085+0000","last_became_peered":"2024-09-12T22:03:33.458085+0000","last_unstale":"2024-09-12T22:03:37.634486+0000","last_undegraded":"2024-09-12T22:03:37.634486+0000","last_fullsized":"2024-09-12T22:03:37.634486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:56.693491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119963+0000","last_change":"2024-09-12T22:03:23.315624+0000","last_active":"2024-09-12T22:03:38.119963+0000","last_peered":"2024-09-12T22:03:38.119963+0000","last_clean":"2024-09-12T22:03:38.119963+0000","last_became_active":"2024-09-12T22:03:23.315346+0000","last_became_peered":"2024-09-12T22:03:23.315346+0000","last_unstale":"2024-09-12T22:03:38.119963+0000","last_undegraded":"2024-09-12T22:03:38.119963+0000","last_fullsized":"2024-09-12T22:03:38.119963+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:15.864121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":30,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120853+0000","last_change":"2024-09-12T22:03:30.339678+0000","last_active":"2024-09-12T22:03:38.120853+0000","last_peered":"2024-09-12T22:03:38.120853+0000","last_clean":"2024-09-12T22:03:38.120853+0000","last_became_active":"2024-09-12T22:03:28.335855+0000","last_became_peered":"2024-09-12T22:03:28.335855+0000","last_unstale":"2024-09-12T22:03:38.120853+0000","last_undegraded":"2024-09-12T22:03:38.120853+0000","last_fullsized":"2024-09-12T22:03:38.120853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:11.750803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633792+0000","last_change":"2024-09-12T22:03:32.459986+0000","last_active":"2024-09-12T22:03:37.633792+0000","last_peered":"2024-09-12T22:03:37.633792+0000","last_clean":"2024-09-12T22:03:37.633792+0000","last_became_active":"2024-09-12T22:03:32.459353+0000","last_became_peered":"2024-09-12T22:03:32.459353+0000","last_unstale":"2024-09-12T22:03:37.633792+0000","last_undegraded":"2024-09-12T22:03:37.633792+0000","last_fullsized":"2024-09-12T22:03:37.633792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:57.496962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120952+0000","last_change":"2024-09-12T22:03:33.460477+0000","last_active":"2024-09-12T22:03:38.120952+0000","last_peered":"2024-09-12T22:03:38.120952+0000","last_clean":"2024-09-12T22:03:38.120952+0000","last_became_active":"2024-09-12T22:03:33.459433+0000","last_became_peered":"2024-09-12T22:03:33.459433+0000","last_unstale":"2024-09-12T22:03:38.120952+0000","last_undegraded":"2024-09-12T22:03:38.120952+0000","last_fullsized":"2024-09-12T22:03:38.120952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:15.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119960+0000","last_change":"2024-09-12T22:03:30.339569+0000","last_active":"2024-09-12T22:03:38.119960+0000","last_peered":"2024-09-12T22:03:38.119960+0000","last_clean":"2024-09-12T22:03:38.119960+0000","last_became_active":"2024-09-12T22:03:28.336643+0000","last_became_peered":"2024-09-12T22:03:28.336643+0000","last_unstale":"2024-09-12T22:03:38.119960+0000","last_undegraded":"2024-09-12T22:03:38.119960+0000","last_fullsized":"2024-09-12T22:03:38.119960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:56.968092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039518000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633563+0000","last_change":"2024-09-12T22:03:32.454155+0000","last_active":"2024-09-12T22:03:37.633563+0000","last_peered":"2024-09-12T22:03:37.633563+0000","last_clean":"2024-09-12T22:03:37.633563+0000","last_became_active":"2024-09-12T22:03:32.453733+0000","last_became_peered":"2024-09-12T22:03:32.453733+0000","last_unstale":"2024-09-12T22:03:37.633563+0000","last_undegraded":"2024-09-12T22:03:37.633563+0000","last_fullsized":"2024-09-12T22:03:37.633563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:09.186165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949078+0000","last_change":"2024-09-12T22:03:33.458657+0000","last_active":"2024-09-12T22:03:36.949078+0000","last_peered":"2024-09-12T22:03:36.949078+0000","last_clean":"2024-09-12T22:03:36.949078+0000","last_became_active":"2024-09-12T22:03:33.458295+0000","last_became_peered":"2024-09-12T22:03:33.458295+0000","last_unstale":"2024-09-12T22:03:36.949078+0000","last_undegraded":"2024-09-12T22:03:36.949078+0000","last_fullsized":"2024-09-12T22:03:36.949078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:25.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633742+0000","last_change":"2024-09-12T22:03:30.343746+0000","last_active":"2024-09-12T22:03:37.633742+0000","last_peered":"2024-09-12T22:03:37.633742+0000","last_clean":"2024-09-12T22:03:37.633742+0000","last_became_active":"2024-09-12T22:03:28.335895+0000","last_became_peered":"2024-09-12T22:03:28.335895+0000","last_unstale":"2024-09-12T22:03:37.633742+0000","last_undegraded":"2024-09-12T22:03:37.633742+0000","last_fullsized":"2024-09-12T22:03:37.633742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.827420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070116600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948158+0000","last_change":"2024-09-12T22:03:32.461331+0000","last_active":"2024-09-12T22:03:36.948158+0000","last_peered":"2024-09-12T22:03:36.948158+0000","last_clean":"2024-09-12T22:03:36.948158+0000","last_became_active":"2024-09-12T22:03:32.460966+0000","last_became_peered":"2024-09-12T22:03:32.460966+0000","last_unstale":"2024-09-12T22:03:36.948158+0000","last_undegraded":"2024-09-12T22:03:36.948158+0000","last_fullsized":"2024-09-12T22:03:36.948158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:18.939990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634490+0000","last_change":"2024-09-12T22:03:33.458277+0000","last_active":"2024-09-12T22:03:37.634490+0000","last_peered":"2024-09-12T22:03:37.634490+0000","last_clean":"2024-09-12T22:03:37.634490+0000","last_became_active":"2024-09-12T22:03:33.457320+0000","last_became_peered":"2024-09-12T22:03:33.457320+0000","last_unstale":"2024-09-12T22:03:37.634490+0000","last_undegraded":"2024-09-12T22:03:37.634490+0000","last_fullsized":"2024-09-12T22:03:37.634490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:46.703481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120406+0000","last_change":"2024-09-12T22:03:30.339989+0000","last_active":"2024-09-12T22:03:38.120406+0000","last_peered":"2024-09-12T22:03:38.120406+0000","last_clean":"2024-09-12T22:03:38.120406+0000","last_became_active":"2024-09-12T22:03:28.335760+0000","last_became_peered":"2024-09-12T22:03:28.335760+0000","last_unstale":"2024-09-12T22:03:38.120406+0000","last_undegraded":"2024-09-12T22:03:38.120406+0000","last_fullsized":"2024-09-12T22:03:38.120406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:29.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120764+0000","last_change":"2024-09-12T22:03:32.456988+0000","last_active":"2024-09-12T22:03:38.120764+0000","last_peered":"2024-09-12T22:03:38.120764+0000","last_clean":"2024-09-12T22:03:38.120764+0000","last_became_active":"2024-09-12T22:03:32.456605+0000","last_became_peered":"2024-09-12T22:03:32.456605+0000","last_unstale":"2024-09-12T22:03:38.120764+0000","last_undegraded":"2024-09-12T22:03:38.120764+0000","last_fullsized":"2024-09-12T22:03:38.120764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:38.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634007+0000","last_change":"2024-09-12T22:03:33.458311+0000","last_active":"2024-09-12T22:03:37.634007+0000","last_peered":"2024-09-12T22:03:37.634007+0000","last_clean":"2024-09-12T22:03:37.634007+0000","last_became_active":"2024-09-12T22:03:33.456397+0000","last_became_peered":"2024-09-12T22:03:33.456397+0000","last_unstale":"2024-09-12T22:03:37.634007+0000","last_undegraded":"2024-09-12T22:03:37.634007+0000","last_fullsized":"2024-09-12T22:03:37.634007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:51.305559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121103+0000","last_change":"2024-09-12T22:03:32.457239+0000","last_active":"2024-09-12T22:03:38.121103+0000","last_peered":"2024-09-12T22:03:38.121103+0000","last_clean":"2024-09-12T22:03:38.121103+0000","last_became_active":"2024-09-12T22:03:32.456807+0000","last_became_peered":"2024-09-12T22:03:32.456807+0000","last_unstale":"2024-09-12T22:03:38.121103+0000","last_undegraded":"2024-09-12T22:03:38.121103+0000","last_fullsized":"2024-09-12T22:03:38.121103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:00.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634340+0000","last_change":"2024-09-12T22:03:30.343489+0000","last_active":"2024-09-12T22:03:37.634340+0000","last_peered":"2024-09-12T22:03:37.634340+0000","last_clean":"2024-09-12T22:03:37.634340+0000","last_became_active":"2024-09-12T22:03:28.335875+0000","last_became_peered":"2024-09-12T22:03:28.335875+0000","last_unstale":"2024-09-12T22:03:37.634340+0000","last_undegraded":"2024-09-12T22:03:37.634340+0000","last_fullsized":"2024-09-12T22:03:37.634340+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:34.561003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042932700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948531+0000","last_change":"2024-09-12T22:03:33.460944+0000","last_active":"2024-09-12T22:03:36.948531+0000","last_peered":"2024-09-12T22:03:36.948531+0000","last_clean":"2024-09-12T22:03:36.948531+0000","last_became_active":"2024-09-12T22:03:33.460514+0000","last_became_peered":"2024-09-12T22:03:33.460514+0000","last_unstale":"2024-09-12T22:03:36.948531+0000","last_undegraded":"2024-09-12T22:03:36.948531+0000","last_fullsized":"2024-09-12T22:03:36.948531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:54.744829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634252+0000","last_change":"2024-09-12T22:03:32.460055+0000","last_active":"2024-09-12T22:03:37.634252+0000","last_peered":"2024-09-12T22:03:37.634252+0000","last_clean":"2024-09-12T22:03:37.634252+0000","last_became_active":"2024-09-12T22:03:32.459276+0000","last_became_peered":"2024-09-12T22:03:32.459276+0000","last_unstale":"2024-09-12T22:03:37.634252+0000","last_undegraded":"2024-09-12T22:03:37.634252+0000","last_fullsized":"2024-09-12T22:03:37.634252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:23.776211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949211+0000","last_change":"2024-09-12T22:03:30.649265+0000","last_active":"2024-09-12T22:03:36.949211+0000","last_peered":"2024-09-12T22:03:36.949211+0000","last_clean":"2024-09-12T22:03:36.949211+0000","last_became_active":"2024-09-12T22:03:28.337193+0000","last_became_peered":"2024-09-12T22:03:28.337193+0000","last_unstale":"2024-09-12T22:03:36.949211+0000","last_undegraded":"2024-09-12T22:03:36.949211+0000","last_fullsized":"2024-09-12T22:03:36.949211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:43.899511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948515+0000","last_change":"2024-09-12T22:03:33.464893+0000","last_active":"2024-09-12T22:03:36.948515+0000","last_peered":"2024-09-12T22:03:36.948515+0000","last_clean":"2024-09-12T22:03:36.948515+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:03:36.948515+0000","last_undegraded":"2024-09-12T22:03:36.948515+0000","last_fullsized":"2024-09-12T22:03:36.948515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:47.948673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634814+0000","last_change":"2024-09-12T22:03:32.460426+0000","last_active":"2024-09-12T22:03:37.634814+0000","last_peered":"2024-09-12T22:03:37.634814+0000","last_clean":"2024-09-12T22:03:37.634814+0000","last_became_active":"2024-09-12T22:03:32.460161+0000","last_became_peered":"2024-09-12T22:03:32.460161+0000","last_unstale":"2024-09-12T22:03:37.634814+0000","last_undegraded":"2024-09-12T22:03:37.634814+0000","last_fullsized":"2024-09-12T22:03:37.634814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.472907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634952+0000","last_change":"2024-09-12T22:03:30.343485+0000","last_active":"2024-09-12T22:03:37.634952+0000","last_peered":"2024-09-12T22:03:37.634952+0000","last_clean":"2024-09-12T22:03:37.634952+0000","last_became_active":"2024-09-12T22:03:28.335961+0000","last_became_peered":"2024-09-12T22:03:28.335961+0000","last_unstale":"2024-09-12T22:03:37.634952+0000","last_undegraded":"2024-09-12T22:03:37.634952+0000","last_fullsized":"2024-09-12T22:03:37.634952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:24.041899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043906199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633375+0000","last_change":"2024-09-12T22:03:33.464709+0000","last_active":"2024-09-12T22:03:37.633375+0000","last_peered":"2024-09-12T22:03:37.633375+0000","last_clean":"2024-09-12T22:03:37.633375+0000","last_became_active":"2024-09-12T22:03:33.464016+0000","last_became_peered":"2024-09-12T22:03:33.464016+0000","last_unstale":"2024-09-12T22:03:37.633375+0000","last_undegraded":"2024-09-12T22:03:37.633375+0000","last_fullsized":"2024-09-12T22:03:37.633375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:07.598247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634893+0000","last_change":"2024-09-12T22:03:32.458014+0000","last_active":"2024-09-12T22:03:37.634893+0000","last_peered":"2024-09-12T22:03:37.634893+0000","last_clean":"2024-09-12T22:03:37.634893+0000","last_became_active":"2024-09-12T22:03:32.457654+0000","last_became_peered":"2024-09-12T22:03:32.457654+0000","last_unstale":"2024-09-12T22:03:37.634893+0000","last_undegraded":"2024-09-12T22:03:37.634893+0000","last_fullsized":"2024-09-12T22:03:37.634893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:08.446521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121056+0000","last_change":"2024-09-12T22:03:30.339817+0000","last_active":"2024-09-12T22:03:38.121056+0000","last_peered":"2024-09-12T22:03:38.121056+0000","last_clean":"2024-09-12T22:03:38.121056+0000","last_became_active":"2024-09-12T22:03:28.336599+0000","last_became_peered":"2024-09-12T22:03:28.336599+0000","last_unstale":"2024-09-12T22:03:38.121056+0000","last_undegraded":"2024-09-12T22:03:38.121056+0000","last_fullsized":"2024-09-12T22:03:38.121056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:36.442618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058522100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948215+0000","last_change":"2024-09-12T22:03:33.456975+0000","last_active":"2024-09-12T22:03:36.948215+0000","last_peered":"2024-09-12T22:03:36.948215+0000","last_clean":"2024-09-12T22:03:36.948215+0000","last_became_active":"2024-09-12T22:03:33.456611+0000","last_became_peered":"2024-09-12T22:03:33.456611+0000","last_unstale":"2024-09-12T22:03:36.948215+0000","last_undegraded":"2024-09-12T22:03:36.948215+0000","last_fullsized":"2024-09-12T22:03:36.948215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:46.309219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120544+0000","last_change":"2024-09-12T22:03:33.455671+0000","last_active":"2024-09-12T22:03:38.120544+0000","last_peered":"2024-09-12T22:03:38.120544+0000","last_clean":"2024-09-12T22:03:38.120544+0000","last_became_active":"2024-09-12T22:03:33.454833+0000","last_became_peered":"2024-09-12T22:03:33.454833+0000","last_unstale":"2024-09-12T22:03:38.120544+0000","last_undegraded":"2024-09-12T22:03:38.120544+0000","last_fullsized":"2024-09-12T22:03:38.120544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:08.773779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120513+0000","last_change":"2024-09-12T22:03:32.458296+0000","last_active":"2024-09-12T22:03:38.120513+0000","last_peered":"2024-09-12T22:03:38.120513+0000","last_clean":"2024-09-12T22:03:38.120513+0000","last_became_active":"2024-09-12T22:03:32.457908+0000","last_became_peered":"2024-09-12T22:03:32.457908+0000","last_unstale":"2024-09-12T22:03:38.120513+0000","last_undegraded":"2024-09-12T22:03:38.120513+0000","last_fullsized":"2024-09-12T22:03:38.120513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:53.758615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633547+0000","last_change":"2024-09-12T22:03:33.458365+0000","last_active":"2024-09-12T22:03:37.633547+0000","last_peered":"2024-09-12T22:03:37.633547+0000","last_clean":"2024-09-12T22:03:37.633547+0000","last_became_active":"2024-09-12T22:03:33.456256+0000","last_became_peered":"2024-09-12T22:03:33.456256+0000","last_unstale":"2024-09-12T22:03:37.633547+0000","last_undegraded":"2024-09-12T22:03:37.633547+0000","last_fullsized":"2024-09-12T22:03:37.633547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:12.145709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949119+0000","last_change":"2024-09-12T22:03:32.461509+0000","last_active":"2024-09-12T22:03:36.949119+0000","last_peered":"2024-09-12T22:03:36.949119+0000","last_clean":"2024-09-12T22:03:36.949119+0000","last_became_active":"2024-09-12T22:03:32.461161+0000","last_became_peered":"2024-09-12T22:03:32.461161+0000","last_unstale":"2024-09-12T22:03:36.949119+0000","last_undegraded":"2024-09-12T22:03:36.949119+0000","last_fullsized":"2024-09-12T22:03:36.949119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:02.888202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120809+0000","last_change":"2024-09-12T22:03:32.457458+0000","last_active":"2024-09-12T22:03:38.120809+0000","last_peered":"2024-09-12T22:03:38.120809+0000","last_clean":"2024-09-12T22:03:38.120809+0000","last_became_active":"2024-09-12T22:03:32.457007+0000","last_became_peered":"2024-09-12T22:03:32.457007+0000","last_unstale":"2024-09-12T22:03:38.120809+0000","last_undegraded":"2024-09-12T22:03:38.120809+0000","last_fullsized":"2024-09-12T22:03:38.120809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:08.474776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633334+0000","last_change":"2024-09-12T22:03:33.465561+0000","last_active":"2024-09-12T22:03:37.633334+0000","last_peered":"2024-09-12T22:03:37.633334+0000","last_clean":"2024-09-12T22:03:37.633334+0000","last_became_active":"2024-09-12T22:03:33.464837+0000","last_became_peered":"2024-09-12T22:03:33.464837+0000","last_unstale":"2024-09-12T22:03:37.633334+0000","last_undegraded":"2024-09-12T22:03:37.633334+0000","last_fullsized":"2024-09-12T22:03:37.633334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:32.859664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634692+0000","last_change":"2024-09-12T22:03:32.458964+0000","last_active":"2024-09-12T22:03:37.634692+0000","last_peered":"2024-09-12T22:03:37.634692+0000","last_clean":"2024-09-12T22:03:37.634692+0000","last_became_active":"2024-09-12T22:03:32.458346+0000","last_became_peered":"2024-09-12T22:03:32.458346+0000","last_unstale":"2024-09-12T22:03:37.634692+0000","last_undegraded":"2024-09-12T22:03:37.634692+0000","last_fullsized":"2024-09-12T22:03:37.634692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:37.178897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633336+0000","last_change":"2024-09-12T22:03:33.458060+0000","last_active":"2024-09-12T22:03:37.633336+0000","last_peered":"2024-09-12T22:03:37.633336+0000","last_clean":"2024-09-12T22:03:37.633336+0000","last_became_active":"2024-09-12T22:03:33.457390+0000","last_became_peered":"2024-09-12T22:03:33.457390+0000","last_unstale":"2024-09-12T22:03:37.633336+0000","last_undegraded":"2024-09-12T22:03:37.633336+0000","last_fullsized":"2024-09-12T22:03:37.633336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:14.711011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949306+0000","last_change":"2024-09-12T22:03:33.460177+0000","last_active":"2024-09-12T22:03:36.949306+0000","last_peered":"2024-09-12T22:03:36.949306+0000","last_clean":"2024-09-12T22:03:36.949306+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:03:36.949306+0000","last_undegraded":"2024-09-12T22:03:36.949306+0000","last_fullsized":"2024-09-12T22:03:36.949306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633492+0000","last_change":"2024-09-12T22:03:32.460441+0000","last_active":"2024-09-12T22:03:37.633492+0000","last_peered":"2024-09-12T22:03:37.633492+0000","last_clean":"2024-09-12T22:03:37.633492+0000","last_became_active":"2024-09-12T22:03:32.460126+0000","last_became_peered":"2024-09-12T22:03:32.460126+0000","last_unstale":"2024-09-12T22:03:37.633492+0000","last_undegraded":"2024-09-12T22:03:37.633492+0000","last_fullsized":"2024-09-12T22:03:37.633492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:52.150617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634575+0000","last_change":"2024-09-12T22:03:33.466167+0000","last_active":"2024-09-12T22:03:37.634575+0000","last_peered":"2024-09-12T22:03:37.634575+0000","last_clean":"2024-09-12T22:03:37.634575+0000","last_became_active":"2024-09-12T22:03:33.465116+0000","last_became_peered":"2024-09-12T22:03:33.465116+0000","last_unstale":"2024-09-12T22:03:37.634575+0000","last_undegraded":"2024-09-12T22:03:37.634575+0000","last_fullsized":"2024-09-12T22:03:37.634575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:19.683631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633484+0000","last_change":"2024-09-12T22:03:32.454262+0000","last_active":"2024-09-12T22:03:37.633484+0000","last_peered":"2024-09-12T22:03:37.633484+0000","last_clean":"2024-09-12T22:03:37.633484+0000","last_became_active":"2024-09-12T22:03:32.453776+0000","last_became_peered":"2024-09-12T22:03:32.453776+0000","last_unstale":"2024-09-12T22:03:37.633484+0000","last_undegraded":"2024-09-12T22:03:37.633484+0000","last_fullsized":"2024-09-12T22:03:37.633484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:57.091523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948901+0000","last_change":"2024-09-12T22:03:33.465186+0000","last_active":"2024-09-12T22:03:36.948901+0000","last_peered":"2024-09-12T22:03:36.948901+0000","last_clean":"2024-09-12T22:03:36.948901+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:03:36.948901+0000","last_undegraded":"2024-09-12T22:03:36.948901+0000","last_fullsized":"2024-09-12T22:03:36.948901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:29.409225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948624+0000","last_change":"2024-09-12T22:03:32.458132+0000","last_active":"2024-09-12T22:03:36.948624+0000","last_peered":"2024-09-12T22:03:36.948624+0000","last_clean":"2024-09-12T22:03:36.948624+0000","last_became_active":"2024-09-12T22:03:32.457817+0000","last_became_peered":"2024-09-12T22:03:32.457817+0000","last_unstale":"2024-09-12T22:03:36.948624+0000","last_undegraded":"2024-09-12T22:03:36.948624+0000","last_fullsized":"2024-09-12T22:03:36.948624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:47.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948638+0000","last_change":"2024-09-12T22:03:33.460730+0000","last_active":"2024-09-12T22:03:36.948638+0000","last_peered":"2024-09-12T22:03:36.948638+0000","last_clean":"2024-09-12T22:03:36.948638+0000","last_became_active":"2024-09-12T22:03:33.460223+0000","last_became_peered":"2024-09-12T22:03:33.460223+0000","last_unstale":"2024-09-12T22:03:36.948638+0000","last_undegraded":"2024-09-12T22:03:36.948638+0000","last_fullsized":"2024-09-12T22:03:36.948638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.406786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948595+0000","last_change":"2024-09-12T22:03:32.461243+0000","last_active":"2024-09-12T22:03:36.948595+0000","last_peered":"2024-09-12T22:03:36.948595+0000","last_clean":"2024-09-12T22:03:36.948595+0000","last_became_active":"2024-09-12T22:03:32.460760+0000","last_became_peered":"2024-09-12T22:03:32.460760+0000","last_unstale":"2024-09-12T22:03:36.948595+0000","last_undegraded":"2024-09-12T22:03:36.948595+0000","last_fullsized":"2024-09-12T22:03:36.948595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:42.848199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120422+0000","last_change":"2024-09-12T22:03:33.462764+0000","last_active":"2024-09-12T22:03:38.120422+0000","last_peered":"2024-09-12T22:03:38.120422+0000","last_clean":"2024-09-12T22:03:38.120422+0000","last_became_active":"2024-09-12T22:03:33.462360+0000","last_became_peered":"2024-09-12T22:03:33.462360+0000","last_unstale":"2024-09-12T22:03:38.120422+0000","last_undegraded":"2024-09-12T22:03:38.120422+0000","last_fullsized":"2024-09-12T22:03:38.120422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120443+0000","last_change":"2024-09-12T22:03:32.457280+0000","last_active":"2024-09-12T22:03:38.120443+0000","last_peered":"2024-09-12T22:03:38.120443+0000","last_clean":"2024-09-12T22:03:38.120443+0000","last_became_active":"2024-09-12T22:03:32.456812+0000","last_became_peered":"2024-09-12T22:03:32.456812+0000","last_unstale":"2024-09-12T22:03:38.120443+0000","last_undegraded":"2024-09-12T22:03:38.120443+0000","last_fullsized":"2024-09-12T22:03:38.120443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:46:51.143125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120065+0000","last_change":"2024-09-12T22:03:33.464094+0000","last_active":"2024-09-12T22:03:38.120065+0000","last_peered":"2024-09-12T22:03:38.120065+0000","last_clean":"2024-09-12T22:03:38.120065+0000","last_became_active":"2024-09-12T22:03:33.463380+0000","last_became_peered":"2024-09-12T22:03:33.463380+0000","last_unstale":"2024-09-12T22:03:38.120065+0000","last_undegraded":"2024-09-12T22:03:38.120065+0000","last_fullsized":"2024-09-12T22:03:38.120065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:11.422942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948983+0000","last_change":"2024-09-12T22:03:32.461230+0000","last_active":"2024-09-12T22:03:36.948983+0000","last_peered":"2024-09-12T22:03:36.948983+0000","last_clean":"2024-09-12T22:03:36.948983+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:03:36.948983+0000","last_undegraded":"2024-09-12T22:03:36.948983+0000","last_fullsized":"2024-09-12T22:03:36.948983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:16.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948424+0000","last_change":"2024-09-12T22:03:33.458634+0000","last_active":"2024-09-12T22:03:36.948424+0000","last_peered":"2024-09-12T22:03:36.948424+0000","last_clean":"2024-09-12T22:03:36.948424+0000","last_became_active":"2024-09-12T22:03:33.458096+0000","last_became_peered":"2024-09-12T22:03:33.458096+0000","last_unstale":"2024-09-12T22:03:36.948424+0000","last_undegraded":"2024-09-12T22:03:36.948424+0000","last_fullsized":"2024-09-12T22:03:36.948424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:09.702722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634795+0000","last_change":"2024-09-12T22:03:32.460314+0000","last_active":"2024-09-12T22:03:37.634795+0000","last_peered":"2024-09-12T22:03:37.634795+0000","last_clean":"2024-09-12T22:03:37.634795+0000","last_became_active":"2024-09-12T22:03:32.459890+0000","last_became_peered":"2024-09-12T22:03:32.459890+0000","last_unstale":"2024-09-12T22:03:37.634795+0000","last_undegraded":"2024-09-12T22:03:37.634795+0000","last_fullsized":"2024-09-12T22:03:37.634795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:00.774244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119819+0000","last_change":"2024-09-12T22:03:33.464082+0000","last_active":"2024-09-12T22:03:38.119819+0000","last_peered":"2024-09-12T22:03:38.119819+0000","last_clean":"2024-09-12T22:03:38.119819+0000","last_became_active":"2024-09-12T22:03:33.462648+0000","last_became_peered":"2024-09-12T22:03:33.462648+0000","last_unstale":"2024-09-12T22:03:38.119819+0000","last_undegraded":"2024-09-12T22:03:38.119819+0000","last_fullsized":"2024-09-12T22:03:38.119819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.466890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634610+0000","last_change":"2024-09-12T22:03:32.459293+0000","last_active":"2024-09-12T22:03:37.634610+0000","last_peered":"2024-09-12T22:03:37.634610+0000","last_clean":"2024-09-12T22:03:37.634610+0000","last_became_active":"2024-09-12T22:03:32.458679+0000","last_became_peered":"2024-09-12T22:03:32.458679+0000","last_unstale":"2024-09-12T22:03:37.634610+0000","last_undegraded":"2024-09-12T22:03:37.634610+0000","last_fullsized":"2024-09-12T22:03:37.634610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:21.083182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":798720,"data_stored":657780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36140,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335700,"statfs":{"total":96636764160,"available":96599756800,"internally_reserved":0,"allocated":811008,"data_stored":658415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35532,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336308,"statfs":{"total":96636764160,"available":96600379392,"internally_reserved":0,"allocated":192512,"data_stored":66253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:03:50.655 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:03:50.655 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-12T22:03:50.980 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 21 2024-09-12T22:03:50.980 INFO:teuthology.orchestra.run.smithi043.stdout:fsid 1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7 2024-09-12T22:03:50.980 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-09-12T22:03:11.964028+0000 2024-09-12T22:03:50.980 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2024-09-12T22:03:36.944923+0000 2024-09-12T22:03:50.981 INFO:teuthology.orchestra.run.smithi043.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T22:03:50.981 INFO:teuthology.orchestra.run.smithi043.stdout:crush_version 5 2024-09-12T22:03:50.981 INFO:teuthology.orchestra.run.smithi043.stdout:full_ratio 0.95 2024-09-12T22:03:50.981 INFO:teuthology.orchestra.run.smithi043.stdout:backfillfull_ratio 0.9 2024-09-12T22:03:50.981 INFO:teuthology.orchestra.run.smithi043.stdout:nearfull_ratio 0.85 2024-09-12T22:03:50.981 INFO:teuthology.orchestra.run.smithi043.stdout:require_min_compat_client luminous 2024-09-12T22:03:50.981 INFO:teuthology.orchestra.run.smithi043.stdout:min_compat_client jewel 2024-09-12T22:03:50.981 INFO:teuthology.orchestra.run.smithi043.stdout:require_osd_release squid 2024-09-12T22:03:50.981 INFO:teuthology.orchestra.run.smithi043.stdout:stretch_mode_enabled false 2024-09-12T22:03:50.981 INFO:teuthology.orchestra.run.smithi043.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-09-12T22:03:50.981 INFO:teuthology.orchestra.run.smithi043.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 16 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.50 2024-09-12T22:03:50.981 INFO:teuthology.orchestra.run.smithi043.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-09-12T22:03:50.981 INFO:teuthology.orchestra.run.smithi043.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-09-12T22:03:50.981 INFO:teuthology.orchestra.run.smithi043.stdout:max_osd 3 2024-09-12T22:03:50.982 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 up in weight 1 up_from 8 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6800/1281227380,v1:172.21.15.47:6801/1281227380] [v2:172.21.15.47:6802/1281227380,v1:172.21.15.47:6803/1281227380] exists,up eb292153-0043-4981-8743-115f848d2064 2024-09-12T22:03:50.982 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 up in weight 1 up_from 9 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6800/1334802479,v1:172.21.15.110:6801/1334802479] [v2:172.21.15.110:6802/1334802479,v1:172.21.15.110:6803/1334802479] exists,up 5f0330a2-15ce-4ffb-a697-da1f930db079 2024-09-12T22:03:50.982 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 up in weight 1 up_from 9 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6800/3565874056,v1:172.21.15.146:6801/3565874056] [v2:172.21.15.146:6802/3565874056,v1:172.21.15.146:6803/3565874056] exists,up ae0b014f-768c-4f57-82c6-3edf9aa9f856 2024-09-12T22:03:50.995 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6800/1281227380,v1:172.21.15.47:6801/1281227380] [v2:172.21.15.47:6802/1281227380,v1:172.21.15.47:6803/1281227380] exists,up eb292153-0043-4981-8743-115f848d2064', 'osd.1 up in weight 1 up_from 9 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6800/1334802479,v1:172.21.15.110:6801/1334802479] [v2:172.21.15.110:6802/1334802479,v1:172.21.15.110:6803/1334802479] exists,up 5f0330a2-15ce-4ffb-a697-da1f930db079', 'osd.2 up in weight 1 up_from 9 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6800/3565874056,v1:172.21.15.146:6801/3565874056] [v2:172.21.15.146:6802/3565874056,v1:172.21.15.146:6803/3565874056] exists,up ae0b014f-768c-4f57-82c6-3edf9aa9f856'] 2024-09-12T22:03:50.995 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-12T22:03:51.097 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T22:03:51.097 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mon.a", 2024-09-12T22:03:51.097 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster": "ceph", 2024-09-12T22:03:51.097 INFO:teuthology.orchestra.run.smithi043.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-12T22:03:51.097 INFO:teuthology.orchestra.run.smithi043.stdout: "admin_socket_mode": "", 2024-09-12T22:03:51.098 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-12T22:03:51.098 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_client_required": "cephx, none", 2024-09-12T22:03:51.098 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_cluster_required": "cephx", 2024-09-12T22:03:51.098 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_debug": "true", 2024-09-12T22:03:51.098 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-12T22:03:51.098 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-12T22:03:51.098 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_service_required": "cephx", 2024-09-12T22:03:51.098 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-12T22:03:51.098 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_supported": "cephx", 2024-09-12T22:03:51.098 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_aio": "true", 2024-09-12T22:03:51.098 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-12T22:03:51.098 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_aio_poll_ms": "250", 2024-09-12T22:03:51.099 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_aio_reap_max": "16", 2024-09-12T22:03:51.099 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_async_discard": "false", 2024-09-12T22:03:51.099 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_block_size": "4096", 2024-09-12T22:03:51.099 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_debug_aio": "false", 2024-09-12T22:03:51.099 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-12T22:03:51.099 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-12T22:03:51.099 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_debug_inflight_ios": "false", 2024-09-12T22:03:51.099 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_enable_discard": "false", 2024-09-12T22:03:51.099 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_flock_retry": "3", 2024-09-12T22:03:51.099 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-12T22:03:51.099 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_inject_crash": "0", 2024-09-12T22:03:51.099 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-12T22:03:51.099 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_ioring": "false", 2024-09-12T22:03:51.100 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_ioring_hipri": "false", 2024-09-12T22:03:51.100 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-12T22:03:51.100 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-12T22:03:51.100 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-12T22:03:51.100 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-12T22:03:51.100 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-12T22:03:51.100 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-12T22:03:51.100 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_type": "", 2024-09-12T22:03:51.100 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_alloc_size": "1048576", 2024-09-12T22:03:51.100 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_allocator": "hybrid", 2024-09-12T22:03:51.100 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_buffered_io": "true", 2024-09-12T22:03:51.100 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_check_for_zeros": "false", 2024-09-12T22:03:51.100 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-12T22:03:51.100 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_compact_log_sync": "false", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_max_log_runway": "4194304", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_max_prefetch": "1048576", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_min_flush_size": "524288", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_min_log_runway": "1048576", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_replay_recovery": "false", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_sync_write": "false", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-12T22:03:51.101 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-12T22:03:51.102 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-12T22:03:51.102 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_allocation_from_file": "true", 2024-09-12T22:03:51.102 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_allocator": "hybrid", 2024-09-12T22:03:51.102 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-12T22:03:51.102 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-12T22:03:51.102 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-12T22:03:51.102 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-12T22:03:51.102 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bdev_label_multi": "true", 2024-09-12T22:03:51.102 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-12T22:03:51.102 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-12T22:03:51.102 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-12T22:03:51.102 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-12T22:03:51.102 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-12T22:03:51.102 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_create": "true", 2024-09-12T22:03:51.104 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_db_create": "false", 2024-09-12T22:03:51.104 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_db_path": "", 2024-09-12T22:03:51.104 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_db_size": "0", 2024-09-12T22:03:51.104 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_path": "", 2024-09-12T22:03:51.104 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_preallocate_file": "false", 2024-09-12T22:03:51.104 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_size": "107374182400", 2024-09-12T22:03:51.104 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_wal_create": "false", 2024-09-12T22:03:51.104 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_wal_path": "", 2024-09-12T22:03:51.104 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_wal_size": "100663296", 2024-09-12T22:03:51.104 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bluefs": "true", 2024-09-12T22:03:51.104 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-12T22:03:51.104 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-12T22:03:51.104 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-12T22:03:51.105 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-12T22:03:51.105 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T22:03:51.105 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T22:03:51.105 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-12T22:03:51.105 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T22:03:51.105 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_autotune": "true", 2024-09-12T22:03:51.105 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-12T22:03:51.105 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-12T22:03:51.105 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-12T22:03:51.105 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-12T22:03:51.105 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_size": "0", 2024-09-12T22:03:51.105 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-12T22:03:51.105 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-12T22:03:51.105 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-12T22:03:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-12T22:03:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_type": "2q", 2024-09-12T22:03:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-12T22:03:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_clone_cow": "true", 2024-09-12T22:03:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-12T22:03:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-12T22:03:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-12T22:03:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-12T22:03:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-12T22:03:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-12T22:03:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-12T22:03:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_mode": "none", 2024-09-12T22:03:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-12T22:03:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_csum_type": "crc32c", 2024-09-12T22:03:51.107 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-12T22:03:51.107 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_freelist": "false", 2024-09-12T22:03:51.107 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-12T22:03:51.107 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-12T22:03:51.107 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-12T22:03:51.107 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-12T22:03:51.107 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-12T22:03:51.107 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-12T22:03:51.107 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-12T22:03:51.107 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-12T22:03:51.107 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-12T22:03:51.107 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-12T22:03:51.107 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-12T22:03:51.107 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-12T22:03:51.108 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_small_allocations": "0", 2024-09-12T22:03:51.108 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-12T22:03:51.108 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_default_buffered_read": "true", 2024-09-12T22:03:51.108 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_default_buffered_write": "false", 2024-09-12T22:03:51.108 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-12T22:03:51.108 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-12T22:03:51.108 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-12T22:03:51.108 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-12T22:03:51.109 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-12T22:03:51.109 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-12T22:03:51.109 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-12T22:03:51.109 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-12T22:03:51.109 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-12T22:03:51.109 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fail_eio": "false", 2024-09-12T22:03:51.109 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-12T22:03:51.109 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-12T22:03:51.109 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-12T22:03:51.109 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_mount": "false", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_umount": "false", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_ignore_data_csum": "false", 2024-09-12T22:03:51.110 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_log_op_age": "5.000000", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_alloc_size": "0", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_blob_size": "0", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_deferred_txc": "32", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_min_alloc_size": "0", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_nid_prealloc": "1024", 2024-09-12T22:03:51.111 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-12T22:03:51.112 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-12T22:03:51.112 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-12T22:03:51.112 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-12T22:03:51.112 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_retry_disk_reads": "3", 2024-09-12T22:03:51.112 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_rocksdb_cf": "true", 2024-09-12T22:03:51.112 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-12T22:03:51.112 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-12T22:03:51.112 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-12T22:03:51.112 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-12T22:03:51.112 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-12T22:03:51.112 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-12T22:03:51.112 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-12T22:03:51.112 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-12T22:03:51.113 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_spdk_mem": "512", 2024-09-12T22:03:51.113 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-12T22:03:51.113 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-12T22:03:51.113 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-12T22:03:51.113 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-12T22:03:51.113 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-12T22:03:51.113 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-12T22:03:51.113 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-12T22:03:51.113 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_tracing": "false", 2024-09-12T22:03:51.113 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-12T22:03:51.113 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-12T22:03:51.113 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-12T22:03:51.113 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-12T22:03:51.113 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_zero_block_detection": "false", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-12T22:03:51.114 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_cluster_require_signatures": "false", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_cluster_require_version": "2", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_require_signatures": "false", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_require_version": "2", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_service_require_signatures": "false", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_service_require_version": "2", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_sign_messages": "true", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "chdir": "", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "client_acl_type": "", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "client_asio_thread_count": "2", 2024-09-12T22:03:51.115 INFO:teuthology.orchestra.run.smithi043.stdout: "client_cache_mid": "0.750000", 2024-09-12T22:03:51.116 INFO:teuthology.orchestra.run.smithi043.stdout: "client_cache_size": "16384", 2024-09-12T22:03:51.116 INFO:teuthology.orchestra.run.smithi043.stdout: "client_caps_release_delay": "5", 2024-09-12T22:03:51.116 INFO:teuthology.orchestra.run.smithi043.stdout: "client_check_pool_perm": "true", 2024-09-12T22:03:51.116 INFO:teuthology.orchestra.run.smithi043.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-12T22:03:51.116 INFO:teuthology.orchestra.run.smithi043.stdout: "client_debug_force_sync_read": "false", 2024-09-12T22:03:51.116 INFO:teuthology.orchestra.run.smithi043.stdout: "client_debug_getattr_caps": "false", 2024-09-12T22:03:51.116 INFO:teuthology.orchestra.run.smithi043.stdout: "client_debug_inject_features": "", 2024-09-12T22:03:51.116 INFO:teuthology.orchestra.run.smithi043.stdout: "client_debug_inject_tick_delay": "0", 2024-09-12T22:03:51.116 INFO:teuthology.orchestra.run.smithi043.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-12T22:03:51.116 INFO:teuthology.orchestra.run.smithi043.stdout: "client_die_on_failed_remount": "false", 2024-09-12T22:03:51.116 INFO:teuthology.orchestra.run.smithi043.stdout: "client_dirsize_rbytes": "true", 2024-09-12T22:03:51.116 INFO:teuthology.orchestra.run.smithi043.stdout: "client_force_lazyio": "false", 2024-09-12T22:03:51.116 INFO:teuthology.orchestra.run.smithi043.stdout: "client_fs": "", 2024-09-12T22:03:51.117 INFO:teuthology.orchestra.run.smithi043.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-12T22:03:51.117 INFO:teuthology.orchestra.run.smithi043.stdout: "client_inject_release_failure": "false", 2024-09-12T22:03:51.117 INFO:teuthology.orchestra.run.smithi043.stdout: "client_max_inline_size": "4096", 2024-09-12T22:03:51.117 INFO:teuthology.orchestra.run.smithi043.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-12T22:03:51.117 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mds_namespace": "", 2024-09-12T22:03:51.117 INFO:teuthology.orchestra.run.smithi043.stdout: "client_metadata": "", 2024-09-12T22:03:51.117 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mount_gid": "-1", 2024-09-12T22:03:51.117 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mount_timeout": "300", 2024-09-12T22:03:51.117 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mount_uid": "-1", 2024-09-12T22:03:51.117 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mountpoint": "/", 2024-09-12T22:03:51.117 INFO:teuthology.orchestra.run.smithi043.stdout: "client_notify_timeout": "10", 2024-09-12T22:03:51.118 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc": "true", 2024-09-12T22:03:51.118 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_max_dirty": "104857600", 2024-09-12T22:03:51.118 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-12T22:03:51.118 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_max_objects": "1000", 2024-09-12T22:03:51.118 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_size": "209715200", 2024-09-12T22:03:51.118 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_target_dirty": "8388608", 2024-09-12T22:03:51.118 INFO:teuthology.orchestra.run.smithi043.stdout: "client_permissions": "true", 2024-09-12T22:03:51.118 INFO:teuthology.orchestra.run.smithi043.stdout: "client_quota": "true", 2024-09-12T22:03:51.118 INFO:teuthology.orchestra.run.smithi043.stdout: "client_quota_df": "true", 2024-09-12T22:03:51.118 INFO:teuthology.orchestra.run.smithi043.stdout: "client_readahead_max_bytes": "0", 2024-09-12T22:03:51.118 INFO:teuthology.orchestra.run.smithi043.stdout: "client_readahead_max_periods": "4", 2024-09-12T22:03:51.118 INFO:teuthology.orchestra.run.smithi043.stdout: "client_readahead_min": "131072", 2024-09-12T22:03:51.118 INFO:teuthology.orchestra.run.smithi043.stdout: "client_reconnect_stale": "false", 2024-09-12T22:03:51.118 INFO:teuthology.orchestra.run.smithi043.stdout: "client_shutdown_timeout": "30", 2024-09-12T22:03:51.119 INFO:teuthology.orchestra.run.smithi043.stdout: "client_snapdir": ".snap", 2024-09-12T22:03:51.119 INFO:teuthology.orchestra.run.smithi043.stdout: "client_tick_interval": "1", 2024-09-12T22:03:51.119 INFO:teuthology.orchestra.run.smithi043.stdout: "client_trace": "", 2024-09-12T22:03:51.119 INFO:teuthology.orchestra.run.smithi043.stdout: "client_try_dentry_invalidate": "false", 2024-09-12T22:03:51.119 INFO:teuthology.orchestra.run.smithi043.stdout: "client_use_faked_inos": "false", 2024-09-12T22:03:51.119 INFO:teuthology.orchestra.run.smithi043.stdout: "client_use_random_mds": "false", 2024-09-12T22:03:51.119 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_graylog": "false", 2024-09-12T22:03:51.119 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-12T22:03:51.119 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_graylog_port": "12201", 2024-09-12T22:03:51.119 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_monitors": "default=true", 2024-09-12T22:03:51.119 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_syslog": "false", 2024-09-12T22:03:51.119 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-12T22:03:51.119 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_syslog_level": "info", 2024-09-12T22:03:51.120 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "-", 2024-09-12T22:03:51.120 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_network": "", 2024-09-12T22:03:51.120 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_network_interface": "", 2024-09-12T22:03:51.120 INFO:teuthology.orchestra.run.smithi043.stdout: "compressor_zlib_isal": "false", 2024-09-12T22:03:51.120 INFO:teuthology.orchestra.run.smithi043.stdout: "compressor_zlib_level": "5", 2024-09-12T22:03:51.120 INFO:teuthology.orchestra.run.smithi043.stdout: "compressor_zlib_winsize": "-15", 2024-09-12T22:03:51.120 INFO:teuthology.orchestra.run.smithi043.stdout: "compressor_zstd_level": "1", 2024-09-12T22:03:51.120 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-12T22:03:51.120 INFO:teuthology.orchestra.run.smithi043.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-12T22:03:51.120 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_alien_op_num_threads": "6", 2024-09-12T22:03:51.120 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-12T22:03:51.120 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-12T22:03:51.120 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-12T22:03:51.121 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_osd_stat_interval": "0", 2024-09-12T22:03:51.121 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_seastar_cpu_cores": "", 2024-09-12T22:03:51.121 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_seastar_num_threads": "0", 2024-09-12T22:03:51.121 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "", 2024-09-12T22:03:51.121 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location_hook": "", 2024-09-12T22:03:51.121 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location_hook_timeout": "10", 2024-09-12T22:03:51.121 INFO:teuthology.orchestra.run.smithi043.stdout: "daemonize": "false", 2024-09-12T22:03:51.121 INFO:teuthology.orchestra.run.smithi043.stdout: "daos_pool": "tank", 2024-09-12T22:03:51.121 INFO:teuthology.orchestra.run.smithi043.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-12T22:03:51.121 INFO:teuthology.orchestra.run.smithi043.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-12T22:03:51.121 INFO:teuthology.orchestra.run.smithi043.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-12T22:03:51.121 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_alienstore": "0/5", 2024-09-12T22:03:51.122 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_allow_any_pool_priority": "false", 2024-09-12T22:03:51.122 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_asok": "1/5", 2024-09-12T22:03:51.122 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_asok_assert_abort": "false", 2024-09-12T22:03:51.122 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_asserts_on_shutdown": "true", 2024-09-12T22:03:51.122 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_auth": "20/20", 2024-09-12T22:03:51.122 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_bdev": "1/3", 2024-09-12T22:03:51.122 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_bluefs": "1/5", 2024-09-12T22:03:51.122 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_bluestore": "1/5", 2024-09-12T22:03:51.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_buffer": "0/1", 2024-09-12T22:03:51.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_ceph_exporter": "1/5", 2024-09-12T22:03:51.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_cephfs_mirror": "0/5", 2024-09-12T22:03:51.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_cephsqlite": "0/5", 2024-09-12T22:03:51.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_client": "0/5", 2024-09-12T22:03:51.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_compressor": "1/5", 2024-09-12T22:03:51.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_context": "0/1", 2024-09-12T22:03:51.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_crimson_interrupt": "0/5", 2024-09-12T22:03:51.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_crush": "1/1", 2024-09-12T22:03:51.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_crypto": "1/5", 2024-09-12T22:03:51.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_cyanstore": "0/5", 2024-09-12T22:03:51.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_deliberately_leak_memory": "false", 2024-09-12T22:03:51.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_disable_randomized_ping": "false", 2024-09-12T22:03:51.124 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_dpdk": "1/5", 2024-09-12T22:03:51.124 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_eventtrace": "1/5", 2024-09-12T22:03:51.124 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_filer": "0/1", 2024-09-12T22:03:51.124 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_filestore": "1/3", 2024-09-12T22:03:51.124 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_finisher": "1/1", 2024-09-12T22:03:51.124 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_fuse": "1/5", 2024-09-12T22:03:51.124 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_heartbeat_testing_span": "0", 2024-09-12T22:03:51.124 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_heartbeatmap": "1/5", 2024-09-12T22:03:51.124 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-12T22:03:51.124 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_javaclient": "1/5", 2024-09-12T22:03:51.124 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_journal": "1/3", 2024-09-12T22:03:51.124 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_journaler": "0/5", 2024-09-12T22:03:51.124 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_kstore": "1/5", 2024-09-12T22:03:51.124 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_lockdep": "0/1", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mclock": "1/5", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds": "1/5", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_balancer": "1/5", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_locker": "1/5", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_log": "1/5", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_log_expire": "1/5", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_migrator": "1/5", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_quiesce": "3/5", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_memstore": "1/5", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mgr": "2/5", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mgrc": "1/5", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mon": "20/20", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_monc": "0/10", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_ms": "1/1", 2024-09-12T22:03:51.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_none": "0/5", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_objclass": "0/5", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_objectcacher": "0/5", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_objecter": "0/1", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_optracker": "0/5", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_osd": "1/5", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_paxos": "20/20", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_perfcounter": "1/5", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_prioritycache": "1/5", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rados": "0/5", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rbd": "0/5", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rbd_mirror": "0/5", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rbd_pwl": "0/5", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rbd_replay": "0/5", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_refs": "0/0", 2024-09-12T22:03:51.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_reserver": "1/1", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw": "1/5", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_access": "1/5", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_datacache": "1/5", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_dbstore": "1/5", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_flight": "1/5", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_sync": "1/5", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rocksdb": "4/5", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore": "0/5", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_backref": "0/5", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_cache": "0/5", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_cleaner": "0/5", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_device": "0/5", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_epm": "0/5", 2024-09-12T22:03:51.127 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-12T22:03:51.128 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_journal": "0/5", 2024-09-12T22:03:51.128 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_lba": "0/5", 2024-09-12T22:03:51.128 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_odata": "0/5", 2024-09-12T22:03:51.128 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_omap": "0/5", 2024-09-12T22:03:51.128 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_onode": "0/5", 2024-09-12T22:03:51.128 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_t": "0/5", 2024-09-12T22:03:51.128 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_tm": "0/5", 2024-09-12T22:03:51.128 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_striper": "0/1", 2024-09-12T22:03:51.128 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_test": "0/5", 2024-09-12T22:03:51.128 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_throttle": "1/1", 2024-09-12T22:03:51.128 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_timer": "0/1", 2024-09-12T22:03:51.129 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_tp": "0/5", 2024-09-12T22:03:51.129 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_trace": "1/5", 2024-09-12T22:03:51.129 INFO:teuthology.orchestra.run.smithi043.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-12T22:03:51.129 INFO:teuthology.orchestra.run.smithi043.stdout: "device_failure_prediction_mode": "none", 2024-09-12T22:03:51.129 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-12T22:03:51.129 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-12T22:03:51.129 INFO:teuthology.orchestra.run.smithi043.stdout: "err_to_graylog": "false", 2024-09-12T22:03:51.129 INFO:teuthology.orchestra.run.smithi043.stdout: "err_to_journald": "false", 2024-09-12T22:03:51.129 INFO:teuthology.orchestra.run.smithi043.stdout: "err_to_stderr": "true", 2024-09-12T22:03:51.129 INFO:teuthology.orchestra.run.smithi043.stdout: "err_to_syslog": "false", 2024-09-12T22:03:51.129 INFO:teuthology.orchestra.run.smithi043.stdout: "event_tracing": "false", 2024-09-12T22:03:51.129 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_addr": "0.0.0.0", 2024-09-12T22:03:51.130 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_http_port": "9926", 2024-09-12T22:03:51.130 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_prio_limit": "5", 2024-09-12T22:03:51.130 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-12T22:03:51.130 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_sort_metrics": "true", 2024-09-12T22:03:51.130 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_stats_period": "5", 2024-09-12T22:03:51.130 INFO:teuthology.orchestra.run.smithi043.stdout: "fake_statfs_for_testing": "0", 2024-09-12T22:03:51.130 INFO:teuthology.orchestra.run.smithi043.stdout: "fatal_signal_handlers": "true", 2024-09-12T22:03:51.130 INFO:teuthology.orchestra.run.smithi043.stdout: "filer_max_purge_ops": "10", 2024-09-12T22:03:51.130 INFO:teuthology.orchestra.run.smithi043.stdout: "filer_max_truncate_ops": "128", 2024-09-12T22:03:51.130 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_apply_finisher_threads": "1", 2024-09-12T22:03:51.130 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_blackhole": "false", 2024-09-12T22:03:51.130 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_btrfs_clone_range": "true", 2024-09-12T22:03:51.130 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_btrfs_snap": "true", 2024-09-12T22:03:51.130 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_caller_concurrency": "10", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_collect_device_partition_information": "true", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_commit_timeout": "600.000000", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_debug_inject_read_err": "false", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_debug_omap_check": "false", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_debug_verify_split": "false", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_dump_file": "", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fadvise": "true", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fail_eio": "true", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fd_cache_shards": "16", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fd_cache_size": "128", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fiemap": "false", 2024-09-12T22:03:51.131 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fiemap_threshold": "4096", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_inject_stall": "0", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_journal_parallel": "false", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_journal_trailing": "false", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_journal_writeahead": "false", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_kill_at": "0", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattrs": "0", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-12T22:03:51.132 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-12T22:03:51.133 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-12T22:03:51.133 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-12T22:03:51.133 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_xattr_value_size": "0", 2024-09-12T22:03:51.133 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-12T22:03:51.133 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-12T22:03:51.133 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-12T22:03:51.133 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_merge_threshold": "-10", 2024-09-12T22:03:51.133 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-12T22:03:51.133 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_odsync_write": "false", 2024-09-12T22:03:51.133 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_omap_backend": "rocksdb", 2024-09-12T22:03:51.133 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_omap_backend_path": "", 2024-09-12T22:03:51.133 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-12T22:03:51.133 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-12T22:03:51.133 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_op_thread_timeout": "60", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_op_threads": "2", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_punch_hole": "false", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_ops": "50", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-12T22:03:51.134 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_seek_data_hole": "false", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_sloppy_crc": "false", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_splice": "false", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_split_multiple": "2", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_split_rand_factor": "20", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_update_to": "1000", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_enable": "true", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-12T22:03:51.135 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-12T22:03:51.136 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-12T22:03:51.136 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-12T22:03:51.136 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-12T22:03:51.136 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-12T22:03:51.136 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_xfs_extsize": "false", 2024-09-12T22:03:51.136 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_zfs_snap": "false", 2024-09-12T22:03:51.136 INFO:teuthology.orchestra.run.smithi043.stdout: "fio_dir": "/tmp/fio", 2024-09-12T22:03:51.136 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7", 2024-09-12T22:03:51.136 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_allow_other": "true", 2024-09-12T22:03:51.136 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_atomic_o_trunc": "true", 2024-09-12T22:03:51.136 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_big_writes": "true", 2024-09-12T22:03:51.136 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_debug": "false", 2024-09-12T22:03:51.136 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_default_permissions": "false", 2024-09-12T22:03:51.137 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_disable_pagecache": "false", 2024-09-12T22:03:51.137 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_max_write": "0", 2024-09-12T22:03:51.137 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_multithreaded": "true", 2024-09-12T22:03:51.137 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_require_active_mds": "true", 2024-09-12T22:03:51.137 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_set_user_groups": "true", 2024-09-12T22:03:51.137 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_splice_move": "true", 2024-09-12T22:03:51.137 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_splice_read": "true", 2024-09-12T22:03:51.137 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_splice_write": "true", 2024-09-12T22:03:51.137 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-12T22:03:51.137 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_use_invalidate_cb": "true", 2024-09-12T22:03:51.137 INFO:teuthology.orchestra.run.smithi043.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-12T22:03:51.137 INFO:teuthology.orchestra.run.smithi043.stdout: "gss_target_name": "ceph", 2024-09-12T22:03:51.137 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_file": "", 2024-09-12T22:03:51.138 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_inject_failure": "0", 2024-09-12T22:03:51.138 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_interval": "5", 2024-09-12T22:03:51.138 INFO:teuthology.orchestra.run.smithi043.stdout: "host": "smithi043", 2024-09-12T22:03:51.138 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-12T22:03:51.138 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-12T22:03:51.138 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-12T22:03:51.138 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-12T22:03:51.138 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-12T22:03:51.138 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-12T22:03:51.138 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-12T22:03:51.138 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-12T22:03:51.138 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-12T22:03:51.138 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "inject_early_sigterm": "false", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "jaeger_agent_port": "6799", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "jaeger_tracing_enable": "false", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_aio": "true", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_align_min_size": "65536", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_block_align": "true", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_block_size": "4096", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_dio": "true", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_discard": "false", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_force_aio": "false", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_ignore_corruption": "false", 2024-09-12T22:03:51.139 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_max_write_bytes": "10485760", 2024-09-12T22:03:51.140 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_max_write_entries": "100", 2024-09-12T22:03:51.140 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_replay_from": "0", 2024-09-12T22:03:51.140 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-12T22:03:51.140 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-12T22:03:51.140 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-12T22:03:51.140 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-12T22:03:51.140 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_write_header_frequency": "0", 2024-09-12T22:03:51.140 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_zero_on_create": "false", 2024-09-12T22:03:51.140 INFO:teuthology.orchestra.run.smithi043.stdout: "journaler_prefetch_periods": "10", 2024-09-12T22:03:51.140 INFO:teuthology.orchestra.run.smithi043.stdout: "journaler_prezero_periods": "5", 2024-09-12T22:03:51.140 INFO:teuthology.orchestra.run.smithi043.stdout: "journaler_write_head_interval": "15", 2024-09-12T22:03:51.140 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "", 2024-09-12T22:03:51.141 INFO:teuthology.orchestra.run.smithi043.stdout: "keyfile": "", 2024-09-12T22:03:51.141 INFO:teuthology.orchestra.run.smithi043.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-12T22:03:51.141 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_backend": "rocksdb", 2024-09-12T22:03:51.141 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_default_stripe_size": "65536", 2024-09-12T22:03:51.141 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_fsck_on_mount": "false", 2024-09-12T22:03:51.141 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-12T22:03:51.141 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_max_bytes": "67108864", 2024-09-12T22:03:51.141 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_max_ops": "512", 2024-09-12T22:03:51.141 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_nid_prealloc": "1024", 2024-09-12T22:03:51.141 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_onode_map_size": "1024", 2024-09-12T22:03:51.141 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-12T22:03:51.141 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_sync_submit_transaction": "false", 2024-09-12T22:03:51.141 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_sync_transaction": "false", 2024-09-12T22:03:51.141 INFO:teuthology.orchestra.run.smithi043.stdout: "librados_thread_count": "2", 2024-09-12T22:03:51.142 INFO:teuthology.orchestra.run.smithi043.stdout: "lockdep": "false", 2024-09-12T22:03:51.142 INFO:teuthology.orchestra.run.smithi043.stdout: "lockdep_force_backtrace": "false", 2024-09-12T22:03:51.142 INFO:teuthology.orchestra.run.smithi043.stdout: "log_coarse_timestamps": "true", 2024-09-12T22:03:51.142 INFO:teuthology.orchestra.run.smithi043.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-12T22:03:51.142 INFO:teuthology.orchestra.run.smithi043.stdout: "log_flush_on_exit": "false", 2024-09-12T22:03:51.142 INFO:teuthology.orchestra.run.smithi043.stdout: "log_graylog_host": "127.0.0.1", 2024-09-12T22:03:51.142 INFO:teuthology.orchestra.run.smithi043.stdout: "log_graylog_port": "12201", 2024-09-12T22:03:51.142 INFO:teuthology.orchestra.run.smithi043.stdout: "log_max_new": "1000", 2024-09-12T22:03:51.142 INFO:teuthology.orchestra.run.smithi043.stdout: "log_max_recent": "10000", 2024-09-12T22:03:51.142 INFO:teuthology.orchestra.run.smithi043.stdout: "log_stderr_prefix": "", 2024-09-12T22:03:51.142 INFO:teuthology.orchestra.run.smithi043.stdout: "log_stop_at_utilization": "0.970000", 2024-09-12T22:03:51.142 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": "true", 2024-09-12T22:03:51.142 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_graylog": "false", 2024-09-12T22:03:51.143 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_journald": "false", 2024-09-12T22:03:51.143 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_stderr": "false", 2024-09-12T22:03:51.143 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_syslog": "false", 2024-09-12T22:03:51.143 INFO:teuthology.orchestra.run.smithi043.stdout: "max_rotating_auth_attempts": "10", 2024-09-12T22:03:51.143 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-12T22:03:51.143 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_action_on_write_error": "1", 2024-09-12T22:03:51.143 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_alternate_name_max": "8192", 2024-09-12T22:03:51.143 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_asio_thread_count": "2", 2024-09-12T22:03:51.143 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_export_pin": "true", 2024-09-12T22:03:51.143 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_fragment_dirs": "true", 2024-09-12T22:03:51.143 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-12T22:03:51.143 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_fragment_interval": "5", 2024-09-12T22:03:51.143 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-12T22:03:51.143 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-12T22:03:51.144 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_interval": "10", 2024-09-12T22:03:51.144 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_max": "-1", 2024-09-12T22:03:51.144 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_max_until": "-1", 2024-09-12T22:03:51.144 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_merge_size": "50", 2024-09-12T22:03:51.144 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_midchunk": "0.300000", 2024-09-12T22:03:51.144 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-12T22:03:51.144 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_min_start": "0.200000", 2024-09-12T22:03:51.144 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_minchunk": "0.001000", 2024-09-12T22:03:51.144 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_mode": "0", 2024-09-12T22:03:51.144 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_need_max": "1.200000", 2024-09-12T22:03:51.144 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_need_min": "0.800000", 2024-09-12T22:03:51.144 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_overload_epochs": "2", 2024-09-12T22:03:51.145 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-12T22:03:51.145 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-12T22:03:51.145 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_split_bits": "3", 2024-09-12T22:03:51.145 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-12T22:03:51.145 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_split_size": "10000", 2024-09-12T22:03:51.145 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-12T22:03:51.145 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_target_decay": "10.000000", 2024-09-12T22:03:51.145 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-12T22:03:51.145 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_beacon_grace": "15.000000", 2024-09-12T22:03:51.145 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_beacon_interval": "4.000000", 2024-09-12T22:03:51.145 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-12T22:03:51.145 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-12T22:03:51.145 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_mid": "0.700000", 2024-09-12T22:03:51.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-12T22:03:51.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_quiesce_delay": "0", 2024-09-12T22:03:51.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-12T22:03:51.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-12T22:03:51.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-12T22:03:51.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_release_free_interval": "10", 2024-09-12T22:03:51.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_reservation": "0.050000", 2024-09-12T22:03:51.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-12T22:03:51.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_trim_interval": "1", 2024-09-12T22:03:51.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_trim_threshold": "262144", 2024-09-12T22:03:51.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-12T22:03:51.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-12T22:03:51.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-12T22:03:51.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_client_prealloc_inos": "1000", 2024-09-12T22:03:51.147 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-12T22:03:51.147 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_connect_bootstrapping": "false", 2024-09-12T22:03:51.147 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_damage_table_max_entries": "10000", 2024-09-12T22:03:51.147 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-12T22:03:51.147 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_debug_auth_pins": "false", 2024-09-12T22:03:51.147 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_debug_frag": "false", 2024-09-12T22:03:51.147 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_debug_scatterstat": "false", 2024-09-12T22:03:51.147 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_debug_subtrees": "false", 2024-09-12T22:03:51.147 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_decay_halflife": "5.000000", 2024-09-12T22:03:51.147 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_default_dir_hash": "2", 2024-09-12T22:03:51.147 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_defer_session_stale": "true", 2024-09-12T22:03:51.148 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_deny_all_reconnect": "false", 2024-09-12T22:03:51.148 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dir_keys_per_op": "16384", 2024-09-12T22:03:51.148 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dir_max_commit_size": "10", 2024-09-12T22:03:51.148 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dir_max_entries": "0", 2024-09-12T22:03:51.148 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dir_prefetch": "true", 2024-09-12T22:03:51.148 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-12T22:03:51.148 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-12T22:03:51.148 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dump_cache_on_map": "false", 2024-09-12T22:03:51.148 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-12T22:03:51.148 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-12T22:03:51.149 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_early_reply": "true", 2024-09-12T22:03:51.149 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_enable_op_tracker": "true", 2024-09-12T22:03:51.149 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_enforce_unique_name": "true", 2024-09-12T22:03:51.149 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-12T22:03:51.149 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-12T22:03:51.149 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_export_ephemeral_random": "true", 2024-09-12T22:03:51.149 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-12T22:03:51.149 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-12T22:03:51.149 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-12T22:03:51.149 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-12T22:03:51.149 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-12T22:03:51.149 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-12T22:03:51.149 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-12T22:03:51.149 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-12T22:03:51.150 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_health_summarize_threshold": "10", 2024-09-12T22:03:51.150 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-12T22:03:51.150 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-12T22:03:51.150 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_health_dummy": "false", 2024-09-12T22:03:51.150 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-12T22:03:51.150 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_migrator_session_race": "false", 2024-09-12T22:03:51.150 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-12T22:03:51.150 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-12T22:03:51.150 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-12T22:03:51.150 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_join_fs": "", 2024-09-12T22:03:51.150 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_journal_format": "1", 2024-09-12T22:03:51.150 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_create_at": "0", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_export_at": "0", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_import_at": "0", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_journal_at": "0", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_journal_expire_at": "0", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_journal_replay_at": "0", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_link_at": "0", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_mdstable_at": "0", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_openc_at": "0", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_rename_at": "0", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_shutdown_at": "0", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_event_large_threshold": "524288", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_events_per_segment": "1024", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-12T22:03:51.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_max_events": "-1", 2024-09-12T22:03:51.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_max_segments": "128", 2024-09-12T22:03:51.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_pause": "false", 2024-09-12T22:03:51.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_segment_size": "0", 2024-09-12T22:03:51.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-12T22:03:51.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-12T22:03:51.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-12T22:03:51.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_trim_threshold": "128", 2024-09-12T22:03:51.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-12T22:03:51.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_warn_factor": "2.000000", 2024-09-12T22:03:51.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_caps_per_client": "1048576", 2024-09-12T22:03:51.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_completed_flushes": "100000", 2024-09-12T22:03:51.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_completed_requests": "100000", 2024-09-12T22:03:51.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_export_size": "20971520", 2024-09-12T22:03:51.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_file_recover": "32", 2024-09-12T22:03:51.153 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_purge_files": "64", 2024-09-12T22:03:51.153 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_purge_ops": "8192", 2024-09-12T22:03:51.153 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-12T22:03:51.153 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-12T22:03:51.153 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_snaps_per_dir": "100", 2024-09-12T22:03:51.153 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_metrics_update_interval": "2", 2024-09-12T22:03:51.153 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_min_caps_per_client": "100", 2024-09-12T22:03:51.153 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_min_caps_working_set": "10000", 2024-09-12T22:03:51.153 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-12T22:03:51.153 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_numa_node": "-1", 2024-09-12T22:03:51.153 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-12T22:03:51.153 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_complaint_time": "30.000000", 2024-09-12T22:03:51.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_history_duration": "600", 2024-09-12T22:03:51.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_history_size": "20", 2024-09-12T22:03:51.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_history_slow_op_size": "20", 2024-09-12T22:03:51.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-12T22:03:51.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_log_threshold": "5", 2024-09-12T22:03:51.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_ping_grace": "15", 2024-09-12T22:03:51.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_ping_interval": "5", 2024-09-12T22:03:51.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-12T22:03:51.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-12T22:03:51.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_max_caps": "30000", 2024-09-12T22:03:51.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-12T22:03:51.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-12T22:03:51.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-12T22:03:51.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_warning_threshold": "262144", 2024-09-12T22:03:51.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-12T22:03:51.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_replay_interval": "1.000000", 2024-09-12T22:03:51.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-12T22:03:51.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-12T22:03:51.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_root_ino_gid": "0", 2024-09-12T22:03:51.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_root_ino_uid": "0", 2024-09-12T22:03:51.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-12T22:03:51.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-12T22:03:51.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-12T22:03:51.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-12T22:03:51.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-12T22:03:51.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-12T22:03:51.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-12T22:03:51.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-12T22:03:51.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-12T22:03:51.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-12T22:03:51.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_shutdown_check": "0", 2024-09-12T22:03:51.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_skip_ino": "0", 2024-09-12T22:03:51.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-12T22:03:51.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_snap_max_uid": "4294967294", 2024-09-12T22:03:51.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_snap_min_uid": "0", 2024-09-12T22:03:51.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_snap_rstat": "false", 2024-09-12T22:03:51.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_standby_replay_damaged": "false", 2024-09-12T22:03:51.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_symlink_recovery": "true", 2024-09-12T22:03:51.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-12T22:03:51.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_thrash_exports": "0", 2024-09-12T22:03:51.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_thrash_fragments": "0", 2024-09-12T22:03:51.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_tick_interval": "5.000000", 2024-09-12T22:03:51.157 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_valgrind_exit": "false", 2024-09-12T22:03:51.157 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_verify_backtrace": "1", 2024-09-12T22:03:51.157 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_verify_scatter": "false", 2024-09-12T22:03:51.157 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-12T22:03:51.157 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_wipe_sessions": "false", 2024-09-12T22:03:51.157 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool_debug": "false", 2024-09-12T22:03:51.157 INFO:teuthology.orchestra.run.smithi043.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-12T22:03:51.157 INFO:teuthology.orchestra.run.smithi043.stdout: "memstore_device_bytes": "1073741824", 2024-09-12T22:03:51.157 INFO:teuthology.orchestra.run.smithi043.stdout: "memstore_page_set": "false", 2024-09-12T22:03:51.157 INFO:teuthology.orchestra.run.smithi043.stdout: "memstore_page_size": "65536", 2024-09-12T22:03:51.157 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_client_bytes": "134217728", 2024-09-12T22:03:51.157 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_client_messages": "512", 2024-09-12T22:03:51.157 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-12T22:03:51.158 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-12T22:03:51.158 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-12T22:03:51.158 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-12T22:03:51.158 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_disabled_modules": "", 2024-09-12T22:03:51.158 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_enable_op_tracker": "true", 2024-09-12T22:03:51.158 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-12T22:03:51.158 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_max_pg_num_change": "128", 2024-09-12T22:03:51.158 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_mds_bytes": "134217728", 2024-09-12T22:03:51.158 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_mds_messages": "128", 2024-09-12T22:03:51.158 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-12T22:03:51.158 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_mon_bytes": "134217728", 2024-09-12T22:03:51.158 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_mon_messages": "128", 2024-09-12T22:03:51.158 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-12T22:03:51.158 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-12T22:03:51.159 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_op_history_duration": "600", 2024-09-12T22:03:51.159 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_op_history_size": "20", 2024-09-12T22:03:51.159 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-12T22:03:51.159 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-12T22:03:51.159 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_op_log_threshold": "5", 2024-09-12T22:03:51.159 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_osd_bytes": "536870912", 2024-09-12T22:03:51.159 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_osd_messages": "8192", 2024-09-12T22:03:51.159 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_pool": "true", 2024-09-12T22:03:51.159 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-12T22:03:51.159 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_standby_modules": "true", 2024-09-12T22:03:51.159 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_stats_period": "5", 2024-09-12T22:03:51.159 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_stats_threshold": "5", 2024-09-12T22:03:51.159 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_tick_period": "2", 2024-09-12T22:03:51.159 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-12T22:03:51.160 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-12T22:03:51.160 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_allow_pool_delete": "true", 2024-09-12T22:03:51.160 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_allow_pool_size_one": "true", 2024-09-12T22:03:51.160 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_auth_validate_all_caps": "true", 2024-09-12T22:03:51.160 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-12T22:03:51.160 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-12T22:03:51.160 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_bytes": "104857600", 2024-09-12T22:03:51.160 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_directed_command_retry": "2", 2024-09-12T22:03:51.160 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-12T22:03:51.160 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-12T22:03:51.160 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-12T22:03:51.160 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-12T22:03:51.160 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_parallel": "3", 2024-09-12T22:03:51.161 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_log_interval": "1.000000", 2024-09-12T22:03:51.161 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-12T22:03:51.161 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_ping_interval": "10.000000", 2024-09-12T22:03:51.161 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-12T22:03:51.161 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_target_rank": "-1", 2024-09-12T22:03:51.161 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-12T22:03:51.161 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-12T22:03:51.161 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-12T22:03:51.161 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_file_level": "debug", 2024-09-12T22:03:51.161 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_file": "true", 2024-09-12T22:03:51.161 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-12T22:03:51.161 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-12T22:03:51.161 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-12T22:03:51.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_journald": "false", 2024-09-12T22:03:51.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-12T22:03:51.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-12T22:03:51.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-12T22:03:51.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-12T22:03:51.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_compact_on_bootstrap": "false", 2024-09-12T22:03:51.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_compact_on_start": "false", 2024-09-12T22:03:51.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_compact_on_trim": "true", 2024-09-12T22:03:51.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-12T22:03:51.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-12T22:03:51.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-12T22:03:51.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cpu_threads": "4", 2024-09-12T22:03:51.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_crush_min_required_version": "hammer", 2024-09-12T22:03:51.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_daemon_bytes": "419430400", 2024-09-12T22:03:51.163 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-12T22:03:51.163 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_data_avail_crit": "5", 2024-09-12T22:03:51.163 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_data_avail_warn": "5", 2024-09-12T22:03:51.163 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_data_size_warn": "16106127360", 2024-09-12T22:03:51.163 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-12T22:03:51.163 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-12T22:03:51.163 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_dump_json": "false", 2024-09-12T22:03:51.163 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-12T22:03:51.163 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_dump_transactions": "false", 2024-09-12T22:03:51.163 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_extra_checks": "false", 2024-09-12T22:03:51.163 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-12T22:03:51.163 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-12T22:03:51.164 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_no_require_reef": "false", 2024-09-12T22:03:51.164 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_no_require_squid": "false", 2024-09-12T22:03:51.164 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-12T22:03:51.164 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-12T22:03:51.164 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-12T22:03:51.164 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_down_mkfs_grace": "120", 2024-09-12T22:03:51.164 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_down_uptime_grace": "60", 2024-09-12T22:03:51.164 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_election_default_strategy": "1", 2024-09-12T22:03:51.164 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_election_timeout": "5.000000", 2024-09-12T22:03:51.164 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-12T22:03:51.164 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_elector_ping_divisor": "2", 2024-09-12T22:03:51.164 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-12T22:03:51.164 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_enable_op_tracker": "true", 2024-09-12T22:03:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_fake_pool_delete": "false", 2024-09-12T22:03:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_force_quorum_join": "false", 2024-09-12T22:03:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-12T22:03:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_globalid_prealloc": "10000", 2024-09-12T22:03:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_detail_to_clog": "false", 2024-09-12T22:03:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_log_update_period": "5", 2024-09-12T22:03:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_max_detail": "50", 2024-09-12T22:03:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_to_clog": "true", 2024-09-12T22:03:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_to_clog_interval": "600", 2024-09-12T22:03:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-12T22:03:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_host": "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]", 2024-09-12T22:03:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_host_override": "", 2024-09-12T22:03:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_initial_members": "", 2024-09-12T22:03:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-12T22:03:51.166 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-12T22:03:51.166 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-12T22:03:51.166 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-12T22:03:51.166 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-12T22:03:51.166 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_lease": "5.000000", 2024-09-12T22:03:51.166 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-12T22:03:51.166 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-12T22:03:51.166 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_log_full_interval": "50", 2024-09-12T22:03:51.166 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_log_max": "10000", 2024-09-12T22:03:51.166 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_log_max_summary": "50", 2024-09-12T22:03:51.166 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-12T22:03:51.166 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_log_epochs": "500", 2024-09-12T22:03:51.166 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-12T22:03:51.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-12T22:03:51.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_osd": "10000", 2024-09-12T22:03:51.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_pg_per_osd": "10000", 2024-09-12T22:03:51.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_pool_pg_num": "65536", 2024-09-12T22:03:51.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-12T22:03:51.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-12T22:03:51.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mds_force_trim_to": "0", 2024-09-12T22:03:51.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mds_skip_sanity": "false", 2024-09-12T22:03:51.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_memory_autotune": "true", 2024-09-12T22:03:51.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_memory_target": "2147483648", 2024-09-12T22:03:51.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_beacon_grace": "30", 2024-09-12T22:03:51.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-12T22:03:51.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_digest_period": "5", 2024-09-12T22:03:51.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_inactive_grace": "60", 2024-09-12T22:03:51.168 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-12T22:03:51.168 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-12T22:03:51.168 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_min_osdmap_epochs": "500", 2024-09-12T22:03:51.168 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_complaint_time": "30", 2024-09-12T22:03:51.168 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_history_duration": "600", 2024-09-12T22:03:51.168 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_history_size": "20", 2024-09-12T22:03:51.168 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_history_slow_op_size": "20", 2024-09-12T22:03:51.168 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-12T22:03:51.168 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_log_threshold": "5", 2024-09-12T22:03:51.168 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-12T22:03:51.168 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-12T22:03:51.168 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-12T22:03:51.168 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_auto_mark_in": "false", 2024-09-12T22:03:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-12T22:03:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-12T22:03:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-12T22:03:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_cache_size": "500", 2024-09-12T22:03:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-12T22:03:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-12T22:03:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-12T22:03:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_down_out_interval": "600", 2024-09-12T22:03:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-12T22:03:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-12T22:03:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_force_trim_to": "0", 2024-09-12T22:03:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-12T22:03:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-12T22:03:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_min_down_reporters": "2", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_report_timeout": "900", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-12T22:03:51.170 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-12T22:03:51.171 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-12T22:03:51.171 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-12T22:03:51.171 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-12T22:03:51.171 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-12T22:03:51.171 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-12T22:03:51.171 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-12T22:03:51.171 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-12T22:03:51.171 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_stuck_threshold": "60", 2024-09-12T22:03:51.171 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-12T22:03:51.171 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-12T22:03:51.171 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-12T22:03:51.171 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-12T22:03:51.171 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-12T22:03:51.172 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-12T22:03:51.172 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_probe_timeout": "2.000000", 2024-09-12T22:03:51.172 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_reweight_max_change": "0.050000", 2024-09-12T22:03:51.172 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_reweight_max_osds": "4", 2024-09-12T22:03:51.172 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-12T22:03:51.172 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-12T22:03:51.172 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-12T22:03:51.172 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-12T22:03:51.172 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-12T22:03:51.172 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_interval": "86400", 2024-09-12T22:03:51.172 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_max_keys": "100", 2024-09-12T22:03:51.172 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_timeout": "300", 2024-09-12T22:03:51.172 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_session_timeout": "300", 2024-09-12T22:03:51.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_smart_report_timeout": "5", 2024-09-12T22:03:51.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stat_smooth_intervals": "6", 2024-09-12T22:03:51.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-12T22:03:51.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stretch_pool_min_size": "2", 2024-09-12T22:03:51.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stretch_pool_size": "4", 2024-09-12T22:03:51.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-12T22:03:51.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-12T22:03:51.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_debug": "false", 2024-09-12T22:03:51.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-12T22:03:51.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-12T22:03:51.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_provider_kill_at": "0", 2024-09-12T22:03:51.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_requester_kill_at": "0", 2024-09-12T22:03:51.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_timeout": "60.000000", 2024-09-12T22:03:51.174 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_target_pg_per_osd": "100", 2024-09-12T22:03:51.174 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_tick_interval": "5", 2024-09-12T22:03:51.174 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_timecheck_interval": "300.000000", 2024-09-12T22:03:51.174 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-12T22:03:51.174 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_use_min_delay_socket": "false", 2024-09-12T22:03:51.174 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_older_version_delay": "604800", 2024-09-12T22:03:51.174 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-12T22:03:51.174 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-12T22:03:51.174 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-12T22:03:51.174 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-12T22:03:51.174 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-12T22:03:51.174 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-12T22:03:51.174 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-12T22:03:51.174 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_misplaced": "false", 2024-09-12T22:03:51.175 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-12T22:03:51.175 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_older_version": "true", 2024-09-12T22:03:51.175 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-12T22:03:51.175 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-12T22:03:51.175 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-12T22:03:51.175 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-12T22:03:51.175 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-12T22:03:51.175 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-12T22:03:51.175 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-12T22:03:51.175 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-12T22:03:51.175 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-12T22:03:51.175 INFO:teuthology.orchestra.run.smithi043.stdout: "monmap": "", 2024-09-12T22:03:51.175 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T22:03:51.175 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-12T22:03:51.176 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-12T22:03:51.176 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T22:03:51.176 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-12T22:03:51.176 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-12T22:03:51.176 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_tracing_enabled": "false", 2024-09-12T22:03:51.176 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_op_threads": "3", 2024-09-12T22:03:51.176 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-12T22:03:51.176 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_cm": "false", 2024-09-12T22:03:51.176 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_device_name": "", 2024-09-12T22:03:51.176 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_dscp": "96", 2024-09-12T22:03:51.176 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-12T22:03:51.176 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-12T22:03:51.176 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_local_gid": "", 2024-09-12T22:03:51.177 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-12T22:03:51.177 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_port_num": "1", 2024-09-12T22:03:51.177 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-12T22:03:51.177 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-12T22:03:51.177 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-12T22:03:51.177 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-12T22:03:51.177 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_sl": "3", 2024-09-12T22:03:51.177 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_support_srq": "true", 2024-09-12T22:03:51.177 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_type": "ib", 2024-09-12T22:03:51.177 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_reap_threshold": "5", 2024-09-12T22:03:51.177 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_before_connect": "false", 2024-09-12T22:03:51.177 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_ipv4": "true", 2024-09-12T22:03:51.177 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_ipv6": "false", 2024-09-12T22:03:51.178 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_msgr1": "true", 2024-09-12T22:03:51.178 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_msgr2": "true", 2024-09-12T22:03:51.178 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_port_max": "7568", 2024-09-12T22:03:51.178 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_port_min": "6800", 2024-09-12T22:03:51.178 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-12T22:03:51.178 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_retry_count": "3", 2024-09-12T22:03:51.178 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_retry_delay": "5", 2024-09-12T22:03:51.178 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_client": "false", 2024-09-12T22:03:51.178 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_mds": "false", 2024-09-12T22:03:51.178 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_mgr": "false", 2024-09-12T22:03:51.178 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_mon": "false", 2024-09-12T22:03:51.178 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_osd": "false", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_client_mode": "crc secure", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_cluster_mode": "crc secure", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_cluster_type": "", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_compress_secure": "false", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_connection_idle_timeout": "900", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_connection_ready_timeout": "10", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_crc_data": "true", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_crc_header": "true", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_bad_msg": "false", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_bug": "true", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_old_message": "true", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_skipped_message": "false", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-12T22:03:51.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_coremask": "0xF", 2024-09-12T22:03:51.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-12T22:03:51.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-12T22:03:51.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_enable_tso": "true", 2024-09-12T22:03:51.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-12T22:03:51.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-12T22:03:51.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_hugepages": "", 2024-09-12T22:03:51.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-12T22:03:51.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-12T22:03:51.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_lro": "true", 2024-09-12T22:03:51.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_memory_channel": "4", 2024-09-12T22:03:51.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-12T22:03:51.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_pmd": "", 2024-09-12T22:03:51.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_port_id": "0", 2024-09-12T22:03:51.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dump_on_send": "false", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_initial_backoff": "0.200000", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_delay_max": "1.000000", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_delay_type": "", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_network_congestion": "0", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_socket_failures": "0", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_learn_addr_from_peer": "true", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_max_accept_failures": "4", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_max_backoff": "15.000000", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_mon_client_mode": "secure crc", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-12T22:03:51.181 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_mon_service_mode": "secure crc", 2024-09-12T22:03:51.182 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_osd_compress_min_size": "1024", 2024-09-12T22:03:51.182 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_osd_compress_mode": "none", 2024-09-12T22:03:51.182 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-12T22:03:51.182 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-12T22:03:51.182 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_pq_min_cost": "65536", 2024-09-12T22:03:51.182 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_public_type": "", 2024-09-12T22:03:51.182 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_service_mode": "crc secure", 2024-09-12T22:03:51.182 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_tcp_listen_backlog": "512", 2024-09-12T22:03:51.182 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_tcp_nodelay": "true", 2024-09-12T22:03:51.182 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-12T22:03:51.182 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_tcp_rcvbuf": "0", 2024-09-12T22:03:51.182 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_type": "async+posix", 2024-09-12T22:03:51.182 INFO:teuthology.orchestra.run.smithi043.stdout: "no_config_file": "false", 2024-09-12T22:03:51.183 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_completion_locks_per_session": "32", 2024-09-12T22:03:51.183 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-12T22:03:51.183 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-12T22:03:51.183 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_inflight_ops": "1024", 2024-09-12T22:03:51.183 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-12T22:03:51.183 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-12T22:03:51.183 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_tick_interval": "5.000000", 2024-09-12T22:03:51.183 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_timeout": "10.000000", 2024-09-12T22:03:51.183 INFO:teuthology.orchestra.run.smithi043.stdout: "objectstore_blackhole": "false", 2024-09-12T22:03:51.183 INFO:teuthology.orchestra.run.smithi043.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-12T22:03:51.183 INFO:teuthology.orchestra.run.smithi043.stdout: "openssl_engine_opts": "", 2024-09-12T22:03:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_delay_time": "5.000000", 2024-09-12T22:03:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_hist_halflife": "1000", 2024-09-12T22:03:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_max_low_ops": "2", 2024-09-12T22:03:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_max_ops": "4", 2024-09-12T22:03:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-12T22:03:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-12T22:03:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_slop": "0.020000", 2024-09-12T22:03:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-12T22:03:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-12T22:03:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_asio_thread_count": "2", 2024-09-12T22:03:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_async_recovery_min_cost": "100", 2024-09-12T22:03:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-12T22:03:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-12T22:03:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backfill_scan_max": "512", 2024-09-12T22:03:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backfill_scan_min": "64", 2024-09-12T22:03:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backoff_on_degraded": "false", 2024-09-12T22:03:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backoff_on_peering": "false", 2024-09-12T22:03:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backoff_on_unfound": "true", 2024-09-12T22:03:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_beacon_report_interval": "300", 2024-09-12T22:03:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bench_duration": "30", 2024-09-12T22:03:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-12T22:03:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bench_max_block_size": "67108864", 2024-09-12T22:03:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-12T22:03:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_blkin_trace_all": "false", 2024-09-12T22:03:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-12T22:03:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-12T22:03:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-12T22:03:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-12T22:03:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_check_for_log_corruption": "false", 2024-09-12T22:03:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-12T22:03:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T22:03:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-12T22:03:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T22:03:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_class_update_on_start": "true", 2024-09-12T22:03:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_client_message_cap": "256", 2024-09-12T22:03:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_client_message_size_cap": "524288000", 2024-09-12T22:03:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_client_op_priority": "63", 2024-09-12T22:03:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_client_watch_timeout": "30", 2024-09-12T22:03:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_command_max_records": "256", 2024-09-12T22:03:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_compact_on_start": "false", 2024-09-12T22:03:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-12T22:03:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-12T22:03:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-12T22:03:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_crush_update_on_start": "true", 2024-09-12T22:03:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_crush_update_weight_set": "true", 2024-09-12T22:03:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-12T22:03:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-12T22:03:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-12T22:03:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-12T22:03:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-12T22:03:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_feed_pullee": "-1", 2024-09-12T22:03:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-12T22:03:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-12T22:03:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-12T22:03:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_misdirected_ops": "false", 2024-09-12T22:03:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_no_acting_change": "false", 2024-09-12T22:03:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_no_purge_strays": "false", 2024-09-12T22:03:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_op_order": "false", 2024-09-12T22:03:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-12T22:03:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-12T22:03:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-12T22:03:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-12T22:03:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_shutdown": "false", 2024-09-12T22:03:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-12T22:03:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-12T22:03:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_trim_objects": "false", 2024-09-12T22:03:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-12T22:03:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-12T22:03:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_verify_snaps": "false", 2024-09-12T22:03:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-12T22:03:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-12T22:03:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_keys": "1024", 2024-09-12T22:03:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-12T22:03:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-12T22:03:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-12T22:03:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_stride": "524288", 2024-09-12T22:03:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-12T22:03:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-12T22:03:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_default_notify_timeout": "30", 2024-09-12T22:03:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_delete_sleep": "0.000000", 2024-09-12T22:03:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-12T22:03:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-12T22:03:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-12T22:03:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_discard_disconnected_ops": "true", 2024-09-12T22:03:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_enable_op_tracker": "true", 2024-09-12T22:03:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-12T22:03:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-12T22:03:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-12T22:03:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-12T22:03:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_info": "true", 2024-09-12T22:03:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_shutdown": "true", 2024-09-12T22:03:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-12T22:03:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-12T22:03:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-12T22:03:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-12T22:03:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-12T22:03:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_function_tracing": "false", 2024-09-12T22:03:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_grace": "20", 2024-09-12T22:03:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_interval": "6", 2024-09-12T22:03:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-12T22:03:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_min_peers": "10", 2024-09-12T22:03:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_min_size": "2000", 2024-09-12T22:03:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_stale": "600", 2024-09-12T22:03:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-12T22:03:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_hit_set_max_size": "100000", 2024-09-12T22:03:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_hit_set_min_size": "1000", 2024-09-12T22:03:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-12T22:03:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-12T22:03:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-12T22:03:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-12T22:03:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-12T22:03:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-12T22:03:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_journal_size": "5120", 2024-09-12T22:03:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_kill_backfill_at": "0", 2024-09-12T22:03:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-12T22:03:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_cache_size": "50", 2024-09-12T22:03:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_dedup": "true", 2024-09-12T22:03:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_message_max": "40", 2024-09-12T22:03:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-12T22:03:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_share_max_epochs": "40", 2024-09-12T22:03:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_attr_name_len": "100", 2024-09-12T22:03:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_attr_size": "0", 2024-09-12T22:03:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_backfills": "1", 2024-09-12T22:03:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_markdown_count": "5", 2024-09-12T22:03:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_markdown_period": "600", 2024-09-12T22:03:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_object_name_len": "2048", 2024-09-12T22:03:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_object_namespace_len": "256", 2024-09-12T22:03:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_object_size": "134217728", 2024-09-12T22:03:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-12T22:03:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_pg_blocked_by": "16", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_pg_log_entries": "10000", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_pgls": "1024", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_push_cost": "8388608", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_push_objects": "10", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_scrubs": "3", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_trimming_pgs": "2", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_write_op_reply_len": "64", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_write_size": "90", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-12T22:03:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_profile": "balanced", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-12T22:03:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-12T22:03:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-12T22:03:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_base": "805306368", 2024-09-12T22:03:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_cache_min": "134217728", 2024-09-12T22:03:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-12T22:03:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-12T22:03:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_target": "4294967296", 2024-09-12T22:03:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_target_autotune": "false", 2024-09-12T22:03:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-12T22:03:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_min_pg_log_entries": "250", 2024-09-12T22:03:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_min_recovery_priority": "0", 2024-09-12T22:03:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-12T22:03:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-12T22:03:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_report_interval": "5", 2024-09-12T22:03:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-12T22:03:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-12T22:03:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_num_cache_shards": "32", 2024-09-12T22:03:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_num_op_tracker_shard": "32", 2024-09-12T22:03:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_numa_auto_affinity": "true", 2024-09-12T22:03:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_numa_node": "-1", 2024-09-12T22:03:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_numa_prefer_iface": "true", 2024-09-12T22:03:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-12T22:03:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_objecter_finishers": "1", 2024-09-12T22:03:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_objectstore": "bluestore", 2024-09-12T22:03:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_objectstore_fuse": "false", 2024-09-12T22:03:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_objectstore_tracing": "false", 2024-09-12T22:03:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_complaint_time": "30.000000", 2024-09-12T22:03:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_history_duration": "600", 2024-09-12T22:03:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_history_size": "20", 2024-09-12T22:03:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_history_slow_op_size": "20", 2024-09-12T22:03:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-12T22:03:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_log_threshold": "5", 2024-09-12T22:03:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_shards": "0", 2024-09-12T22:03:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_shards_hdd": "5", 2024-09-12T22:03:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_shards_ssd": "8", 2024-09-12T22:03:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-12T22:03:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-12T22:03:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-12T22:03:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-12T22:03:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_pq_min_cost": "65536", 2024-09-12T22:03:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-12T22:03:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_queue_cut_off": "high", 2024-09-12T22:03:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-12T22:03:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_thread_timeout": "15", 2024-09-12T22:03:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_open_classes_on_start": "true", 2024-09-12T22:03:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_os_flags": "0", 2024-09-12T22:03:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_peering_op_priority": "255", 2024-09-12T22:03:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_delete_cost": "1048576", 2024-09-12T22:03:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_delete_priority": "5", 2024-09-12T22:03:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-12T22:03:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-12T22:03:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-12T22:03:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_log_trim_max": "10000", 2024-09-12T22:03:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_log_trim_min": "100", 2024-09-12T22:03:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-12T22:03:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-12T22:03:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-12T22:03:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-12T22:03:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-12T22:03:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-12T22:03:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-12T22:03:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-12T22:03:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-12T22:03:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-12T22:03:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_crimson": "false", 2024-09-12T22:03:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-12T22:03:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-12T22:03:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-12T22:03:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-12T22:03:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-12T22:03:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-12T22:03:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-12T22:03:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-12T22:03:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flags": "0", 2024-09-12T22:03:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-12T22:03:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_min_size": "0", 2024-09-12T22:03:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-12T22:03:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_pg_num": "32", 2024-09-12T22:03:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_pgp_num": "0", 2024-09-12T22:03:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-12T22:03:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_read_ratio": "70", 2024-09-12T22:03:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_size": "2", 2024-09-12T22:03:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_type": "replicated", 2024-09-12T22:03:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-12T22:03:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-12T22:03:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_push_per_object_cost": "1000", 2024-09-12T22:03:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-12T22:03:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recover_clone_overlap": "true", 2024-09-12T22:03:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-12T22:03:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_cost": "20971520", 2024-09-12T22:03:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-12T22:03:51.203 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_active": "0", 2024-09-12T22:03:51.203 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-12T22:03:51.203 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-12T22:03:51.203 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-12T22:03:51.203 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-12T22:03:51.203 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_single_start": "1", 2024-09-12T22:03:51.203 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_op_priority": "3", 2024-09-12T22:03:51.203 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-12T22:03:51.203 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_priority": "5", 2024-09-12T22:03:51.203 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-12T22:03:51.203 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_sleep": "0.000000", 2024-09-12T22:03:51.203 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-12T22:03:51.204 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-12T22:03:51.204 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-12T22:03:51.204 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_repair_during_recovery": "false", 2024-09-12T22:03:51.204 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_requested_scrub_priority": "120", 2024-09-12T22:03:51.204 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-12T22:03:51.204 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-12T22:03:51.204 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_auto_repair": "false", 2024-09-12T22:03:51.204 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-12T22:03:51.204 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-12T22:03:51.204 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_begin_hour": "0", 2024-09-12T22:03:51.204 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_begin_week_day": "0", 2024-09-12T22:03:51.204 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_chunk_max": "25", 2024-09-12T22:03:51.205 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_chunk_min": "5", 2024-09-12T22:03:51.205 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_cost": "52428800", 2024-09-12T22:03:51.205 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-12T22:03:51.205 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_during_recovery": "false", 2024-09-12T22:03:51.205 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_end_hour": "0", 2024-09-12T22:03:51.205 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_end_week_day": "0", 2024-09-12T22:03:51.205 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_event_cost": "4096", 2024-09-12T22:03:51.205 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-12T22:03:51.205 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-12T22:03:51.205 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_invalid_stats": "true", 2024-09-12T22:03:51.206 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-12T22:03:51.206 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-12T22:03:51.206 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_max_preemptions": "5", 2024-09-12T22:03:51.206 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-12T22:03:51.206 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_priority": "5", 2024-09-12T22:03:51.206 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_sleep": "0.000000", 2024-09-12T22:03:51.206 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-12T22:03:51.206 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-12T22:03:51.206 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-12T22:03:51.206 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_skip_data_digest": "false", 2024-09-12T22:03:51.206 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_smart_report_timeout": "5", 2024-09-12T22:03:51.206 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_cost": "1048576", 2024-09-12T22:03:51.206 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_priority": "5", 2024-09-12T22:03:51.207 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-12T22:03:51.207 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-12T22:03:51.207 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-12T22:03:51.207 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-12T22:03:51.207 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-12T22:03:51.207 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-12T22:03:51.207 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-12T22:03:51.207 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_target_transaction_size": "30", 2024-09-12T22:03:51.207 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-12T22:03:51.207 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-12T22:03:51.207 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-12T22:03:51.207 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-12T22:03:51.208 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-12T22:03:51.208 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-12T22:03:51.208 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-12T22:03:51.208 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-12T22:03:51.208 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-12T22:03:51.208 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-12T22:03:51.208 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tracing": "false", 2024-09-12T22:03:51.208 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_use_stale_snap": "false", 2024-09-12T22:03:51.208 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T22:03:51.208 INFO:teuthology.orchestra.run.smithi043.stdout: "osdc_blkin_trace_all": "false", 2024-09-12T22:03:51.208 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_kill_at": "0", 2024-09-12T22:03:51.208 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_max_join_drift": "10", 2024-09-12T22:03:51.208 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_min": "500", 2024-09-12T22:03:51.209 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_min_wait": "0.050000", 2024-09-12T22:03:51.209 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_propose_interval": "1.000000", 2024-09-12T22:03:51.209 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_service_trim_max": "500", 2024-09-12T22:03:51.209 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-12T22:03:51.209 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_service_trim_min": "250", 2024-09-12T22:03:51.209 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_stash_full_interval": "25", 2024-09-12T22:03:51.209 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_trim_max": "500", 2024-09-12T22:03:51.209 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_trim_min": "250", 2024-09-12T22:03:51.209 INFO:teuthology.orchestra.run.smithi043.stdout: "perf": "true", 2024-09-12T22:03:51.209 INFO:teuthology.orchestra.run.smithi043.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-12T22:03:51.209 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-12T22:03:51.209 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-12T22:03:51.209 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "-", 2024-09-12T22:03:51.210 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrv": "", 2024-09-12T22:03:51.210 INFO:teuthology.orchestra.run.smithi043.stdout: "public_bind_addr": "-", 2024-09-12T22:03:51.210 INFO:teuthology.orchestra.run.smithi043.stdout: "public_network": "", 2024-09-12T22:03:51.210 INFO:teuthology.orchestra.run.smithi043.stdout: "public_network_interface": "", 2024-09-12T22:03:51.210 INFO:teuthology.orchestra.run.smithi043.stdout: "qat_compressor_busy_polling": "false", 2024-09-12T22:03:51.210 INFO:teuthology.orchestra.run.smithi043.stdout: "qat_compressor_enabled": "false", 2024-09-12T22:03:51.210 INFO:teuthology.orchestra.run.smithi043.stdout: "qat_compressor_session_max_number": "256", 2024-09-12T22:03:51.210 INFO:teuthology.orchestra.run.smithi043.stdout: "rados_mon_op_timeout": "0", 2024-09-12T22:03:51.210 INFO:teuthology.orchestra.run.smithi043.stdout: "rados_osd_op_timeout": "0", 2024-09-12T22:03:51.210 INFO:teuthology.orchestra.run.smithi043.stdout: "rados_tracing": "false", 2024-09-12T22:03:51.210 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_atime_update_interval": "60", 2024-09-12T22:03:51.210 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-12T22:03:51.210 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_balance_parent_reads": "false", 2024-09-12T22:03:51.210 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_balance_snap_reads": "false", 2024-09-12T22:03:51.211 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_blkin_trace_all": "false", 2024-09-12T22:03:51.211 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-12T22:03:51.211 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-12T22:03:51.211 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache": "true", 2024-09-12T22:03:51.211 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-12T22:03:51.211 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-12T22:03:51.211 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-12T22:03:51.211 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-12T22:03:51.211 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_policy": "writearound", 2024-09-12T22:03:51.211 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_size": "33554432", 2024-09-12T22:03:51.211 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-12T22:03:51.211 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-12T22:03:51.211 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_clone_copy_on_read": "false", 2024-09-12T22:03:51.212 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_compression_hint": "none", 2024-09-12T22:03:51.212 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_concurrent_management_ops": "10", 2024-09-12T22:03:51.212 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-12T22:03:51.212 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_clone_format": "auto", 2024-09-12T22:03:51.212 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_data_pool": "", 2024-09-12T22:03:51.212 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_features": "61", 2024-09-12T22:03:51.212 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_format": "2", 2024-09-12T22:03:51.212 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_map_options": "", 2024-09-12T22:03:51.212 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_order": "22", 2024-09-12T22:03:51.212 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_pool": "rbd", 2024-09-12T22:03:51.212 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-12T22:03:51.212 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_stripe_count": "0", 2024-09-12T22:03:51.212 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_stripe_unit": "0", 2024-09-12T22:03:51.212 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-12T22:03:51.213 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-12T22:03:51.213 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-12T22:03:51.213 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_enable_alloc_hint": "true", 2024-09-12T22:03:51.213 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-12T22:03:51.213 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_io_scheduler": "simple", 2024-09-12T22:03:51.213 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-12T22:03:51.213 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-12T22:03:51.213 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-12T22:03:51.213 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-12T22:03:51.213 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-12T22:03:51.213 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-12T22:03:51.213 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-12T22:03:51.213 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-12T22:03:51.214 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-12T22:03:51.214 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_order": "24", 2024-09-12T22:03:51.214 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_pool": "", 2024-09-12T22:03:51.214 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_splay_width": "4", 2024-09-12T22:03:51.214 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_localize_parent_reads": "false", 2024-09-12T22:03:51.214 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_localize_snap_reads": "false", 2024-09-12T22:03:51.214 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-12T22:03:51.214 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-12T22:03:51.214 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-12T22:03:51.214 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-12T22:03:51.214 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-12T22:03:51.214 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-12T22:03:51.214 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-12T22:03:51.214 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-12T22:03:51.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-12T22:03:51.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-12T22:03:51.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-12T22:03:51.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-12T22:03:51.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-12T22:03:51.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-12T22:03:51.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-12T22:03:51.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-12T22:03:51.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-12T22:03:51.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-12T22:03:51.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-12T22:03:51.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-12T22:03:51.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-12T22:03:51.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-12T22:03:51.216 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-12T22:03:51.216 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-12T22:03:51.216 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-12T22:03:51.216 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-12T22:03:51.216 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-12T22:03:51.216 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-12T22:03:51.216 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-12T22:03:51.216 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-12T22:03:51.216 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-12T22:03:51.216 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mtime_update_interval": "60", 2024-09-12T22:03:51.216 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_non_blocking_aio": "true", 2024-09-12T22:03:51.216 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_op_thread_timeout": "60", 2024-09-12T22:03:51.216 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_op_threads": "1", 2024-09-12T22:03:51.216 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_parent_cache_enabled": "false", 2024-09-12T22:03:51.217 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-12T22:03:51.217 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-12T22:03:51.217 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-12T22:03:51.217 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_plugins": "", 2024-09-12T22:03:51.217 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_bps_burst": "0", 2024-09-12T22:03:51.217 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-12T22:03:51.217 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_bps_limit": "0", 2024-09-12T22:03:51.217 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_exclude_ops": "0", 2024-09-12T22:03:51.217 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_iops_burst": "0", 2024-09-12T22:03:51.217 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-12T22:03:51.217 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_iops_limit": "0", 2024-09-12T22:03:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-12T22:03:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-12T22:03:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-12T22:03:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-12T22:03:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-12T22:03:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-12T22:03:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-12T22:03:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-12T22:03:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-12T22:03:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-12T22:03:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-12T22:03:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-12T22:03:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-12T22:03:51.219 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-12T22:03:51.219 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_read_from_replica_policy": "default", 2024-09-12T22:03:51.219 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-12T22:03:51.219 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-12T22:03:51.219 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-12T22:03:51.219 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-12T22:03:51.219 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_skip_partial_discard": "true", 2024-09-12T22:03:51.219 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-12T22:03:51.219 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_tracing": "false", 2024-09-12T22:03:51.219 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_validate_names": "true", 2024-09-12T22:03:51.219 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_validate_pool": "true", 2024-09-12T22:03:51.219 INFO:teuthology.orchestra.run.smithi043.stdout: "restapi_base_url": "", 2024-09-12T22:03:51.220 INFO:teuthology.orchestra.run.smithi043.stdout: "restapi_log_level": "", 2024-09-12T22:03:51.220 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-12T22:03:51.220 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-12T22:03:51.220 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_acl_grants_max_num": "100", 2024-09-12T22:03:51.220 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_admin_entry": "admin", 2024-09-12T22:03:51.220 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-12T22:03:51.220 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_backend_store": "rados", 2024-09-12T22:03:51.220 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_barbican_url": "", 2024-09-12T22:03:51.220 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_beast_enable_async": "true", 2024-09-12T22:03:51.220 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_counters_cache": "false", 2024-09-12T22:03:51.220 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-12T22:03:51.220 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-12T22:03:51.221 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-12T22:03:51.221 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-12T22:03:51.221 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-12T22:03:51.221 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-12T22:03:51.221 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-12T22:03:51.221 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-12T22:03:51.221 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cache_enabled": "true", 2024-09-12T22:03:51.221 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cache_expiry_interval": "900", 2024-09-12T22:03:51.221 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cache_lru_size": "25000", 2024-09-12T22:03:51.221 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_config_store": "rados", 2024-09-12T22:03:51.221 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_content_length_compat": "false", 2024-09-12T22:03:51.222 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_copy_obj_progress": "true", 2024-09-12T22:03:51.222 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-12T22:03:51.222 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cors_rules_max_num": "100", 2024-09-12T22:03:51.222 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cross_domain_policy": "", 2024-09-12T22:03:51.222 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-12T22:03:51.222 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_addr": "", 2024-09-12T22:03:51.222 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-12T22:03:51.222 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-12T22:03:51.223 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-12T22:03:51.223 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-12T22:03:51.223 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_password": "", 2024-09-12T22:03:51.223 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-12T22:03:51.223 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_username": "", 2024-09-12T22:03:51.223 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_require_ssl": "true", 2024-09-12T22:03:51.223 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-12T22:03:51.223 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-12T22:03:51.223 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-12T22:03:51.223 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-12T22:03:51.223 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-12T22:03:51.223 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-12T22:03:51.223 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-12T22:03:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-12T22:03:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-12T22:03:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-12T22:03:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-12T22:03:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-12T22:03:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-12T22:03:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-12T22:03:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-12T22:03:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_addr": "", 2024-09-12T22:03:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_auth": "token", 2024-09-12T22:03:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_namespace": "", 2024-09-12T22:03:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_prefix": "", 2024-09-12T22:03:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-12T22:03:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-12T22:03:51.225 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-12T22:03:51.225 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-12T22:03:51.225 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_token_file": "", 2024-09-12T22:03:51.225 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-12T22:03:51.225 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_buffersize": "524288", 2024-09-12T22:03:51.225 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-12T22:03:51.225 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_low_speed_time": "300", 2024-09-12T22:03:51.225 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-12T22:03:51.225 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-12T22:03:51.225 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-12T22:03:51.225 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-12T22:03:51.225 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-12T22:03:51.225 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-12T22:03:51.225 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-12T22:03:51.226 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-12T22:03:51.226 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-12T22:03:51.226 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-12T22:03:51.226 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-12T22:03:51.226 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d4n_port": "6379", 2024-09-12T22:03:51.226 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-12T22:03:51.226 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_log_changes_size": "1000", 2024-09-12T22:03:51.226 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_log_num_shards": "128", 2024-09-12T22:03:51.226 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-12T22:03:51.226 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_log_window": "30", 2024-09-12T22:03:51.226 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-12T22:03:51.226 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-12T22:03:51.226 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-12T22:03:51.227 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-12T22:03:51.227 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-12T22:03:51.227 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-12T22:03:51.227 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-12T22:03:51.227 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-12T22:03:51.227 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-12T22:03:51.227 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-12T22:03:51.227 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-12T22:03:51.227 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-12T22:03:51.227 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-12T22:03:51.227 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-12T22:03:51.227 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-12T22:03:51.227 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-12T22:03:51.228 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-12T22:03:51.228 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-12T22:03:51.228 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-12T22:03:51.228 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-12T22:03:51.228 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-12T22:03:51.228 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-12T22:03:51.228 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-12T22:03:51.228 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-12T22:03:51.228 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-12T22:03:51.228 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dns_name": "", 2024-09-12T22:03:51.228 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dns_s3website_name": "", 2024-09-12T22:03:51.228 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dynamic_resharding": "true", 2024-09-12T22:03:51.228 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_gc_threads": "true", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_lc_threads": "true", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_ops_log": "false", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_quota_threads": "true", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_static_website": "false", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_usage_log": "false", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enforce_swift_acls": "true", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_exit_timeout_secs": "120", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_expose_bucket": "false", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_extended_http_attrs": "", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_filter": "none", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_frontends": "beast port=7480", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-12T22:03:51.229 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_deferred": "50", 2024-09-12T22:03:51.230 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-12T22:03:51.230 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_objs": "32", 2024-09-12T22:03:51.230 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-12T22:03:51.230 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-12T22:03:51.230 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-12T22:03:51.230 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-12T22:03:51.230 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_processor_period": "3600", 2024-09-12T22:03:51.230 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-12T22:03:51.230 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-12T22:03:51.230 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-12T22:03:51.230 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-12T22:03:51.230 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_init_timeout": "300", 2024-09-12T22:03:51.230 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-12T22:03:51.230 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-12T22:03:51.231 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_kafka_connection_idle": "300", 2024-09-12T22:03:51.231 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-12T22:03:51.231 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-12T22:03:51.231 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-12T22:03:51.231 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-12T22:03:51.231 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-12T22:03:51.231 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_domain": "", 2024-09-12T22:03:51.231 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_password": "", 2024-09-12T22:03:51.232 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_password_path": "", 2024-09-12T22:03:51.232 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_project": "", 2024-09-12T22:03:51.232 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_tenant": "", 2024-09-12T22:03:51.232 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_token": "", 2024-09-12T22:03:51.232 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_token_path": "", 2024-09-12T22:03:51.232 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_user": "", 2024-09-12T22:03:51.232 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_api_version": "2", 2024-09-12T22:03:51.232 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_domain": "", 2024-09-12T22:03:51.232 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_password": "", 2024-09-12T22:03:51.232 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_project": "", 2024-09-12T22:03:51.232 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_user": "", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_url": "", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_debug_interval": "-1", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_lock_max_time": "90", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_max_objs": "32", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_max_rules": "1000", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_max_worker": "3", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-12T22:03:51.233 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_thread_delay": "0", 2024-09-12T22:03:51.234 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-12T22:03:51.234 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_dnattr": "uid", 2024-09-12T22:03:51.234 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-12T22:03:51.234 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_searchfilter": "", 2024-09-12T22:03:51.234 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-12T22:03:51.234 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_uri": "", 2024-09-12T22:03:51.234 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-12T22:03:51.234 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-12T22:03:51.234 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-12T22:03:51.234 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_log_http_headers": "", 2024-09-12T22:03:51.234 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-12T22:03:51.234 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-12T22:03:51.234 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_log_object_name_utc": "false", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_attr_name_len": "0", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_attr_size": "0", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_chunk_size": "4194304", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_listing_results": "1000", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_notify_retries": "10", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_put_param_size": "1048576", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_put_size": "5368709120", 2024-09-12T22:03:51.235 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_slo_entries": "1000", 2024-09-12T22:03:51.236 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_md_log_max_shards": "64", 2024-09-12T22:03:51.236 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-12T22:03:51.236 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-12T22:03:51.236 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-12T22:03:51.236 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-12T22:03:51.236 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_mp_lock_max_time": "600", 2024-09-12T22:03:51.236 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-12T22:03:51.236 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-12T22:03:51.236 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-12T22:03:51.236 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-12T22:03:51.236 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-12T22:03:51.236 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-12T22:03:51.237 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-12T22:03:51.237 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-12T22:03:51.237 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_max_gc": "300", 2024-09-12T22:03:51.237 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-12T22:03:51.237 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-12T22:03:51.237 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-12T22:03:51.237 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-12T22:03:51.237 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-12T22:03:51.237 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-12T22:03:51.237 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-12T22:03:51.237 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_num_async_rados_threads": "32", 2024-09-12T22:03:51.237 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_num_control_oids": "8", 2024-09-12T22:03:51.238 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_numa_node": "-1", 2024-09-12T22:03:51.238 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-12T22:03:51.238 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-12T22:03:51.238 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_objexp_chunk_size": "100", 2024-09-12T22:03:51.238 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_objexp_gc_interval": "600", 2024-09-12T22:03:51.238 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-12T22:03:51.238 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-12T22:03:51.238 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-12T22:03:51.238 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_op_thread_timeout": "600", 2024-09-12T22:03:51.238 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_op_tracing": "false", 2024-09-12T22:03:51.238 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_opa_token": "", 2024-09-12T22:03:51.238 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_opa_url": "", 2024-09-12T22:03:51.238 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_opa_verify_ssl": "true", 2024-09-12T22:03:51.238 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-12T22:03:51.239 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-12T22:03:51.239 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ops_log_rados": "false", 2024-09-12T22:03:51.239 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ops_log_socket_path": "", 2024-09-12T22:03:51.239 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-12T22:03:51.239 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-12T22:03:51.239 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-12T22:03:51.239 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_period_push_interval": "2.000000", 2024-09-12T22:03:51.239 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-12T22:03:51.239 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-12T22:03:51.239 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-12T22:03:51.239 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-12T22:03:51.239 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_posix_cache_lanes": "3", 2024-09-12T22:03:51.239 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-12T22:03:51.239 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-12T22:03:51.240 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_posix_cache_partitions": "3", 2024-09-12T22:03:51.240 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-12T22:03:51.240 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_print_continue": "true", 2024-09-12T22:03:51.240 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-12T22:03:51.240 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-12T22:03:51.240 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-12T22:03:51.240 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-12T22:03:51.240 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-12T22:03:51.240 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_rados_tracing": "false", 2024-09-12T22:03:51.240 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_realm": "", 2024-09-12T22:03:51.240 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_realm_id": "", 2024-09-12T22:03:51.240 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-12T22:03:51.240 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_region": "", 2024-09-12T22:03:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-12T22:03:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-12T22:03:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-12T22:03:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-12T22:03:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_request_uri": "", 2024-09-12T22:03:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_batch_size": "64", 2024-09-12T22:03:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-12T22:03:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_max_aio": "128", 2024-09-12T22:03:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_num_logs": "16", 2024-09-12T22:03:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_thread_interval": "600", 2024-09-12T22:03:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_resolve_cname": "false", 2024-09-12T22:03:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-12T22:03:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_run_sync_thread": "true", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_scheduler_type": "throttler", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_script_uri": "", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_service_provider_name": "", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_client_id": "", 2024-09-12T22:03:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_client_secret": "", 2024-09-12T22:03:51.243 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_entry": "sts", 2024-09-12T22:03:51.243 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_key": "sts", 2024-09-12T22:03:51.243 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-12T22:03:51.243 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_min_session_duration": "900", 2024-09-12T22:03:51.243 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_token_introspection_url": "", 2024-09-12T22:03:51.243 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_account_in_url": "false", 2024-09-12T22:03:51.243 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_auth_entry": "auth", 2024-09-12T22:03:51.243 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_auth_url": "", 2024-09-12T22:03:51.243 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_custom_header": "", 2024-09-12T22:03:51.243 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-12T22:03:51.243 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_need_stats": "true", 2024-09-12T22:03:51.243 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_tenant_name": "", 2024-09-12T22:03:51.243 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_token_expiration": "86400", 2024-09-12T22:03:51.243 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_url": "", 2024-09-12T22:03:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_url_prefix": "swift", 2024-09-12T22:03:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-12T22:03:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-12T22:03:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-12T22:03:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_lease_period": "120", 2024-09-12T22:03:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-12T22:03:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-12T22:03:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-12T22:03:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-12T22:03:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-12T22:03:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-12T22:03:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-12T22:03:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-12T22:03:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-12T22:03:51.245 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_thread_pool_size": "512", 2024-09-12T22:03:51.245 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-12T22:03:51.245 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-12T22:03:51.245 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-12T22:03:51.245 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-12T22:03:51.245 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_comment": "", 2024-09-12T22:03:51.245 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_createby": "", 2024-09-12T22:03:51.245 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_encoding": "", 2024-09-12T22:03:51.245 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_flag": "false", 2024-09-12T22:03:51.245 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-12T22:03:51.245 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_origin": "", 2024-09-12T22:03:51.246 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-12T22:03:51.246 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_tracker": "", 2024-09-12T22:03:51.246 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_trust_forwarded_https": "false", 2024-09-12T22:03:51.246 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-12T22:03:51.246 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-12T22:03:51.246 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_usage_max_shards": "32", 2024-09-12T22:03:51.246 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_usage_max_user_shards": "1", 2024-09-12T22:03:51.246 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_use_opa_authz": "false", 2024-09-12T22:03:51.246 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_counters_cache": "false", 2024-09-12T22:03:51.246 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-12T22:03:51.246 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-12T22:03:51.246 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-12T22:03:51.246 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_max_buckets": "1000", 2024-09-12T22:03:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_policies_max_num": "100", 2024-09-12T22:03:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-12T22:03:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-12T22:03:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-12T22:03:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-12T22:03:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_unique_email": "true", 2024-09-12T22:03:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_verify_ssl": "true", 2024-09-12T22:03:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-12T22:03:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zone": "", 2024-09-12T22:03:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zone_id": "", 2024-09-12T22:03:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-12T22:03:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zonegroup": "", 2024-09-12T22:03:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zonegroup_id": "", 2024-09-12T22:03:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-12T22:03:51.248 INFO:teuthology.orchestra.run.smithi043.stdout: "rgwlc_auto_session_clear": "true", 2024-09-12T22:03:51.248 INFO:teuthology.orchestra.run.smithi043.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-12T22:03:51.248 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_block_size": "4096", 2024-09-12T22:03:51.248 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-12T22:03:51.248 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-12T22:03:51.248 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-12T22:03:51.248 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-12T22:03:51.248 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-12T22:03:51.248 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_size": "536870912", 2024-09-12T22:03:51.248 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-12T22:03:51.248 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-12T22:03:51.248 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-12T22:03:51.248 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-12T22:03:51.249 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-12T22:03:51.249 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-12T22:03:51.249 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-12T22:03:51.249 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-12T22:03:51.249 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_index_type": "binary_search", 2024-09-12T22:03:51.249 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-12T22:03:51.249 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-12T22:03:51.249 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_partition_filters": "false", 2024-09-12T22:03:51.249 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_perf": "false", 2024-09-12T22:03:51.249 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-12T22:03:51.249 INFO:teuthology.orchestra.run.smithi043.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-12T22:03:51.249 INFO:teuthology.orchestra.run.smithi043.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-12T22:03:51.249 INFO:teuthology.orchestra.run.smithi043.stdout: "run_dir": "/var/run/ceph", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_block_create": "true", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_cache_lru_size": "67108864", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_default_max_object_size": "16777216", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_device_size": "53687091200", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_full_integrity_check": "false", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_journal_batch_capacity": "16", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_main_device_type": "SSD", 2024-09-12T22:03:51.250 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-12T22:03:51.251 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-12T22:03:51.251 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-12T22:03:51.251 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-12T22:03:51.251 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-12T22:03:51.251 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-12T22:03:51.251 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_segment_size": "67108864", 2024-09-12T22:03:51.251 INFO:teuthology.orchestra.run.smithi043.stdout: "set_keepcaps": "false", 2024-09-12T22:03:51.251 INFO:teuthology.orchestra.run.smithi043.stdout: "setgroup": "", 2024-09-12T22:03:51.251 INFO:teuthology.orchestra.run.smithi043.stdout: "setuser": "", 2024-09-12T22:03:51.251 INFO:teuthology.orchestra.run.smithi043.stdout: "setuser_match_path": "", 2024-09-12T22:03:51.251 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-12T22:03:51.251 INFO:teuthology.orchestra.run.smithi043.stdout: "thp": "false", 2024-09-12T22:03:51.251 INFO:teuthology.orchestra.run.smithi043.stdout: "threadpool_default_timeout": "60", 2024-09-12T22:03:51.252 INFO:teuthology.orchestra.run.smithi043.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-12T22:03:51.252 INFO:teuthology.orchestra.run.smithi043.stdout: "throttler_perf_counter": "true" 2024-09-12T22:03:51.252 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T22:03:51.254 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-12T22:03:51.370 INFO:teuthology.orchestra.run.smithi043.stdout:mon.a: {} 2024-09-12T22:03:51.370 INFO:teuthology.orchestra.run.smithi043.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:03:51.378 INFO:teuthology.orchestra.run.smithi043.stdout:mon.b: {} 2024-09-12T22:03:51.379 INFO:teuthology.orchestra.run.smithi043.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:03:51.387 INFO:teuthology.orchestra.run.smithi043.stdout:mon.c: {} 2024-09-12T22:03:51.387 INFO:teuthology.orchestra.run.smithi043.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:03:51.398 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-09-12T22:03:51.398 INFO:teuthology.run_tasks:Running task radosbench... 2024-09-12T22:03:51.412 INFO:tasks.radosbench:Beginning radosbench... 2024-09-12T22:03:51.412 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-12T22:03:51.412 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-12T22:03:51.413 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-12T22:03:51.413 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:03:51.413 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:03:51.413 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T22:03:51.413 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T22:03:51.414 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-12T22:03:51.414 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-12T22:03:51.414 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:03:51.415 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-12T22:03:51.415 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:03:51.415 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-12T22:03:51.415 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:03:51.417 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:51.414+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:51.516 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:51.515+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:51.536 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:03:51.536 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T22:03:51.537 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T22:03:51.537 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:03:51.546 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:03:51.554 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-09-12T22:03:51.555 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:03:51.573 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:03:51.573 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:03:51.591 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:03:51.591 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:03:51.617 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:51.615+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:51.653 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:51.653 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:51.662 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:03:51.717 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:51.716+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:51.751 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:51.751 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T22:03:51.751 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 21, 2024-09-12T22:03:51.752 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7", 2024-09-12T22:03:51.752 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-09-12T22:03:11.964028+0000", 2024-09-12T22:03:51.752 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-09-12T22:03:36.944923+0000", 2024-09-12T22:03:51.752 INFO:teuthology.orchestra.run.smithi043.stdout: "last_up_change": "2024-09-12T22:03:21.299348+0000", 2024-09-12T22:03:51.752 INFO:teuthology.orchestra.run.smithi043.stdout: "last_in_change": "2024-09-12T22:03:12.758606+0000", 2024-09-12T22:03:51.752 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T22:03:51.752 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_num": 5799936, 2024-09-12T22:03:51.752 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_set": [ 2024-09-12T22:03:51.752 INFO:teuthology.orchestra.run.smithi043.stdout: "pglog_hardlimit", 2024-09-12T22:03:51.752 INFO:teuthology.orchestra.run.smithi043.stdout: "purged_snapdirs", 2024-09-12T22:03:51.752 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_deletes", 2024-09-12T22:03:51.752 INFO:teuthology.orchestra.run.smithi043.stdout: "sortbitwise" 2024-09-12T22:03:51.752 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T22:03:51.753 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_version": 5, 2024-09-12T22:03:51.753 INFO:teuthology.orchestra.run.smithi043.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T22:03:51.753 INFO:teuthology.orchestra.run.smithi043.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T22:03:51.753 INFO:teuthology.orchestra.run.smithi043.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T22:03:51.753 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_snapshot": "", 2024-09-12T22:03:51.753 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_max": 4, 2024-09-12T22:03:51.753 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd": 3, 2024-09-12T22:03:51.753 INFO:teuthology.orchestra.run.smithi043.stdout: "require_min_compat_client": "luminous", 2024-09-12T22:03:51.753 INFO:teuthology.orchestra.run.smithi043.stdout: "min_compat_client": "jewel", 2024-09-12T22:03:51.753 INFO:teuthology.orchestra.run.smithi043.stdout: "require_osd_release": "squid", 2024-09-12T22:03:51.753 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_crimson": false, 2024-09-12T22:03:51.753 INFO:teuthology.orchestra.run.smithi043.stdout: "pools": [ 2024-09-12T22:03:51.753 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.754 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 1, 2024-09-12T22:03:51.754 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": ".mgr", 2024-09-12T22:03:51.754 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-09-12T22:03:22.281699+0000", 2024-09-12T22:03:51.754 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-09-12T22:03:51.754 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-09-12T22:03:51.754 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-09-12T22:03:51.754 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-09-12T22:03:51.754 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-09-12T22:03:51.754 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-09-12T22:03:51.754 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:03:51.754 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:03:51.754 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:03:51.755 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:03:51.755 INFO:teuthology.orchestra.run.smithi043.stdout: "is_stretch_pool": false, 2024-09-12T22:03:51.755 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-09-12T22:03:51.755 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:03:51.755 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 1, 2024-09-12T22:03:51.755 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 1, 2024-09-12T22:03:51.755 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 1, 2024-09-12T22:03:51.755 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 1, 2024-09-12T22:03:51.755 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 1, 2024-09-12T22:03:51.755 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-09-12T22:03:51.755 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-09-12T22:03:51.756 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-09-12T22:03:51.756 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-09-12T22:03:51.756 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-09-12T22:03:51.756 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-09-12T22:03:51.756 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-09-12T22:03:51.756 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.756 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "12", 2024-09-12T22:03:51.756 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-09-12T22:03:51.756 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:03:51.756 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:03:51.756 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-09-12T22:03:51.756 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:03:51.756 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-09-12T22:03:51.757 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-09-12T22:03:51.757 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-09-12T22:03:51.757 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-09-12T22:03:51.757 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-09-12T22:03:51.757 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-09-12T22:03:51.757 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-09-12T22:03:51.757 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-09-12T22:03:51.757 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-09-12T22:03:51.757 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-09-12T22:03:51.757 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-09-12T22:03:51.757 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-09-12T22:03:51.757 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-09-12T22:03:51.757 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:03:51.758 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:03:51.758 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:03:51.758 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-09-12T22:03:51.758 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-09-12T22:03:51.758 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-09-12T22:03:51.758 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-09-12T22:03:51.758 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-09-12T22:03:51.758 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.758 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-09-12T22:03:51.759 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-09-12T22:03:51.759 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-09-12T22:03:51.759 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:03:51.759 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:03:51.759 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:03:51.759 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:03:51.759 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-09-12T22:03:51.759 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-09-12T22:03:51.759 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-09-12T22:03:51.759 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-09-12T22:03:51.759 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-09-12T22:03:51.759 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_max": 32, 2024-09-12T22:03:51.759 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 1 2024-09-12T22:03:51.760 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.760 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-09-12T22:03:51.760 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": {} 2024-09-12T22:03:51.760 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.760 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-09-12T22:03:51.760 INFO:teuthology.orchestra.run.smithi043.stdout: "score_type": "Fair distribution", 2024-09-12T22:03:51.760 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 2.9900000095367432, 2024-09-12T22:03:51.760 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 2.9900000095367432, 2024-09-12T22:03:51.760 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T22:03:51.760 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 2, 2024-09-12T22:03:51.760 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 2, 2024-09-12T22:03:51.760 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:03:51.760 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-09-12T22:03:51.761 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:03:51.761 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.761 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.761 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.761 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 2, 2024-09-12T22:03:51.761 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "rbd", 2024-09-12T22:03:51.761 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-09-12T22:03:26.987767+0000", 2024-09-12T22:03:51.761 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 8193, 2024-09-12T22:03:51.761 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T22:03:51.761 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-09-12T22:03:51.761 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-09-12T22:03:51.761 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-09-12T22:03:51.762 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-09-12T22:03:51.762 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:03:51.762 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:03:51.762 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:03:51.762 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:03:51.762 INFO:teuthology.orchestra.run.smithi043.stdout: "is_stretch_pool": false, 2024-09-12T22:03:51.762 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-09-12T22:03:51.762 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:03:51.762 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 8, 2024-09-12T22:03:51.762 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 8, 2024-09-12T22:03:51.762 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 8, 2024-09-12T22:03:51.762 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 8, 2024-09-12T22:03:51.762 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 8, 2024-09-12T22:03:51.763 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-09-12T22:03:51.763 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-09-12T22:03:51.763 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-09-12T22:03:51.763 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-09-12T22:03:51.763 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-09-12T22:03:51.763 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-09-12T22:03:51.763 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-09-12T22:03:51.763 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.763 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "16", 2024-09-12T22:03:51.763 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-09-12T22:03:51.763 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:03:51.763 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:03:51.763 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-09-12T22:03:51.763 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:03:51.764 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 2, 2024-09-12T22:03:51.764 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 16, 2024-09-12T22:03:51.764 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-09-12T22:03:51.764 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-09-12T22:03:51.764 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-09-12T22:03:51.764 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-09-12T22:03:51.764 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-09-12T22:03:51.764 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-09-12T22:03:51.764 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-09-12T22:03:51.764 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-09-12T22:03:51.764 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-09-12T22:03:51.764 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-09-12T22:03:51.764 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-09-12T22:03:51.765 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:03:51.765 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:03:51.765 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:03:51.765 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-09-12T22:03:51.765 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-09-12T22:03:51.765 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-09-12T22:03:51.765 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-09-12T22:03:51.765 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-09-12T22:03:51.765 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.765 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-09-12T22:03:51.765 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-09-12T22:03:51.765 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-09-12T22:03:51.765 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:03:51.766 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:03:51.766 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:03:51.766 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:03:51.766 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-09-12T22:03:51.766 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-09-12T22:03:51.766 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-09-12T22:03:51.766 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-09-12T22:03:51.766 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-09-12T22:03:51.766 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-09-12T22:03:51.766 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd": {} 2024-09-12T22:03:51.766 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.766 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-09-12T22:03:51.766 INFO:teuthology.orchestra.run.smithi043.stdout: "score_type": "Fair distribution", 2024-09-12T22:03:51.767 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.5, 2024-09-12T22:03:51.767 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.5, 2024-09-12T22:03:51.767 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-09-12T22:03:51.767 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.5, 2024-09-12T22:03:51.767 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.5, 2024-09-12T22:03:51.767 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:03:51.767 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-09-12T22:03:51.767 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:03:51.767 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.767 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.767 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.767 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 3, 2024-09-12T22:03:51.767 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_metadata", 2024-09-12T22:03:51.767 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-09-12T22:03:31.328134+0000", 2024-09-12T22:03:51.768 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-09-12T22:03:51.768 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-09-12T22:03:51.768 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-09-12T22:03:51.768 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-09-12T22:03:51.768 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-09-12T22:03:51.768 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-09-12T22:03:51.768 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:03:51.768 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:03:51.768 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:03:51.768 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:03:51.768 INFO:teuthology.orchestra.run.smithi043.stdout: "is_stretch_pool": false, 2024-09-12T22:03:51.768 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-09-12T22:03:51.768 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:03:51.769 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 32, 2024-09-12T22:03:51.769 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 32, 2024-09-12T22:03:51.769 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 32, 2024-09-12T22:03:51.769 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 32, 2024-09-12T22:03:51.769 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 32, 2024-09-12T22:03:51.769 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-09-12T22:03:51.769 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-09-12T22:03:51.769 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-09-12T22:03:51.769 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-09-12T22:03:51.769 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-09-12T22:03:51.769 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-09-12T22:03:51.769 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-09-12T22:03:51.769 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.769 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "19", 2024-09-12T22:03:51.770 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-09-12T22:03:51.770 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:03:51.770 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:03:51.770 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-09-12T22:03:51.770 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:03:51.770 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-09-12T22:03:51.770 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-09-12T22:03:51.770 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-09-12T22:03:51.770 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-09-12T22:03:51.770 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-09-12T22:03:51.770 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-09-12T22:03:51.770 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-09-12T22:03:51.770 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-09-12T22:03:51.771 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-09-12T22:03:51.771 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-09-12T22:03:51.771 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-09-12T22:03:51.771 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-09-12T22:03:51.771 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-09-12T22:03:51.771 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:03:51.771 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:03:51.771 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:03:51.771 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-09-12T22:03:51.771 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-09-12T22:03:51.771 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-09-12T22:03:51.771 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-09-12T22:03:51.772 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-09-12T22:03:51.772 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.772 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-09-12T22:03:51.772 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-09-12T22:03:51.772 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-09-12T22:03:51.772 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:03:51.772 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:03:51.772 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:03:51.772 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:03:51.772 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-09-12T22:03:51.772 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-09-12T22:03:51.772 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-09-12T22:03:51.772 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-09-12T22:03:51.772 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-09-12T22:03:51.773 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_bias": 4, 2024-09-12T22:03:51.773 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 16, 2024-09-12T22:03:51.773 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_priority": 5 2024-09-12T22:03:51.773 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.773 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-09-12T22:03:51.773 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-09-12T22:03:51.773 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": "cephfs" 2024-09-12T22:03:51.773 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.773 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.773 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-09-12T22:03:51.773 INFO:teuthology.orchestra.run.smithi043.stdout: "score_type": "Fair distribution", 2024-09-12T22:03:51.773 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-09-12T22:03:51.773 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-09-12T22:03:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-09-12T22:03:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T22:03:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T22:03:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:03:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-09-12T22:03:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:03:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 4, 2024-09-12T22:03:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_data", 2024-09-12T22:03:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-09-12T22:03:31.777050+0000", 2024-09-12T22:03:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-09-12T22:03:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-09-12T22:03:51.775 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-09-12T22:03:51.775 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-09-12T22:03:51.775 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-09-12T22:03:51.775 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-09-12T22:03:51.775 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:03:51.775 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:03:51.775 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:03:51.775 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:03:51.775 INFO:teuthology.orchestra.run.smithi043.stdout: "is_stretch_pool": false, 2024-09-12T22:03:51.775 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-09-12T22:03:51.775 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:03:51.775 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 64, 2024-09-12T22:03:51.775 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 64, 2024-09-12T22:03:51.775 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 64, 2024-09-12T22:03:51.776 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 64, 2024-09-12T22:03:51.776 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 64, 2024-09-12T22:03:51.776 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-09-12T22:03:51.776 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-09-12T22:03:51.776 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-09-12T22:03:51.776 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-09-12T22:03:51.776 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-09-12T22:03:51.776 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-09-12T22:03:51.776 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-09-12T22:03:51.777 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.777 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "20", 2024-09-12T22:03:51.777 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-09-12T22:03:51.777 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:03:51.777 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:03:51.777 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-09-12T22:03:51.777 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:03:51.777 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-09-12T22:03:51.777 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-09-12T22:03:51.777 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-09-12T22:03:51.777 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-09-12T22:03:51.778 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-09-12T22:03:51.778 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-09-12T22:03:51.778 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-09-12T22:03:51.778 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-09-12T22:03:51.778 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-09-12T22:03:51.778 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-09-12T22:03:51.778 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-09-12T22:03:51.778 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-09-12T22:03:51.778 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-09-12T22:03:51.778 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:03:51.778 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:03:51.778 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:03:51.778 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-09-12T22:03:51.779 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-09-12T22:03:51.779 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-09-12T22:03:51.779 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-09-12T22:03:51.779 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-09-12T22:03:51.779 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.779 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-09-12T22:03:51.779 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-09-12T22:03:51.779 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-09-12T22:03:51.779 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:03:51.779 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:03:51.779 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:03:51.779 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:03:51.779 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-09-12T22:03:51.780 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-09-12T22:03:51.780 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-09-12T22:03:51.780 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-09-12T22:03:51.780 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-09-12T22:03:51.780 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 64, 2024-09-12T22:03:51.780 INFO:teuthology.orchestra.run.smithi043.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T22:03:51.780 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.780 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-09-12T22:03:51.780 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-09-12T22:03:51.780 INFO:teuthology.orchestra.run.smithi043.stdout: "data": "cephfs" 2024-09-12T22:03:51.780 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.780 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.780 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-09-12T22:03:51.780 INFO:teuthology.orchestra.run.smithi043.stdout: "score_type": "Fair distribution", 2024-09-12T22:03:51.781 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-09-12T22:03:51.781 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-09-12T22:03:51.781 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-09-12T22:03:51.781 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T22:03:51.781 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T22:03:51.781 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:03:51.781 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-09-12T22:03:51.781 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:03:51.781 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.781 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.781 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T22:03:51.781 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-09-12T22:03:51.781 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.782 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-09-12T22:03:51.782 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "eb292153-0043-4981-8743-115f848d2064", 2024-09-12T22:03:51.782 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-09-12T22:03:51.782 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-09-12T22:03:51.782 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-09-12T22:03:51.782 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-09-12T22:03:51.782 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-09-12T22:03:51.782 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-09-12T22:03:51.782 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-09-12T22:03:51.782 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 18, 2024-09-12T22:03:51.782 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-09-12T22:03:51.782 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-09-12T22:03:51.782 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-12T22:03:51.782 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-12T22:03:51.783 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.783 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-12T22:03:51.783 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.47:6800", 2024-09-12T22:03:51.783 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1281227380 2024-09-12T22:03:51.783 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.783 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.783 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-12T22:03:51.783 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.47:6801", 2024-09-12T22:03:51.783 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1281227380 2024-09-12T22:03:51.783 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.783 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.783 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.783 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-09-12T22:03:51.783 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-12T22:03:51.784 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.784 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-12T22:03:51.784 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.47:6802", 2024-09-12T22:03:51.784 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1281227380 2024-09-12T22:03:51.784 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.784 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.784 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-12T22:03:51.784 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.47:6803", 2024-09-12T22:03:51.784 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1281227380 2024-09-12T22:03:51.784 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.784 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.784 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.784 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-09-12T22:03:51.785 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-12T22:03:51.785 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.785 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-12T22:03:51.785 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.47:6806", 2024-09-12T22:03:51.785 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1281227380 2024-09-12T22:03:51.785 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.785 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.785 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-12T22:03:51.785 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.47:6807", 2024-09-12T22:03:51.785 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1281227380 2024-09-12T22:03:51.785 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.785 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.785 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.785 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-09-12T22:03:51.786 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-12T22:03:51.786 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.786 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-12T22:03:51.786 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.47:6804", 2024-09-12T22:03:51.786 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1281227380 2024-09-12T22:03:51.786 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.786 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.786 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-12T22:03:51.786 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.47:6805", 2024-09-12T22:03:51.786 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1281227380 2024-09-12T22:03:51.786 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.786 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.786 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.786 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.47:6801/1281227380", 2024-09-12T22:03:51.787 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.47:6803/1281227380", 2024-09-12T22:03:51.787 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.47:6807/1281227380", 2024-09-12T22:03:51.787 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.47:6805/1281227380", 2024-09-12T22:03:51.787 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-09-12T22:03:51.787 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-09-12T22:03:51.787 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-09-12T22:03:51.787 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.787 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.787 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-09-12T22:03:51.787 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "5f0330a2-15ce-4ffb-a697-da1f930db079", 2024-09-12T22:03:51.787 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-09-12T22:03:51.787 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-09-12T22:03:51.787 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-09-12T22:03:51.788 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-09-12T22:03:51.788 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-09-12T22:03:51.788 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-09-12T22:03:51.788 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 9, 2024-09-12T22:03:51.788 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 18, 2024-09-12T22:03:51.788 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-09-12T22:03:51.788 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-09-12T22:03:51.788 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-12T22:03:51.788 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-12T22:03:51.788 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.788 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-12T22:03:51.788 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.110:6800", 2024-09-12T22:03:51.788 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1334802479 2024-09-12T22:03:51.788 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.789 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.789 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-12T22:03:51.789 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.110:6801", 2024-09-12T22:03:51.789 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1334802479 2024-09-12T22:03:51.789 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.789 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.789 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.789 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-09-12T22:03:51.789 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-12T22:03:51.789 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.789 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-12T22:03:51.789 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.110:6802", 2024-09-12T22:03:51.789 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1334802479 2024-09-12T22:03:51.789 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.790 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.790 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-12T22:03:51.790 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.110:6803", 2024-09-12T22:03:51.790 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1334802479 2024-09-12T22:03:51.790 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.790 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.790 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.790 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-09-12T22:03:51.790 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-12T22:03:51.790 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.790 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-12T22:03:51.790 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.110:6806", 2024-09-12T22:03:51.790 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1334802479 2024-09-12T22:03:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-12T22:03:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.110:6807", 2024-09-12T22:03:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1334802479 2024-09-12T22:03:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-09-12T22:03:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-12T22:03:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-12T22:03:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.110:6804", 2024-09-12T22:03:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1334802479 2024-09-12T22:03:51.792 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.792 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.792 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-12T22:03:51.792 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.110:6805", 2024-09-12T22:03:51.792 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1334802479 2024-09-12T22:03:51.792 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.792 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.792 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.792 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.110:6801/1334802479", 2024-09-12T22:03:51.792 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.110:6803/1334802479", 2024-09-12T22:03:51.792 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.110:6807/1334802479", 2024-09-12T22:03:51.792 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.110:6805/1334802479", 2024-09-12T22:03:51.792 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-09-12T22:03:51.793 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-09-12T22:03:51.793 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-09-12T22:03:51.793 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.793 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.793 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.793 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-09-12T22:03:51.793 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "ae0b014f-768c-4f57-82c6-3edf9aa9f856", 2024-09-12T22:03:51.793 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-09-12T22:03:51.793 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-09-12T22:03:51.793 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-09-12T22:03:51.793 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-09-12T22:03:51.793 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-09-12T22:03:51.793 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-09-12T22:03:51.794 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 9, 2024-09-12T22:03:51.794 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 18, 2024-09-12T22:03:51.794 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-09-12T22:03:51.794 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-09-12T22:03:51.794 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-12T22:03:51.794 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-12T22:03:51.794 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.794 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-12T22:03:51.794 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.146:6800", 2024-09-12T22:03:51.794 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3565874056 2024-09-12T22:03:51.794 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.794 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.794 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-12T22:03:51.795 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.146:6801", 2024-09-12T22:03:51.795 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3565874056 2024-09-12T22:03:51.795 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.795 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.795 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.795 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-09-12T22:03:51.795 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-12T22:03:51.795 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.795 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-12T22:03:51.795 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.146:6802", 2024-09-12T22:03:51.795 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3565874056 2024-09-12T22:03:51.795 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.795 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.795 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-12T22:03:51.796 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.146:6803", 2024-09-12T22:03:51.796 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3565874056 2024-09-12T22:03:51.796 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.796 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.796 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.796 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-09-12T22:03:51.796 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-12T22:03:51.796 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.796 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-12T22:03:51.796 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.146:6806", 2024-09-12T22:03:51.796 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3565874056 2024-09-12T22:03:51.796 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.796 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.797 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-12T22:03:51.797 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.146:6807", 2024-09-12T22:03:51.797 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3565874056 2024-09-12T22:03:51.797 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.797 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.797 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.797 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-09-12T22:03:51.797 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-12T22:03:51.797 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.797 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-12T22:03:51.797 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.146:6804", 2024-09-12T22:03:51.797 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3565874056 2024-09-12T22:03:51.797 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.798 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.798 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-12T22:03:51.798 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.146:6805", 2024-09-12T22:03:51.798 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3565874056 2024-09-12T22:03:51.798 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.798 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.798 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.798 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.146:6801/3565874056", 2024-09-12T22:03:51.798 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.146:6803/3565874056", 2024-09-12T22:03:51.798 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.146:6807/3565874056", 2024-09-12T22:03:51.798 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.146:6805/3565874056", 2024-09-12T22:03:51.798 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-09-12T22:03:51.798 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-09-12T22:03:51.798 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-09-12T22:03:51.799 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.799 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.799 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T22:03:51.799 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_xinfo": [ 2024-09-12T22:03:51.799 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.799 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-09-12T22:03:51.799 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-09-12T22:03:51.799 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-09-12T22:03:51.799 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-09-12T22:03:51.799 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540701547738038271, 2024-09-12T22:03:51.799 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-09-12T22:03:51.799 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-09-12T22:03:18.927187+0000", 2024-09-12T22:03:51.799 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-09-12T22:03:51.799 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.800 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.800 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-09-12T22:03:51.800 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-09-12T22:03:51.800 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-09-12T22:03:51.800 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-09-12T22:03:51.800 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540701547738038271, 2024-09-12T22:03:51.800 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-09-12T22:03:51.800 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-09-12T22:03:19.386650+0000", 2024-09-12T22:03:51.800 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-09-12T22:03:51.800 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.800 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.800 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-09-12T22:03:51.800 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-09-12T22:03:51.800 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-09-12T22:03:51.801 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-09-12T22:03:51.801 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540701547738038271, 2024-09-12T22:03:51.801 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-09-12T22:03:51.801 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-09-12T22:03:19.957366+0000", 2024-09-12T22:03:51.801 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-09-12T22:03:51.801 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.801 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T22:03:51.801 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap": [], 2024-09-12T22:03:51.801 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_items": [], 2024-09-12T22:03:51.801 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_primaries": [], 2024-09-12T22:03:51.801 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_temp": [], 2024-09-12T22:03:51.801 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_temp": [], 2024-09-12T22:03:51.801 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklist": {}, 2024-09-12T22:03:51.801 INFO:teuthology.orchestra.run.smithi043.stdout: "range_blocklist": {}, 2024-09-12T22:03:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profiles": { 2024-09-12T22:03:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: "default": { 2024-09-12T22:03:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-failure-domain": "osd", 2024-09-12T22:03:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: "k": "2", 2024-09-12T22:03:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: "m": "1", 2024-09-12T22:03:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin": "jerasure", 2024-09-12T22:03:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: "technique": "reed_sol_van" 2024-09-12T22:03:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps_queue": [], 2024-09-12T22:03:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: "new_removed_snaps": [], 2024-09-12T22:03:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: "new_purged_snaps": [ 2024-09-12T22:03:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 2, 2024-09-12T22:03:51.803 INFO:teuthology.orchestra.run.smithi043.stdout: "snaps": [ 2024-09-12T22:03:51.803 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:51.803 INFO:teuthology.orchestra.run.smithi043.stdout: "begin": 2, 2024-09-12T22:03:51.803 INFO:teuthology.orchestra.run.smithi043.stdout: "length": 1 2024-09-12T22:03:51.803 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.803 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:51.803 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.803 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T22:03:51.803 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_node_flags": {}, 2024-09-12T22:03:51.803 INFO:teuthology.orchestra.run.smithi043.stdout: "device_class_flags": {}, 2024-09-12T22:03:51.803 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": { 2024-09-12T22:03:51.803 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_enabled": false, 2024-09-12T22:03:51.803 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_bucket_count": 0, 2024-09-12T22:03:51.803 INFO:teuthology.orchestra.run.smithi043.stdout: "degraded_stretch_mode": 0, 2024-09-12T22:03:51.804 INFO:teuthology.orchestra.run.smithi043.stdout: "recovering_stretch_mode": 0, 2024-09-12T22:03:51.804 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_bucket": 0 2024-09-12T22:03:51.804 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:51.804 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T22:03:51.805 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:51.805 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:51.806 INFO:tasks.thrashosds.thrasher:j is {'epoch': 21, 'fsid': '1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7', 'created': '2024-09-12T22:03:11.964028+0000', 'modified': '2024-09-12T22:03:36.944923+0000', 'last_up_change': '2024-09-12T22:03:21.299348+0000', 'last_in_change': '2024-09-12T22:03:12.758606+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T22:03:22.281699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T22:03:26.987767+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T22:03:31.328134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T22:03:31.777050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'eb292153-0043-4981-8743-115f848d2064', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6800', 'nonce': 1281227380}, {'type': 'v1', 'addr': '172.21.15.47:6801', 'nonce': 1281227380}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6802', 'nonce': 1281227380}, {'type': 'v1', 'addr': '172.21.15.47:6803', 'nonce': 1281227380}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6806', 'nonce': 1281227380}, {'type': 'v1', 'addr': '172.21.15.47:6807', 'nonce': 1281227380}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6804', 'nonce': 1281227380}, {'type': 'v1', 'addr': '172.21.15.47:6805', 'nonce': 1281227380}]}, 'public_addr': '172.21.15.47:6801/1281227380', 'cluster_addr': '172.21.15.47:6803/1281227380', 'heartbeat_back_addr': '172.21.15.47:6807/1281227380', 'heartbeat_front_addr': '172.21.15.47:6805/1281227380', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '5f0330a2-15ce-4ffb-a697-da1f930db079', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 1334802479}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 1334802479}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 1334802479}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 1334802479}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 1334802479}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 1334802479}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 1334802479}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 1334802479}]}, 'public_addr': '172.21.15.110:6801/1334802479', 'cluster_addr': '172.21.15.110:6803/1334802479', 'heartbeat_back_addr': '172.21.15.110:6807/1334802479', 'heartbeat_front_addr': '172.21.15.110:6805/1334802479', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'ae0b014f-768c-4f57-82c6-3edf9aa9f856', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6800', 'nonce': 3565874056}, {'type': 'v1', 'addr': '172.21.15.146:6801', 'nonce': 3565874056}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6802', 'nonce': 3565874056}, {'type': 'v1', 'addr': '172.21.15.146:6803', 'nonce': 3565874056}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6806', 'nonce': 3565874056}, {'type': 'v1', 'addr': '172.21.15.146:6807', 'nonce': 3565874056}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6804', 'nonce': 3565874056}, {'type': 'v1', 'addr': '172.21.15.146:6805', 'nonce': 3565874056}]}, 'public_addr': '172.21.15.146:6801/3565874056', 'cluster_addr': '172.21.15.146:6803/3565874056', 'heartbeat_back_addr': '172.21.15.146:6807/3565874056', 'heartbeat_front_addr': '172.21.15.146:6805/3565874056', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:03:18.927187+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:03:19.386650+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:03:19.957366+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [{'pool': 2, 'snaps': [{'begin': 2, 'length': 1}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T22:03:51.806 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:03:51.807 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:03:51.818 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:51.818+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:51.919 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:51.918+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:51.922 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:51.922 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:51.931 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:03:51.995 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'unique_pool_0' created 2024-09-12T22:03:51.995 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-09-12T22:03:52.008 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-12T22:03:52.020 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:52.019+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:52.036 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:52.036 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:52.045 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:03:52.108 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:03:52.110 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:03:52.119 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-12T22:03:51.992915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":103636,"kb_used_data":1760,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":283011884,"statfs":{"total":289910292480,"available":289804169216,"internally_reserved":0,"allocated":1802240,"data_stored":1382448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.752937"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949228+0000","last_change":"2024-09-12T22:03:33.459321+0000","last_active":"2024-09-12T22:03:36.949228+0000","last_peered":"2024-09-12T22:03:36.949228+0000","last_clean":"2024-09-12T22:03:36.949228+0000","last_became_active":"2024-09-12T22:03:33.458897+0000","last_became_peered":"2024-09-12T22:03:33.458897+0000","last_unstale":"2024-09-12T22:03:36.949228+0000","last_undegraded":"2024-09-12T22:03:36.949228+0000","last_fullsized":"2024-09-12T22:03:36.949228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:20.716362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948961+0000","last_change":"2024-09-12T22:03:33.463659+0000","last_active":"2024-09-12T22:03:36.948961+0000","last_peered":"2024-09-12T22:03:36.948961+0000","last_clean":"2024-09-12T22:03:36.948961+0000","last_became_active":"2024-09-12T22:03:33.463296+0000","last_became_peered":"2024-09-12T22:03:33.463296+0000","last_unstale":"2024-09-12T22:03:36.948961+0000","last_undegraded":"2024-09-12T22:03:36.948961+0000","last_fullsized":"2024-09-12T22:03:36.948961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:10.270667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120413+0000","last_change":"2024-09-12T22:03:33.462148+0000","last_active":"2024-09-12T22:03:38.120413+0000","last_peered":"2024-09-12T22:03:38.120413+0000","last_clean":"2024-09-12T22:03:38.120413+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:03:38.120413+0000","last_undegraded":"2024-09-12T22:03:38.120413+0000","last_fullsized":"2024-09-12T22:03:38.120413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:36.909948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120215+0000","last_change":"2024-09-12T22:03:33.464418+0000","last_active":"2024-09-12T22:03:38.120215+0000","last_peered":"2024-09-12T22:03:38.120215+0000","last_clean":"2024-09-12T22:03:38.120215+0000","last_became_active":"2024-09-12T22:03:33.463811+0000","last_became_peered":"2024-09-12T22:03:33.463811+0000","last_unstale":"2024-09-12T22:03:38.120215+0000","last_undegraded":"2024-09-12T22:03:38.120215+0000","last_fullsized":"2024-09-12T22:03:38.120215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:48.374991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948625+0000","last_change":"2024-09-12T22:03:33.459995+0000","last_active":"2024-09-12T22:03:36.948625+0000","last_peered":"2024-09-12T22:03:36.948625+0000","last_clean":"2024-09-12T22:03:36.948625+0000","last_became_active":"2024-09-12T22:03:33.459653+0000","last_became_peered":"2024-09-12T22:03:33.459653+0000","last_unstale":"2024-09-12T22:03:36.948625+0000","last_undegraded":"2024-09-12T22:03:36.948625+0000","last_fullsized":"2024-09-12T22:03:36.948625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:15.288581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119840+0000","last_change":"2024-09-12T22:03:33.464646+0000","last_active":"2024-09-12T22:03:38.119840+0000","last_peered":"2024-09-12T22:03:38.119840+0000","last_clean":"2024-09-12T22:03:38.119840+0000","last_became_active":"2024-09-12T22:03:33.463793+0000","last_became_peered":"2024-09-12T22:03:33.463793+0000","last_unstale":"2024-09-12T22:03:38.119840+0000","last_undegraded":"2024-09-12T22:03:38.119840+0000","last_fullsized":"2024-09-12T22:03:38.119840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.153436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119951+0000","last_change":"2024-09-12T22:03:33.463183+0000","last_active":"2024-09-12T22:03:38.119951+0000","last_peered":"2024-09-12T22:03:38.119951+0000","last_clean":"2024-09-12T22:03:38.119951+0000","last_became_active":"2024-09-12T22:03:33.462752+0000","last_became_peered":"2024-09-12T22:03:33.462752+0000","last_unstale":"2024-09-12T22:03:38.119951+0000","last_undegraded":"2024-09-12T22:03:38.119951+0000","last_fullsized":"2024-09-12T22:03:38.119951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:25.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119620+0000","last_change":"2024-09-12T22:03:33.465552+0000","last_active":"2024-09-12T22:03:38.119620+0000","last_peered":"2024-09-12T22:03:38.119620+0000","last_clean":"2024-09-12T22:03:38.119620+0000","last_became_active":"2024-09-12T22:03:33.464745+0000","last_became_peered":"2024-09-12T22:03:33.464745+0000","last_unstale":"2024-09-12T22:03:38.119620+0000","last_undegraded":"2024-09-12T22:03:38.119620+0000","last_fullsized":"2024-09-12T22:03:38.119620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:42.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634348+0000","last_change":"2024-09-12T22:03:33.461075+0000","last_active":"2024-09-12T22:03:37.634348+0000","last_peered":"2024-09-12T22:03:37.634348+0000","last_clean":"2024-09-12T22:03:37.634348+0000","last_became_active":"2024-09-12T22:03:33.459892+0000","last_became_peered":"2024-09-12T22:03:33.459892+0000","last_unstale":"2024-09-12T22:03:37.634348+0000","last_undegraded":"2024-09-12T22:03:37.634348+0000","last_fullsized":"2024-09-12T22:03:37.634348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:25.087808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949026+0000","last_change":"2024-09-12T22:03:33.459292+0000","last_active":"2024-09-12T22:03:36.949026+0000","last_peered":"2024-09-12T22:03:36.949026+0000","last_clean":"2024-09-12T22:03:36.949026+0000","last_became_active":"2024-09-12T22:03:33.458956+0000","last_became_peered":"2024-09-12T22:03:33.458956+0000","last_unstale":"2024-09-12T22:03:36.949026+0000","last_undegraded":"2024-09-12T22:03:36.949026+0000","last_fullsized":"2024-09-12T22:03:36.949026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.153436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120553+0000","last_change":"2024-09-12T22:03:33.464766+0000","last_active":"2024-09-12T22:03:38.120553+0000","last_peered":"2024-09-12T22:03:38.120553+0000","last_clean":"2024-09-12T22:03:38.120553+0000","last_became_active":"2024-09-12T22:03:33.463545+0000","last_became_peered":"2024-09-12T22:03:33.463545+0000","last_unstale":"2024-09-12T22:03:38.120553+0000","last_undegraded":"2024-09-12T22:03:38.120553+0000","last_fullsized":"2024-09-12T22:03:38.120553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:27.861352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948602+0000","last_change":"2024-09-12T22:03:33.465069+0000","last_active":"2024-09-12T22:03:36.948602+0000","last_peered":"2024-09-12T22:03:36.948602+0000","last_clean":"2024-09-12T22:03:36.948602+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:03:36.948602+0000","last_undegraded":"2024-09-12T22:03:36.948602+0000","last_fullsized":"2024-09-12T22:03:36.948602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948404+0000","last_change":"2024-09-12T22:03:33.458519+0000","last_active":"2024-09-12T22:03:36.948404+0000","last_peered":"2024-09-12T22:03:36.948404+0000","last_clean":"2024-09-12T22:03:36.948404+0000","last_became_active":"2024-09-12T22:03:33.458138+0000","last_became_peered":"2024-09-12T22:03:33.458138+0000","last_unstale":"2024-09-12T22:03:36.948404+0000","last_undegraded":"2024-09-12T22:03:36.948404+0000","last_fullsized":"2024-09-12T22:03:36.948404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:18.784928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119916+0000","last_change":"2024-09-12T22:03:33.457584+0000","last_active":"2024-09-12T22:03:38.119916+0000","last_peered":"2024-09-12T22:03:38.119916+0000","last_clean":"2024-09-12T22:03:38.119916+0000","last_became_active":"2024-09-12T22:03:33.456732+0000","last_became_peered":"2024-09-12T22:03:33.456732+0000","last_unstale":"2024-09-12T22:03:38.119916+0000","last_undegraded":"2024-09-12T22:03:38.119916+0000","last_fullsized":"2024-09-12T22:03:38.119916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:20.716362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120012+0000","last_change":"2024-09-12T22:03:33.455903+0000","last_active":"2024-09-12T22:03:38.120012+0000","last_peered":"2024-09-12T22:03:38.120012+0000","last_clean":"2024-09-12T22:03:38.120012+0000","last_became_active":"2024-09-12T22:03:33.455399+0000","last_became_peered":"2024-09-12T22:03:33.455399+0000","last_unstale":"2024-09-12T22:03:38.120012+0000","last_undegraded":"2024-09-12T22:03:38.120012+0000","last_fullsized":"2024-09-12T22:03:38.120012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:06.785269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119637+0000","last_change":"2024-09-12T22:03:33.465252+0000","last_active":"2024-09-12T22:03:38.119637+0000","last_peered":"2024-09-12T22:03:38.119637+0000","last_clean":"2024-09-12T22:03:38.119637+0000","last_became_active":"2024-09-12T22:03:33.464524+0000","last_became_peered":"2024-09-12T22:03:33.464524+0000","last_unstale":"2024-09-12T22:03:38.119637+0000","last_undegraded":"2024-09-12T22:03:38.119637+0000","last_fullsized":"2024-09-12T22:03:38.119637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.406786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634727+0000","last_change":"2024-09-12T22:03:33.457075+0000","last_active":"2024-09-12T22:03:37.634727+0000","last_peered":"2024-09-12T22:03:37.634727+0000","last_clean":"2024-09-12T22:03:37.634727+0000","last_became_active":"2024-09-12T22:03:33.456463+0000","last_became_peered":"2024-09-12T22:03:33.456463+0000","last_unstale":"2024-09-12T22:03:37.634727+0000","last_undegraded":"2024-09-12T22:03:37.634727+0000","last_fullsized":"2024-09-12T22:03:37.634727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:40.945193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949187+0000","last_change":"2024-09-12T22:03:33.463614+0000","last_active":"2024-09-12T22:03:36.949187+0000","last_peered":"2024-09-12T22:03:36.949187+0000","last_clean":"2024-09-12T22:03:36.949187+0000","last_became_active":"2024-09-12T22:03:33.463245+0000","last_became_peered":"2024-09-12T22:03:33.463245+0000","last_unstale":"2024-09-12T22:03:36.949187+0000","last_undegraded":"2024-09-12T22:03:36.949187+0000","last_fullsized":"2024-09-12T22:03:36.949187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:11.422942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634149+0000","last_change":"2024-09-12T22:03:33.457934+0000","last_active":"2024-09-12T22:03:37.634149+0000","last_peered":"2024-09-12T22:03:37.634149+0000","last_clean":"2024-09-12T22:03:37.634149+0000","last_became_active":"2024-09-12T22:03:33.457458+0000","last_became_peered":"2024-09-12T22:03:33.457458+0000","last_unstale":"2024-09-12T22:03:37.634149+0000","last_undegraded":"2024-09-12T22:03:37.634149+0000","last_fullsized":"2024-09-12T22:03:37.634149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:32.748239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120307+0000","last_change":"2024-09-12T22:03:33.464118+0000","last_active":"2024-09-12T22:03:38.120307+0000","last_peered":"2024-09-12T22:03:38.120307+0000","last_clean":"2024-09-12T22:03:38.120307+0000","last_became_active":"2024-09-12T22:03:33.463243+0000","last_became_peered":"2024-09-12T22:03:33.463243+0000","last_unstale":"2024-09-12T22:03:38.120307+0000","last_undegraded":"2024-09-12T22:03:38.120307+0000","last_fullsized":"2024-09-12T22:03:38.120307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:34.450477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120288+0000","last_change":"2024-09-12T22:03:33.465705+0000","last_active":"2024-09-12T22:03:38.120288+0000","last_peered":"2024-09-12T22:03:38.120288+0000","last_clean":"2024-09-12T22:03:38.120288+0000","last_became_active":"2024-09-12T22:03:33.465207+0000","last_became_peered":"2024-09-12T22:03:33.465207+0000","last_unstale":"2024-09-12T22:03:38.120288+0000","last_undegraded":"2024-09-12T22:03:38.120288+0000","last_fullsized":"2024-09-12T22:03:38.120288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.780572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948470+0000","last_change":"2024-09-12T22:03:33.460994+0000","last_active":"2024-09-12T22:03:36.948470+0000","last_peered":"2024-09-12T22:03:36.948470+0000","last_clean":"2024-09-12T22:03:36.948470+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:03:36.948470+0000","last_undegraded":"2024-09-12T22:03:36.948470+0000","last_fullsized":"2024-09-12T22:03:36.948470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:20.363291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633254+0000","last_change":"2024-09-12T22:03:33.466950+0000","last_active":"2024-09-12T22:03:37.633254+0000","last_peered":"2024-09-12T22:03:37.633254+0000","last_clean":"2024-09-12T22:03:37.633254+0000","last_became_active":"2024-09-12T22:03:33.466609+0000","last_became_peered":"2024-09-12T22:03:33.466609+0000","last_unstale":"2024-09-12T22:03:37.633254+0000","last_undegraded":"2024-09-12T22:03:37.633254+0000","last_fullsized":"2024-09-12T22:03:37.633254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:34.396185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948002+0000","last_change":"2024-09-12T22:03:33.460375+0000","last_active":"2024-09-12T22:03:36.948002+0000","last_peered":"2024-09-12T22:03:36.948002+0000","last_clean":"2024-09-12T22:03:36.948002+0000","last_became_active":"2024-09-12T22:03:33.459687+0000","last_became_peered":"2024-09-12T22:03:33.459687+0000","last_unstale":"2024-09-12T22:03:36.948002+0000","last_undegraded":"2024-09-12T22:03:36.948002+0000","last_fullsized":"2024-09-12T22:03:36.948002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:34.897642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949272+0000","last_change":"2024-09-12T22:03:33.456508+0000","last_active":"2024-09-12T22:03:36.949272+0000","last_peered":"2024-09-12T22:03:36.949272+0000","last_clean":"2024-09-12T22:03:36.949272+0000","last_became_active":"2024-09-12T22:03:33.456189+0000","last_became_peered":"2024-09-12T22:03:33.456189+0000","last_unstale":"2024-09-12T22:03:36.949272+0000","last_undegraded":"2024-09-12T22:03:36.949272+0000","last_fullsized":"2024-09-12T22:03:36.949272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.466890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634563+0000","last_change":"2024-09-12T22:03:33.465866+0000","last_active":"2024-09-12T22:03:37.634563+0000","last_peered":"2024-09-12T22:03:37.634563+0000","last_clean":"2024-09-12T22:03:37.634563+0000","last_became_active":"2024-09-12T22:03:33.464254+0000","last_became_peered":"2024-09-12T22:03:33.464254+0000","last_unstale":"2024-09-12T22:03:37.634563+0000","last_undegraded":"2024-09-12T22:03:37.634563+0000","last_fullsized":"2024-09-12T22:03:37.634563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:51.045864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120695+0000","last_change":"2024-09-12T22:03:33.461282+0000","last_active":"2024-09-12T22:03:38.120695+0000","last_peered":"2024-09-12T22:03:38.120695+0000","last_clean":"2024-09-12T22:03:38.120695+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:03:38.120695+0000","last_undegraded":"2024-09-12T22:03:38.120695+0000","last_fullsized":"2024-09-12T22:03:38.120695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:32.302716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948773+0000","last_change":"2024-09-12T22:03:33.467229+0000","last_active":"2024-09-12T22:03:36.948773+0000","last_peered":"2024-09-12T22:03:36.948773+0000","last_clean":"2024-09-12T22:03:36.948773+0000","last_became_active":"2024-09-12T22:03:33.464691+0000","last_became_peered":"2024-09-12T22:03:33.464691+0000","last_unstale":"2024-09-12T22:03:36.948773+0000","last_undegraded":"2024-09-12T22:03:36.948773+0000","last_fullsized":"2024-09-12T22:03:36.948773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.780572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634065+0000","last_change":"2024-09-12T22:03:33.460674+0000","last_active":"2024-09-12T22:03:37.634065+0000","last_peered":"2024-09-12T22:03:37.634065+0000","last_clean":"2024-09-12T22:03:37.634065+0000","last_became_active":"2024-09-12T22:03:33.458902+0000","last_became_peered":"2024-09-12T22:03:33.458902+0000","last_unstale":"2024-09-12T22:03:37.634065+0000","last_undegraded":"2024-09-12T22:03:37.634065+0000","last_fullsized":"2024-09-12T22:03:37.634065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:01.247039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948605+0000","last_change":"2024-09-12T22:03:33.456842+0000","last_active":"2024-09-12T22:03:36.948605+0000","last_peered":"2024-09-12T22:03:36.948605+0000","last_clean":"2024-09-12T22:03:36.948605+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:03:36.948605+0000","last_undegraded":"2024-09-12T22:03:36.948605+0000","last_fullsized":"2024-09-12T22:03:36.948605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:56.383351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633245+0000","last_change":"2024-09-12T22:03:33.459380+0000","last_active":"2024-09-12T22:03:37.633245+0000","last_peered":"2024-09-12T22:03:37.633245+0000","last_clean":"2024-09-12T22:03:37.633245+0000","last_became_active":"2024-09-12T22:03:33.458357+0000","last_became_peered":"2024-09-12T22:03:33.458357+0000","last_unstale":"2024-09-12T22:03:37.633245+0000","last_undegraded":"2024-09-12T22:03:37.633245+0000","last_fullsized":"2024-09-12T22:03:37.633245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:15.811200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119698+0000","last_change":"2024-09-12T22:03:33.463134+0000","last_active":"2024-09-12T22:03:38.119698+0000","last_peered":"2024-09-12T22:03:38.119698+0000","last_clean":"2024-09-12T22:03:38.119698+0000","last_became_active":"2024-09-12T22:03:33.462566+0000","last_became_peered":"2024-09-12T22:03:33.462566+0000","last_unstale":"2024-09-12T22:03:38.119698+0000","last_undegraded":"2024-09-12T22:03:38.119698+0000","last_fullsized":"2024-09-12T22:03:38.119698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:48.428755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948711+0000","last_change":"2024-09-12T22:03:33.460277+0000","last_active":"2024-09-12T22:03:36.948711+0000","last_peered":"2024-09-12T22:03:36.948711+0000","last_clean":"2024-09-12T22:03:36.948711+0000","last_became_active":"2024-09-12T22:03:33.459696+0000","last_became_peered":"2024-09-12T22:03:33.459696+0000","last_unstale":"2024-09-12T22:03:36.948711+0000","last_undegraded":"2024-09-12T22:03:36.948711+0000","last_fullsized":"2024-09-12T22:03:36.948711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:42.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120607+0000","last_change":"2024-09-12T22:03:32.457419+0000","last_active":"2024-09-12T22:03:38.120607+0000","last_peered":"2024-09-12T22:03:38.120607+0000","last_clean":"2024-09-12T22:03:38.120607+0000","last_became_active":"2024-09-12T22:03:32.456846+0000","last_became_peered":"2024-09-12T22:03:32.456846+0000","last_unstale":"2024-09-12T22:03:38.120607+0000","last_undegraded":"2024-09-12T22:03:38.120607+0000","last_fullsized":"2024-09-12T22:03:38.120607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:55.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949001+0000","last_change":"2024-09-12T22:03:33.458607+0000","last_active":"2024-09-12T22:03:36.949001+0000","last_peered":"2024-09-12T22:03:36.949001+0000","last_clean":"2024-09-12T22:03:36.949001+0000","last_became_active":"2024-09-12T22:03:33.457815+0000","last_became_peered":"2024-09-12T22:03:33.457815+0000","last_unstale":"2024-09-12T22:03:36.949001+0000","last_undegraded":"2024-09-12T22:03:36.949001+0000","last_fullsized":"2024-09-12T22:03:36.949001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:48.428755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633671+0000","last_change":"2024-09-12T22:03:32.458436+0000","last_active":"2024-09-12T22:03:37.633671+0000","last_peered":"2024-09-12T22:03:37.633671+0000","last_clean":"2024-09-12T22:03:37.633671+0000","last_became_active":"2024-09-12T22:03:32.457647+0000","last_became_peered":"2024-09-12T22:03:32.457647+0000","last_unstale":"2024-09-12T22:03:37.633671+0000","last_undegraded":"2024-09-12T22:03:37.633671+0000","last_fullsized":"2024-09-12T22:03:37.633671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:57.394698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634795+0000","last_change":"2024-09-12T22:03:33.466388+0000","last_active":"2024-09-12T22:03:37.634795+0000","last_peered":"2024-09-12T22:03:37.634795+0000","last_clean":"2024-09-12T22:03:37.634795+0000","last_became_active":"2024-09-12T22:03:33.464101+0000","last_became_peered":"2024-09-12T22:03:33.464101+0000","last_unstale":"2024-09-12T22:03:37.634795+0000","last_undegraded":"2024-09-12T22:03:37.634795+0000","last_fullsized":"2024-09-12T22:03:37.634795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:39:52.512160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948250+0000","last_change":"2024-09-12T22:03:32.461341+0000","last_active":"2024-09-12T22:03:36.948250+0000","last_peered":"2024-09-12T22:03:36.948250+0000","last_clean":"2024-09-12T22:03:36.948250+0000","last_became_active":"2024-09-12T22:03:32.460840+0000","last_became_peered":"2024-09-12T22:03:32.460840+0000","last_unstale":"2024-09-12T22:03:36.948250+0000","last_undegraded":"2024-09-12T22:03:36.948250+0000","last_fullsized":"2024-09-12T22:03:36.948250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:08.751696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634330+0000","last_change":"2024-09-12T22:03:33.464983+0000","last_active":"2024-09-12T22:03:37.634330+0000","last_peered":"2024-09-12T22:03:37.634330+0000","last_clean":"2024-09-12T22:03:37.634330+0000","last_became_active":"2024-09-12T22:03:33.464497+0000","last_became_peered":"2024-09-12T22:03:33.464497+0000","last_unstale":"2024-09-12T22:03:37.634330+0000","last_undegraded":"2024-09-12T22:03:37.634330+0000","last_fullsized":"2024-09-12T22:03:37.634330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:20.643181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119729+0000","last_change":"2024-09-12T22:03:32.453200+0000","last_active":"2024-09-12T22:03:38.119729+0000","last_peered":"2024-09-12T22:03:38.119729+0000","last_clean":"2024-09-12T22:03:38.119729+0000","last_became_active":"2024-09-12T22:03:32.452937+0000","last_became_peered":"2024-09-12T22:03:32.452937+0000","last_unstale":"2024-09-12T22:03:38.119729+0000","last_undegraded":"2024-09-12T22:03:38.119729+0000","last_fullsized":"2024-09-12T22:03:38.119729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:37.122599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120976+0000","last_change":"2024-09-12T22:03:32.458776+0000","last_active":"2024-09-12T22:03:38.120976+0000","last_peered":"2024-09-12T22:03:38.120976+0000","last_clean":"2024-09-12T22:03:38.120976+0000","last_became_active":"2024-09-12T22:03:32.458223+0000","last_became_peered":"2024-09-12T22:03:32.458223+0000","last_unstale":"2024-09-12T22:03:38.120976+0000","last_undegraded":"2024-09-12T22:03:38.120976+0000","last_fullsized":"2024-09-12T22:03:38.120976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:25.999548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948060+0000","last_change":"2024-09-12T22:03:33.465308+0000","last_active":"2024-09-12T22:03:36.948060+0000","last_peered":"2024-09-12T22:03:36.948060+0000","last_clean":"2024-09-12T22:03:36.948060+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:03:36.948060+0000","last_undegraded":"2024-09-12T22:03:36.948060+0000","last_fullsized":"2024-09-12T22:03:36.948060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:35.733622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949175+0000","last_change":"2024-09-12T22:03:32.461301+0000","last_active":"2024-09-12T22:03:36.949175+0000","last_peered":"2024-09-12T22:03:36.949175+0000","last_clean":"2024-09-12T22:03:36.949175+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:03:36.949175+0000","last_undegraded":"2024-09-12T22:03:36.949175+0000","last_fullsized":"2024-09-12T22:03:36.949175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:39.872272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948189+0000","last_change":"2024-09-12T22:03:33.458592+0000","last_active":"2024-09-12T22:03:36.948189+0000","last_peered":"2024-09-12T22:03:36.948189+0000","last_clean":"2024-09-12T22:03:36.948189+0000","last_became_active":"2024-09-12T22:03:33.458077+0000","last_became_peered":"2024-09-12T22:03:33.458077+0000","last_unstale":"2024-09-12T22:03:36.948189+0000","last_undegraded":"2024-09-12T22:03:36.948189+0000","last_fullsized":"2024-09-12T22:03:36.948189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.333348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121065+0000","last_change":"2024-09-12T22:03:32.459540+0000","last_active":"2024-09-12T22:03:38.121065+0000","last_peered":"2024-09-12T22:03:38.121065+0000","last_clean":"2024-09-12T22:03:38.121065+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:03:38.121065+0000","last_undegraded":"2024-09-12T22:03:38.121065+0000","last_fullsized":"2024-09-12T22:03:38.121065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:22.143242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120192+0000","last_change":"2024-09-12T22:03:33.464832+0000","last_active":"2024-09-12T22:03:38.120192+0000","last_peered":"2024-09-12T22:03:38.120192+0000","last_clean":"2024-09-12T22:03:38.120192+0000","last_became_active":"2024-09-12T22:03:33.463400+0000","last_became_peered":"2024-09-12T22:03:33.463400+0000","last_unstale":"2024-09-12T22:03:38.120192+0000","last_undegraded":"2024-09-12T22:03:38.120192+0000","last_fullsized":"2024-09-12T22:03:38.120192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:11:53.438877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120596+0000","last_change":"2024-09-12T22:03:32.456243+0000","last_active":"2024-09-12T22:03:38.120596+0000","last_peered":"2024-09-12T22:03:38.120596+0000","last_clean":"2024-09-12T22:03:38.120596+0000","last_became_active":"2024-09-12T22:03:32.455840+0000","last_became_peered":"2024-09-12T22:03:32.455840+0000","last_unstale":"2024-09-12T22:03:38.120596+0000","last_undegraded":"2024-09-12T22:03:38.120596+0000","last_fullsized":"2024-09-12T22:03:38.120596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:47.319431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633986+0000","last_change":"2024-09-12T22:03:33.465572+0000","last_active":"2024-09-12T22:03:37.633986+0000","last_peered":"2024-09-12T22:03:37.633986+0000","last_clean":"2024-09-12T22:03:37.633986+0000","last_became_active":"2024-09-12T22:03:33.465000+0000","last_became_peered":"2024-09-12T22:03:33.465000+0000","last_unstale":"2024-09-12T22:03:37.633986+0000","last_undegraded":"2024-09-12T22:03:37.633986+0000","last_fullsized":"2024-09-12T22:03:37.633986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:37.418482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634361+0000","last_change":"2024-09-12T22:03:32.458041+0000","last_active":"2024-09-12T22:03:37.634361+0000","last_peered":"2024-09-12T22:03:37.634361+0000","last_clean":"2024-09-12T22:03:37.634361+0000","last_became_active":"2024-09-12T22:03:32.457583+0000","last_became_peered":"2024-09-12T22:03:32.457583+0000","last_unstale":"2024-09-12T22:03:37.634361+0000","last_undegraded":"2024-09-12T22:03:37.634361+0000","last_fullsized":"2024-09-12T22:03:37.634361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:15.688344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120351+0000","last_change":"2024-09-12T22:03:33.462786+0000","last_active":"2024-09-12T22:03:38.120351+0000","last_peered":"2024-09-12T22:03:38.120351+0000","last_clean":"2024-09-12T22:03:38.120351+0000","last_became_active":"2024-09-12T22:03:33.462488+0000","last_became_peered":"2024-09-12T22:03:33.462488+0000","last_unstale":"2024-09-12T22:03:38.120351+0000","last_undegraded":"2024-09-12T22:03:38.120351+0000","last_fullsized":"2024-09-12T22:03:38.120351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:24.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120200+0000","last_change":"2024-09-12T22:03:32.457448+0000","last_active":"2024-09-12T22:03:38.120200+0000","last_peered":"2024-09-12T22:03:38.120200+0000","last_clean":"2024-09-12T22:03:38.120200+0000","last_became_active":"2024-09-12T22:03:32.457013+0000","last_became_peered":"2024-09-12T22:03:32.457013+0000","last_unstale":"2024-09-12T22:03:38.120200+0000","last_undegraded":"2024-09-12T22:03:38.120200+0000","last_fullsized":"2024-09-12T22:03:38.120200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:27.694073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120791+0000","last_change":"2024-09-12T22:03:33.459084+0000","last_active":"2024-09-12T22:03:38.120791+0000","last_peered":"2024-09-12T22:03:38.120791+0000","last_clean":"2024-09-12T22:03:38.120791+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:03:38.120791+0000","last_undegraded":"2024-09-12T22:03:38.120791+0000","last_fullsized":"2024-09-12T22:03:38.120791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:50.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948293+0000","last_change":"2024-09-12T22:03:32.461417+0000","last_active":"2024-09-12T22:03:36.948293+0000","last_peered":"2024-09-12T22:03:36.948293+0000","last_clean":"2024-09-12T22:03:36.948293+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:03:36.948293+0000","last_undegraded":"2024-09-12T22:03:36.948293+0000","last_fullsized":"2024-09-12T22:03:36.948293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:22.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120631+0000","last_change":"2024-09-12T22:03:33.457927+0000","last_active":"2024-09-12T22:03:38.120631+0000","last_peered":"2024-09-12T22:03:38.120631+0000","last_clean":"2024-09-12T22:03:38.120631+0000","last_became_active":"2024-09-12T22:03:33.457548+0000","last_became_peered":"2024-09-12T22:03:33.457548+0000","last_unstale":"2024-09-12T22:03:38.120631+0000","last_undegraded":"2024-09-12T22:03:38.120631+0000","last_fullsized":"2024-09-12T22:03:38.120631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:17.407499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948139+0000","last_change":"2024-09-12T22:03:32.458122+0000","last_active":"2024-09-12T22:03:36.948139+0000","last_peered":"2024-09-12T22:03:36.948139+0000","last_clean":"2024-09-12T22:03:36.948139+0000","last_became_active":"2024-09-12T22:03:32.457812+0000","last_became_peered":"2024-09-12T22:03:32.457812+0000","last_unstale":"2024-09-12T22:03:36.948139+0000","last_undegraded":"2024-09-12T22:03:36.948139+0000","last_fullsized":"2024-09-12T22:03:36.948139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:33.359519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634486+0000","last_change":"2024-09-12T22:03:33.459649+0000","last_active":"2024-09-12T22:03:37.634486+0000","last_peered":"2024-09-12T22:03:37.634486+0000","last_clean":"2024-09-12T22:03:37.634486+0000","last_became_active":"2024-09-12T22:03:33.458085+0000","last_became_peered":"2024-09-12T22:03:33.458085+0000","last_unstale":"2024-09-12T22:03:37.634486+0000","last_undegraded":"2024-09-12T22:03:37.634486+0000","last_fullsized":"2024-09-12T22:03:37.634486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:56.693491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119963+0000","last_change":"2024-09-12T22:03:23.315624+0000","last_active":"2024-09-12T22:03:38.119963+0000","last_peered":"2024-09-12T22:03:38.119963+0000","last_clean":"2024-09-12T22:03:38.119963+0000","last_became_active":"2024-09-12T22:03:23.315346+0000","last_became_peered":"2024-09-12T22:03:23.315346+0000","last_unstale":"2024-09-12T22:03:38.119963+0000","last_undegraded":"2024-09-12T22:03:38.119963+0000","last_fullsized":"2024-09-12T22:03:38.119963+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:15.864121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":30,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120853+0000","last_change":"2024-09-12T22:03:30.339678+0000","last_active":"2024-09-12T22:03:38.120853+0000","last_peered":"2024-09-12T22:03:38.120853+0000","last_clean":"2024-09-12T22:03:38.120853+0000","last_became_active":"2024-09-12T22:03:28.335855+0000","last_became_peered":"2024-09-12T22:03:28.335855+0000","last_unstale":"2024-09-12T22:03:38.120853+0000","last_undegraded":"2024-09-12T22:03:38.120853+0000","last_fullsized":"2024-09-12T22:03:38.120853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:11.750803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633792+0000","last_change":"2024-09-12T22:03:32.459986+0000","last_active":"2024-09-12T22:03:37.633792+0000","last_peered":"2024-09-12T22:03:37.633792+0000","last_clean":"2024-09-12T22:03:37.633792+0000","last_became_active":"2024-09-12T22:03:32.459353+0000","last_became_peered":"2024-09-12T22:03:32.459353+0000","last_unstale":"2024-09-12T22:03:37.633792+0000","last_undegraded":"2024-09-12T22:03:37.633792+0000","last_fullsized":"2024-09-12T22:03:37.633792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:57.496962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120952+0000","last_change":"2024-09-12T22:03:33.460477+0000","last_active":"2024-09-12T22:03:38.120952+0000","last_peered":"2024-09-12T22:03:38.120952+0000","last_clean":"2024-09-12T22:03:38.120952+0000","last_became_active":"2024-09-12T22:03:33.459433+0000","last_became_peered":"2024-09-12T22:03:33.459433+0000","last_unstale":"2024-09-12T22:03:38.120952+0000","last_undegraded":"2024-09-12T22:03:38.120952+0000","last_fullsized":"2024-09-12T22:03:38.120952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:15.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119960+0000","last_change":"2024-09-12T22:03:30.339569+0000","last_active":"2024-09-12T22:03:38.119960+0000","last_peered":"2024-09-12T22:03:38.119960+0000","last_clean":"2024-09-12T22:03:38.119960+0000","last_became_active":"2024-09-12T22:03:28.336643+0000","last_became_peered":"2024-09-12T22:03:28.336643+0000","last_unstale":"2024-09-12T22:03:38.119960+0000","last_undegraded":"2024-09-12T22:03:38.119960+0000","last_fullsized":"2024-09-12T22:03:38.119960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:56.968092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039518000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633563+0000","last_change":"2024-09-12T22:03:32.454155+0000","last_active":"2024-09-12T22:03:37.633563+0000","last_peered":"2024-09-12T22:03:37.633563+0000","last_clean":"2024-09-12T22:03:37.633563+0000","last_became_active":"2024-09-12T22:03:32.453733+0000","last_became_peered":"2024-09-12T22:03:32.453733+0000","last_unstale":"2024-09-12T22:03:37.633563+0000","last_undegraded":"2024-09-12T22:03:37.633563+0000","last_fullsized":"2024-09-12T22:03:37.633563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:09.186165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949078+0000","last_change":"2024-09-12T22:03:33.458657+0000","last_active":"2024-09-12T22:03:36.949078+0000","last_peered":"2024-09-12T22:03:36.949078+0000","last_clean":"2024-09-12T22:03:36.949078+0000","last_became_active":"2024-09-12T22:03:33.458295+0000","last_became_peered":"2024-09-12T22:03:33.458295+0000","last_unstale":"2024-09-12T22:03:36.949078+0000","last_undegraded":"2024-09-12T22:03:36.949078+0000","last_fullsized":"2024-09-12T22:03:36.949078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:25.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633742+0000","last_change":"2024-09-12T22:03:30.343746+0000","last_active":"2024-09-12T22:03:37.633742+0000","last_peered":"2024-09-12T22:03:37.633742+0000","last_clean":"2024-09-12T22:03:37.633742+0000","last_became_active":"2024-09-12T22:03:28.335895+0000","last_became_peered":"2024-09-12T22:03:28.335895+0000","last_unstale":"2024-09-12T22:03:37.633742+0000","last_undegraded":"2024-09-12T22:03:37.633742+0000","last_fullsized":"2024-09-12T22:03:37.633742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.827420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070116600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948158+0000","last_change":"2024-09-12T22:03:32.461331+0000","last_active":"2024-09-12T22:03:36.948158+0000","last_peered":"2024-09-12T22:03:36.948158+0000","last_clean":"2024-09-12T22:03:36.948158+0000","last_became_active":"2024-09-12T22:03:32.460966+0000","last_became_peered":"2024-09-12T22:03:32.460966+0000","last_unstale":"2024-09-12T22:03:36.948158+0000","last_undegraded":"2024-09-12T22:03:36.948158+0000","last_fullsized":"2024-09-12T22:03:36.948158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:18.939990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634490+0000","last_change":"2024-09-12T22:03:33.458277+0000","last_active":"2024-09-12T22:03:37.634490+0000","last_peered":"2024-09-12T22:03:37.634490+0000","last_clean":"2024-09-12T22:03:37.634490+0000","last_became_active":"2024-09-12T22:03:33.457320+0000","last_became_peered":"2024-09-12T22:03:33.457320+0000","last_unstale":"2024-09-12T22:03:37.634490+0000","last_undegraded":"2024-09-12T22:03:37.634490+0000","last_fullsized":"2024-09-12T22:03:37.634490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:46.703481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120406+0000","last_change":"2024-09-12T22:03:30.339989+0000","last_active":"2024-09-12T22:03:38.120406+0000","last_peered":"2024-09-12T22:03:38.120406+0000","last_clean":"2024-09-12T22:03:38.120406+0000","last_became_active":"2024-09-12T22:03:28.335760+0000","last_became_peered":"2024-09-12T22:03:28.335760+0000","last_unstale":"2024-09-12T22:03:38.120406+0000","last_undegraded":"2024-09-12T22:03:38.120406+0000","last_fullsized":"2024-09-12T22:03:38.120406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:29.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120764+0000","last_change":"2024-09-12T22:03:32.456988+0000","last_active":"2024-09-12T22:03:38.120764+0000","last_peered":"2024-09-12T22:03:38.120764+0000","last_clean":"2024-09-12T22:03:38.120764+0000","last_became_active":"2024-09-12T22:03:32.456605+0000","last_became_peered":"2024-09-12T22:03:32.456605+0000","last_unstale":"2024-09-12T22:03:38.120764+0000","last_undegraded":"2024-09-12T22:03:38.120764+0000","last_fullsized":"2024-09-12T22:03:38.120764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:38.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634007+0000","last_change":"2024-09-12T22:03:33.458311+0000","last_active":"2024-09-12T22:03:37.634007+0000","last_peered":"2024-09-12T22:03:37.634007+0000","last_clean":"2024-09-12T22:03:37.634007+0000","last_became_active":"2024-09-12T22:03:33.456397+0000","last_became_peered":"2024-09-12T22:03:33.456397+0000","last_unstale":"2024-09-12T22:03:37.634007+0000","last_undegraded":"2024-09-12T22:03:37.634007+0000","last_fullsized":"2024-09-12T22:03:37.634007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:51.305559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121103+0000","last_change":"2024-09-12T22:03:32.457239+0000","last_active":"2024-09-12T22:03:38.121103+0000","last_peered":"2024-09-12T22:03:38.121103+0000","last_clean":"2024-09-12T22:03:38.121103+0000","last_became_active":"2024-09-12T22:03:32.456807+0000","last_became_peered":"2024-09-12T22:03:32.456807+0000","last_unstale":"2024-09-12T22:03:38.121103+0000","last_undegraded":"2024-09-12T22:03:38.121103+0000","last_fullsized":"2024-09-12T22:03:38.121103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:00.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634340+0000","last_change":"2024-09-12T22:03:30.343489+0000","last_active":"2024-09-12T22:03:37.634340+0000","last_peered":"2024-09-12T22:03:37.634340+0000","last_clean":"2024-09-12T22:03:37.634340+0000","last_became_active":"2024-09-12T22:03:28.335875+0000","last_became_peered":"2024-09-12T22:03:28.335875+0000","last_unstale":"2024-09-12T22:03:37.634340+0000","last_undegraded":"2024-09-12T22:03:37.634340+0000","last_fullsized":"2024-09-12T22:03:37.634340+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:34.561003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042932700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948531+0000","last_change":"2024-09-12T22:03:33.460944+0000","last_active":"2024-09-12T22:03:36.948531+0000","last_peered":"2024-09-12T22:03:36.948531+0000","last_clean":"2024-09-12T22:03:36.948531+0000","last_became_active":"2024-09-12T22:03:33.460514+0000","last_became_peered":"2024-09-12T22:03:33.460514+0000","last_unstale":"2024-09-12T22:03:36.948531+0000","last_undegraded":"2024-09-12T22:03:36.948531+0000","last_fullsized":"2024-09-12T22:03:36.948531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:54.744829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634252+0000","last_change":"2024-09-12T22:03:32.460055+0000","last_active":"2024-09-12T22:03:37.634252+0000","last_peered":"2024-09-12T22:03:37.634252+0000","last_clean":"2024-09-12T22:03:37.634252+0000","last_became_active":"2024-09-12T22:03:32.459276+0000","last_became_peered":"2024-09-12T22:03:32.459276+0000","last_unstale":"2024-09-12T22:03:37.634252+0000","last_undegraded":"2024-09-12T22:03:37.634252+0000","last_fullsized":"2024-09-12T22:03:37.634252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:23.776211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949211+0000","last_change":"2024-09-12T22:03:30.649265+0000","last_active":"2024-09-12T22:03:36.949211+0000","last_peered":"2024-09-12T22:03:36.949211+0000","last_clean":"2024-09-12T22:03:36.949211+0000","last_became_active":"2024-09-12T22:03:28.337193+0000","last_became_peered":"2024-09-12T22:03:28.337193+0000","last_unstale":"2024-09-12T22:03:36.949211+0000","last_undegraded":"2024-09-12T22:03:36.949211+0000","last_fullsized":"2024-09-12T22:03:36.949211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:43.899511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948515+0000","last_change":"2024-09-12T22:03:33.464893+0000","last_active":"2024-09-12T22:03:36.948515+0000","last_peered":"2024-09-12T22:03:36.948515+0000","last_clean":"2024-09-12T22:03:36.948515+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:03:36.948515+0000","last_undegraded":"2024-09-12T22:03:36.948515+0000","last_fullsized":"2024-09-12T22:03:36.948515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:47.948673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634814+0000","last_change":"2024-09-12T22:03:32.460426+0000","last_active":"2024-09-12T22:03:37.634814+0000","last_peered":"2024-09-12T22:03:37.634814+0000","last_clean":"2024-09-12T22:03:37.634814+0000","last_became_active":"2024-09-12T22:03:32.460161+0000","last_became_peered":"2024-09-12T22:03:32.460161+0000","last_unstale":"2024-09-12T22:03:37.634814+0000","last_undegraded":"2024-09-12T22:03:37.634814+0000","last_fullsized":"2024-09-12T22:03:37.634814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.472907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634952+0000","last_change":"2024-09-12T22:03:30.343485+0000","last_active":"2024-09-12T22:03:37.634952+0000","last_peered":"2024-09-12T22:03:37.634952+0000","last_clean":"2024-09-12T22:03:37.634952+0000","last_became_active":"2024-09-12T22:03:28.335961+0000","last_became_peered":"2024-09-12T22:03:28.335961+0000","last_unstale":"2024-09-12T22:03:37.634952+0000","last_undegraded":"2024-09-12T22:03:37.634952+0000","last_fullsized":"2024-09-12T22:03:37.634952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:24.041899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043906199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633375+0000","last_change":"2024-09-12T22:03:33.464709+0000","last_active":"2024-09-12T22:03:37.633375+0000","last_peered":"2024-09-12T22:03:37.633375+0000","last_clean":"2024-09-12T22:03:37.633375+0000","last_became_active":"2024-09-12T22:03:33.464016+0000","last_became_peered":"2024-09-12T22:03:33.464016+0000","last_unstale":"2024-09-12T22:03:37.633375+0000","last_undegraded":"2024-09-12T22:03:37.633375+0000","last_fullsized":"2024-09-12T22:03:37.633375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:07.598247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:03:51.988229+0000","last_change":"2024-09-12T22:03:51.988229+0000","last_active":"2024-09-12T22:03:51.988229+0000","last_peered":"2024-09-12T22:03:51.988229+0000","last_clean":"2024-09-12T22:03:51.988229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:03:51.988229+0000","last_undegraded":"2024-09-12T22:03:51.988229+0000","last_fullsized":"2024-09-12T22:03:51.988229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:51.988229+0000","last_clean_scrub_stamp":"2024-09-12T22:03:51.988229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634893+0000","last_change":"2024-09-12T22:03:32.458014+0000","last_active":"2024-09-12T22:03:37.634893+0000","last_peered":"2024-09-12T22:03:37.634893+0000","last_clean":"2024-09-12T22:03:37.634893+0000","last_became_active":"2024-09-12T22:03:32.457654+0000","last_became_peered":"2024-09-12T22:03:32.457654+0000","last_unstale":"2024-09-12T22:03:37.634893+0000","last_undegraded":"2024-09-12T22:03:37.634893+0000","last_fullsized":"2024-09-12T22:03:37.634893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:08.446521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.121056+0000","last_change":"2024-09-12T22:03:30.339817+0000","last_active":"2024-09-12T22:03:38.121056+0000","last_peered":"2024-09-12T22:03:38.121056+0000","last_clean":"2024-09-12T22:03:38.121056+0000","last_became_active":"2024-09-12T22:03:28.336599+0000","last_became_peered":"2024-09-12T22:03:28.336599+0000","last_unstale":"2024-09-12T22:03:38.121056+0000","last_undegraded":"2024-09-12T22:03:38.121056+0000","last_fullsized":"2024-09-12T22:03:38.121056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:36.442618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058522100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948215+0000","last_change":"2024-09-12T22:03:33.456975+0000","last_active":"2024-09-12T22:03:36.948215+0000","last_peered":"2024-09-12T22:03:36.948215+0000","last_clean":"2024-09-12T22:03:36.948215+0000","last_became_active":"2024-09-12T22:03:33.456611+0000","last_became_peered":"2024-09-12T22:03:33.456611+0000","last_unstale":"2024-09-12T22:03:36.948215+0000","last_undegraded":"2024-09-12T22:03:36.948215+0000","last_fullsized":"2024-09-12T22:03:36.948215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:46.309219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120544+0000","last_change":"2024-09-12T22:03:33.455671+0000","last_active":"2024-09-12T22:03:38.120544+0000","last_peered":"2024-09-12T22:03:38.120544+0000","last_clean":"2024-09-12T22:03:38.120544+0000","last_became_active":"2024-09-12T22:03:33.454833+0000","last_became_peered":"2024-09-12T22:03:33.454833+0000","last_unstale":"2024-09-12T22:03:38.120544+0000","last_undegraded":"2024-09-12T22:03:38.120544+0000","last_fullsized":"2024-09-12T22:03:38.120544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:08.773779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120513+0000","last_change":"2024-09-12T22:03:32.458296+0000","last_active":"2024-09-12T22:03:38.120513+0000","last_peered":"2024-09-12T22:03:38.120513+0000","last_clean":"2024-09-12T22:03:38.120513+0000","last_became_active":"2024-09-12T22:03:32.457908+0000","last_became_peered":"2024-09-12T22:03:32.457908+0000","last_unstale":"2024-09-12T22:03:38.120513+0000","last_undegraded":"2024-09-12T22:03:38.120513+0000","last_fullsized":"2024-09-12T22:03:38.120513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:53.758615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633547+0000","last_change":"2024-09-12T22:03:33.458365+0000","last_active":"2024-09-12T22:03:37.633547+0000","last_peered":"2024-09-12T22:03:37.633547+0000","last_clean":"2024-09-12T22:03:37.633547+0000","last_became_active":"2024-09-12T22:03:33.456256+0000","last_became_peered":"2024-09-12T22:03:33.456256+0000","last_unstale":"2024-09-12T22:03:37.633547+0000","last_undegraded":"2024-09-12T22:03:37.633547+0000","last_fullsized":"2024-09-12T22:03:37.633547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:12.145709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949119+0000","last_change":"2024-09-12T22:03:32.461509+0000","last_active":"2024-09-12T22:03:36.949119+0000","last_peered":"2024-09-12T22:03:36.949119+0000","last_clean":"2024-09-12T22:03:36.949119+0000","last_became_active":"2024-09-12T22:03:32.461161+0000","last_became_peered":"2024-09-12T22:03:32.461161+0000","last_unstale":"2024-09-12T22:03:36.949119+0000","last_undegraded":"2024-09-12T22:03:36.949119+0000","last_fullsized":"2024-09-12T22:03:36.949119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:02.888202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120809+0000","last_change":"2024-09-12T22:03:32.457458+0000","last_active":"2024-09-12T22:03:38.120809+0000","last_peered":"2024-09-12T22:03:38.120809+0000","last_clean":"2024-09-12T22:03:38.120809+0000","last_became_active":"2024-09-12T22:03:32.457007+0000","last_became_peered":"2024-09-12T22:03:32.457007+0000","last_unstale":"2024-09-12T22:03:38.120809+0000","last_undegraded":"2024-09-12T22:03:38.120809+0000","last_fullsized":"2024-09-12T22:03:38.120809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:08.474776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633334+0000","last_change":"2024-09-12T22:03:33.465561+0000","last_active":"2024-09-12T22:03:37.633334+0000","last_peered":"2024-09-12T22:03:37.633334+0000","last_clean":"2024-09-12T22:03:37.633334+0000","last_became_active":"2024-09-12T22:03:33.464837+0000","last_became_peered":"2024-09-12T22:03:33.464837+0000","last_unstale":"2024-09-12T22:03:37.633334+0000","last_undegraded":"2024-09-12T22:03:37.633334+0000","last_fullsized":"2024-09-12T22:03:37.633334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:32.859664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634692+0000","last_change":"2024-09-12T22:03:32.458964+0000","last_active":"2024-09-12T22:03:37.634692+0000","last_peered":"2024-09-12T22:03:37.634692+0000","last_clean":"2024-09-12T22:03:37.634692+0000","last_became_active":"2024-09-12T22:03:32.458346+0000","last_became_peered":"2024-09-12T22:03:32.458346+0000","last_unstale":"2024-09-12T22:03:37.634692+0000","last_undegraded":"2024-09-12T22:03:37.634692+0000","last_fullsized":"2024-09-12T22:03:37.634692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:37.178897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633336+0000","last_change":"2024-09-12T22:03:33.458060+0000","last_active":"2024-09-12T22:03:37.633336+0000","last_peered":"2024-09-12T22:03:37.633336+0000","last_clean":"2024-09-12T22:03:37.633336+0000","last_became_active":"2024-09-12T22:03:33.457390+0000","last_became_peered":"2024-09-12T22:03:33.457390+0000","last_unstale":"2024-09-12T22:03:37.633336+0000","last_undegraded":"2024-09-12T22:03:37.633336+0000","last_fullsized":"2024-09-12T22:03:37.633336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:14.711011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.949306+0000","last_change":"2024-09-12T22:03:33.460177+0000","last_active":"2024-09-12T22:03:36.949306+0000","last_peered":"2024-09-12T22:03:36.949306+0000","last_clean":"2024-09-12T22:03:36.949306+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:03:36.949306+0000","last_undegraded":"2024-09-12T22:03:36.949306+0000","last_fullsized":"2024-09-12T22:03:36.949306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633492+0000","last_change":"2024-09-12T22:03:32.460441+0000","last_active":"2024-09-12T22:03:37.633492+0000","last_peered":"2024-09-12T22:03:37.633492+0000","last_clean":"2024-09-12T22:03:37.633492+0000","last_became_active":"2024-09-12T22:03:32.460126+0000","last_became_peered":"2024-09-12T22:03:32.460126+0000","last_unstale":"2024-09-12T22:03:37.633492+0000","last_undegraded":"2024-09-12T22:03:37.633492+0000","last_fullsized":"2024-09-12T22:03:37.633492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:52.150617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634575+0000","last_change":"2024-09-12T22:03:33.466167+0000","last_active":"2024-09-12T22:03:37.634575+0000","last_peered":"2024-09-12T22:03:37.634575+0000","last_clean":"2024-09-12T22:03:37.634575+0000","last_became_active":"2024-09-12T22:03:33.465116+0000","last_became_peered":"2024-09-12T22:03:33.465116+0000","last_unstale":"2024-09-12T22:03:37.634575+0000","last_undegraded":"2024-09-12T22:03:37.634575+0000","last_fullsized":"2024-09-12T22:03:37.634575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:19.683631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.633484+0000","last_change":"2024-09-12T22:03:32.454262+0000","last_active":"2024-09-12T22:03:37.633484+0000","last_peered":"2024-09-12T22:03:37.633484+0000","last_clean":"2024-09-12T22:03:37.633484+0000","last_became_active":"2024-09-12T22:03:32.453776+0000","last_became_peered":"2024-09-12T22:03:32.453776+0000","last_unstale":"2024-09-12T22:03:37.633484+0000","last_undegraded":"2024-09-12T22:03:37.633484+0000","last_fullsized":"2024-09-12T22:03:37.633484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:57.091523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948901+0000","last_change":"2024-09-12T22:03:33.465186+0000","last_active":"2024-09-12T22:03:36.948901+0000","last_peered":"2024-09-12T22:03:36.948901+0000","last_clean":"2024-09-12T22:03:36.948901+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:03:36.948901+0000","last_undegraded":"2024-09-12T22:03:36.948901+0000","last_fullsized":"2024-09-12T22:03:36.948901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:29.409225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948624+0000","last_change":"2024-09-12T22:03:32.458132+0000","last_active":"2024-09-12T22:03:36.948624+0000","last_peered":"2024-09-12T22:03:36.948624+0000","last_clean":"2024-09-12T22:03:36.948624+0000","last_became_active":"2024-09-12T22:03:32.457817+0000","last_became_peered":"2024-09-12T22:03:32.457817+0000","last_unstale":"2024-09-12T22:03:36.948624+0000","last_undegraded":"2024-09-12T22:03:36.948624+0000","last_fullsized":"2024-09-12T22:03:36.948624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:47.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948638+0000","last_change":"2024-09-12T22:03:33.460730+0000","last_active":"2024-09-12T22:03:36.948638+0000","last_peered":"2024-09-12T22:03:36.948638+0000","last_clean":"2024-09-12T22:03:36.948638+0000","last_became_active":"2024-09-12T22:03:33.460223+0000","last_became_peered":"2024-09-12T22:03:33.460223+0000","last_unstale":"2024-09-12T22:03:36.948638+0000","last_undegraded":"2024-09-12T22:03:36.948638+0000","last_fullsized":"2024-09-12T22:03:36.948638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.406786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948595+0000","last_change":"2024-09-12T22:03:32.461243+0000","last_active":"2024-09-12T22:03:36.948595+0000","last_peered":"2024-09-12T22:03:36.948595+0000","last_clean":"2024-09-12T22:03:36.948595+0000","last_became_active":"2024-09-12T22:03:32.460760+0000","last_became_peered":"2024-09-12T22:03:32.460760+0000","last_unstale":"2024-09-12T22:03:36.948595+0000","last_undegraded":"2024-09-12T22:03:36.948595+0000","last_fullsized":"2024-09-12T22:03:36.948595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:42.848199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120422+0000","last_change":"2024-09-12T22:03:33.462764+0000","last_active":"2024-09-12T22:03:38.120422+0000","last_peered":"2024-09-12T22:03:38.120422+0000","last_clean":"2024-09-12T22:03:38.120422+0000","last_became_active":"2024-09-12T22:03:33.462360+0000","last_became_peered":"2024-09-12T22:03:33.462360+0000","last_unstale":"2024-09-12T22:03:38.120422+0000","last_undegraded":"2024-09-12T22:03:38.120422+0000","last_fullsized":"2024-09-12T22:03:38.120422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120443+0000","last_change":"2024-09-12T22:03:32.457280+0000","last_active":"2024-09-12T22:03:38.120443+0000","last_peered":"2024-09-12T22:03:38.120443+0000","last_clean":"2024-09-12T22:03:38.120443+0000","last_became_active":"2024-09-12T22:03:32.456812+0000","last_became_peered":"2024-09-12T22:03:32.456812+0000","last_unstale":"2024-09-12T22:03:38.120443+0000","last_undegraded":"2024-09-12T22:03:38.120443+0000","last_fullsized":"2024-09-12T22:03:38.120443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:46:51.143125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.120065+0000","last_change":"2024-09-12T22:03:33.464094+0000","last_active":"2024-09-12T22:03:38.120065+0000","last_peered":"2024-09-12T22:03:38.120065+0000","last_clean":"2024-09-12T22:03:38.120065+0000","last_became_active":"2024-09-12T22:03:33.463380+0000","last_became_peered":"2024-09-12T22:03:33.463380+0000","last_unstale":"2024-09-12T22:03:38.120065+0000","last_undegraded":"2024-09-12T22:03:38.120065+0000","last_fullsized":"2024-09-12T22:03:38.120065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:11.422942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948983+0000","last_change":"2024-09-12T22:03:32.461230+0000","last_active":"2024-09-12T22:03:36.948983+0000","last_peered":"2024-09-12T22:03:36.948983+0000","last_clean":"2024-09-12T22:03:36.948983+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:03:36.948983+0000","last_undegraded":"2024-09-12T22:03:36.948983+0000","last_fullsized":"2024-09-12T22:03:36.948983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:16.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:36.948424+0000","last_change":"2024-09-12T22:03:33.458634+0000","last_active":"2024-09-12T22:03:36.948424+0000","last_peered":"2024-09-12T22:03:36.948424+0000","last_clean":"2024-09-12T22:03:36.948424+0000","last_became_active":"2024-09-12T22:03:33.458096+0000","last_became_peered":"2024-09-12T22:03:33.458096+0000","last_unstale":"2024-09-12T22:03:36.948424+0000","last_undegraded":"2024-09-12T22:03:36.948424+0000","last_fullsized":"2024-09-12T22:03:36.948424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:09.702722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634795+0000","last_change":"2024-09-12T22:03:32.460314+0000","last_active":"2024-09-12T22:03:37.634795+0000","last_peered":"2024-09-12T22:03:37.634795+0000","last_clean":"2024-09-12T22:03:37.634795+0000","last_became_active":"2024-09-12T22:03:32.459890+0000","last_became_peered":"2024-09-12T22:03:32.459890+0000","last_unstale":"2024-09-12T22:03:37.634795+0000","last_undegraded":"2024-09-12T22:03:37.634795+0000","last_fullsized":"2024-09-12T22:03:37.634795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:00.774244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:38.119819+0000","last_change":"2024-09-12T22:03:33.464082+0000","last_active":"2024-09-12T22:03:38.119819+0000","last_peered":"2024-09-12T22:03:38.119819+0000","last_clean":"2024-09-12T22:03:38.119819+0000","last_became_active":"2024-09-12T22:03:33.462648+0000","last_became_peered":"2024-09-12T22:03:33.462648+0000","last_unstale":"2024-09-12T22:03:38.119819+0000","last_undegraded":"2024-09-12T22:03:38.119819+0000","last_fullsized":"2024-09-12T22:03:38.119819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.466890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:03:37.634610+0000","last_change":"2024-09-12T22:03:32.459293+0000","last_active":"2024-09-12T22:03:37.634610+0000","last_peered":"2024-09-12T22:03:37.634610+0000","last_clean":"2024-09-12T22:03:37.634610+0000","last_became_active":"2024-09-12T22:03:32.458679+0000","last_became_peered":"2024-09-12T22:03:32.458679+0000","last_unstale":"2024-09-12T22:03:37.634610+0000","last_undegraded":"2024-09-12T22:03:37.634610+0000","last_fullsized":"2024-09-12T22:03:37.634610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:21.083182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":798720,"data_stored":657780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36140,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335700,"statfs":{"total":96636764160,"available":96599756800,"internally_reserved":0,"allocated":811008,"data_stored":658415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35532,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336308,"statfs":{"total":96636764160,"available":96600379392,"internally_reserved":0,"allocated":192512,"data_stored":66253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:03:52.125 INFO:tasks.thrashosds.thrasher:Setting 4.12 to [2, 1] 2024-09-12T22:03:52.125 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.12', '2', '1'] 2024-09-12T22:03:52.125 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.12 2 1 2024-09-12T22:03:52.128 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:52.125+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:52.148 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:52.148 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:52.156 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:03:52.227 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:52.226+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:52.282 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:03:52.328 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:52.327+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:52.429 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:52.428+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:52.434 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:03:52.530 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:52.529+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:52.545 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:03:52.630 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:52.630+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:52.665 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:52.665 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:52.675 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:03:52.731 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:52.730+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:52.783 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:52.783 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:52.791 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:03:52.833 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:52.832+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:52.933 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:52.932+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:52.939 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:52.939 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:52.948 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:03:52.997 INFO:teuthology.orchestra.run.smithi043.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-12T22:03:53.000 INFO:teuthology.orchestra.run.smithi043.stderr:set 4.12 pg_upmap mapping to [2,1] 2024-09-12T22:03:53.033 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:53.033+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:53.066 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:53.066 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:53.075 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:03:53.135 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:53.134+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:53.177 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:53.177 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:53.186 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:03:53.235 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:53.234+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:53.288 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:53.289 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:53.297 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:03:53.338 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:53.337+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:53.405 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:53.405 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:53.414 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:03:53.458 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:53.457+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:53.516 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:53.516 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:53.525 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:03:53.538 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:53.537+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:53.603 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:03:53.639 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:53.638+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:53.667 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:53.667 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:53.676 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:03:53.740 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:53.739+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:53.741 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-09-12T22:03:53.741 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:03:53.758 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:03:53.758 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:03:53.776 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:03:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:03:53.796 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:03:53.797 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T22:03:53.797 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T22:03:53.797 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:03:53.804 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:03:53.841 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:53.840+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:03:53.912 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T22:03:53.912 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T22:03:53.913 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T22:03:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:03:53.921 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:03:53.942 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:53.942+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:54.011 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:03:54.016 DEBUG:teuthology.orchestra.run.smithi043:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2024-09-12T22:03:54.031 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:03:54.031 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T22:03:54.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T22:03:54.031 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T22:03:54.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.031 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4239.0:1 2.3 e14/13 2:c4c92e5a:::rbd_trash:head v 14'1, mlcod=0'0)", 2024-09-12T22:03:54.031 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:28.336411+0000", 2024-09-12T22:03:54.031 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.692108894, 2024-09-12T22:03:54.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00097462600000000003, 2024-09-12T22:03:54.032 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.032 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.032 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.032 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:28.336411+0000", 2024-09-12T22:03:54.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:28.336411+0000", 2024-09-12T22:03:54.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:28.336412+0000", 2024-09-12T22:03:54.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9700000000000002e-07 2024-09-12T22:03:54.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:28.336416+0000", 2024-09-12T22:03:54.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.053e-06 2024-09-12T22:03:54.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:28.336427+0000", 2024-09-12T22:03:54.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0791000000000001e-05 2024-09-12T22:03:54.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:28.336439+0000", 2024-09-12T22:03:54.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2628e-05 2024-09-12T22:03:54.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:28.336491+0000", 2024-09-12T22:03:54.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1585999999999997e-05 2024-09-12T22:03:54.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:28.336515+0000", 2024-09-12T22:03:54.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4241000000000001e-05 2024-09-12T22:03:54.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:54.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:28.337348+0000", 2024-09-12T22:03:54.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00083299199999999996 2024-09-12T22:03:54.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:28.337386+0000", 2024-09-12T22:03:54.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:03:54.037 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.037 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.037 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.037 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4239.0:5 2.2 e15/13 2:5cea7035:::rbd_info:head v 15'1, mlcod=0'0)", 2024-09-12T22:03:54.037 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:29.337305+0000", 2024-09-12T22:03:54.037 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.691215061000001, 2024-09-12T22:03:54.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00075482999999999995, 2024-09-12T22:03:54.038 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.038 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.038 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.038 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:29.337305+0000", 2024-09-12T22:03:54.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:29.337305+0000", 2024-09-12T22:03:54.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:29.337306+0000", 2024-09-12T22:03:54.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8799999999999999e-07 2024-09-12T22:03:54.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:29.337313+0000", 2024-09-12T22:03:54.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5360000000000004e-06 2024-09-12T22:03:54.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:29.337325+0000", 2024-09-12T22:03:54.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1732e-05 2024-09-12T22:03:54.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:29.337332+0000", 2024-09-12T22:03:54.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.81e-06 2024-09-12T22:03:54.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:29.337377+0000", 2024-09-12T22:03:54.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5357e-05 2024-09-12T22:03:54.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:29.337392+0000", 2024-09-12T22:03:54.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4800000000000001e-05 2024-09-12T22:03:54.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:54.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:29.338024+0000", 2024-09-12T22:03:54.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063249699999999999 2024-09-12T22:03:54.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:29.338060+0000", 2024-09-12T22:03:54.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.591e-05 2024-09-12T22:03:54.043 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.043 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.043 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.043 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4239.0:7 2.2 e16/13 2:5cea7035:::rbd_info:head v 16'2, mlcod=0'0)", 2024-09-12T22:03:54.043 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:30.341473+0000", 2024-09-12T22:03:54.043 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.687047438, 2024-09-12T22:03:54.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00097670000000000005, 2024-09-12T22:03:54.043 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.044 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.044 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.044 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:30.341473+0000", 2024-09-12T22:03:54.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:30.341473+0000", 2024-09-12T22:03:54.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:30.341474+0000", 2024-09-12T22:03:54.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:03:54.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:30.341496+0000", 2024-09-12T22:03:54.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2739999999999999e-05 2024-09-12T22:03:54.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:30.341524+0000", 2024-09-12T22:03:54.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7396e-05 2024-09-12T22:03:54.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:30.341545+0000", 2024-09-12T22:03:54.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1265999999999999e-05 2024-09-12T22:03:54.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:30.341683+0000", 2024-09-12T22:03:54.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138264 2024-09-12T22:03:54.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:30.341700+0000", 2024-09-12T22:03:54.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6549e-05 2024-09-12T22:03:54.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:54.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:30.342408+0000", 2024-09-12T22:03:54.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00070782600000000005 2024-09-12T22:03:54.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:30.342450+0000", 2024-09-12T22:03:54.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2089000000000003e-05 2024-09-12T22:03:54.048 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.048 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.048 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.049 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.049 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:03:54.049 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.578796375, 2024-09-12T22:03:54.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017423646000000001, 2024-09-12T22:03:54.049 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.049 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.050 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.050 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:03:54.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:03:54.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449728+0000", 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449750+0000", 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2391e-05 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449775+0000", 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4831999999999999e-05 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449785+0000", 2024-09-12T22:03:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0361e-05 2024-09-12T22:03:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449857+0000", 2024-09-12T22:03:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1990999999999996e-05 2024-09-12T22:03:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:03:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449863+0000", 2024-09-12T22:03:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6570000000000002e-06 2024-09-12T22:03:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462558+0000", 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012695032 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462703+0000", 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014444100000000001 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462853+0000", 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015042300000000001 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:54.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465147+0000", 2024-09-12T22:03:54.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022944789999999999 2024-09-12T22:03:54.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467012+0000", 2024-09-12T22:03:54.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018646030000000001 2024-09-12T22:03:54.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:54.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467095+0000", 2024-09-12T22:03:54.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2695999999999996e-05 2024-09-12T22:03:54.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467148+0000", 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2958999999999999e-05 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.578707531999999, 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018410795000000001, 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.055 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.056 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.056 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:03:54.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:03:54.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449814+0000", 2024-09-12T22:03:54.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:03:54.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449827+0000", 2024-09-12T22:03:54.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3373000000000001e-05 2024-09-12T22:03:54.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:03:54.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.081e-06 2024-09-12T22:03:54.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449853+0000", 2024-09-12T22:03:54.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7181e-05 2024-09-12T22:03:54.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449914+0000", 2024-09-12T22:03:54.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0736000000000003e-05 2024-09-12T22:03:54.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:03:54.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449921+0000", 2024-09-12T22:03:54.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2559999999999996e-06 2024-09-12T22:03:54.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461147+0000", 2024-09-12T22:03:54.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011226211999999999 2024-09-12T22:03:54.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461353+0000", 2024-09-12T22:03:54.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000205217 2024-09-12T22:03:54.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461512+0000", 2024-09-12T22:03:54.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015960700000000001 2024-09-12T22:03:54.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:54.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464643+0000", 2024-09-12T22:03:54.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003130238 2024-09-12T22:03:54.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468132+0000", 2024-09-12T22:03:54.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0034897109999999999 2024-09-12T22:03:54.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:54.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468182+0000", 2024-09-12T22:03:54.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0209e-05 2024-09-12T22:03:54.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468224+0000", 2024-09-12T22:03:54.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1199000000000003e-05 2024-09-12T22:03:54.061 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.061 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.061 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.578650057000001, 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017523931, 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:03:54.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449871+0000", 2024-09-12T22:03:54.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:03:54.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449890+0000", 2024-09-12T22:03:54.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9245999999999998e-05 2024-09-12T22:03:54.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449899+0000", 2024-09-12T22:03:54.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1530000000000003e-06 2024-09-12T22:03:54.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449905+0000", 2024-09-12T22:03:54.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8100000000000003e-06 2024-09-12T22:03:54.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449942+0000", 2024-09-12T22:03:54.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7119000000000002e-05 2024-09-12T22:03:54.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449945+0000", 2024-09-12T22:03:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0529999999999998e-06 2024-09-12T22:03:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463125+0000", 2024-09-12T22:03:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013179326 2024-09-12T22:03:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463171+0000", 2024-09-12T22:03:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6455000000000002e-05 2024-09-12T22:03:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463242+0000", 2024-09-12T22:03:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0430000000000002e-05 2024-09-12T22:03:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465152+0000", 2024-09-12T22:03:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001910082 2024-09-12T22:03:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467291+0000", 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021394119999999998 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467351+0000", 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9673999999999998e-05 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467394+0000", 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3477999999999999e-05 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.068 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.068 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:03:54.068 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.578602950000001, 2024-09-12T22:03:54.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018417978000000002, 2024-09-12T22:03:54.068 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.068 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.068 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.068 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:03:54.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:03:54.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449918+0000", 2024-09-12T22:03:54.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:03:54.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449923+0000", 2024-09-12T22:03:54.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1959999999999999e-06 2024-09-12T22:03:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449928+0000", 2024-09-12T22:03:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3989999999999997e-06 2024-09-12T22:03:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449931+0000", 2024-09-12T22:03:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5750000000000001e-06 2024-09-12T22:03:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449968+0000", 2024-09-12T22:03:54.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7209999999999998e-05 2024-09-12T22:03:54.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:54.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449974+0000", 2024-09-12T22:03:54.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9730000000000002e-06 2024-09-12T22:03:54.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462282+0000", 2024-09-12T22:03:54.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012308102 2024-09-12T22:03:54.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462368+0000", 2024-09-12T22:03:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5920000000000004e-05 2024-09-12T22:03:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462490+0000", 2024-09-12T22:03:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121478 2024-09-12T22:03:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465141+0000", 2024-09-12T22:03:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026515990000000001 2024-09-12T22:03:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468273+0000", 2024-09-12T22:03:54.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003131736 2024-09-12T22:03:54.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:54.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468308+0000", 2024-09-12T22:03:54.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4572e-05 2024-09-12T22:03:54.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468335+0000", 2024-09-12T22:03:54.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7727999999999999e-05 2024-09-12T22:03:54.073 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.074 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.074 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.074 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.074 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:03:54.074 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.578584076999999, 2024-09-12T22:03:54.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018483090000000001, 2024-09-12T22:03:54.074 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.074 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.074 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.074 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449937+0000", 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0699999999999999e-07 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449939+0000", 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.853e-06 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449943+0000", 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8999999999999999e-06 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449956+0000", 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2843000000000001e-05 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:03:54.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0277000000000002e-05 2024-09-12T22:03:54.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:54.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449990+0000", 2024-09-12T22:03:54.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1410000000000001e-06 2024-09-12T22:03:54.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463480+0000", 2024-09-12T22:03:54.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013490564 2024-09-12T22:03:54.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463553+0000", 2024-09-12T22:03:54.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3094000000000002e-05 2024-09-12T22:03:54.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:54.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463629+0000", 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5610000000000003e-05 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465158+0000", 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015294169999999999 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468328+0000", 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031699699999999998 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:54.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468381+0000", 2024-09-12T22:03:54.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2398000000000002e-05 2024-09-12T22:03:54.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468419+0000", 2024-09-12T22:03:54.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8816000000000002e-05 2024-09-12T22:03:54.080 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.080 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.080 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.080 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.080 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.578555535, 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017182808000000001, 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:03:54.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2500000000000001e-07 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449968+0000", 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7140000000000002e-06 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449975+0000", 2024-09-12T22:03:54.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:03:54.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449980+0000", 2024-09-12T22:03:54.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1659999999999996e-06 2024-09-12T22:03:54.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450048+0000", 2024-09-12T22:03:54.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8823000000000002e-05 2024-09-12T22:03:54.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:03:54.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450052+0000", 2024-09-12T22:03:54.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8689999999999997e-06 2024-09-12T22:03:54.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461166+0000", 2024-09-12T22:03:54.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011114166999999999 2024-09-12T22:03:54.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461279+0000", 2024-09-12T22:03:54.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000112212 2024-09-12T22:03:54.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:54.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461417+0000", 2024-09-12T22:03:54.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138202 2024-09-12T22:03:54.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.085 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.085 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:54.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463371+0000", 2024-09-12T22:03:54.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019543120000000001 2024-09-12T22:03:54.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.085 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.085 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467009+0000", 2024-09-12T22:03:54.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036383180000000002 2024-09-12T22:03:54.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467109+0000", 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9601999999999999e-05 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467148+0000", 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8618000000000002e-05 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.086 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.578509480000001, 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017404473, 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.087 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:03:54.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.088 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450012+0000", 2024-09-12T22:03:54.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T22:03:54.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.088 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450016+0000", 2024-09-12T22:03:54.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9389999999999999e-06 2024-09-12T22:03:54.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8209999999999997e-06 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450036+0000", 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0496000000000001e-05 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9070999999999997e-05 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450100+0000", 2024-09-12T22:03:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0089999999999998e-06 2024-09-12T22:03:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461992+0000", 2024-09-12T22:03:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011891868999999999 2024-09-12T22:03:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462124+0000", 2024-09-12T22:03:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013271299999999999 2024-09-12T22:03:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467415+0000", 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052909029999999996 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.578471239999999, 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018455814000000001, 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.092 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:54.092 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:03:54.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:03:54.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450050+0000", 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2e-07 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450053+0000", 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0819999999999999e-06 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450061+0000", 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8169999999999999e-06 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450080+0000", 2024-09-12T22:03:54.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9219999999999999e-05 2024-09-12T22:03:54.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:03:54.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0834000000000002e-05 2024-09-12T22:03:54.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:54.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450123+0000", 2024-09-12T22:03:54.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5830000000000001e-06 2024-09-12T22:03:54.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464167+0000", 2024-09-12T22:03:54.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014043517 2024-09-12T22:03:54.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464298+0000", 2024-09-12T22:03:54.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013117099999999999 2024-09-12T22:03:54.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468505+0000", 2024-09-12T22:03:54.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042070700000000003 2024-09-12T22:03:54.096 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.096 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.096 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.096 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.096 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:03:54.096 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.578425380999999, 2024-09-12T22:03:54.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018063523000000001, 2024-09-12T22:03:54.096 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.096 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.096 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:54.096 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:03:54.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:03:54.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450096+0000", 2024-09-12T22:03:54.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7899999999999998e-07 2024-09-12T22:03:54.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450100+0000", 2024-09-12T22:03:54.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:03:54.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450107+0000", 2024-09-12T22:03:54.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9269999999999999e-06 2024-09-12T22:03:54.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450112+0000", 2024-09-12T22:03:54.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2909999999999998e-06 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450156+0000", 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3665999999999998e-05 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450160+0000", 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.822e-06 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.459675+0000", 2024-09-12T22:03:54.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0095155039999999993 2024-09-12T22:03:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.459901+0000", 2024-09-12T22:03:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000225419 2024-09-12T22:03:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468159+0000", 2024-09-12T22:03:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082579100000000003 2024-09-12T22:03:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 3 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.454118+0000", 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.574402751000001, 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047604359999999998, 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "reached pg", 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.454118+0000", 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.454118+0000", 2024-09-12T22:03:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.454118+0000", 2024-09-12T22:03:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:03:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.454129+0000", 2024-09-12T22:03:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0441999999999999e-05 2024-09-12T22:03:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.454158+0000", 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9918000000000001e-05 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.454179+0000", 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0458999999999998e-05 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.454277+0000", 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8009000000000003e-05 2024-09-12T22:03:54.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.458878+0000", 2024-09-12T22:03:54.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046011460000000004 2024-09-12T22:03:54.104 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.104 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.104 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.104 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(mds.0.3:34 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:03:54.104 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.458920+0000", 2024-09-12T22:03:54.104 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.569600086000001, 2024-09-12T22:03:54.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038545960000000001, 2024-09-12T22:03:54.104 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.105 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.105 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.105 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.458920+0000", 2024-09-12T22:03:54.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.458920+0000", 2024-09-12T22:03:54.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.458921+0000", 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9200000000000001e-07 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.458940+0000", 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9599999999999999e-05 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.458992+0000", 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1623999999999999e-05 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.459002+0000", 2024-09-12T22:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0192e-05 2024-09-12T22:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.460520+0000", 2024-09-12T22:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015179810000000001 2024-09-12T22:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.460542+0000", 2024-09-12T22:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1906999999999999e-05 2024-09-12T22:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462728+0000", 2024-09-12T22:03:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021859259999999999 2024-09-12T22:03:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462775+0000", 2024-09-12T22:03:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6774000000000003e-05 2024-09-12T22:03:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.108 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(mds.0.3:16 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.464941+0000", 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.563579765, 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017398660000000001, 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464941+0000", 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464941+0000", 2024-09-12T22:03:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464941+0000", 2024-09-12T22:03:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3799999999999997e-07 2024-09-12T22:03:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464948+0000", 2024-09-12T22:03:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8730000000000001e-06 2024-09-12T22:03:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464958+0000", 2024-09-12T22:03:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0190000000000001e-05 2024-09-12T22:03:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464968+0000", 2024-09-12T22:03:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8679999999999994e-06 2024-09-12T22:03:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465103+0000", 2024-09-12T22:03:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013442599999999999 2024-09-12T22:03:54.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465123+0000", 2024-09-12T22:03:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0102000000000002e-05 2024-09-12T22:03:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466638+0000", 2024-09-12T22:03:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015150490000000001 2024-09-12T22:03:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466680+0000", 2024-09-12T22:03:54.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.282e-05 2024-09-12T22:03:54.113 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.113 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.113 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.113 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(mds.0.3:12 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:03:54.113 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.464987+0000", 2024-09-12T22:03:54.113 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.563533738, 2024-09-12T22:03:54.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016970119999999999, 2024-09-12T22:03:54.113 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.113 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.113 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.113 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464987+0000", 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464987+0000", 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464987+0000", 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.34e-07 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464994+0000", 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7610000000000002e-06 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465009+0000", 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4752999999999999e-05 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465016+0000", 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1910000000000003e-06 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465092+0000", 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6233e-05 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465124+0000", 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1927000000000001e-05 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466651+0000", 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015273820000000001 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466684+0000", 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2330999999999999e-05 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(mds.0.3:28 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.465326+0000", 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.563194484, 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015853729999999999, 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.117 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465326+0000", 2024-09-12T22:03:54.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465326+0000", 2024-09-12T22:03:54.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465327+0000", 2024-09-12T22:03:54.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5499999999999997e-07 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465333+0000", 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2840000000000003e-06 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465345+0000", 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2011000000000001e-05 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465363+0000", 2024-09-12T22:03:54.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8193e-05 2024-09-12T22:03:54.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465414+0000", 2024-09-12T22:03:54.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0797999999999997e-05 2024-09-12T22:03:54.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465450+0000", 2024-09-12T22:03:54.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5735000000000003e-05 2024-09-12T22:03:54.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:54.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466878+0000", 2024-09-12T22:03:54.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001428155 2024-09-12T22:03:54.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466911+0000", 2024-09-12T22:03:54.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3442000000000003e-05 2024-09-12T22:03:54.121 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.121 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.121 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.121 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:03:54.121 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.466836+0000", 2024-09-12T22:03:54.121 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.561684061000001, 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032881000000000002, 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466836+0000", 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466836+0000", 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466837+0000", 2024-09-12T22:03:54.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.68e-07 2024-09-12T22:03:54.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466849+0000", 2024-09-12T22:03:54.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2303000000000001e-05 2024-09-12T22:03:54.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466858+0000", 2024-09-12T22:03:54.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8789999999999992e-06 2024-09-12T22:03:54.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466867+0000", 2024-09-12T22:03:54.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6759999999999996e-06 2024-09-12T22:03:54.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466996+0000", 2024-09-12T22:03:54.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012940900000000001 2024-09-12T22:03:54.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467005+0000", 2024-09-12T22:03:54.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:03:54.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467165+0000", 2024-09-12T22:03:54.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000160464 2024-09-12T22:03:54.125 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.125 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.125 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.125 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop_reply(mds.0.3:17 3.b e19/17 ondisk, result = 0)", 2024-09-12T22:03:54.125 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.466888+0000", 2024-09-12T22:03:54.125 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.561632466999999, 2024-09-12T22:03:54.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028973399999999999, 2024-09-12T22:03:54.126 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.126 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.126 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:54.126 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466888+0000", 2024-09-12T22:03:54.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466888+0000", 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466888+0000", 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8500000000000002e-07 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466892+0000", 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8010000000000001e-06 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466926+0000", 2024-09-12T22:03:54.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3615999999999998e-05 2024-09-12T22:03:54.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466936+0000", 2024-09-12T22:03:54.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0327e-05 2024-09-12T22:03:54.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.466990+0000", 2024-09-12T22:03:54.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3773999999999997e-05 2024-09-12T22:03:54.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467004+0000", 2024-09-12T22:03:54.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3608000000000001e-05 2024-09-12T22:03:54.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467178+0000", 2024-09-12T22:03:54.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017412300000000001 2024-09-12T22:03:54.129 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.129 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.129 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.129 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:03:54.129 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:35.447782+0000", 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.580738756999999, 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001480154, 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:35.447782+0000", 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:35.447782+0000", 2024-09-12T22:03:54.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:54.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:54.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:35.447783+0000", 2024-09-12T22:03:54.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.809e-06 2024-09-12T22:03:54.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:54.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:35.447791+0000", 2024-09-12T22:03:54.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9899999999999997e-06 2024-09-12T22:03:54.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:54.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:35.447807+0000", 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5458999999999999e-05 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:35.447813+0000", 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:35.447880+0000", 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6526999999999995e-05 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:54.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:35.447975+0000", 2024-09-12T22:03:54.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5290000000000004e-05 2024-09-12T22:03:54.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.133 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:54.133 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:35.448059+0000", 2024-09-12T22:03:54.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3875999999999995e-05 2024-09-12T22:03:54.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.133 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:54.133 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:35.448611+0000", 2024-09-12T22:03:54.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00055206500000000002 2024-09-12T22:03:54.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.133 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:35.449195+0000", 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00058387499999999998 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:35.449230+0000", 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5206999999999997e-05 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:35.449262+0000", 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1464999999999998e-05 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.134 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.135 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:54.135 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:54.135 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:03:54.136 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:03:54.137 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:54.135+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:54.137 INFO:teuthology.run_tasks:Running task admin_socket... 2024-09-12T22:03:54.151 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-09-12T22:03:54.151 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-09-12T22:03:54.189 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:hints = 1 2024-09-12T22:03:54.189 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2024-09-12T22:03:54.189 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Object prefix: benchmark_data_smithi043_32659 2024-09-12T22:03:54.189 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T22:03:54.189 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 0 0 0 0 0 0 - 0 2024-09-12T22:03:54.236 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:54.235+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:54.311 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:03:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:03:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:725 5.5 e24/22 5:a658b401:::benchmark_data_smithi043_32659_object724:head v 24'55, mlcod=24'53)", 2024-09-12T22:03:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:54.308916+0000", 2024-09-12T22:03:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0011443950000000001, 2024-09-12T22:03:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001166243, 2024-09-12T22:03:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:03:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.308916+0000", 2024-09-12T22:03:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.308916+0000", 2024-09-12T22:03:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.308916+0000", 2024-09-12T22:03:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-09-12T22:03:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.308973+0000", 2024-09-12T22:03:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6603e-05 2024-09-12T22:03:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.308989+0000", 2024-09-12T22:03:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6447999999999999e-05 2024-09-12T22:03:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.308996+0000", 2024-09-12T22:03:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1240000000000002e-06 2024-09-12T22:03:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309060+0000", 2024-09-12T22:03:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4125e-05 2024-09-12T22:03:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309078+0000", 2024-09-12T22:03:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8014999999999999e-05 2024-09-12T22:03:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:727 5.d e24/22 5:b0e7d32c:::benchmark_data_smithi043_32659_object726:head v 24'49, mlcod=24'45)", 2024-09-12T22:03:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:54.309153+0000", 2024-09-12T22:03:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00090689700000000004, 2024-09-12T22:03:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00096625300000000003, 2024-09-12T22:03:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:03:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309153+0000", 2024-09-12T22:03:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309153+0000", 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309154+0000", 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309219+0000", 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4758999999999994e-05 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309228+0000", 2024-09-12T22:03:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9359999999999994e-06 2024-09-12T22:03:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309234+0000", 2024-09-12T22:03:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4040000000000003e-06 2024-09-12T22:03:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309286+0000", 2024-09-12T22:03:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1994999999999999e-05 2024-09-12T22:03:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309296+0000", 2024-09-12T22:03:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0142999999999999e-05 2024-09-12T22:03:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:732 5.2 5:44233b19:::benchmark_data_smithi043_32659_object731:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:54.309316+0000", 2024-09-12T22:03:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00074410299999999997, 2024-09-12T22:03:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00083936099999999995, 2024-09-12T22:03:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:03:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:03:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 732 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309316+0000", 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309316+0000", 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309317+0000", 2024-09-12T22:03:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8299999999999995e-07 2024-09-12T22:03:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309441+0000", 2024-09-12T22:03:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012412400000000001 2024-09-12T22:03:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309456+0000", 2024-09-12T22:03:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5255999999999999e-05 2024-09-12T22:03:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309465+0000", 2024-09-12T22:03:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:03:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309516+0000", 2024-09-12T22:03:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0494999999999997e-05 2024-09-12T22:03:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309624+0000", 2024-09-12T22:03:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010825200000000001 2024-09-12T22:03:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309712+0000", 2024-09-12T22:03:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7834e-05 2024-09-12T22:03:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:730 5.3 e24/22 5:cb663dec:::benchmark_data_smithi043_32659_object729:head v 24'36, mlcod=24'33)", 2024-09-12T22:03:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:54.309453+0000", 2024-09-12T22:03:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00060696600000000002, 2024-09-12T22:03:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075880700000000001, 2024-09-12T22:03:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:03:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309453+0000", 2024-09-12T22:03:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309453+0000", 2024-09-12T22:03:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309454+0000", 2024-09-12T22:03:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:03:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309527+0000", 2024-09-12T22:03:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3431999999999998e-05 2024-09-12T22:03:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309544+0000", 2024-09-12T22:03:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7314999999999999e-05 2024-09-12T22:03:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309551+0000", 2024-09-12T22:03:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3960000000000003e-06 2024-09-12T22:03:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309585+0000", 2024-09-12T22:03:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4236999999999998e-05 2024-09-12T22:03:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309602+0000", 2024-09-12T22:03:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7150999999999999e-05 2024-09-12T22:03:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:734 5.7 5:ef0e6c0e:::benchmark_data_smithi043_32659_object733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:54.309543+0000", 2024-09-12T22:03:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00051689200000000002, 2024-09-12T22:03:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00070929399999999996, 2024-09-12T22:03:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:03:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:03:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 734 2024-09-12T22:03:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309543+0000", 2024-09-12T22:03:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309543+0000", 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309544+0000", 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309669+0000", 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480799999999999 2024-09-12T22:03:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309686+0000", 2024-09-12T22:03:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7286e-05 2024-09-12T22:03:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309693+0000", 2024-09-12T22:03:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:03:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309844+0000", 2024-09-12T22:03:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000151445 2024-09-12T22:03:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.310068+0000", 2024-09-12T22:03:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022326400000000001 2024-09-12T22:03:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.310156+0000", 2024-09-12T22:03:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8613e-05 2024-09-12T22:03:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:731 5.c e24/22 5:35cc0c26:::benchmark_data_smithi043_32659_object730:head v 24'44, mlcod=24'42)", 2024-09-12T22:03:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:54.309583+0000", 2024-09-12T22:03:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00047754900000000002, 2024-09-12T22:03:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00071775599999999995, 2024-09-12T22:03:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:03:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309583+0000", 2024-09-12T22:03:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309583+0000", 2024-09-12T22:03:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309583+0000", 2024-09-12T22:03:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2599999999999998e-07 2024-09-12T22:03:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309747+0000", 2024-09-12T22:03:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000163962 2024-09-12T22:03:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309754+0000", 2024-09-12T22:03:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2110000000000001e-06 2024-09-12T22:03:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309759+0000", 2024-09-12T22:03:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9629999999999997e-06 2024-09-12T22:03:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309819+0000", 2024-09-12T22:03:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0084999999999998e-05 2024-09-12T22:03:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309836+0000", 2024-09-12T22:03:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7183000000000001e-05 2024-09-12T22:03:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:736 5.7 5.e4f4de87 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:54.309850+0000", 2024-09-12T22:03:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00021033599999999999, 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00050399199999999998, 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 736 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309850+0000", 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309850+0000", 2024-09-12T22:03:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309850+0000", 2024-09-12T22:03:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5000000000000002e-07 2024-09-12T22:03:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309970+0000", 2024-09-12T22:03:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011937700000000001 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309979+0000", 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2350000000000005e-06 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309986+0000", 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4999999999999996e-06 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:733 5.5 e24/22 5:a9c67475:::benchmark_data_smithi043_32659_object732:head v 24'56, mlcod=24'53)", 2024-09-12T22:03:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:54.309951+0000", 2024-09-12T22:03:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000109249, 2024-09-12T22:03:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044227300000000003, 2024-09-12T22:03:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:03:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309951+0000", 2024-09-12T22:03:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309951+0000", 2024-09-12T22:03:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.309951+0000", 2024-09-12T22:03:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:03:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.310002+0000", 2024-09-12T22:03:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0788999999999998e-05 2024-09-12T22:03:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.310010+0000", 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0409999999999998e-06 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.310016+0000", 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.310057+0000", 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1223000000000002e-05 2024-09-12T22:03:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:54.310086+0000", 2024-09-12T22:03:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8742999999999999e-05 2024-09-12T22:03:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:03:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 8 2024-09-12T22:03:54.343 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:03:54.345 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:03:54.345 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:54.343+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:54.445 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:54.444+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:54.501 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:03:54.501 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:03:54.501 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:03:54.501 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:03:54.502 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:03:54.514 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:03:54.546 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:54.545+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:54.647 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:54.646+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:54.711 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:03:54.711 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:03:54.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:03:54.711 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:03:54.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.712 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4138.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:03:54.712 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:23.765765+0000", 2024-09-12T22:03:54.712 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.942518590999999, 2024-09-12T22:03:54.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012658954, 2024-09-12T22:03:54.712 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.712 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.712 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:03:54.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4138", 2024-09-12T22:03:54.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/1234714031", 2024-09-12T22:03:54.712 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 140 2024-09-12T22:03:54.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.713 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.765765+0000", 2024-09-12T22:03:54.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.765765+0000", 2024-09-12T22:03:54.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.765765+0000", 2024-09-12T22:03:54.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3900000000000005e-07 2024-09-12T22:03:54.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.765840+0000", 2024-09-12T22:03:54.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4986000000000003e-05 2024-09-12T22:03:54.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.765846+0000", 2024-09-12T22:03:54.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1059999999999999e-06 2024-09-12T22:03:54.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.765849+0000", 2024-09-12T22:03:54.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.788e-06 2024-09-12T22:03:54.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.771078+0000", 2024-09-12T22:03:54.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.005228768 2024-09-12T22:03:54.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.771156+0000", 2024-09-12T22:03:54.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7570000000000004e-05 2024-09-12T22:03:54.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.771279+0000", 2024-09-12T22:03:54.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012297400000000001 2024-09-12T22:03:54.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.772208+0000", 2024-09-12T22:03:54.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092975700000000002 2024-09-12T22:03:54.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.778342+0000", 2024-09-12T22:03:54.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061337409999999998 2024-09-12T22:03:54.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.778389+0000", 2024-09-12T22:03:54.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7304e-05 2024-09-12T22:03:54.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.778424+0000", 2024-09-12T22:03:54.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4421000000000001e-05 2024-09-12T22:03:54.718 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.718 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.718 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.718 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.718 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.258560125999999, 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018534981999999998, 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:03:54.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449725+0000", 2024-09-12T22:03:54.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799999999999999e-06 2024-09-12T22:03:54.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449731+0000", 2024-09-12T22:03:54.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.801e-06 2024-09-12T22:03:54.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449745+0000", 2024-09-12T22:03:54.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4198e-05 2024-09-12T22:03:54.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449758+0000", 2024-09-12T22:03:54.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2858e-05 2024-09-12T22:03:54.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449815+0000", 2024-09-12T22:03:54.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6978999999999998e-05 2024-09-12T22:03:54.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:03:54.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:03:54.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2369999999999997e-06 2024-09-12T22:03:54.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457683+0000", 2024-09-12T22:03:54.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078622640000000008 2024-09-12T22:03:54.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457840+0000", 2024-09-12T22:03:54.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015715299999999999 2024-09-12T22:03:54.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457972+0000", 2024-09-12T22:03:54.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013179500000000001 2024-09-12T22:03:54.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462325+0000", 2024-09-12T22:03:54.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043526859999999997 2024-09-12T22:03:54.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468180+0000", 2024-09-12T22:03:54.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058557169999999999 2024-09-12T22:03:54.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468221+0000", 2024-09-12T22:03:54.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0673000000000002e-05 2024-09-12T22:03:54.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468258+0000", 2024-09-12T22:03:54.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7240999999999998e-05 2024-09-12T22:03:54.725 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.725 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.725 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.725 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.725 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:03:54.725 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.258507515000002, 2024-09-12T22:03:54.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018748032000000001, 2024-09-12T22:03:54.725 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.725 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.726 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.726 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:03:54.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:03:54.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449779+0000", 2024-09-12T22:03:54.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4869999999999998e-06 2024-09-12T22:03:54.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449783+0000", 2024-09-12T22:03:54.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:03:54.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449791+0000", 2024-09-12T22:03:54.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2640000000000002e-06 2024-09-12T22:03:54.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449796+0000", 2024-09-12T22:03:54.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9370000000000001e-06 2024-09-12T22:03:54.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449915+0000", 2024-09-12T22:03:54.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118559 2024-09-12T22:03:54.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:54.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449920+0000", 2024-09-12T22:03:54.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.101e-06 2024-09-12T22:03:54.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458578+0000", 2024-09-12T22:03:54.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008657662 2024-09-12T22:03:54.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458978+0000", 2024-09-12T22:03:54.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00039977399999999998 2024-09-12T22:03:54.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459130+0000", 2024-09-12T22:03:54.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000152394 2024-09-12T22:03:54.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462793+0000", 2024-09-12T22:03:54.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036628770000000001 2024-09-12T22:03:54.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468451+0000", 2024-09-12T22:03:54.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056577820000000001 2024-09-12T22:03:54.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468501+0000", 2024-09-12T22:03:54.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0609999999999998e-05 2024-09-12T22:03:54.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468524+0000", 2024-09-12T22:03:54.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2804000000000001e-05 2024-09-12T22:03:54.733 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.733 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.733 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.734 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.734 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:03:54.734 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.258472814000001, 2024-09-12T22:03:54.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018816113999999998, 2024-09-12T22:03:54.734 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.734 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.734 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.734 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:03:54.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:03:54.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:03:54.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-09-12T22:03:54.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:03:54.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3360000000000001e-06 2024-09-12T22:03:54.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449832+0000", 2024-09-12T22:03:54.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1528e-05 2024-09-12T22:03:54.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:03:54.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-12T22:03:54.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459429+0000", 2024-09-12T22:03:54.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095926970000000007 2024-09-12T22:03:54.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459597+0000", 2024-09-12T22:03:54.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000168309 2024-09-12T22:03:54.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459829+0000", 2024-09-12T22:03:54.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231158 2024-09-12T22:03:54.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462796+0000", 2024-09-12T22:03:54.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029673849999999999 2024-09-12T22:03:54.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468558+0000", 2024-09-12T22:03:54.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057621449999999998 2024-09-12T22:03:54.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468592+0000", 2024-09-12T22:03:54.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4241e-05 2024-09-12T22:03:54.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468627+0000", 2024-09-12T22:03:54.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4511999999999998e-05 2024-09-12T22:03:54.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.741 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.741 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.741 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:03:54.741 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.258405786000001, 2024-09-12T22:03:54.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018845905, 2024-09-12T22:03:54.742 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.742 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.742 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.742 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:03:54.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:03:54.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:03:54.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:03:54.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449881+0000", 2024-09-12T22:03:54.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.005e-06 2024-09-12T22:03:54.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449887+0000", 2024-09-12T22:03:54.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9050000000000002e-06 2024-09-12T22:03:54.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449892+0000", 2024-09-12T22:03:54.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2009999999999998e-06 2024-09-12T22:03:54.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460279+0000", 2024-09-12T22:03:54.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010386808000000001 2024-09-12T22:03:54.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460427+0000", 2024-09-12T22:03:54.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014789 2024-09-12T22:03:54.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460572+0000", 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014453099999999999 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462799+0000", 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002227049 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468672+0000", 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058730060000000001 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468704+0000", 2024-09-12T22:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2421e-05 2024-09-12T22:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468724+0000", 2024-09-12T22:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9582e-05 2024-09-12T22:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.258375315999999, 2024-09-12T22:03:54.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015455175, 2024-09-12T22:03:54.748 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.748 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.748 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.748 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:03:54.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:03:54.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449909+0000", 2024-09-12T22:03:54.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2099999999999997e-07 2024-09-12T22:03:54.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449912+0000", 2024-09-12T22:03:54.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1439999999999999e-06 2024-09-12T22:03:54.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449925+0000", 2024-09-12T22:03:54.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2944e-05 2024-09-12T22:03:54.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449931+0000", 2024-09-12T22:03:54.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3289999999999999e-06 2024-09-12T22:03:54.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:03:54.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:03:54.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449990+0000", 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8090000000000004e-06 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.455881+0000", 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058904400000000003 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456556+0000", 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00067549500000000002 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456742+0000", 2024-09-12T22:03:54.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018546799999999999 2024-09-12T22:03:54.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461053+0000", 2024-09-12T22:03:54.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043118310000000003 2024-09-12T22:03:54.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465220+0000", 2024-09-12T22:03:54.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041667750000000002 2024-09-12T22:03:54.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465316+0000", 2024-09-12T22:03:54.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5996999999999996e-05 2024-09-12T22:03:54.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465363+0000", 2024-09-12T22:03:54.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7111999999999999e-05 2024-09-12T22:03:54.753 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.753 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.753 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.753 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.258332925000001, 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017913407999999999, 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3499999999999996e-07 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449955+0000", 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4379999999999999e-06 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449963+0000", 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2719999999999997e-06 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449970+0000", 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5930000000000002e-06 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450563+0000", 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00059351900000000003 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:03:54.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450570+0000", 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3900000000000004e-06 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461148+0000", 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010577354000000001 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461312+0000", 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016392300000000001 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:54.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461525+0000", 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021282199999999999 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464272+0000", 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027469740000000001 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467749+0000", 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003477235 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467815+0000", 2024-09-12T22:03:54.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5974000000000002e-05 2024-09-12T22:03:54.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467864+0000", 2024-09-12T22:03:54.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9279e-05 2024-09-12T22:03:54.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.759 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.759 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.759 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.258301458999998, 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018827507, 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:03:54.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:03:54.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:03:54.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:03:54.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2739999999999999e-06 2024-09-12T22:03:54.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449999+0000", 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3349e-05 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450005+0000", 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.609e-06 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461006+0000", 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011000876 2024-09-12T22:03:54.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461236+0000", 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000230301 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461362+0000", 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012541900000000001 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464797+0000", 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034350840000000001 2024-09-12T22:03:54.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468754+0000", 2024-09-12T22:03:54.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039576689999999996 2024-09-12T22:03:54.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468784+0000", 2024-09-12T22:03:54.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9558000000000001e-05 2024-09-12T22:03:54.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468810+0000", 2024-09-12T22:03:54.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5752e-05 2024-09-12T22:03:54.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.765 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.765 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.765 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:03:54.766 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.258269587000001, 2024-09-12T22:03:54.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018888559999999999, 2024-09-12T22:03:54.766 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.766 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.766 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.766 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450015+0000", 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450018+0000", 2024-09-12T22:03:54.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3840000000000001e-06 2024-09-12T22:03:54.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:03:54.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8859999999999998e-06 2024-09-12T22:03:54.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450030+0000", 2024-09-12T22:03:54.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4829999999999999e-06 2024-09-12T22:03:54.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465718+0000", 2024-09-12T22:03:54.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015688163000000001 2024-09-12T22:03:54.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465793+0000", 2024-09-12T22:03:54.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4788000000000003e-05 2024-09-12T22:03:54.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466015+0000", 2024-09-12T22:03:54.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000221394 2024-09-12T22:03:54.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467628+0000", 2024-09-12T22:03:54.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016131190000000001 2024-09-12T22:03:54.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468849+0000", 2024-09-12T22:03:54.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012211699999999999 2024-09-12T22:03:54.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468878+0000", 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8708e-05 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468902+0000", 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868e-05 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.771 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:23 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.772 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:03:54.772 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.258246140000001, 2024-09-12T22:03:54.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021189669000000001, 2024-09-12T22:03:54.772 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.772 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.772 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.772 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:03:54.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450038+0000", 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450042+0000", 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7720000000000001e-06 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450058+0000", 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6379999999999999e-05 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450067+0000", 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3870000000000001e-06 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466409+0000", 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016341418999999999 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466467+0000", 2024-09-12T22:03:54.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8613999999999998e-05 2024-09-12T22:03:54.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466612+0000", 2024-09-12T22:03:54.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014415000000000001 2024-09-12T22:03:54.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467856+0000", 2024-09-12T22:03:54.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012440039999999999 2024-09-12T22:03:54.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471178+0000", 2024-09-12T22:03:54.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033227450000000002 2024-09-12T22:03:54.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471207+0000", 2024-09-12T22:03:54.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8571000000000001e-05 2024-09-12T22:03:54.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471227+0000", 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0109999999999999e-05 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.2582056, 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021231197, 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450079+0000", 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450083+0000", 2024-09-12T22:03:54.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1989999999999999e-06 2024-09-12T22:03:54.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450092+0000", 2024-09-12T22:03:54.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9400000000000008e-06 2024-09-12T22:03:54.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450097+0000", 2024-09-12T22:03:54.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:03:54.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466898+0000", 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016801226999999998 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466975+0000", 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6197000000000002e-05 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467158+0000", 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183876 2024-09-12T22:03:54.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468270+0000", 2024-09-12T22:03:54.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001111229 2024-09-12T22:03:54.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471260+0000", 2024-09-12T22:03:54.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002989907 2024-09-12T22:03:54.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471289+0000", 2024-09-12T22:03:54.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9271000000000001e-05 2024-09-12T22:03:54.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471309+0000", 2024-09-12T22:03:54.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0302999999999999e-05 2024-09-12T22:03:54.782 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.258178998999998, 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018145809999999998, 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:03:54.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:03:54.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:03:54.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:03:54.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450114+0000", 2024-09-12T22:03:54.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1849999999999993e-06 2024-09-12T22:03:54.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:03:54.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1350000000000003e-06 2024-09-12T22:03:54.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450128+0000", 2024-09-12T22:03:54.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2040000000000002e-06 2024-09-12T22:03:54.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454085+0000", 2024-09-12T22:03:54.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00395736 2024-09-12T22:03:54.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:54.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454090+0000", 2024-09-12T22:03:54.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.378e-06 2024-09-12T22:03:54.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457076+0000", 2024-09-12T22:03:54.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002985747 2024-09-12T22:03:54.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457178+0000", 2024-09-12T22:03:54.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010242 2024-09-12T22:03:54.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457452+0000", 2024-09-12T22:03:54.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027313000000000001 2024-09-12T22:03:54.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462024+0000", 2024-09-12T22:03:54.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045727040000000004 2024-09-12T22:03:54.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468161+0000", 2024-09-12T22:03:54.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061372019999999996 2024-09-12T22:03:54.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468212+0000", 2024-09-12T22:03:54.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0707000000000001e-05 2024-09-12T22:03:54.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468250+0000", 2024-09-12T22:03:54.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8148000000000001e-05 2024-09-12T22:03:54.790 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.790 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.790 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.790 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.790 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:03:54.791 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.257587622999999, 2024-09-12T22:03:54.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017301410999999999, 2024-09-12T22:03:54.791 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.791 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.791 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.791 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:03:54.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:03:54.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450699+0000", 2024-09-12T22:03:54.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0019999999999998e-06 2024-09-12T22:03:54.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450705+0000", 2024-09-12T22:03:54.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3199999999999996e-06 2024-09-12T22:03:54.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450717+0000", 2024-09-12T22:03:54.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2069000000000001e-05 2024-09-12T22:03:54.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450726+0000", 2024-09-12T22:03:54.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2840000000000006e-06 2024-09-12T22:03:54.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454318+0000", 2024-09-12T22:03:54.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035919580000000001 2024-09-12T22:03:54.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:54.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454323+0000", 2024-09-12T22:03:54.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2490000000000001e-06 2024-09-12T22:03:54.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462054+0000", 2024-09-12T22:03:54.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0077311319999999999 2024-09-12T22:03:54.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462135+0000", 2024-09-12T22:03:54.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1558999999999996e-05 2024-09-12T22:03:54.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:54.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462273+0000", 2024-09-12T22:03:54.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013781000000000001 2024-09-12T22:03:54.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464587+0000", 2024-09-12T22:03:54.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023134319999999998 2024-09-12T22:03:54.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467908+0000", 2024-09-12T22:03:54.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033211310000000002 2024-09-12T22:03:54.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467960+0000", 2024-09-12T22:03:54.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2537000000000002e-05 2024-09-12T22:03:54.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467997+0000", 2024-09-12T22:03:54.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6928000000000003e-05 2024-09-12T22:03:54.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.797 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.798 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:34 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.798 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450741+0000", 2024-09-12T22:03:54.798 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.257542569000002, 2024-09-12T22:03:54.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013890173, 2024-09-12T22:03:54.798 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.798 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.798 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.798 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450741+0000", 2024-09-12T22:03:54.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450741+0000", 2024-09-12T22:03:54.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450742+0000", 2024-09-12T22:03:54.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4899999999999995e-07 2024-09-12T22:03:54.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450756+0000", 2024-09-12T22:03:54.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4025e-05 2024-09-12T22:03:54.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450773+0000", 2024-09-12T22:03:54.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7702000000000001e-05 2024-09-12T22:03:54.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450780+0000", 2024-09-12T22:03:54.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-06 2024-09-12T22:03:54.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453175+0000", 2024-09-12T22:03:54.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023946710000000001 2024-09-12T22:03:54.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:03:54.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453181+0000", 2024-09-12T22:03:54.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5590000000000002e-06 2024-09-12T22:03:54.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457039+0000", 2024-09-12T22:03:54.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038575649999999999 2024-09-12T22:03:54.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457181+0000", 2024-09-12T22:03:54.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000141736 2024-09-12T22:03:54.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:54.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457979+0000", 2024-09-12T22:03:54.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0007986 2024-09-12T22:03:54.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461984+0000", 2024-09-12T22:03:54.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040052910000000002 2024-09-12T22:03:54.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464519+0000", 2024-09-12T22:03:54.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002534597 2024-09-12T22:03:54.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464582+0000", 2024-09-12T22:03:54.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3441999999999993e-05 2024-09-12T22:03:54.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464631+0000", 2024-09-12T22:03:54.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8675999999999999e-05 2024-09-12T22:03:54.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.805 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.806 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.806 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:03:54.806 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.257491443999999, 2024-09-12T22:03:54.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020127506999999999, 2024-09-12T22:03:54.806 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.806 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.806 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.806 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:03:54.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:03:54.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450793+0000", 2024-09-12T22:03:54.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2800000000000005e-07 2024-09-12T22:03:54.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450813+0000", 2024-09-12T22:03:54.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0063000000000001e-05 2024-09-12T22:03:54.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450847+0000", 2024-09-12T22:03:54.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3973000000000002e-05 2024-09-12T22:03:54.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450862+0000", 2024-09-12T22:03:54.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5358000000000001e-05 2024-09-12T22:03:54.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454355+0000", 2024-09-12T22:03:54.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003492841 2024-09-12T22:03:54.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:54.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454359+0000", 2024-09-12T22:03:54.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-09-12T22:03:54.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458704+0000", 2024-09-12T22:03:54.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043452459999999997 2024-09-12T22:03:54.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459009+0000", 2024-09-12T22:03:54.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030526199999999999 2024-09-12T22:03:54.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459143+0000", 2024-09-12T22:03:54.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013375 2024-09-12T22:03:54.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462690+0000", 2024-09-12T22:03:54.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035466579999999998 2024-09-12T22:03:54.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470863+0000", 2024-09-12T22:03:54.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0081734089999999995 2024-09-12T22:03:54.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470898+0000", 2024-09-12T22:03:54.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4445e-05 2024-09-12T22:03:54.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470920+0000", 2024-09-12T22:03:54.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1844e-05 2024-09-12T22:03:54.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.813 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.813 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.813 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450885+0000", 2024-09-12T22:03:54.813 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.257398504000001, 2024-09-12T22:03:54.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014578333000000001, 2024-09-12T22:03:54.813 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.813 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.813 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.814 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450885+0000", 2024-09-12T22:03:54.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450885+0000", 2024-09-12T22:03:54.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450886+0000", 2024-09-12T22:03:54.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9199999999999999e-07 2024-09-12T22:03:54.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450892+0000", 2024-09-12T22:03:54.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:03:54.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450915+0000", 2024-09-12T22:03:54.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3447000000000001e-05 2024-09-12T22:03:54.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450928+0000", 2024-09-12T22:03:54.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3026e-05 2024-09-12T22:03:54.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452357+0000", 2024-09-12T22:03:54.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001428721 2024-09-12T22:03:54.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:03:54.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452364+0000", 2024-09-12T22:03:54.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9419999999999998e-06 2024-09-12T22:03:54.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456803+0000", 2024-09-12T22:03:54.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044385010000000001 2024-09-12T22:03:54.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456933+0000", 2024-09-12T22:03:54.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130211 2024-09-12T22:03:54.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457059+0000", 2024-09-12T22:03:54.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012614899999999999 2024-09-12T22:03:54.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459965+0000", 2024-09-12T22:03:54.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029057319999999998 2024-09-12T22:03:54.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465344+0000", 2024-09-12T22:03:54.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0053789279999999998 2024-09-12T22:03:54.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465405+0000", 2024-09-12T22:03:54.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1105000000000005e-05 2024-09-12T22:03:54.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465463+0000", 2024-09-12T22:03:54.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8711000000000001e-05 2024-09-12T22:03:54.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.820 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.820 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.820 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:03:54.820 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.255961325000001, 2024-09-12T22:03:54.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018704596, 2024-09-12T22:03:54.821 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.821 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.821 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.821 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:03:54.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:03:54.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452323+0000", 2024-09-12T22:03:54.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:03:54.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452337+0000", 2024-09-12T22:03:54.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:03:54.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452489+0000", 2024-09-12T22:03:54.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015167699999999999 2024-09-12T22:03:54.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452498+0000", 2024-09-12T22:03:54.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9709999999999993e-06 2024-09-12T22:03:54.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454393+0000", 2024-09-12T22:03:54.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001895171 2024-09-12T22:03:54.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:54.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454397+0000", 2024-09-12T22:03:54.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4470000000000002e-06 2024-09-12T22:03:54.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459570+0000", 2024-09-12T22:03:54.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051728160000000002 2024-09-12T22:03:54.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459718+0000", 2024-09-12T22:03:54.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014857800000000001 2024-09-12T22:03:54.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459920+0000", 2024-09-12T22:03:54.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000202043 2024-09-12T22:03:54.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462696+0000", 2024-09-12T22:03:54.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027756299999999999 2024-09-12T22:03:54.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470963+0000", 2024-09-12T22:03:54.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082671359999999996 2024-09-12T22:03:54.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471000+0000", 2024-09-12T22:03:54.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6748999999999997e-05 2024-09-12T22:03:54.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471027+0000", 2024-09-12T22:03:54.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7118e-05 2024-09-12T22:03:54.827 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.827 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.827 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.828 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.828 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453198+0000", 2024-09-12T22:03:54.828 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.255085911999998, 2024-09-12T22:03:54.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014690379999999999, 2024-09-12T22:03:54.828 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.828 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.828 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.828 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453198+0000", 2024-09-12T22:03:54.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453198+0000", 2024-09-12T22:03:54.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453199+0000", 2024-09-12T22:03:54.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.02e-07 2024-09-12T22:03:54.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453205+0000", 2024-09-12T22:03:54.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2809999999999997e-06 2024-09-12T22:03:54.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453218+0000", 2024-09-12T22:03:54.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3305000000000001e-05 2024-09-12T22:03:54.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453228+0000", 2024-09-12T22:03:54.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4050000000000006e-06 2024-09-12T22:03:54.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453295+0000", 2024-09-12T22:03:54.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7266000000000003e-05 2024-09-12T22:03:54.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:54.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453300+0000", 2024-09-12T22:03:54.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3920000000000002e-06 2024-09-12T22:03:54.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459323+0000", 2024-09-12T22:03:54.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060229869999999996 2024-09-12T22:03:54.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459455+0000", 2024-09-12T22:03:54.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131657 2024-09-12T22:03:54.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:54.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459569+0000", 2024-09-12T22:03:54.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113986 2024-09-12T22:03:54.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461991+0000", 2024-09-12T22:03:54.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024220320000000002 2024-09-12T22:03:54.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467728+0000", 2024-09-12T22:03:54.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057376520000000002 2024-09-12T22:03:54.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467806+0000", 2024-09-12T22:03:54.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7705000000000002e-05 2024-09-12T22:03:54.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467888+0000", 2024-09-12T22:03:54.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1810000000000004e-05 2024-09-12T22:03:54.835 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.835 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.835 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.836 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.836 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:03:54.836 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.255035647, 2024-09-12T22:03:54.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017680218000000001, 2024-09-12T22:03:54.836 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.836 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.836 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:54.836 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:03:54.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:03:54.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453249+0000", 2024-09-12T22:03:54.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:03:54.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453253+0000", 2024-09-12T22:03:54.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3630000000000004e-06 2024-09-12T22:03:54.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453261+0000", 2024-09-12T22:03:54.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9319999999999996e-06 2024-09-12T22:03:54.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453267+0000", 2024-09-12T22:03:54.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7989999999999999e-06 2024-09-12T22:03:54.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454995+0000", 2024-09-12T22:03:54.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001727793 2024-09-12T22:03:54.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:03:54.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.455000+0000", 2024-09-12T22:03:54.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0289999999999996e-06 2024-09-12T22:03:54.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461445+0000", 2024-09-12T22:03:54.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064456870000000003 2024-09-12T22:03:54.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461546+0000", 2024-09-12T22:03:54.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101036 2024-09-12T22:03:54.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:54.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461680+0000", 2024-09-12T22:03:54.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013407299999999999 2024-09-12T22:03:54.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:54.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464622+0000", 2024-09-12T22:03:54.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029413379999999999 2024-09-12T22:03:54.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:54.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470850+0000", 2024-09-12T22:03:54.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.006227977 2024-09-12T22:03:54.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:54.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470902+0000", 2024-09-12T22:03:54.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1916000000000002e-05 2024-09-12T22:03:54.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470928+0000", 2024-09-12T22:03:54.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.65e-05 2024-09-12T22:03:54.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.843 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.843 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:54.843 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:03:54.843 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.255004051, 2024-09-12T22:03:54.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017838390999999999, 2024-09-12T22:03:54.844 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:54.844 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:54.844 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:03:54.844 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:54.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:54.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:03:54.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:54.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:03:54.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:54.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:54.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453280+0000", 2024-09-12T22:03:54.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:03:54.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:54.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453284+0000", 2024-09-12T22:03:54.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.194e-06 2024-09-12T22:03:54.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:54.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453337+0000", 2024-09-12T22:03:54.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2330999999999998e-05 2024-09-12T22:03:54.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:54.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453353+0000", 2024-09-12T22:03:54.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6001000000000001e-05 2024-09-12T22:03:54.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454421+0000", 2024-09-12T22:03:54.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010681009999999999 2024-09-12T22:03:54.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:54.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454424+0000", 2024-09-12T22:03:54.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2550000000000002e-06 2024-09-12T22:03:54.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:54.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460376+0000", 2024-09-12T22:03:54.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059517770000000001 2024-09-12T22:03:54.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:54.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460536+0000", 2024-09-12T22:03:54.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015984699999999999 2024-09-12T22:03:54.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:54.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:54.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:54.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471118+0000", 2024-09-12T22:03:54.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010582322999999999 2024-09-12T22:03:54.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.849 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:54.849 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:54.849 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:03:54.851 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:54.849+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:54.851 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:03:54.951 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:54.950+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:55.002 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-09-12T22:03:55.010 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:03:55.010 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:03:55.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.011 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5209 5.4 5.e7d9ac4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T22:03:55.011 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:55.007014+0000", 2024-09-12T22:03:55.011 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0022754860000000002, 2024-09-12T22:03:55.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022978790000000001, 2024-09-12T22:03:55.011 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.011 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.011 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "op must wait for map", 2024-09-12T22:03:55.011 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:55.011 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:55.012 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.012 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5209 2024-09-12T22:03:55.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.012 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007014+0000", 2024-09-12T22:03:55.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007014+0000", 2024-09-12T22:03:55.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007015+0000", 2024-09-12T22:03:55.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9800000000000003e-07 2024-09-12T22:03:55.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007109+0000", 2024-09-12T22:03:55.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4425999999999993e-05 2024-09-12T22:03:55.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007119+0000", 2024-09-12T22:03:55.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.414e-06 2024-09-12T22:03:55.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007125+0000", 2024-09-12T22:03:55.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8580000000000002e-06 2024-09-12T22:03:55.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007177+0000", 2024-09-12T22:03:55.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1530999999999998e-05 2024-09-12T22:03:55.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:03:55.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007183+0000", 2024-09-12T22:03:55.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0079999999999999e-06 2024-09-12T22:03:55.015 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.015 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.015 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.016 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:5208 5.f e25/22 5:f74be8af:::benchmark_data_smithi043_32659_object5207:head v 25'337, mlcod=24'334)", 2024-09-12T22:03:55.016 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:55.007221+0000", 2024-09-12T22:03:55.016 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0020688740000000001, 2024-09-12T22:03:55.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021653760000000001, 2024-09-12T22:03:55.016 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.016 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.016 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:03:55.016 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007221+0000", 2024-09-12T22:03:55.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007221+0000", 2024-09-12T22:03:55.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007221+0000", 2024-09-12T22:03:55.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5099999999999999e-07 2024-09-12T22:03:55.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007289+0000", 2024-09-12T22:03:55.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7540999999999996e-05 2024-09-12T22:03:55.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007297+0000", 2024-09-12T22:03:55.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.824e-06 2024-09-12T22:03:55.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007301+0000", 2024-09-12T22:03:55.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6140000000000002e-06 2024-09-12T22:03:55.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007337+0000", 2024-09-12T22:03:55.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5678e-05 2024-09-12T22:03:55.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007347+0000", 2024-09-12T22:03:55.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.048e-05 2024-09-12T22:03:55.020 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.020 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.020 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.020 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5215 5.d 5.69323aed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T22:03:55.020 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:55.007818+0000", 2024-09-12T22:03:55.020 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0014718699999999999, 2024-09-12T22:03:55.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0016259779999999999, 2024-09-12T22:03:55.020 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.020 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.021 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "op must wait for map", 2024-09-12T22:03:55.021 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:55.021 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:55.021 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.021 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5215 2024-09-12T22:03:55.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.021 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007818+0000", 2024-09-12T22:03:55.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007818+0000", 2024-09-12T22:03:55.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007818+0000", 2024-09-12T22:03:55.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1699999999999998e-07 2024-09-12T22:03:55.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007878+0000", 2024-09-12T22:03:55.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0109999999999999e-05 2024-09-12T22:03:55.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007885+0000", 2024-09-12T22:03:55.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7290000000000003e-06 2024-09-12T22:03:55.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007889+0000", 2024-09-12T22:03:55.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.065e-06 2024-09-12T22:03:55.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007923+0000", 2024-09-12T22:03:55.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3386999999999997e-05 2024-09-12T22:03:55.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:03:55.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.007926+0000", 2024-09-12T22:03:55.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5410000000000001e-06 2024-09-12T22:03:55.024 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.025 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.025 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.025 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:5206 5.9 e25/22 5:974d91d0:::benchmark_data_smithi043_32659_object5205:head v 25'316, mlcod=24'311)", 2024-09-12T22:03:55.025 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:55.008254+0000", 2024-09-12T22:03:55.025 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0010353770000000001, 2024-09-12T22:03:55.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001255021, 2024-09-12T22:03:55.025 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.025 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.025 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:03:55.025 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008254+0000", 2024-09-12T22:03:55.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008254+0000", 2024-09-12T22:03:55.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008254+0000", 2024-09-12T22:03:55.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3799999999999999e-07 2024-09-12T22:03:55.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008317+0000", 2024-09-12T22:03:55.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2299999999999996e-05 2024-09-12T22:03:55.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008325+0000", 2024-09-12T22:03:55.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0029999999999994e-06 2024-09-12T22:03:55.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008330+0000", 2024-09-12T22:03:55.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9010000000000002e-06 2024-09-12T22:03:55.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008364+0000", 2024-09-12T22:03:55.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3989000000000003e-05 2024-09-12T22:03:55.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008375+0000", 2024-09-12T22:03:55.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1232e-05 2024-09-12T22:03:55.029 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.029 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.029 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.029 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:5216 5.a e25/22 5:535faa96:::benchmark_data_smithi043_32659_object5215:head v 25'324, mlcod=24'322)", 2024-09-12T22:03:55.029 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:55.008489+0000", 2024-09-12T22:03:55.029 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000800576, 2024-09-12T22:03:55.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001078423, 2024-09-12T22:03:55.030 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.030 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.030 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:03:55.030 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008489+0000", 2024-09-12T22:03:55.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008489+0000", 2024-09-12T22:03:55.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008489+0000", 2024-09-12T22:03:55.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:03:55.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008558+0000", 2024-09-12T22:03:55.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8202999999999997e-05 2024-09-12T22:03:55.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008571+0000", 2024-09-12T22:03:55.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3603e-05 2024-09-12T22:03:55.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008577+0000", 2024-09-12T22:03:55.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7660000000000004e-06 2024-09-12T22:03:55.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008641+0000", 2024-09-12T22:03:55.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3979999999999994e-05 2024-09-12T22:03:55.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008660+0000", 2024-09-12T22:03:55.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9320000000000001e-05 2024-09-12T22:03:55.033 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.033 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.033 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.034 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:5213 5.f e25/22 5:fa523af3:::benchmark_data_smithi043_32659_object5212:head v 25'339, mlcod=24'335)", 2024-09-12T22:03:55.034 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:55.008732+0000", 2024-09-12T22:03:55.034 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00055706400000000002, 2024-09-12T22:03:55.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00089649800000000002, 2024-09-12T22:03:55.034 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.034 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.034 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:03:55.034 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008732+0000", 2024-09-12T22:03:55.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008732+0000", 2024-09-12T22:03:55.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008733+0000", 2024-09-12T22:03:55.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5199999999999997e-07 2024-09-12T22:03:55.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008792+0000", 2024-09-12T22:03:55.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9126000000000003e-05 2024-09-12T22:03:55.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008799+0000", 2024-09-12T22:03:55.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0400000000000004e-06 2024-09-12T22:03:55.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008803+0000", 2024-09-12T22:03:55.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9149999999999998e-06 2024-09-12T22:03:55.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008853+0000", 2024-09-12T22:03:55.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0297000000000003e-05 2024-09-12T22:03:55.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.008871+0000", 2024-09-12T22:03:55.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7317999999999999e-05 2024-09-12T22:03:55.038 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.038 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.038 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.038 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5219 5.0 5.3f39e7a0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T22:03:55.038 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:55.009014+0000", 2024-09-12T22:03:55.038 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00027570300000000003, 2024-09-12T22:03:55.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00067156699999999998, 2024-09-12T22:03:55.038 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.038 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.038 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:03:55.038 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:55.039 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:55.039 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.039 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5219 2024-09-12T22:03:55.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.039 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.009014+0000", 2024-09-12T22:03:55.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.009014+0000", 2024-09-12T22:03:55.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.009015+0000", 2024-09-12T22:03:55.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.37e-07 2024-09-12T22:03:55.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.009058+0000", 2024-09-12T22:03:55.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3460000000000001e-05 2024-09-12T22:03:55.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.009067+0000", 2024-09-12T22:03:55.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3680000000000008e-06 2024-09-12T22:03:55.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.009074+0000", 2024-09-12T22:03:55.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.725e-06 2024-09-12T22:03:55.041 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.042 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.042 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.042 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.042 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:03:55.042 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 7 2024-09-12T22:03:55.042 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:03:55.044 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:03:55.088 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:55.087+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:55.152 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:55.151+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:55.168 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'squid'} 2024-09-12T22:03:55.168 DEBUG:teuthology.orchestra.run.smithi043:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=squid' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-09-12T22:03:55.189 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 1 16 6309 6293 393.29 393.312 0.00362602 0.00253813 2024-09-12T22:03:55.203 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:03:55.203 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:03:55.203 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:03:55.203 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:03:55.203 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:03:55.215 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:03:55.254 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:55.253+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:55.355 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:55.354+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:55.420 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:03:55.420 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:03:55.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:03:55.420 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:03:55.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.420 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4138.0:135 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'93, mlcod=11'89)", 2024-09-12T22:03:55.420 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:23.768784+0000", 2024-09-12T22:03:55.420 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 31.648463569, 2024-09-12T22:03:55.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0086372489999999996, 2024-09-12T22:03:55.421 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.421 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.421 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.421 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.768784+0000", 2024-09-12T22:03:55.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.768784+0000", 2024-09-12T22:03:55.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.768785+0000", 2024-09-12T22:03:55.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2200000000000004e-07 2024-09-12T22:03:55.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.768790+0000", 2024-09-12T22:03:55.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4770000000000002e-06 2024-09-12T22:03:55.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.768797+0000", 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9700000000000002e-06 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.768802+0000", 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.771812+0000", 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003009173 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.771828+0000", 2024-09-12T22:03:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6095000000000001e-05 2024-09-12T22:03:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.777387+0000", 2024-09-12T22:03:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005558927 2024-09-12T22:03:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.777421+0000", 2024-09-12T22:03:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4765999999999999e-05 2024-09-12T22:03:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.425 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.425 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4138.0:136 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'94, mlcod=11'89)", 2024-09-12T22:03:55.425 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:23.769292+0000", 2024-09-12T22:03:55.425 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 31.647955547999999, 2024-09-12T22:03:55.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0084968930000000002, 2024-09-12T22:03:55.425 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.425 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.425 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.425 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.769292+0000", 2024-09-12T22:03:55.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.769292+0000", 2024-09-12T22:03:55.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.769293+0000", 2024-09-12T22:03:55.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1999999999999999e-07 2024-09-12T22:03:55.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.769300+0000", 2024-09-12T22:03:55.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9280000000000004e-06 2024-09-12T22:03:55.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.769310+0000", 2024-09-12T22:03:55.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0264e-05 2024-09-12T22:03:55.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.769316+0000", 2024-09-12T22:03:55.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4400000000000002e-06 2024-09-12T22:03:55.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.772021+0000", 2024-09-12T22:03:55.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027044980000000001 2024-09-12T22:03:55.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.772031+0000", 2024-09-12T22:03:55.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0481e-05 2024-09-12T22:03:55.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.777763+0000", 2024-09-12T22:03:55.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0057311250000000001 2024-09-12T22:03:55.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.777789+0000", 2024-09-12T22:03:55.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6537e-05 2024-09-12T22:03:55.429 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.429 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.429 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.429 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4138.0:137 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'95, mlcod=11'89)", 2024-09-12T22:03:55.429 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:23.769716+0000", 2024-09-12T22:03:55.430 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 31.647532220999999, 2024-09-12T22:03:55.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0080945749999999997, 2024-09-12T22:03:55.430 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.430 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.430 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.430 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.769716+0000", 2024-09-12T22:03:55.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.769716+0000", 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.769716+0000", 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.99e-07 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.769744+0000", 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7838999999999999e-05 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.769756+0000", 2024-09-12T22:03:55.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.208e-05 2024-09-12T22:03:55.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.432 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.769762+0000", 2024-09-12T22:03:55.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2199999999999997e-06 2024-09-12T22:03:55.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.432 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.772277+0000", 2024-09-12T22:03:55.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025145480000000001 2024-09-12T22:03:55.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.772288+0000", 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1354e-05 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.777791+0000", 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0055023379999999998 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:23.777810+0000", 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9497e-05 2024-09-12T22:03:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.451393+0000", 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.965854663000002, 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012754669999999999, 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451393+0000", 2024-09-12T22:03:55.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451393+0000", 2024-09-12T22:03:55.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451408+0000", 2024-09-12T22:03:55.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5079000000000001e-05 2024-09-12T22:03:55.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451417+0000", 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5299999999999996e-06 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451429+0000", 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2628e-05 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451444+0000", 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5105e-05 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452220+0000", 2024-09-12T22:03:55.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077575300000000001 2024-09-12T22:03:55.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452529+0000", 2024-09-12T22:03:55.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00030873899999999999 2024-09-12T22:03:55.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:55.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452963+0000", 2024-09-12T22:03:55.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00043367699999999999 2024-09-12T22:03:55.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455843+0000", 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028807049999999999 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464032+0000", 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0081885159999999999 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464086+0000", 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4549999999999998e-05 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.439 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.439 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464148+0000", 2024-09-12T22:03:55.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1388000000000002e-05 2024-09-12T22:03:55.439 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.439 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.439 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.439 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:55.439 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452091+0000", 2024-09-12T22:03:55.439 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.965157114, 2024-09-12T22:03:55.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012037842, 2024-09-12T22:03:55.439 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.439 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.440 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.440 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.440 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452091+0000", 2024-09-12T22:03:55.440 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.440 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452091+0000", 2024-09-12T22:03:55.440 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452092+0000", 2024-09-12T22:03:55.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0899999999999999e-06 2024-09-12T22:03:55.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452100+0000", 2024-09-12T22:03:55.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3499999999999997e-06 2024-09-12T22:03:55.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452112+0000", 2024-09-12T22:03:55.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1584e-05 2024-09-12T22:03:55.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.442 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452121+0000", 2024-09-12T22:03:55.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8740000000000001e-06 2024-09-12T22:03:55.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.442 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452714+0000", 2024-09-12T22:03:55.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00059324400000000004 2024-09-12T22:03:55.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.442 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452838+0000", 2024-09-12T22:03:55.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012385299999999999 2024-09-12T22:03:55.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.443 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:55.443 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.453222+0000", 2024-09-12T22:03:55.443 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00038446699999999999 2024-09-12T22:03:55.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.443 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.443 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456140+0000", 2024-09-12T22:03:55.443 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0029179190000000002 2024-09-12T22:03:55.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.443 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.443 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464060+0000", 2024-09-12T22:03:55.444 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0079196160000000008 2024-09-12T22:03:55.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.444 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.444 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464089+0000", 2024-09-12T22:03:55.444 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9431e-05 2024-09-12T22:03:55.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.444 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.444 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464128+0000", 2024-09-12T22:03:55.444 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9413999999999999e-05 2024-09-12T22:03:55.444 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.444 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.444 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.445 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:55.445 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452136+0000", 2024-09-12T22:03:55.445 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.965111536999999, 2024-09-12T22:03:55.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.008428662, 2024-09-12T22:03:55.445 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.445 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.445 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.445 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.445 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.445 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452136+0000", 2024-09-12T22:03:55.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452136+0000", 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452137+0000", 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.37e-07 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452141+0000", 2024-09-12T22:03:55.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8310000000000003e-06 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452148+0000", 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0319999999999998e-06 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452153+0000", 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6710000000000004e-06 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452523+0000", 2024-09-12T22:03:55.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000369952 2024-09-12T22:03:55.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452715+0000", 2024-09-12T22:03:55.448 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019143599999999999 2024-09-12T22:03:55.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:55.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452874+0000", 2024-09-12T22:03:55.448 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015903299999999999 2024-09-12T22:03:55.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455195+0000", 2024-09-12T22:03:55.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023215219999999999 2024-09-12T22:03:55.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.449 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.449 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.460292+0000", 2024-09-12T22:03:55.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0050970679999999997 2024-09-12T22:03:55.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.449 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.449 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.460442+0000", 2024-09-12T22:03:55.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000149233 2024-09-12T22:03:55.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.449 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.460565+0000", 2024-09-12T22:03:55.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012324699999999999 2024-09-12T22:03:55.450 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.450 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.450 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.450 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:55.450 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:03:55.450 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.964985116000001, 2024-09-12T22:03:55.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012474654999999999, 2024-09-12T22:03:55.450 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.450 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.450 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.451 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:03:55.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:03:55.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:03:55.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1500000000000003e-07 2024-09-12T22:03:55.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452268+0000", 2024-09-12T22:03:55.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8640000000000004e-06 2024-09-12T22:03:55.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452311+0000", 2024-09-12T22:03:55.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2255000000000001e-05 2024-09-12T22:03:55.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.453 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452326+0000", 2024-09-12T22:03:55.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5209e-05 2024-09-12T22:03:55.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.453 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.453 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455447+0000", 2024-09-12T22:03:55.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031213209999999998 2024-09-12T22:03:55.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.453 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.453 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455502+0000", 2024-09-12T22:03:55.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4925e-05 2024-09-12T22:03:55.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455592+0000", 2024-09-12T22:03:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9850000000000002e-05 2024-09-12T22:03:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.457408+0000", 2024-09-12T22:03:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001816018 2024-09-12T22:03:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464635+0000", 2024-09-12T22:03:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0072269350000000003 2024-09-12T22:03:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464682+0000", 2024-09-12T22:03:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7308000000000002e-05 2024-09-12T22:03:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464737+0000", 2024-09-12T22:03:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5155000000000003e-05 2024-09-12T22:03:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.456 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:55.456 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452345+0000", 2024-09-12T22:03:55.456 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.964902889000001, 2024-09-12T22:03:55.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012534264, 2024-09-12T22:03:55.456 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.456 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.456 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.456 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452345+0000", 2024-09-12T22:03:55.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452345+0000", 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452346+0000", 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.212e-06 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452352+0000", 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1850000000000001e-06 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452362+0000", 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6209999999999999e-06 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452380+0000", 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7909000000000001e-05 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455611+0000", 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032308889999999998 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455675+0000", 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4783999999999995e-05 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455866+0000", 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019059900000000001 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.457440+0000", 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015739269999999999 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464782+0000", 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0073417100000000004 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464835+0000", 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3709999999999999e-05 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464879+0000", 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3717999999999997e-05 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.461 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:55.461 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452394+0000", 2024-09-12T22:03:55.461 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.964853517999998, 2024-09-12T22:03:55.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0085960529999999993, 2024-09-12T22:03:55.461 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.461 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.461 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.461 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452394+0000", 2024-09-12T22:03:55.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452394+0000", 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452395+0000", 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0800000000000004e-07 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452400+0000", 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1909999999999999e-06 2024-09-12T22:03:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452408+0000", 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0069999999999997e-06 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452427+0000", 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8473000000000001e-05 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.453465+0000", 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0010385430000000001 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.453548+0000", 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2596000000000007e-05 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.453682+0000", 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000134704 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455889+0000", 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022067269999999999 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.460903+0000", 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0050141220000000002 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.460950+0000", 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6859e-05 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.460990+0000", 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0123000000000002e-05 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.465 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452540+0000", 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.964707284999999, 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012490559, 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452540+0000", 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452540+0000", 2024-09-12T22:03:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452541+0000", 2024-09-12T22:03:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1299999999999999e-07 2024-09-12T22:03:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452546+0000", 2024-09-12T22:03:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.758e-06 2024-09-12T22:03:55.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452561+0000", 2024-09-12T22:03:55.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.541e-05 2024-09-12T22:03:55.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452570+0000", 2024-09-12T22:03:55.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4309999999999994e-06 2024-09-12T22:03:55.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456142+0000", 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035725409999999998 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456258+0000", 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115728 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456384+0000", 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125506 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.459667+0000", 2024-09-12T22:03:55.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032833129999999999 2024-09-12T22:03:55.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464968+0000", 2024-09-12T22:03:55.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005300941 2024-09-12T22:03:55.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.465004+0000", 2024-09-12T22:03:55.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6606999999999997e-05 2024-09-12T22:03:55.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.465031+0000", 2024-09-12T22:03:55.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6611e-05 2024-09-12T22:03:55.471 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.471 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.471 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.471 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:55.471 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452584+0000", 2024-09-12T22:03:55.471 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.964663862999998, 2024-09-12T22:03:55.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011678836999999999, 2024-09-12T22:03:55.471 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.471 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.471 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:03:55.471 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.472 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452584+0000", 2024-09-12T22:03:55.472 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.472 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452584+0000", 2024-09-12T22:03:55.472 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.472 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452584+0000", 2024-09-12T22:03:55.472 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.82e-07 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452588+0000", 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3069999999999998e-06 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452596+0000", 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2290000000000003e-06 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452603+0000", 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0690000000000004e-06 2024-09-12T22:03:55.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452704+0000", 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000101339 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452799+0000", 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4920999999999995e-05 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464263+0000", 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.01146339 2024-09-12T22:03:55.474 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5133 5.e 5:731a25e2:::benchmark_data_smithi043_32659_object5132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.987886+0000", 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.42936197199999998, 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.01358233, 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.475 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5133 2024-09-12T22:03:55.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.476 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987886+0000", 2024-09-12T22:03:55.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987886+0000", 2024-09-12T22:03:55.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987887+0000", 2024-09-12T22:03:55.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:03:55.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987988+0000", 2024-09-12T22:03:55.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000101266 2024-09-12T22:03:55.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987996+0000", 2024-09-12T22:03:55.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:03:55.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988002+0000", 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8080000000000001e-06 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988196+0000", 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019422999999999999 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988298+0000", 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010208999999999999 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988420+0000", 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012256499999999999 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989796+0000", 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001375743 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001390+0000", 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011594089 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001433+0000", 2024-09-12T22:03:55.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2420999999999999e-05 2024-09-12T22:03:55.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.480 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.480 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001468+0000", 2024-09-12T22:03:55.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5423999999999998e-05 2024-09-12T22:03:55.480 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.480 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.480 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.480 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5136 5.b 5:de031c2e:::benchmark_data_smithi043_32659_object5135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:55.480 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.988747+0000", 2024-09-12T22:03:55.481 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.428500942, 2024-09-12T22:03:55.481 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013407914999999999, 2024-09-12T22:03:55.481 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.481 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.481 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:55.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:55.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.481 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5136 2024-09-12T22:03:55.481 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.481 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.481 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.481 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.481 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988747+0000", 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988747+0000", 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988748+0000", 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988848+0000", 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000100355 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988860+0000", 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1719000000000001e-05 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988867+0000", 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0690000000000004e-06 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988917+0000", 2024-09-12T22:03:55.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9777000000000001e-05 2024-09-12T22:03:55.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989021+0000", 2024-09-12T22:03:55.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010412300000000001 2024-09-12T22:03:55.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:55.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989093+0000", 2024-09-12T22:03:55.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1958999999999993e-05 2024-09-12T22:03:55.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991058+0000", 2024-09-12T22:03:55.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019651349999999998 2024-09-12T22:03:55.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002073+0000", 2024-09-12T22:03:55.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011014990000000001 2024-09-12T22:03:55.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002117+0000", 2024-09-12T22:03:55.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4317000000000003e-05 2024-09-12T22:03:55.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002155+0000", 2024-09-12T22:03:55.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7524999999999997e-05 2024-09-12T22:03:55.486 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.486 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.486 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.486 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5137 5.e 5:76ceaa0c:::benchmark_data_smithi043_32659_object5136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:55.486 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.988884+0000", 2024-09-12T22:03:55.486 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.428363418, 2024-09-12T22:03:55.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013010671, 2024-09-12T22:03:55.486 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.487 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.487 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.487 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:55.487 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:55.487 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.487 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5137 2024-09-12T22:03:55.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.487 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.487 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.487 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988884+0000", 2024-09-12T22:03:55.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988884+0000", 2024-09-12T22:03:55.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988885+0000", 2024-09-12T22:03:55.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4000000000000001e-07 2024-09-12T22:03:55.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988914+0000", 2024-09-12T22:03:55.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8912999999999999e-05 2024-09-12T22:03:55.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988923+0000", 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.67e-06 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988945+0000", 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2677e-05 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988993+0000", 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7497999999999998e-05 2024-09-12T22:03:55.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989109+0000", 2024-09-12T22:03:55.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011662099999999999 2024-09-12T22:03:55.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:55.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989264+0000", 2024-09-12T22:03:55.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015485 2024-09-12T22:03:55.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990950+0000", 2024-09-12T22:03:55.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0016853930000000001 2024-09-12T22:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001809+0000", 2024-09-12T22:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010859818 2024-09-12T22:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001863+0000", 2024-09-12T22:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3736000000000002e-05 2024-09-12T22:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001895+0000", 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1854999999999999e-05 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5138 5.b 5:d969c28c:::benchmark_data_smithi043_32659_object5137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.989883+0000", 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.42736511199999999, 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012360691, 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:55.492 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:55.493 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.493 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5138 2024-09-12T22:03:55.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.493 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989883+0000", 2024-09-12T22:03:55.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989883+0000", 2024-09-12T22:03:55.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989884+0000", 2024-09-12T22:03:55.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8999999999999995e-07 2024-09-12T22:03:55.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990012+0000", 2024-09-12T22:03:55.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000128245 2024-09-12T22:03:55.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990022+0000", 2024-09-12T22:03:55.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.927e-06 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990029+0000", 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3610000000000003e-06 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990112+0000", 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3323000000000002e-05 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990249+0000", 2024-09-12T22:03:55.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013706499999999999 2024-09-12T22:03:55.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:55.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990426+0000", 2024-09-12T22:03:55.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017672599999999999 2024-09-12T22:03:55.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991995+0000", 2024-09-12T22:03:55.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015690579999999999 2024-09-12T22:03:55.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002163+0000", 2024-09-12T22:03:55.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010167697 2024-09-12T22:03:55.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002207+0000", 2024-09-12T22:03:55.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4030999999999999e-05 2024-09-12T22:03:55.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002243+0000", 2024-09-12T22:03:55.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6368000000000001e-05 2024-09-12T22:03:55.497 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.497 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.497 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5141 5.e 5:733a9c59:::benchmark_data_smithi043_32659_object5140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.990266+0000", 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.42698192499999998, 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011697701, 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5141 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.498 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990266+0000", 2024-09-12T22:03:55.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990266+0000", 2024-09-12T22:03:55.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990267+0000", 2024-09-12T22:03:55.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5799999999999998e-07 2024-09-12T22:03:55.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990333+0000", 2024-09-12T22:03:55.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6358000000000004e-05 2024-09-12T22:03:55.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990343+0000", 2024-09-12T22:03:55.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5750000000000007e-06 2024-09-12T22:03:55.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990349+0000", 2024-09-12T22:03:55.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6880000000000002e-06 2024-09-12T22:03:55.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990386+0000", 2024-09-12T22:03:55.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6918999999999997e-05 2024-09-12T22:03:55.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990474+0000", 2024-09-12T22:03:55.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7978000000000004e-05 2024-09-12T22:03:55.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:55.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990588+0000", 2024-09-12T22:03:55.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000113677 2024-09-12T22:03:55.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991952+0000", 2024-09-12T22:03:55.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0013635520000000001 2024-09-12T22:03:55.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001901+0000", 2024-09-12T22:03:55.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0099496159999999997 2024-09-12T22:03:55.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001936+0000", 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5163999999999997e-05 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001964+0000", 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7216000000000002e-05 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5144 5.b 5:db6bc9e3:::benchmark_data_smithi043_32659_object5143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:55.503 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.990487+0000", 2024-09-12T22:03:55.504 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.426760325, 2024-09-12T22:03:55.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011864091, 2024-09-12T22:03:55.504 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.504 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.504 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.504 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:55.504 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:55.504 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.504 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5144 2024-09-12T22:03:55.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.504 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990487+0000", 2024-09-12T22:03:55.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990487+0000", 2024-09-12T22:03:55.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990488+0000", 2024-09-12T22:03:55.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.99e-07 2024-09-12T22:03:55.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990549+0000", 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0695000000000001e-05 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990558+0000", 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.935e-06 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990564+0000", 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2840000000000003e-06 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991093+0000", 2024-09-12T22:03:55.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00052932999999999995 2024-09-12T22:03:55.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991188+0000", 2024-09-12T22:03:55.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4613999999999999e-05 2024-09-12T22:03:55.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:55.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991265+0000", 2024-09-12T22:03:55.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7171999999999999e-05 2024-09-12T22:03:55.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.992545+0000", 2024-09-12T22:03:55.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012794379999999999 2024-09-12T22:03:55.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002259+0000", 2024-09-12T22:03:55.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0097143060000000007 2024-09-12T22:03:55.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002306+0000", 2024-09-12T22:03:55.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7017000000000001e-05 2024-09-12T22:03:55.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.509 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002352+0000", 2024-09-12T22:03:55.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5600999999999999e-05 2024-09-12T22:03:55.509 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.509 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.509 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.509 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5152 5.e 5:716f8568:::benchmark_data_smithi043_32659_object5151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:55.509 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.992678+0000", 2024-09-12T22:03:55.509 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.424569378, 2024-09-12T22:03:55.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093589220000000004, 2024-09-12T22:03:55.509 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5152 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.992678+0000", 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.992678+0000", 2024-09-12T22:03:55.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.992679+0000", 2024-09-12T22:03:55.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:03:55.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.992767+0000", 2024-09-12T22:03:55.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8150000000000001e-05 2024-09-12T22:03:55.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.992774+0000", 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6590000000000001e-06 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.992778+0000", 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9639999999999997e-06 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.992819+0000", 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.992922+0000", 2024-09-12T22:03:55.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010333 2024-09-12T22:03:55.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:55.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.993043+0000", 2024-09-12T22:03:55.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012016299999999999 2024-09-12T22:03:55.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.994341+0000", 2024-09-12T22:03:55.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012983879999999999 2024-09-12T22:03:55.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001970+0000", 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.007628658 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002006+0000", 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6115000000000002e-05 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002037+0000", 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1609000000000002e-05 2024-09-12T22:03:55.514 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.515 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.515 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.515 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5160 5.e 5:7d07a572:::benchmark_data_smithi043_32659_object5159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:55.515 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.994266+0000", 2024-09-12T22:03:55.515 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.422981363, 2024-09-12T22:03:55.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0078595049999999993, 2024-09-12T22:03:55.515 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.515 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.515 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.515 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:55.515 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:55.515 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.516 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5160 2024-09-12T22:03:55.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.516 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.516 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.516 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.994266+0000", 2024-09-12T22:03:55.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.516 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.516 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.994266+0000", 2024-09-12T22:03:55.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.994267+0000", 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.61e-07 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.994400+0000", 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000132924 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.994410+0000", 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.73e-06 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.994417+0000", 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000002e-06 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.994457+0000", 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9762000000000003e-05 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.994534+0000", 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7013000000000003e-05 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.994612+0000", 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7896000000000001e-05 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.995510+0000", 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00089827699999999995 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002043+0000", 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0065335740000000003 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002094+0000", 2024-09-12T22:03:55.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0940999999999999e-05 2024-09-12T22:03:55.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002126+0000", 2024-09-12T22:03:55.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1576999999999999e-05 2024-09-12T22:03:55.520 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.520 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.520 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.520 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:6959 5.e 5:7c15ba9e:::benchmark_data_smithi043_32659_object6958:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T22:03:55.521 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:55.291271+0000", 2024-09-12T22:03:55.521 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.12597641800000001, 2024-09-12T22:03:55.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010522482, 2024-09-12T22:03:55.521 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:55.521 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:55.521 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:55.521 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:55.521 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:55.521 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.521 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 6959 2024-09-12T22:03:55.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.521 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:55.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291271+0000", 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291271+0000", 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291272+0000", 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6400000000000001e-07 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291301+0000", 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8776999999999999e-05 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291311+0000", 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0261000000000001e-05 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291318+0000", 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.63e-06 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:55.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291437+0000", 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119337 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291599+0000", 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016229699999999999 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291739+0000", 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013980899999999999 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.293218+0000", 2024-09-12T22:03:55.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014792189999999999 2024-09-12T22:03:55.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:55.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.301697+0000", 2024-09-12T22:03:55.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0084787200000000004 2024-09-12T22:03:55.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:55.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.301750+0000", 2024-09-12T22:03:55.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2914000000000002e-05 2024-09-12T22:03:55.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:55.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:55.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:55.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.301794+0000", 2024-09-12T22:03:55.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3754000000000002e-05 2024-09-12T22:03:55.526 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.526 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.526 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.526 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:55.526 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:55.526 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:03:55.527 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:03:55.528 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:55.526+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:55.595 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-09-12T22:03:55.628 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:55.627+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:55.708 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:03:55.708 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T22:03:55.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.708 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:9309 5.2 e25/22 5:4938794d:::benchmark_data_smithi043_32659_object9308:head v 25'599, mlcod=25'597)", 2024-09-12T22:03:55.708 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:55.705724+0000", 2024-09-12T22:03:55.709 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00073972899999999995, 2024-09-12T22:03:55.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076233099999999999, 2024-09-12T22:03:55.709 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:55.709 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:55.709 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:55.709 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:55.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:55.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705724+0000", 2024-09-12T22:03:55.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:55.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705724+0000", 2024-09-12T22:03:55.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:55.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705725+0000", 2024-09-12T22:03:55.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.85e-07 2024-09-12T22:03:55.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:55.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705787+0000", 2024-09-12T22:03:55.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1990999999999997e-05 2024-09-12T22:03:55.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705832+0000", 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5089999999999997e-05 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705851+0000", 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8924999999999999e-05 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705907+0000", 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5702000000000003e-05 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:55.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705924+0000", 2024-09-12T22:03:55.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6858e-05 2024-09-12T22:03:55.712 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.712 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:55.712 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.712 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:9310 5.7 e25/22 5:e9d51a80:::benchmark_data_smithi043_32659_object9309:head v 25'586, mlcod=25'584)", 2024-09-12T22:03:55.712 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:55.705881+0000", 2024-09-12T22:03:55.712 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00058316399999999995, 2024-09-12T22:03:55.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000672677, 2024-09-12T22:03:55.712 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:55.712 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:55.713 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:55.713 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:55.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:55.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705881+0000", 2024-09-12T22:03:55.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:55.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705881+0000", 2024-09-12T22:03:55.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705881+0000", 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2199999999999999e-07 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705941+0000", 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9997000000000002e-05 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705950+0000", 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1859999999999992e-06 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705955+0000", 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8660000000000002e-06 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706009+0000", 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3551999999999998e-05 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706025+0000", 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5627000000000001e-05 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:55.715 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.716 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:9308 5.4 e25/22 5:2d783149:::benchmark_data_smithi043_32659_object9307:head v 25'590, mlcod=25'588)", 2024-09-12T22:03:55.716 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:55.705784+0000", 2024-09-12T22:03:55.716 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00068048399999999997, 2024-09-12T22:03:55.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00083667500000000005, 2024-09-12T22:03:55.716 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:55.716 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:55.716 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:55.716 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:55.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:55.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705784+0000", 2024-09-12T22:03:55.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:55.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705784+0000", 2024-09-12T22:03:55.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:55.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705784+0000", 2024-09-12T22:03:55.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0200000000000001e-07 2024-09-12T22:03:55.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:55.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705996+0000", 2024-09-12T22:03:55.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021166499999999999 2024-09-12T22:03:55.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:55.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706006+0000", 2024-09-12T22:03:55.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.577e-06 2024-09-12T22:03:55.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706011+0000", 2024-09-12T22:03:55.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5609999999999998e-06 2024-09-12T22:03:55.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.718 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706120+0000", 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109267 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706155+0000", 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4513e-05 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:9313 5.1 e25/22 5:8f55dcc1:::benchmark_data_smithi043_32659_object9312:head v 25'534, mlcod=25'532)", 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:55.705983+0000", 2024-09-12T22:03:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.000481056, 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00070609299999999998, 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705983+0000", 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705983+0000", 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:55.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705984+0000", 2024-09-12T22:03:55.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:03:55.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:55.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706049+0000", 2024-09-12T22:03:55.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5843e-05 2024-09-12T22:03:55.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:55.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706058+0000", 2024-09-12T22:03:55.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5210000000000002e-06 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706063+0000", 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.468e-06 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706107+0000", 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4088999999999997e-05 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706126+0000", 2024-09-12T22:03:55.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8388000000000001e-05 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:9311 5.0 e25/22 5:04547aba:::benchmark_data_smithi043_32659_object9310:head v 25'533, mlcod=25'531)", 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:55.706028+0000", 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00043610600000000002, 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00073214700000000005, 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:55.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706028+0000", 2024-09-12T22:03:55.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:55.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706028+0000", 2024-09-12T22:03:55.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:55.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706028+0000", 2024-09-12T22:03:55.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2100000000000002e-07 2024-09-12T22:03:55.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706055+0000", 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6508000000000001e-05 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706062+0000", 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6660000000000002e-06 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706066+0000", 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.622e-06 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:55.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706113+0000", 2024-09-12T22:03:55.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6675999999999998e-05 2024-09-12T22:03:55.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:55.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706131+0000", 2024-09-12T22:03:55.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.821e-05 2024-09-12T22:03:55.726 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.726 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:55.726 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.726 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:9306 5.b e25/22)", 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:55.706602+0000", 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9998622, 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022305799999999999, 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706602+0000", 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:55.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706602+0000", 2024-09-12T22:03:55.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:55.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706603+0000", 2024-09-12T22:03:55.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0200000000000002e-07 2024-09-12T22:03:55.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:55.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706637+0000", 2024-09-12T22:03:55.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4625999999999997e-05 2024-09-12T22:03:55.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706647+0000", 2024-09-12T22:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8400000000000007e-06 2024-09-12T22:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706655+0000", 2024-09-12T22:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6830000000000008e-06 2024-09-12T22:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:9316 5.8 e25/22 5:10086ee3:::benchmark_data_smithi043_32659_object9315:head v 25'594, mlcod=25'592)", 2024-09-12T22:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:55.706675+0000", 2024-09-12T22:03:55.730 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9997888, 2024-09-12T22:03:55.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000208395, 2024-09-12T22:03:55.730 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:55.730 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:55.730 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:55.730 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:55.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:55.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706675+0000", 2024-09-12T22:03:55.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:55.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706675+0000", 2024-09-12T22:03:55.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:55.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706676+0000", 2024-09-12T22:03:55.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3599999999999999e-07 2024-09-12T22:03:55.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:55.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706709+0000", 2024-09-12T22:03:55.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3127999999999999e-05 2024-09-12T22:03:55.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706720+0000", 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.081e-05 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706726+0000", 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7150000000000003e-06 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706770+0000", 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4295000000000002e-05 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:55.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706788+0000", 2024-09-12T22:03:55.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7785e-05 2024-09-12T22:03:55.733 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.733 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:55.733 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.733 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:9312 5.7 e25/22 5:ed1337db:::benchmark_data_smithi043_32659_object9311:head v 25'587, mlcod=25'584)", 2024-09-12T22:03:55.733 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:55.706667+0000", 2024-09-12T22:03:55.733 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9997978, 2024-09-12T22:03:55.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000273811, 2024-09-12T22:03:55.733 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:55.733 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:55.733 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:55.734 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:55.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:55.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706667+0000", 2024-09-12T22:03:55.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:55.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706667+0000", 2024-09-12T22:03:55.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:55.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706667+0000", 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0200000000000001e-07 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706718+0000", 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1099e-05 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706732+0000", 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3264e-05 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706738+0000", 2024-09-12T22:03:55.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9229999999999999e-06 2024-09-12T22:03:55.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:55.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706781+0000", 2024-09-12T22:03:55.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3441e-05 2024-09-12T22:03:55.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:55.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706793+0000", 2024-09-12T22:03:55.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2371999999999999e-05 2024-09-12T22:03:55.736 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.736 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:55.737 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.737 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop_reply(client.4514.0:9304 5.a e25/22)", 2024-09-12T22:03:55.737 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:55.706739+0000", 2024-09-12T22:03:55.737 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9997253, 2024-09-12T22:03:55.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026082699999999999, 2024-09-12T22:03:55.737 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:55.737 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:55.737 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T22:03:55.737 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:55.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:55.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706739+0000", 2024-09-12T22:03:55.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:55.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706739+0000", 2024-09-12T22:03:55.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:55.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706739+0000", 2024-09-12T22:03:55.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:03:55.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:55.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706742+0000", 2024-09-12T22:03:55.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5660000000000001e-06 2024-09-12T22:03:55.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:55.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706748+0000", 2024-09-12T22:03:55.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6089999999999997e-06 2024-09-12T22:03:55.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706754+0000", 2024-09-12T22:03:55.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3199999999999999e-06 2024-09-12T22:03:55.740 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.740 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:55.740 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.740 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:9304 5.a 5:50cff4ad:::benchmark_data_smithi043_32659_object9303:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T22:03:55.740 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:55.704931+0000", 2024-09-12T22:03:55.740 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.001533146, 2024-09-12T22:03:55.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021311350000000001, 2024-09-12T22:03:55.740 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 9304 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.704931+0000", 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:55.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.704931+0000", 2024-09-12T22:03:55.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:55.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.704932+0000", 2024-09-12T22:03:55.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6200000000000006e-07 2024-09-12T22:03:55.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:55.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705071+0000", 2024-09-12T22:03:55.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000139097 2024-09-12T22:03:55.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:55.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705082+0000", 2024-09-12T22:03:55.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0784999999999999e-05 2024-09-12T22:03:55.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705089+0000", 2024-09-12T22:03:55.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3339999999999996e-06 2024-09-12T22:03:55.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:55.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705209+0000", 2024-09-12T22:03:55.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120029 2024-09-12T22:03:55.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:55.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705305+0000", 2024-09-12T22:03:55.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5617000000000003e-05 2024-09-12T22:03:55.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:55.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705414+0000", 2024-09-12T22:03:55.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000108775 2024-09-12T22:03:55.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:55.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706972+0000", 2024-09-12T22:03:55.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015585219999999999 2024-09-12T22:03:55.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.707052+0000", 2024-09-12T22:03:55.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9726000000000002e-05 2024-09-12T22:03:55.745 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.745 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:55.745 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.745 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:9314 5.6 5:69439cc1:::benchmark_data_smithi043_32659_object9313:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T22:03:55.745 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:55.705530+0000", 2024-09-12T22:03:55.745 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00093435600000000001, 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001625633, 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 9314 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705530+0000", 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705530+0000", 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705531+0000", 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705596+0000", 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5536000000000004e-05 2024-09-12T22:03:55.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705605+0000", 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8699999999999998e-06 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705610+0000", 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9989999999999999e-06 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705655+0000", 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:03:55.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:55.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705754+0000", 2024-09-12T22:03:55.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9099999999999996e-05 2024-09-12T22:03:55.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:55.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705888+0000", 2024-09-12T22:03:55.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000133647 2024-09-12T22:03:55.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:55.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.706982+0000", 2024-09-12T22:03:55.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010941569999999999 2024-09-12T22:03:55.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.750 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:55.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.750 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:9315 5.a 5:56b6c2e3:::benchmark_data_smithi043_32659_object9314:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T22:03:55.750 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:55.705623+0000", 2024-09-12T22:03:55.750 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00084086100000000004, 2024-09-12T22:03:55.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001607743, 2024-09-12T22:03:55.750 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:55.750 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:55.750 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:55.750 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:55.750 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 9315 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705623+0000", 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705623+0000", 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:55.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705624+0000", 2024-09-12T22:03:55.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0900000000000001e-07 2024-09-12T22:03:55.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:55.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705682+0000", 2024-09-12T22:03:55.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8474000000000003e-05 2024-09-12T22:03:55.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:55.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705690+0000", 2024-09-12T22:03:55.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.267e-06 2024-09-12T22:03:55.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705693+0000", 2024-09-12T22:03:55.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8210000000000003e-06 2024-09-12T22:03:55.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:55.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705750+0000", 2024-09-12T22:03:55.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6743999999999997e-05 2024-09-12T22:03:55.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:55.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705834+0000", 2024-09-12T22:03:55.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3344999999999996e-05 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705936+0000", 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102422 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:9305 5.b e25/22 5:da3fc920:::benchmark_data_smithi043_32659_object9304:head v 25'606, mlcod=25'604)", 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:55.705646+0000", 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00081824199999999995, 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016518150000000001, 2024-09-12T22:03:55.754 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705646+0000", 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705646+0000", 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:55.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705646+0000", 2024-09-12T22:03:55.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.68e-07 2024-09-12T22:03:55.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:55.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705719+0000", 2024-09-12T22:03:55.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2502999999999993e-05 2024-09-12T22:03:55.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:55.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705724+0000", 2024-09-12T22:03:55.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7979999999999996e-06 2024-09-12T22:03:55.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705727+0000", 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.208e-06 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705764+0000", 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7230000000000001e-05 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:55.705777+0000", 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2811e-05 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.757 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:55.758 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.758 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:55.758 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T22:03:55.758 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 13 2024-09-12T22:03:55.758 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:03:55.759 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:55.758+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:55.760 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T22:03:55.760 INFO:teuthology.orchestra.run.smithi043.stdout: "ops": [ 2024-09-12T22:03:55.760 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.760 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9486, 2024-09-12T22:03:55.760 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.67389fd6", 2024-09-12T22:03:55.760 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-09-12T22:03:55.761 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9485", 2024-09-12T22:03:55.761 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.761 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9485", 2024-09-12T22:03:55.761 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.761 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.761 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.761 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.761 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.167999s", 2024-09-12T22:03:55.761 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0029999639999999999, 2024-09-12T22:03:55.761 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.761 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.761 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.761 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.737340+0000", 2024-09-12T22:03:55.761 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.762 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.762 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.762 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.762 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.762 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.762 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9491, 2024-09-12T22:03:55.762 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.8753ad95", 2024-09-12T22:03:55.762 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-09-12T22:03:55.762 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9490", 2024-09-12T22:03:55.762 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.762 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9490", 2024-09-12T22:03:55.762 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.762 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.762 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.168999s", 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0019999760000000001, 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.737883+0000", 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9497, 2024-09-12T22:03:55.763 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.e071f933", 2024-09-12T22:03:55.764 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-09-12T22:03:55.764 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9496", 2024-09-12T22:03:55.764 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.764 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9496", 2024-09-12T22:03:55.764 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.764 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.764 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.764 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.764 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.170999s", 2024-09-12T22:03:55.764 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0, 2024-09-12T22:03:55.764 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.764 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.764 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.765 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.739700+0000", 2024-09-12T22:03:55.765 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.765 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.765 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.765 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.765 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.765 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.765 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9498, 2024-09-12T22:03:55.765 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.e06c351c", 2024-09-12T22:03:55.765 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-09-12T22:03:55.765 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9497", 2024-09-12T22:03:55.765 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.765 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9497", 2024-09-12T22:03:55.765 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.766 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.766 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.766 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.766 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.170999s", 2024-09-12T22:03:55.766 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0, 2024-09-12T22:03:55.766 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.766 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.766 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.766 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.739811+0000", 2024-09-12T22:03:55.766 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.766 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.766 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.766 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.766 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9499, 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.4a626525", 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9498", 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9498", 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.170999s", 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.00099998800000000005, 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.767 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.768 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.768 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.739823+0000", 2024-09-12T22:03:55.768 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.768 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.768 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.768 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.768 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.768 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.768 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9484, 2024-09-12T22:03:55.768 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.a39dc5b2", 2024-09-12T22:03:55.768 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-09-12T22:03:55.768 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9483", 2024-09-12T22:03:55.768 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.768 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9483", 2024-09-12T22:03:55.769 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.769 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.769 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.769 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.769 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.167999s", 2024-09-12T22:03:55.769 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0039999520000000002, 2024-09-12T22:03:55.769 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.769 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.769 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.769 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.737311+0000", 2024-09-12T22:03:55.769 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.769 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.769 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.769 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.770 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.770 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.770 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9500, 2024-09-12T22:03:55.770 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.455b879f", 2024-09-12T22:03:55.770 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-09-12T22:03:55.770 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9499", 2024-09-12T22:03:55.770 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.770 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9499", 2024-09-12T22:03:55.770 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.770 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.770 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.770 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.770 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.170999s", 2024-09-12T22:03:55.770 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.00099998800000000005, 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.740250+0000", 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9501, 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.d352e247", 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9500", 2024-09-12T22:03:55.771 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.772 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9500", 2024-09-12T22:03:55.772 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.772 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.772 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.772 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.772 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.170999s", 2024-09-12T22:03:55.772 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.00099998800000000005, 2024-09-12T22:03:55.772 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.772 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.772 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.772 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.740308+0000", 2024-09-12T22:03:55.772 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.772 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9488, 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.3b52ab5e", 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9487", 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9487", 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.773 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.168999s", 2024-09-12T22:03:55.774 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0029999639999999999, 2024-09-12T22:03:55.774 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.774 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.774 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.774 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.737704+0000", 2024-09-12T22:03:55.774 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.774 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.774 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.774 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.774 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.774 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.774 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9489, 2024-09-12T22:03:55.774 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.c9ff5c6e", 2024-09-12T22:03:55.774 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-09-12T22:03:55.775 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9488", 2024-09-12T22:03:55.775 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.775 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9488", 2024-09-12T22:03:55.775 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.775 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.775 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.775 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.775 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.168999s", 2024-09-12T22:03:55.775 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0029999639999999999, 2024-09-12T22:03:55.775 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.775 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.775 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.775 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.737804+0000", 2024-09-12T22:03:55.775 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.776 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.776 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.776 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.776 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.776 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.776 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9492, 2024-09-12T22:03:55.776 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.9a0f119b", 2024-09-12T22:03:55.776 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-09-12T22:03:55.776 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9491", 2024-09-12T22:03:55.776 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.776 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9491", 2024-09-12T22:03:55.776 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.776 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.776 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.777 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.777 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.168999s", 2024-09-12T22:03:55.777 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0029999639999999999, 2024-09-12T22:03:55.777 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.777 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.777 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.777 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.737941+0000", 2024-09-12T22:03:55.777 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.777 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.777 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.777 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.777 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.777 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9493, 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.37332678", 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9492", 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9492", 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.168999s", 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0029999639999999999, 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.778 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.779 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.738065+0000", 2024-09-12T22:03:55.779 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.779 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.779 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.779 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.779 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.779 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.779 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9494, 2024-09-12T22:03:55.779 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.375d52a8", 2024-09-12T22:03:55.779 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-09-12T22:03:55.779 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9493", 2024-09-12T22:03:55.779 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.779 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9493", 2024-09-12T22:03:55.779 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.780 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.780 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.780 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.780 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.168999s", 2024-09-12T22:03:55.780 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0029999639999999999, 2024-09-12T22:03:55.780 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.780 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.780 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.780 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.738474+0000", 2024-09-12T22:03:55.780 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.780 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.780 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.780 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.781 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.781 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.781 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9495, 2024-09-12T22:03:55.781 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.75dd703b", 2024-09-12T22:03:55.781 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-09-12T22:03:55.781 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9494", 2024-09-12T22:03:55.781 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.781 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9494", 2024-09-12T22:03:55.781 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.781 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.781 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.781 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.781 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.168999s", 2024-09-12T22:03:55.781 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0029999639999999999, 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.738527+0000", 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9496, 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.76d08594", 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9495", 2024-09-12T22:03:55.782 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9495", 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.169999s", 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0019999760000000001, 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.739595+0000", 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.783 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.784 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T22:03:55.784 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T22:03:55.784 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9502, 2024-09-12T22:03:55.784 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.3a5bcf5b", 2024-09-12T22:03:55.784 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-09-12T22:03:55.784 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_32659_object9501", 2024-09-12T22:03:55.784 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-09-12T22:03:55.784 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_32659_object9501", 2024-09-12T22:03:55.784 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-09-12T22:03:55.784 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-09-12T22:03:55.784 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-09-12T22:03:55.784 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-09-12T22:03:55.784 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "460.170999s", 2024-09-12T22:03:55.784 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.00099998800000000005, 2024-09-12T22:03:55.785 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-09-12T22:03:55.785 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-09-12T22:03:55.785 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-09-12T22:03:55.785 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-09-12T22:03:55.740315+0000", 2024-09-12T22:03:55.785 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-09-12T22:03:55.785 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T22:03:55.785 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-09-12T22:03:55.785 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T22:03:55.785 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T22:03:55.785 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T22:03:55.785 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_ops": [], 2024-09-12T22:03:55.785 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_ops": [], 2024-09-12T22:03:55.785 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_stat_ops": [], 2024-09-12T22:03:55.785 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_ops": [], 2024-09-12T22:03:55.786 INFO:teuthology.orchestra.run.smithi043.stdout: "command_ops": [] 2024-09-12T22:03:55.786 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T22:03:55.786 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:03:55.786 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 9486, "pg": "5.67389fd6", "osd": 0, "object_id": "benchmark_data_smithi043_32659_object9485", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9485", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.167999s", "age": 0.0029999639999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.737340+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9491, "pg": "5.8753ad95", "osd": 0, "object_id": "benchmark_data_smithi043_32659_object9490", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9490", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.168999s", "age": 0.0019999760000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.737883+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9497, "pg": "5.e071f933", "osd": 0, "object_id": "benchmark_data_smithi043_32659_object9496", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9496", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.170999s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.739700+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9498, "pg": "5.e06c351c", "osd": 0, "object_id": "benchmark_data_smithi043_32659_object9497", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9497", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.170999s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.739811+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9499, "pg": "5.4a626525", "osd": 0, "object_id": "benchmark_data_smithi043_32659_object9498", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9498", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.170999s", "age": 0.00099998800000000005, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.739823+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9484, "pg": "5.a39dc5b2", "osd": 1, "object_id": "benchmark_data_smithi043_32659_object9483", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9483", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.167999s", "age": 0.0039999520000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.737311+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9500, "pg": "5.455b879f", "osd": 1, "object_id": "benchmark_data_smithi043_32659_object9499", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9499", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.170999s", "age": 0.00099998800000000005, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.740250+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9501, "pg": "5.d352e247", "osd": 1, "object_id": "benchmark_data_smithi043_32659_object9500", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9500", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.170999s", "age": 0.00099998800000000005, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.740308+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9488, "pg": "5.3b52ab5e", "osd": 2, "object_id": "benchmark_data_smithi043_32659_object9487", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9487", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.168999s", "age": 0.0029999639999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.737704+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9489, "pg": "5.c9ff5c6e", "osd": 2, "object_id": "benchmark_data_smithi043_32659_object9488", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9488", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.168999s", "age": 0.0029999639999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.737804+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9492, "pg": "5.9a0f119b", "osd": 2, "object_id": "benchmark_data_smithi043_32659_object9491", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9491", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.168999s", "age": 0.0029999639999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.737941+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9493, "pg": "5.37332678", "osd": 2, "object_id": "benchmark_data_smithi043_32659_object9492", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9492", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.168999s", "age": 0.0029999639999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.738065+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9494, "pg": "5.375d52a8", "osd": 2, "object_id": "benchmark_data_smithi043_32659_object9493", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9493", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.168999s", "age": 0.0029999639999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.738474+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9495, "pg": "5.75dd703b", "osd": 2, "object_id": "benchmark_data_smithi043_32659_object9494", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9494", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.168999s", "age": 0.0029999639999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.738527+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9496, "pg": "5.76d08594", "osd": 2, "object_id": "benchmark_data_smithi043_32659_object9495", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9495", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.169999s", "age": 0.0019999760000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.739595+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9502, "pg": "5.3a5bcf5b", "osd": 2, "object_id": "benchmark_data_smithi043_32659_object9501", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_32659_object9501", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "460.170999s", "age": 0.00099998800000000005, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T22:03:55.740315+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-09-12T22:03:55.787 DEBUG:teuthology.orchestra.run.smithi043:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-09-12T22:03:55.787 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:03:55.831 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-09-12T22:03:55.860 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:55.859+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:55.887 DEBUG:teuthology.parallel:result is None 2024-09-12T22:03:55.887 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-09-12T22:03:55.896 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2024-09-12T22:03:55.896 INFO:teuthology.orchestra.run:waiting for 2100 2024-09-12T22:03:55.919 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-09-12T22:03:55.919 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:03:55.940 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:03:55.941 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:03:55.960 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:03:55.961 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:03:55.961 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:55.960+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:55.971 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:55.971 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:55.987 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:03:56.071 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:56.070+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:56.162 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:56.161+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:56.189 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 2 16 11775 11759 367.444 341.625 0.00180945 0.00271408 2024-09-12T22:03:56.195 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:56.195 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:56.209 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:03:56.264 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:56.263+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:56.359 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:56.359 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:56.364 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:56.363+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:56.371 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:03:56.465 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:56.464+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:56.566 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:56.564+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:56.568 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:56.568 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:56.582 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:03:56.667 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:56.665+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:56.731 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:56.731 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:56.744 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:03:56.785 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:56.784+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:56.869 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:56.868+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:56.892 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:56.892 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:56.904 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:03:56.970 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:56.969+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:57.045 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:03:57.053 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:57.053 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:57.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:03:57.108 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:57.107+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:57.171 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:57.170+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:57.189 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 3 16 16481 16465 342.997 294.125 0.00245732 0.00291146 2024-09-12T22:03:57.223 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:57.223 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:57.237 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:03:57.281 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:57.280+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:57.373 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:57.372+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:57.404 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:57.404 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:57.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:03:57.502 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:57.501+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:57.574 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:57.573+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:57.638 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:57.638 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:57.653 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:03:57.675 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:57.674+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:57.777 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:57.776+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:57.867 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:57.867 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:57.878 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:57.877+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:57.880 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:03:57.973 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:03:57.979 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:57.978+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:58.014 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-09-12T22:03:58.017 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:03:58.018 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:03:58.018 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-12T22:03:58.018 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T22:03:58.018 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T22:03:58.018 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-12T22:03:58.032 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:03:58.032 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:03:58.047 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:03:58.088 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:58.087+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:58.107 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-09-12T22:03:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:03:58.127 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:03:58.127 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:03:58.145 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:03:58.145 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:03:58.179 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:03:58.179 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T22:03:58.179 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:03:58.180 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:58.179+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:58.189 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 4 16 20792 20776 324.602 269.438 0.00250352 0.0030773 2024-09-12T22:03:58.245 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:03:58.246 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:03:58.246 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:03:58.246 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:03:58.246 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:03:58.259 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:03:58.304 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:58.303+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:58.381 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:58.381+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:58.411 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:03:58.412 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:03:58.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:03:58.412 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:03:58.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.412 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4138.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:03:58.412 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:23.765765+0000", 2024-09-12T22:03:58.412 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.642914939000001, 2024-09-12T22:03:58.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012658954, 2024-09-12T22:03:58.412 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.412 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.412 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.412 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:03:58.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4138", 2024-09-12T22:03:58.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/1234714031", 2024-09-12T22:03:58.413 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 140 2024-09-12T22:03:58.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.413 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.765765+0000", 2024-09-12T22:03:58.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.765765+0000", 2024-09-12T22:03:58.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.765765+0000", 2024-09-12T22:03:58.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3900000000000005e-07 2024-09-12T22:03:58.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.765840+0000", 2024-09-12T22:03:58.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4986000000000003e-05 2024-09-12T22:03:58.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.765846+0000", 2024-09-12T22:03:58.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1059999999999999e-06 2024-09-12T22:03:58.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.765849+0000", 2024-09-12T22:03:58.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.788e-06 2024-09-12T22:03:58.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.771078+0000", 2024-09-12T22:03:58.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.005228768 2024-09-12T22:03:58.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.771156+0000", 2024-09-12T22:03:58.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7570000000000004e-05 2024-09-12T22:03:58.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.771279+0000", 2024-09-12T22:03:58.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012297400000000001 2024-09-12T22:03:58.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.772208+0000", 2024-09-12T22:03:58.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092975700000000002 2024-09-12T22:03:58.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.778342+0000", 2024-09-12T22:03:58.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061337409999999998 2024-09-12T22:03:58.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.778389+0000", 2024-09-12T22:03:58.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7304e-05 2024-09-12T22:03:58.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:23.778424+0000", 2024-09-12T22:03:58.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4421000000000001e-05 2024-09-12T22:03:58.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.418 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.419 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.419 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:03:58.419 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.958956474000001, 2024-09-12T22:03:58.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018534981999999998, 2024-09-12T22:03:58.419 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.419 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.419 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.420 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:03:58.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:03:58.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449725+0000", 2024-09-12T22:03:58.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799999999999999e-06 2024-09-12T22:03:58.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449731+0000", 2024-09-12T22:03:58.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.801e-06 2024-09-12T22:03:58.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449745+0000", 2024-09-12T22:03:58.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4198e-05 2024-09-12T22:03:58.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449758+0000", 2024-09-12T22:03:58.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2858e-05 2024-09-12T22:03:58.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449815+0000", 2024-09-12T22:03:58.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6978999999999998e-05 2024-09-12T22:03:58.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:03:58.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:03:58.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2369999999999997e-06 2024-09-12T22:03:58.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457683+0000", 2024-09-12T22:03:58.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078622640000000008 2024-09-12T22:03:58.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457840+0000", 2024-09-12T22:03:58.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015715299999999999 2024-09-12T22:03:58.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457972+0000", 2024-09-12T22:03:58.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013179500000000001 2024-09-12T22:03:58.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462325+0000", 2024-09-12T22:03:58.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043526859999999997 2024-09-12T22:03:58.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468180+0000", 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058557169999999999 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468221+0000", 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0673000000000002e-05 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468258+0000", 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7240999999999998e-05 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.426 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.426 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:03:58.426 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.958903863, 2024-09-12T22:03:58.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018748032000000001, 2024-09-12T22:03:58.426 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.426 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.426 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.426 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:03:58.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:03:58.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449779+0000", 2024-09-12T22:03:58.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4869999999999998e-06 2024-09-12T22:03:58.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449783+0000", 2024-09-12T22:03:58.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:03:58.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449791+0000", 2024-09-12T22:03:58.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2640000000000002e-06 2024-09-12T22:03:58.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449796+0000", 2024-09-12T22:03:58.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9370000000000001e-06 2024-09-12T22:03:58.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449915+0000", 2024-09-12T22:03:58.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118559 2024-09-12T22:03:58.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:58.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449920+0000", 2024-09-12T22:03:58.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.101e-06 2024-09-12T22:03:58.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458578+0000", 2024-09-12T22:03:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008657662 2024-09-12T22:03:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458978+0000", 2024-09-12T22:03:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00039977399999999998 2024-09-12T22:03:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459130+0000", 2024-09-12T22:03:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000152394 2024-09-12T22:03:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462793+0000", 2024-09-12T22:03:58.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036628770000000001 2024-09-12T22:03:58.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468451+0000", 2024-09-12T22:03:58.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056577820000000001 2024-09-12T22:03:58.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468501+0000", 2024-09-12T22:03:58.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0609999999999998e-05 2024-09-12T22:03:58.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468524+0000", 2024-09-12T22:03:58.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2804000000000001e-05 2024-09-12T22:03:58.432 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.432 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.432 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.432 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.432 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:03:58.432 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.958869161999999, 2024-09-12T22:03:58.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018816113999999998, 2024-09-12T22:03:58.432 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.433 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.433 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.433 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:03:58.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:03:58.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3360000000000001e-06 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449832+0000", 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1528e-05 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:03:58.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-12T22:03:58.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459429+0000", 2024-09-12T22:03:58.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095926970000000007 2024-09-12T22:03:58.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459597+0000", 2024-09-12T22:03:58.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000168309 2024-09-12T22:03:58.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459829+0000", 2024-09-12T22:03:58.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231158 2024-09-12T22:03:58.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462796+0000", 2024-09-12T22:03:58.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029673849999999999 2024-09-12T22:03:58.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468558+0000", 2024-09-12T22:03:58.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057621449999999998 2024-09-12T22:03:58.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468592+0000", 2024-09-12T22:03:58.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4241e-05 2024-09-12T22:03:58.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468627+0000", 2024-09-12T22:03:58.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4511999999999998e-05 2024-09-12T22:03:58.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.438 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.438 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.958802133999999, 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018845905, 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:03:58.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:03:58.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:03:58.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449881+0000", 2024-09-12T22:03:58.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.005e-06 2024-09-12T22:03:58.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449887+0000", 2024-09-12T22:03:58.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9050000000000002e-06 2024-09-12T22:03:58.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449892+0000", 2024-09-12T22:03:58.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2009999999999998e-06 2024-09-12T22:03:58.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460279+0000", 2024-09-12T22:03:58.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010386808000000001 2024-09-12T22:03:58.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460427+0000", 2024-09-12T22:03:58.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014789 2024-09-12T22:03:58.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460572+0000", 2024-09-12T22:03:58.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014453099999999999 2024-09-12T22:03:58.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462799+0000", 2024-09-12T22:03:58.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002227049 2024-09-12T22:03:58.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468672+0000", 2024-09-12T22:03:58.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058730060000000001 2024-09-12T22:03:58.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468704+0000", 2024-09-12T22:03:58.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2421e-05 2024-09-12T22:03:58.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468724+0000", 2024-09-12T22:03:58.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9582e-05 2024-09-12T22:03:58.444 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.444 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.444 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.444 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.444 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:03:58.444 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.958771664, 2024-09-12T22:03:58.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015455175, 2024-09-12T22:03:58.444 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.444 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.444 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.444 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:03:58.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:03:58.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449909+0000", 2024-09-12T22:03:58.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2099999999999997e-07 2024-09-12T22:03:58.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449912+0000", 2024-09-12T22:03:58.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1439999999999999e-06 2024-09-12T22:03:58.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449925+0000", 2024-09-12T22:03:58.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2944e-05 2024-09-12T22:03:58.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449931+0000", 2024-09-12T22:03:58.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3289999999999999e-06 2024-09-12T22:03:58.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:03:58.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:03:58.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:03:58.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449990+0000", 2024-09-12T22:03:58.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8090000000000004e-06 2024-09-12T22:03:58.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.455881+0000", 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058904400000000003 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456556+0000", 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00067549500000000002 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456742+0000", 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018546799999999999 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461053+0000", 2024-09-12T22:03:58.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043118310000000003 2024-09-12T22:03:58.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465220+0000", 2024-09-12T22:03:58.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041667750000000002 2024-09-12T22:03:58.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465316+0000", 2024-09-12T22:03:58.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5996999999999996e-05 2024-09-12T22:03:58.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465363+0000", 2024-09-12T22:03:58.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7111999999999999e-05 2024-09-12T22:03:58.450 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.450 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.450 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.450 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.450 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:03:58.450 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.958729272999999, 2024-09-12T22:03:58.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017913407999999999, 2024-09-12T22:03:58.450 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:03:58.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3499999999999996e-07 2024-09-12T22:03:58.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449955+0000", 2024-09-12T22:03:58.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4379999999999999e-06 2024-09-12T22:03:58.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449963+0000", 2024-09-12T22:03:58.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2719999999999997e-06 2024-09-12T22:03:58.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449970+0000", 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5930000000000002e-06 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450563+0000", 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00059351900000000003 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450570+0000", 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3900000000000004e-06 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461148+0000", 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010577354000000001 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461312+0000", 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016392300000000001 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461525+0000", 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021282199999999999 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464272+0000", 2024-09-12T22:03:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027469740000000001 2024-09-12T22:03:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467749+0000", 2024-09-12T22:03:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003477235 2024-09-12T22:03:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467815+0000", 2024-09-12T22:03:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5974000000000002e-05 2024-09-12T22:03:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467864+0000", 2024-09-12T22:03:58.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9279e-05 2024-09-12T22:03:58.456 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.456 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.456 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.456 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.456 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:03:58.456 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.958697807, 2024-09-12T22:03:58.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018827507, 2024-09-12T22:03:58.456 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:03:58.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:03:58.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:03:58.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2739999999999999e-06 2024-09-12T22:03:58.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449999+0000", 2024-09-12T22:03:58.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3349e-05 2024-09-12T22:03:58.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450005+0000", 2024-09-12T22:03:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.609e-06 2024-09-12T22:03:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461006+0000", 2024-09-12T22:03:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011000876 2024-09-12T22:03:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461236+0000", 2024-09-12T22:03:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000230301 2024-09-12T22:03:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461362+0000", 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012541900000000001 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464797+0000", 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034350840000000001 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468754+0000", 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039576689999999996 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468784+0000", 2024-09-12T22:03:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9558000000000001e-05 2024-09-12T22:03:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468810+0000", 2024-09-12T22:03:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5752e-05 2024-09-12T22:03:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.958665934999999, 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018888559999999999, 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:03:58.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450015+0000", 2024-09-12T22:03:58.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:03:58.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450018+0000", 2024-09-12T22:03:58.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3840000000000001e-06 2024-09-12T22:03:58.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:03:58.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8859999999999998e-06 2024-09-12T22:03:58.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450030+0000", 2024-09-12T22:03:58.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4829999999999999e-06 2024-09-12T22:03:58.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465718+0000", 2024-09-12T22:03:58.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015688163000000001 2024-09-12T22:03:58.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465793+0000", 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4788000000000003e-05 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466015+0000", 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000221394 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467628+0000", 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016131190000000001 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468849+0000", 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012211699999999999 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468878+0000", 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8708e-05 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468902+0000", 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868e-05 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.467 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.468 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:23 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.468 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:03:58.468 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.958642487999999, 2024-09-12T22:03:58.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021189669000000001, 2024-09-12T22:03:58.468 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.468 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.468 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.468 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:03:58.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:03:58.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450038+0000", 2024-09-12T22:03:58.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:03:58.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450042+0000", 2024-09-12T22:03:58.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7720000000000001e-06 2024-09-12T22:03:58.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450058+0000", 2024-09-12T22:03:58.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6379999999999999e-05 2024-09-12T22:03:58.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450067+0000", 2024-09-12T22:03:58.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3870000000000001e-06 2024-09-12T22:03:58.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466409+0000", 2024-09-12T22:03:58.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016341418999999999 2024-09-12T22:03:58.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466467+0000", 2024-09-12T22:03:58.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8613999999999998e-05 2024-09-12T22:03:58.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466612+0000", 2024-09-12T22:03:58.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014415000000000001 2024-09-12T22:03:58.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467856+0000", 2024-09-12T22:03:58.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012440039999999999 2024-09-12T22:03:58.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471178+0000", 2024-09-12T22:03:58.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033227450000000002 2024-09-12T22:03:58.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471207+0000", 2024-09-12T22:03:58.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8571000000000001e-05 2024-09-12T22:03:58.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471227+0000", 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0109999999999999e-05 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.958601947999998, 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021231197, 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.473 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.474 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.474 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:03:58.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:03:58.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450079+0000", 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450083+0000", 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1989999999999999e-06 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450092+0000", 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9400000000000008e-06 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450097+0000", 2024-09-12T22:03:58.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:03:58.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466898+0000", 2024-09-12T22:03:58.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016801226999999998 2024-09-12T22:03:58.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466975+0000", 2024-09-12T22:03:58.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6197000000000002e-05 2024-09-12T22:03:58.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467158+0000", 2024-09-12T22:03:58.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183876 2024-09-12T22:03:58.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468270+0000", 2024-09-12T22:03:58.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001111229 2024-09-12T22:03:58.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471260+0000", 2024-09-12T22:03:58.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002989907 2024-09-12T22:03:58.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471289+0000", 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9271000000000001e-05 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471309+0000", 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0302999999999999e-05 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.478 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.479 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:03:58.479 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.958575347, 2024-09-12T22:03:58.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018145809999999998, 2024-09-12T22:03:58.479 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.479 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.479 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.479 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:03:58.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450114+0000", 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1849999999999993e-06 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:03:58.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1350000000000003e-06 2024-09-12T22:03:58.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450128+0000", 2024-09-12T22:03:58.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2040000000000002e-06 2024-09-12T22:03:58.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454085+0000", 2024-09-12T22:03:58.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00395736 2024-09-12T22:03:58.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454090+0000", 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.378e-06 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457076+0000", 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002985747 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457178+0000", 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010242 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457452+0000", 2024-09-12T22:03:58.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027313000000000001 2024-09-12T22:03:58.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462024+0000", 2024-09-12T22:03:58.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045727040000000004 2024-09-12T22:03:58.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468161+0000", 2024-09-12T22:03:58.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061372019999999996 2024-09-12T22:03:58.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468212+0000", 2024-09-12T22:03:58.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0707000000000001e-05 2024-09-12T22:03:58.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468250+0000", 2024-09-12T22:03:58.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8148000000000001e-05 2024-09-12T22:03:58.484 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.484 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.484 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.957983971000001, 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017301410999999999, 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450699+0000", 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0019999999999998e-06 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450705+0000", 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3199999999999996e-06 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450717+0000", 2024-09-12T22:03:58.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2069000000000001e-05 2024-09-12T22:03:58.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450726+0000", 2024-09-12T22:03:58.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2840000000000006e-06 2024-09-12T22:03:58.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454318+0000", 2024-09-12T22:03:58.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035919580000000001 2024-09-12T22:03:58.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:58.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454323+0000", 2024-09-12T22:03:58.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2490000000000001e-06 2024-09-12T22:03:58.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462054+0000", 2024-09-12T22:03:58.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0077311319999999999 2024-09-12T22:03:58.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462135+0000", 2024-09-12T22:03:58.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1558999999999996e-05 2024-09-12T22:03:58.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462273+0000", 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013781000000000001 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464587+0000", 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023134319999999998 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467908+0000", 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033211310000000002 2024-09-12T22:03:58.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467960+0000", 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2537000000000002e-05 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467997+0000", 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6928000000000003e-05 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.490 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:34 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.491 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450741+0000", 2024-09-12T22:03:58.491 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.957938917, 2024-09-12T22:03:58.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013890173, 2024-09-12T22:03:58.491 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.491 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.491 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.491 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450741+0000", 2024-09-12T22:03:58.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450741+0000", 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450742+0000", 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4899999999999995e-07 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450756+0000", 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4025e-05 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450773+0000", 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7702000000000001e-05 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450780+0000", 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-06 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453175+0000", 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023946710000000001 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:03:58.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453181+0000", 2024-09-12T22:03:58.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5590000000000002e-06 2024-09-12T22:03:58.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457039+0000", 2024-09-12T22:03:58.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038575649999999999 2024-09-12T22:03:58.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457181+0000", 2024-09-12T22:03:58.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000141736 2024-09-12T22:03:58.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:58.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457979+0000", 2024-09-12T22:03:58.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0007986 2024-09-12T22:03:58.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461984+0000", 2024-09-12T22:03:58.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040052910000000002 2024-09-12T22:03:58.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464519+0000", 2024-09-12T22:03:58.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002534597 2024-09-12T22:03:58.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464582+0000", 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3441999999999993e-05 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464631+0000", 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8675999999999999e-05 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.496 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.497 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:03:58.497 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.957887792000001, 2024-09-12T22:03:58.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020127506999999999, 2024-09-12T22:03:58.497 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.497 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.497 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.497 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:03:58.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450793+0000", 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2800000000000005e-07 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450813+0000", 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0063000000000001e-05 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450847+0000", 2024-09-12T22:03:58.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3973000000000002e-05 2024-09-12T22:03:58.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450862+0000", 2024-09-12T22:03:58.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5358000000000001e-05 2024-09-12T22:03:58.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454355+0000", 2024-09-12T22:03:58.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003492841 2024-09-12T22:03:58.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454359+0000", 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458704+0000", 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043452459999999997 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459009+0000", 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030526199999999999 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459143+0000", 2024-09-12T22:03:58.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013375 2024-09-12T22:03:58.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462690+0000", 2024-09-12T22:03:58.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035466579999999998 2024-09-12T22:03:58.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470863+0000", 2024-09-12T22:03:58.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0081734089999999995 2024-09-12T22:03:58.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470898+0000", 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4445e-05 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470920+0000", 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1844e-05 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.502 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450885+0000", 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.957794851999999, 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014578333000000001, 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450885+0000", 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450885+0000", 2024-09-12T22:03:58.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450886+0000", 2024-09-12T22:03:58.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9199999999999999e-07 2024-09-12T22:03:58.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450892+0000", 2024-09-12T22:03:58.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:03:58.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450915+0000", 2024-09-12T22:03:58.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3447000000000001e-05 2024-09-12T22:03:58.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450928+0000", 2024-09-12T22:03:58.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3026e-05 2024-09-12T22:03:58.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452357+0000", 2024-09-12T22:03:58.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001428721 2024-09-12T22:03:58.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:03:58.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452364+0000", 2024-09-12T22:03:58.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9419999999999998e-06 2024-09-12T22:03:58.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456803+0000", 2024-09-12T22:03:58.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044385010000000001 2024-09-12T22:03:58.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456933+0000", 2024-09-12T22:03:58.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130211 2024-09-12T22:03:58.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457059+0000", 2024-09-12T22:03:58.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012614899999999999 2024-09-12T22:03:58.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459965+0000", 2024-09-12T22:03:58.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029057319999999998 2024-09-12T22:03:58.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465344+0000", 2024-09-12T22:03:58.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0053789279999999998 2024-09-12T22:03:58.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465405+0000", 2024-09-12T22:03:58.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1105000000000005e-05 2024-09-12T22:03:58.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465463+0000", 2024-09-12T22:03:58.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8711000000000001e-05 2024-09-12T22:03:58.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.508 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.509 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.509 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:03:58.509 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.956357672999999, 2024-09-12T22:03:58.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018704596, 2024-09-12T22:03:58.509 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.509 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.509 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.509 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:03:58.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:03:58.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452323+0000", 2024-09-12T22:03:58.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:03:58.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452337+0000", 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452489+0000", 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015167699999999999 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452498+0000", 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9709999999999993e-06 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454393+0000", 2024-09-12T22:03:58.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001895171 2024-09-12T22:03:58.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:58.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454397+0000", 2024-09-12T22:03:58.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4470000000000002e-06 2024-09-12T22:03:58.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459570+0000", 2024-09-12T22:03:58.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051728160000000002 2024-09-12T22:03:58.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459718+0000", 2024-09-12T22:03:58.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014857800000000001 2024-09-12T22:03:58.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459920+0000", 2024-09-12T22:03:58.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000202043 2024-09-12T22:03:58.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462696+0000", 2024-09-12T22:03:58.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027756299999999999 2024-09-12T22:03:58.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470963+0000", 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082671359999999996 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471000+0000", 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6748999999999997e-05 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471027+0000", 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7118e-05 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.514 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453198+0000", 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.95548226, 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014690379999999999, 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453198+0000", 2024-09-12T22:03:58.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453198+0000", 2024-09-12T22:03:58.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453199+0000", 2024-09-12T22:03:58.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.02e-07 2024-09-12T22:03:58.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453205+0000", 2024-09-12T22:03:58.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2809999999999997e-06 2024-09-12T22:03:58.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453218+0000", 2024-09-12T22:03:58.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3305000000000001e-05 2024-09-12T22:03:58.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453228+0000", 2024-09-12T22:03:58.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4050000000000006e-06 2024-09-12T22:03:58.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453295+0000", 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7266000000000003e-05 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453300+0000", 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3920000000000002e-06 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459323+0000", 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060229869999999996 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459455+0000", 2024-09-12T22:03:58.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131657 2024-09-12T22:03:58.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:58.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459569+0000", 2024-09-12T22:03:58.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113986 2024-09-12T22:03:58.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461991+0000", 2024-09-12T22:03:58.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024220320000000002 2024-09-12T22:03:58.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467728+0000", 2024-09-12T22:03:58.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057376520000000002 2024-09-12T22:03:58.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467806+0000", 2024-09-12T22:03:58.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7705000000000002e-05 2024-09-12T22:03:58.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467888+0000", 2024-09-12T22:03:58.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1810000000000004e-05 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.955431995000001, 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017680218000000001, 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453249+0000", 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453253+0000", 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3630000000000004e-06 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453261+0000", 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9319999999999996e-06 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453267+0000", 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7989999999999999e-06 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454995+0000", 2024-09-12T22:03:58.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001727793 2024-09-12T22:03:58.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:03:58.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.455000+0000", 2024-09-12T22:03:58.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0289999999999996e-06 2024-09-12T22:03:58.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461445+0000", 2024-09-12T22:03:58.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064456870000000003 2024-09-12T22:03:58.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461546+0000", 2024-09-12T22:03:58.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101036 2024-09-12T22:03:58.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:58.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461680+0000", 2024-09-12T22:03:58.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013407299999999999 2024-09-12T22:03:58.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:03:58.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464622+0000", 2024-09-12T22:03:58.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029413379999999999 2024-09-12T22:03:58.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:58.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470850+0000", 2024-09-12T22:03:58.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.006227977 2024-09-12T22:03:58.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:03:58.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470902+0000", 2024-09-12T22:03:58.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1916000000000002e-05 2024-09-12T22:03:58.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470928+0000", 2024-09-12T22:03:58.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.65e-05 2024-09-12T22:03:58.526 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.955400398999998, 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017838390999999999, 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:03:58.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:03:58.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:03:58.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:03:58.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:03:58.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:03:58.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453280+0000", 2024-09-12T22:03:58.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:03:58.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453284+0000", 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.194e-06 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453337+0000", 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2330999999999998e-05 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453353+0000", 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6001000000000001e-05 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454421+0000", 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010681009999999999 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454424+0000", 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2550000000000002e-06 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460376+0000", 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059517770000000001 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:03:58.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460536+0000", 2024-09-12T22:03:58.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015984699999999999 2024-09-12T22:03:58.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:03:58.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:03:58.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:03:58.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471118+0000", 2024-09-12T22:03:58.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010582322999999999 2024-09-12T22:03:58.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.531 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:03:58.531 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:03:58.531 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:03:58.533 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:03:58.533 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:58.531+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:58.634 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:58.632+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:58.680 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:03:58.680 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:03:58.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.680 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:22856 5.8 5:1a35e0d1:::benchmark_data_smithi043_32659_object22855:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:58.680 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:58.677579+0000", 2024-09-12T22:03:58.680 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0015094469999999999, 2024-09-12T22:03:58.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001529421, 2024-09-12T22:03:58.681 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:58.681 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:58.681 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:58.681 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:58.681 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:58.681 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:58.681 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 22856 2024-09-12T22:03:58.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.681 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:58.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:58.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677579+0000", 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677579+0000", 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677580+0000", 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:58.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677659+0000", 2024-09-12T22:03:58.683 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.86e-05 2024-09-12T22:03:58.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.683 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.683 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:58.683 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677668+0000", 2024-09-12T22:03:58.683 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4180000000000003e-06 2024-09-12T22:03:58.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.683 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.683 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.683 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677675+0000", 2024-09-12T22:03:58.683 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8750000000000002e-06 2024-09-12T22:03:58.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:58.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677708+0000", 2024-09-12T22:03:58.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2740999999999997e-05 2024-09-12T22:03:58.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:58.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677785+0000", 2024-09-12T22:03:58.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7569000000000002e-05 2024-09-12T22:03:58.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:58.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677914+0000", 2024-09-12T22:03:58.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012848800000000001 2024-09-12T22:03:58.685 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:58.685 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:58.685 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:58.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.685 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:22858 5.4 5:2f6cd704:::benchmark_data_smithi043_32659_object22857:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:58.685 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:58.677694+0000", 2024-09-12T22:03:58.685 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0013946989999999999, 2024-09-12T22:03:58.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001462639, 2024-09-12T22:03:58.685 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:58.685 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 22858 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677694+0000", 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:58.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677694+0000", 2024-09-12T22:03:58.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:58.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:58.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677695+0000", 2024-09-12T22:03:58.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:03:58.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:58.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677786+0000", 2024-09-12T22:03:58.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1448999999999998e-05 2024-09-12T22:03:58.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:58.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677795+0000", 2024-09-12T22:03:58.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9789999999999999e-06 2024-09-12T22:03:58.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677801+0000", 2024-09-12T22:03:58.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2049999999999999e-06 2024-09-12T22:03:58.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:58.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677853+0000", 2024-09-12T22:03:58.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1269e-05 2024-09-12T22:03:58.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.689 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:58.689 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678020+0000", 2024-09-12T22:03:58.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016702700000000001 2024-09-12T22:03:58.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.689 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:58.689 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678151+0000", 2024-09-12T22:03:58.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013128900000000001 2024-09-12T22:03:58.689 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:58.689 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:58.689 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:58.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:22857 5.9 e26/22 5:9645d572:::benchmark_data_smithi043_32659_object22856:head v 26'1379, mlcod=26'1375)", 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:58.677985+0000", 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001103251, 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012100310000000001, 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677985+0000", 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677985+0000", 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.677986+0000", 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2300000000000001e-07 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678063+0000", 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7124000000000002e-05 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678070+0000", 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3209999999999999e-06 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678075+0000", 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4240000000000003e-06 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678110+0000", 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4875000000000001e-05 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:58.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678127+0000", 2024-09-12T22:03:58.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7071999999999998e-05 2024-09-12T22:03:58.693 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:58.693 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:58.693 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:58.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.693 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:22860 5.f e26/22 5:fd3f6859:::benchmark_data_smithi043_32659_object22859:head v 26'1459, mlcod=26'1457)", 2024-09-12T22:03:58.693 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:58.678258+0000", 2024-09-12T22:03:58.693 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00083086599999999998, 2024-09-12T22:03:58.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00096776900000000005, 2024-09-12T22:03:58.693 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:58.693 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:58.693 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:03:58.694 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:58.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:58.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678258+0000", 2024-09-12T22:03:58.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:58.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:58.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678258+0000", 2024-09-12T22:03:58.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:58.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:58.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678258+0000", 2024-09-12T22:03:58.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8999999999999996e-07 2024-09-12T22:03:58.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:58.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678317+0000", 2024-09-12T22:03:58.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8972999999999999e-05 2024-09-12T22:03:58.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:58.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678327+0000", 2024-09-12T22:03:58.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9550000000000004e-06 2024-09-12T22:03:58.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678333+0000", 2024-09-12T22:03:58.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6149999999999996e-06 2024-09-12T22:03:58.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.696 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:58.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678387+0000", 2024-09-12T22:03:58.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3872999999999997e-05 2024-09-12T22:03:58.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.696 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:58.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678410+0000", 2024-09-12T22:03:58.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3180000000000002e-05 2024-09-12T22:03:58.696 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:58.696 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:58.697 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:58.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.697 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:22862 5.4 5:29c18011:::benchmark_data_smithi043_32659_object22861:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:58.697 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:58.678388+0000", 2024-09-12T22:03:58.697 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00070073800000000001, 2024-09-12T22:03:58.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00087083799999999997, 2024-09-12T22:03:58.697 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:58.697 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:58.697 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:58.697 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:58.697 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:58.697 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:58.697 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 22862 2024-09-12T22:03:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678388+0000", 2024-09-12T22:03:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678388+0000", 2024-09-12T22:03:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678389+0000", 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678414+0000", 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4875000000000002e-05 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678422+0000", 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7960000000000001e-06 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.678428+0000", 2024-09-12T22:03:58.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8980000000000001e-06 2024-09-12T22:03:58.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:58.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.679038+0000", 2024-09-12T22:03:58.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000609988 2024-09-12T22:03:58.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:58.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.679131+0000", 2024-09-12T22:03:58.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2677999999999996e-05 2024-09-12T22:03:58.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:58.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.679211+0000", 2024-09-12T22:03:58.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9874000000000001e-05 2024-09-12T22:03:58.701 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:58.701 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:58.701 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:58.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.701 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:22853 5.0 5:06be6472:::benchmark_data_smithi043_32659_object22852:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:58.701 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:58.676325+0000", 2024-09-12T22:03:58.701 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0027641570000000002, 2024-09-12T22:03:58.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0029792659999999999, 2024-09-12T22:03:58.701 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 22853 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.676325+0000", 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.676325+0000", 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.676325+0000", 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.676394+0000", 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9227000000000007e-05 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.676402+0000", 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6329999999999996e-06 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.676406+0000", 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1400000000000002e-06 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.676459+0000", 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2487000000000001e-05 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:58.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.676597+0000", 2024-09-12T22:03:58.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000138023 2024-09-12T22:03:58.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:58.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:58.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:58.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.676733+0000", 2024-09-12T22:03:58.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013596800000000001 2024-09-12T22:03:58.705 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:58.705 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:58.705 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:58.705 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:58.705 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:03:58.705 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 6 2024-09-12T22:03:58.705 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:03:58.706 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:03:58.735 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:58.734+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:58.835 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:58.834+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:58.855 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:03:58.855 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:03:58.856 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:03:58.856 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:03:58.856 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:03:58.869 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:03:58.937 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:58.936+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:59.016 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:03:59.016 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:03:59.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:03:59.016 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:03:59.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.017 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.017 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.451393+0000", 2024-09-12T22:03:59.017 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.562320086, 2024-09-12T22:03:59.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012754669999999999, 2024-09-12T22:03:59.017 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.017 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.017 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.017 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451393+0000", 2024-09-12T22:03:59.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451393+0000", 2024-09-12T22:03:59.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451408+0000", 2024-09-12T22:03:59.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5079000000000001e-05 2024-09-12T22:03:59.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451417+0000", 2024-09-12T22:03:59.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5299999999999996e-06 2024-09-12T22:03:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451429+0000", 2024-09-12T22:03:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2628e-05 2024-09-12T22:03:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451444+0000", 2024-09-12T22:03:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5105e-05 2024-09-12T22:03:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452220+0000", 2024-09-12T22:03:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077575300000000001 2024-09-12T22:03:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452529+0000", 2024-09-12T22:03:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00030873899999999999 2024-09-12T22:03:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452963+0000", 2024-09-12T22:03:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00043367699999999999 2024-09-12T22:03:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455843+0000", 2024-09-12T22:03:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028807049999999999 2024-09-12T22:03:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464032+0000", 2024-09-12T22:03:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0081885159999999999 2024-09-12T22:03:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464086+0000", 2024-09-12T22:03:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4549999999999998e-05 2024-09-12T22:03:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464148+0000", 2024-09-12T22:03:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1388000000000002e-05 2024-09-12T22:03:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452091+0000", 2024-09-12T22:03:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.561622537000002, 2024-09-12T22:03:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012037842, 2024-09-12T22:03:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452091+0000", 2024-09-12T22:03:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452091+0000", 2024-09-12T22:03:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452092+0000", 2024-09-12T22:03:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0899999999999999e-06 2024-09-12T22:03:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452100+0000", 2024-09-12T22:03:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3499999999999997e-06 2024-09-12T22:03:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452112+0000", 2024-09-12T22:03:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1584e-05 2024-09-12T22:03:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452121+0000", 2024-09-12T22:03:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8740000000000001e-06 2024-09-12T22:03:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452714+0000", 2024-09-12T22:03:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00059324400000000004 2024-09-12T22:03:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452838+0000", 2024-09-12T22:03:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012385299999999999 2024-09-12T22:03:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.453222+0000", 2024-09-12T22:03:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00038446699999999999 2024-09-12T22:03:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456140+0000", 2024-09-12T22:03:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0029179190000000002 2024-09-12T22:03:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464060+0000", 2024-09-12T22:03:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0079196160000000008 2024-09-12T22:03:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464089+0000", 2024-09-12T22:03:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9431e-05 2024-09-12T22:03:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464128+0000", 2024-09-12T22:03:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9413999999999999e-05 2024-09-12T22:03:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:03:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.561450538999999, 2024-09-12T22:03:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012474654999999999, 2024-09-12T22:03:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:03:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:03:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:03:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1500000000000003e-07 2024-09-12T22:03:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452268+0000", 2024-09-12T22:03:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8640000000000004e-06 2024-09-12T22:03:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452311+0000", 2024-09-12T22:03:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2255000000000001e-05 2024-09-12T22:03:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452326+0000", 2024-09-12T22:03:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5209e-05 2024-09-12T22:03:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455447+0000", 2024-09-12T22:03:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031213209999999998 2024-09-12T22:03:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455502+0000", 2024-09-12T22:03:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4925e-05 2024-09-12T22:03:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455592+0000", 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9850000000000002e-05 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.457408+0000", 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001816018 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464635+0000", 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0072269350000000003 2024-09-12T22:03:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464682+0000", 2024-09-12T22:03:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7308000000000002e-05 2024-09-12T22:03:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464737+0000", 2024-09-12T22:03:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5155000000000003e-05 2024-09-12T22:03:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452345+0000", 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.561368311999999, 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012534264, 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452345+0000", 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452345+0000", 2024-09-12T22:03:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452346+0000", 2024-09-12T22:03:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.212e-06 2024-09-12T22:03:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452352+0000", 2024-09-12T22:03:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1850000000000001e-06 2024-09-12T22:03:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452362+0000", 2024-09-12T22:03:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6209999999999999e-06 2024-09-12T22:03:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452380+0000", 2024-09-12T22:03:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7909000000000001e-05 2024-09-12T22:03:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455611+0000", 2024-09-12T22:03:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032308889999999998 2024-09-12T22:03:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455675+0000", 2024-09-12T22:03:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4783999999999995e-05 2024-09-12T22:03:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455866+0000", 2024-09-12T22:03:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019059900000000001 2024-09-12T22:03:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.457440+0000", 2024-09-12T22:03:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015739269999999999 2024-09-12T22:03:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464782+0000", 2024-09-12T22:03:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0073417100000000004 2024-09-12T22:03:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464835+0000", 2024-09-12T22:03:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3709999999999999e-05 2024-09-12T22:03:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464879+0000", 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3717999999999997e-05 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452540+0000", 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.561172708000001, 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012490559, 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452540+0000", 2024-09-12T22:03:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452540+0000", 2024-09-12T22:03:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452541+0000", 2024-09-12T22:03:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1299999999999999e-07 2024-09-12T22:03:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452546+0000", 2024-09-12T22:03:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.758e-06 2024-09-12T22:03:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452561+0000", 2024-09-12T22:03:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.541e-05 2024-09-12T22:03:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452570+0000", 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4309999999999994e-06 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456142+0000", 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035725409999999998 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456258+0000", 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115728 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456384+0000", 2024-09-12T22:03:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125506 2024-09-12T22:03:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.459667+0000", 2024-09-12T22:03:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032833129999999999 2024-09-12T22:03:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464968+0000", 2024-09-12T22:03:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005300941 2024-09-12T22:03:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.465004+0000", 2024-09-12T22:03:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6606999999999997e-05 2024-09-12T22:03:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.465031+0000", 2024-09-12T22:03:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6611e-05 2024-09-12T22:03:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452584+0000", 2024-09-12T22:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.561129286, 2024-09-12T22:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011678836999999999, 2024-09-12T22:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452584+0000", 2024-09-12T22:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452584+0000", 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452584+0000", 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.82e-07 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452588+0000", 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3069999999999998e-06 2024-09-12T22:03:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452596+0000", 2024-09-12T22:03:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2290000000000003e-06 2024-09-12T22:03:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452603+0000", 2024-09-12T22:03:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0690000000000004e-06 2024-09-12T22:03:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452704+0000", 2024-09-12T22:03:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000101339 2024-09-12T22:03:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452799+0000", 2024-09-12T22:03:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4920999999999995e-05 2024-09-12T22:03:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464263+0000", 2024-09-12T22:03:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.01146339 2024-09-12T22:03:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5133 5.e 5:731a25e2:::benchmark_data_smithi043_32659_object5132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.987886+0000", 2024-09-12T22:03:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0258273950000003, 2024-09-12T22:03:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.01358233, 2024-09-12T22:03:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5133 2024-09-12T22:03:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987886+0000", 2024-09-12T22:03:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987886+0000", 2024-09-12T22:03:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987887+0000", 2024-09-12T22:03:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:03:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987988+0000", 2024-09-12T22:03:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000101266 2024-09-12T22:03:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987996+0000", 2024-09-12T22:03:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:03:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988002+0000", 2024-09-12T22:03:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8080000000000001e-06 2024-09-12T22:03:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988196+0000", 2024-09-12T22:03:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019422999999999999 2024-09-12T22:03:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988298+0000", 2024-09-12T22:03:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010208999999999999 2024-09-12T22:03:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988420+0000", 2024-09-12T22:03:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012256499999999999 2024-09-12T22:03:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989796+0000", 2024-09-12T22:03:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001375743 2024-09-12T22:03:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001390+0000", 2024-09-12T22:03:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011594089 2024-09-12T22:03:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001433+0000", 2024-09-12T22:03:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2420999999999999e-05 2024-09-12T22:03:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001468+0000", 2024-09-12T22:03:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5423999999999998e-05 2024-09-12T22:03:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5136 5.b 5:de031c2e:::benchmark_data_smithi043_32659_object5135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.988747+0000", 2024-09-12T22:03:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.024966365, 2024-09-12T22:03:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013407914999999999, 2024-09-12T22:03:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5136 2024-09-12T22:03:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988747+0000", 2024-09-12T22:03:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988747+0000", 2024-09-12T22:03:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988748+0000", 2024-09-12T22:03:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:03:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988848+0000", 2024-09-12T22:03:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000100355 2024-09-12T22:03:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988860+0000", 2024-09-12T22:03:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1719000000000001e-05 2024-09-12T22:03:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988867+0000", 2024-09-12T22:03:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0690000000000004e-06 2024-09-12T22:03:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988917+0000", 2024-09-12T22:03:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9777000000000001e-05 2024-09-12T22:03:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989021+0000", 2024-09-12T22:03:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010412300000000001 2024-09-12T22:03:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989093+0000", 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1958999999999993e-05 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991058+0000", 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019651349999999998 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002073+0000", 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011014990000000001 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002117+0000", 2024-09-12T22:03:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4317000000000003e-05 2024-09-12T22:03:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002155+0000", 2024-09-12T22:03:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7524999999999997e-05 2024-09-12T22:03:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5137 5.e 5:76ceaa0c:::benchmark_data_smithi043_32659_object5136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.988884+0000", 2024-09-12T22:03:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0248288409999997, 2024-09-12T22:03:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013010671, 2024-09-12T22:03:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5137 2024-09-12T22:03:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988884+0000", 2024-09-12T22:03:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988884+0000", 2024-09-12T22:03:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988885+0000", 2024-09-12T22:03:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4000000000000001e-07 2024-09-12T22:03:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988914+0000", 2024-09-12T22:03:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8912999999999999e-05 2024-09-12T22:03:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988923+0000", 2024-09-12T22:03:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.67e-06 2024-09-12T22:03:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988945+0000", 2024-09-12T22:03:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2677e-05 2024-09-12T22:03:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988993+0000", 2024-09-12T22:03:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7497999999999998e-05 2024-09-12T22:03:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989109+0000", 2024-09-12T22:03:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011662099999999999 2024-09-12T22:03:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989264+0000", 2024-09-12T22:03:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015485 2024-09-12T22:03:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990950+0000", 2024-09-12T22:03:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0016853930000000001 2024-09-12T22:03:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001809+0000", 2024-09-12T22:03:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010859818 2024-09-12T22:03:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001863+0000", 2024-09-12T22:03:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3736000000000002e-05 2024-09-12T22:03:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001895+0000", 2024-09-12T22:03:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1854999999999999e-05 2024-09-12T22:03:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5138 5.b 5:d969c28c:::benchmark_data_smithi043_32659_object5137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.989883+0000", 2024-09-12T22:03:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0238305350000001, 2024-09-12T22:03:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012360691, 2024-09-12T22:03:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5138 2024-09-12T22:03:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989883+0000", 2024-09-12T22:03:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989883+0000", 2024-09-12T22:03:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989884+0000", 2024-09-12T22:03:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8999999999999995e-07 2024-09-12T22:03:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990012+0000", 2024-09-12T22:03:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000128245 2024-09-12T22:03:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990022+0000", 2024-09-12T22:03:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.927e-06 2024-09-12T22:03:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990029+0000", 2024-09-12T22:03:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3610000000000003e-06 2024-09-12T22:03:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990112+0000", 2024-09-12T22:03:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3323000000000002e-05 2024-09-12T22:03:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990249+0000", 2024-09-12T22:03:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013706499999999999 2024-09-12T22:03:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990426+0000", 2024-09-12T22:03:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017672599999999999 2024-09-12T22:03:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991995+0000", 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015690579999999999 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002163+0000", 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010167697 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002207+0000", 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4030999999999999e-05 2024-09-12T22:03:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002243+0000", 2024-09-12T22:03:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6368000000000001e-05 2024-09-12T22:03:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5141 5.e 5:733a9c59:::benchmark_data_smithi043_32659_object5140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.990266+0000", 2024-09-12T22:03:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0234473480000004, 2024-09-12T22:03:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011697701, 2024-09-12T22:03:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5141 2024-09-12T22:03:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990266+0000", 2024-09-12T22:03:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990266+0000", 2024-09-12T22:03:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990267+0000", 2024-09-12T22:03:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5799999999999998e-07 2024-09-12T22:03:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990333+0000", 2024-09-12T22:03:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6358000000000004e-05 2024-09-12T22:03:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990343+0000", 2024-09-12T22:03:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5750000000000007e-06 2024-09-12T22:03:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990349+0000", 2024-09-12T22:03:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6880000000000002e-06 2024-09-12T22:03:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990386+0000", 2024-09-12T22:03:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6918999999999997e-05 2024-09-12T22:03:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990474+0000", 2024-09-12T22:03:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7978000000000004e-05 2024-09-12T22:03:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990588+0000", 2024-09-12T22:03:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000113677 2024-09-12T22:03:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991952+0000", 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0013635520000000001 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001901+0000", 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0099496159999999997 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001936+0000", 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5163999999999997e-05 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001964+0000", 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7216000000000002e-05 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5144 5.b 5:db6bc9e3:::benchmark_data_smithi043_32659_object5143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.990487+0000", 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0232257479999998, 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011864091, 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5144 2024-09-12T22:03:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990487+0000", 2024-09-12T22:03:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990487+0000", 2024-09-12T22:03:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990488+0000", 2024-09-12T22:03:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.99e-07 2024-09-12T22:03:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990549+0000", 2024-09-12T22:03:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0695000000000001e-05 2024-09-12T22:03:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990558+0000", 2024-09-12T22:03:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.935e-06 2024-09-12T22:03:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990564+0000", 2024-09-12T22:03:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2840000000000003e-06 2024-09-12T22:03:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991093+0000", 2024-09-12T22:03:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00052932999999999995 2024-09-12T22:03:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991188+0000", 2024-09-12T22:03:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4613999999999999e-05 2024-09-12T22:03:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991265+0000", 2024-09-12T22:03:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7171999999999999e-05 2024-09-12T22:03:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.992545+0000", 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012794379999999999 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002259+0000", 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0097143060000000007 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002306+0000", 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7017000000000001e-05 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002352+0000", 2024-09-12T22:03:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5600999999999999e-05 2024-09-12T22:03:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:6959 5.e 5:7c15ba9e:::benchmark_data_smithi043_32659_object6958:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T22:03:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:55.291271+0000", 2024-09-12T22:03:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.7224418410000002, 2024-09-12T22:03:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010522482, 2024-09-12T22:03:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 6959 2024-09-12T22:03:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291271+0000", 2024-09-12T22:03:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291271+0000", 2024-09-12T22:03:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291272+0000", 2024-09-12T22:03:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6400000000000001e-07 2024-09-12T22:03:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291301+0000", 2024-09-12T22:03:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8776999999999999e-05 2024-09-12T22:03:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291311+0000", 2024-09-12T22:03:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0261000000000001e-05 2024-09-12T22:03:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291318+0000", 2024-09-12T22:03:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.63e-06 2024-09-12T22:03:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291437+0000", 2024-09-12T22:03:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119337 2024-09-12T22:03:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291599+0000", 2024-09-12T22:03:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016229699999999999 2024-09-12T22:03:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.291739+0000", 2024-09-12T22:03:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013980899999999999 2024-09-12T22:03:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.293218+0000", 2024-09-12T22:03:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014792189999999999 2024-09-12T22:03:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.301697+0000", 2024-09-12T22:03:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0084787200000000004 2024-09-12T22:03:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.301750+0000", 2024-09-12T22:03:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2914000000000002e-05 2024-09-12T22:03:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.301794+0000", 2024-09-12T22:03:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3754000000000002e-05 2024-09-12T22:03:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:21214 5.b 5:d7094b00:::benchmark_data_smithi043_32659_object21213:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:58.285181+0000", 2024-09-12T22:03:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.72853189600000001, 2024-09-12T22:03:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0099740460000000003, 2024-09-12T22:03:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 21214 2024-09-12T22:03:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.285181+0000", 2024-09-12T22:03:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.285181+0000", 2024-09-12T22:03:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.285182+0000", 2024-09-12T22:03:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1999999999999999e-07 2024-09-12T22:03:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.285228+0000", 2024-09-12T22:03:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-05 2024-09-12T22:03:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.285236+0000", 2024-09-12T22:03:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3280000000000006e-06 2024-09-12T22:03:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.285243+0000", 2024-09-12T22:03:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7739999999999999e-06 2024-09-12T22:03:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.287153+0000", 2024-09-12T22:03:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019097929999999999 2024-09-12T22:03:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.287287+0000", 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000134015 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.287422+0000", 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135723 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.294017+0000", 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.006594183 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.295092+0000", 2024-09-12T22:03:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001075307 2024-09-12T22:03:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.295133+0000", 2024-09-12T22:03:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1322000000000002e-05 2024-09-12T22:03:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.295155+0000", 2024-09-12T22:03:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2191000000000001e-05 2024-09-12T22:03:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:22069 5.e 5:7adecacf:::benchmark_data_smithi043_32659_object22068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:58.490629+0000", 2024-09-12T22:03:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.52308463100000002, 2024-09-12T22:03:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010884361, 2024-09-12T22:03:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 22069 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.490629+0000", 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.490629+0000", 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.490629+0000", 2024-09-12T22:03:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1299999999999999e-07 2024-09-12T22:03:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.490657+0000", 2024-09-12T22:03:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7438999999999999e-05 2024-09-12T22:03:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.490663+0000", 2024-09-12T22:03:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0170000000000002e-06 2024-09-12T22:03:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.490666+0000", 2024-09-12T22:03:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5260000000000002e-06 2024-09-12T22:03:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.491465+0000", 2024-09-12T22:03:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00079833400000000004 2024-09-12T22:03:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.491541+0000", 2024-09-12T22:03:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6398999999999998e-05 2024-09-12T22:03:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.491615+0000", 2024-09-12T22:03:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4237000000000001e-05 2024-09-12T22:03:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.493332+0000", 2024-09-12T22:03:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017171899999999999 2024-09-12T22:03:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.501441+0000", 2024-09-12T22:03:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0081083549999999994 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.501475+0000", 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4162000000000003e-05 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.501513+0000", 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7988999999999998e-05 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:23003 5.9 e26/22 5:9a2bc04c:::benchmark_data_smithi043_32659_object23002:head v 26'1387, mlcod=26'1385)", 2024-09-12T22:03:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:58.710753+0000", 2024-09-12T22:03:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.30296047999999998, 2024-09-12T22:03:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010066102, 2024-09-12T22:03:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.710753+0000", 2024-09-12T22:03:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.710753+0000", 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.710753+0000", 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3099999999999997e-07 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.710806+0000", 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2513999999999999e-05 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.710813+0000", 2024-09-12T22:03:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9290000000000001e-06 2024-09-12T22:03:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.710818+0000", 2024-09-12T22:03:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2499999999999997e-06 2024-09-12T22:03:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.710871+0000", 2024-09-12T22:03:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2969000000000001e-05 2024-09-12T22:03:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.710906+0000", 2024-09-12T22:03:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4740000000000003e-05 2024-09-12T22:03:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.720777+0000", 2024-09-12T22:03:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0098713499999999992 2024-09-12T22:03:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.720819+0000", 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1718999999999998e-05 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:23717 5.8 5:1e24a8b1:::benchmark_data_smithi043_32659_object23716:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:58.880465+0000", 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.13324825700000001, 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010876607999999999, 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 23717 2024-09-12T22:03:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.880465+0000", 2024-09-12T22:03:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.880465+0000", 2024-09-12T22:03:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.880466+0000", 2024-09-12T22:03:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4099999999999997e-07 2024-09-12T22:03:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.880663+0000", 2024-09-12T22:03:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019741100000000001 2024-09-12T22:03:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.880675+0000", 2024-09-12T22:03:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1888e-05 2024-09-12T22:03:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.880683+0000", 2024-09-12T22:03:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7849999999999992e-06 2024-09-12T22:03:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.882005+0000", 2024-09-12T22:03:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001322225 2024-09-12T22:03:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.882121+0000", 2024-09-12T22:03:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116166 2024-09-12T22:03:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.882209+0000", 2024-09-12T22:03:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7423000000000006e-05 2024-09-12T22:03:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.886176+0000", 2024-09-12T22:03:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0039675200000000004 2024-09-12T22:03:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.891232+0000", 2024-09-12T22:03:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0050562519999999998 2024-09-12T22:03:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.891294+0000", 2024-09-12T22:03:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1433000000000006e-05 2024-09-12T22:03:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.891342+0000", 2024-09-12T22:03:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7664000000000003e-05 2024-09-12T22:03:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:23722 5.0 5:03bc2a55:::benchmark_data_smithi043_32659_object23721:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:58.882463+0000", 2024-09-12T22:03:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.131250586, 2024-09-12T22:03:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.009975823, 2024-09-12T22:03:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 23722 2024-09-12T22:03:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.882463+0000", 2024-09-12T22:03:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.882463+0000", 2024-09-12T22:03:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.882463+0000", 2024-09-12T22:03:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:03:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.882629+0000", 2024-09-12T22:03:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016604900000000001 2024-09-12T22:03:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.882639+0000", 2024-09-12T22:03:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6600000000000007e-06 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.882646+0000", 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2439999999999996e-06 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.883385+0000", 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00073894399999999995 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.883500+0000", 2024-09-12T22:03:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115217 2024-09-12T22:03:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.883659+0000", 2024-09-12T22:03:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015850099999999999 2024-09-12T22:03:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.888646+0000", 2024-09-12T22:03:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049871639999999997 2024-09-12T22:03:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.892342+0000", 2024-09-12T22:03:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003695566 2024-09-12T22:03:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.892401+0000", 2024-09-12T22:03:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8947999999999999e-05 2024-09-12T22:03:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.892438+0000", 2024-09-12T22:03:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7786e-05 2024-09-12T22:03:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.118 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.118 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:23729 5.0 5:016a0748:::benchmark_data_smithi043_32659_object23728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.118 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:58.883550+0000", 2024-09-12T22:03:59.118 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.13016280799999999, 2024-09-12T22:03:59.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010957557, 2024-09-12T22:03:59.118 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.118 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.118 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.118 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:59.118 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:59.118 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.118 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 23729 2024-09-12T22:03:59.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.119 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.883550+0000", 2024-09-12T22:03:59.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.883550+0000", 2024-09-12T22:03:59.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.883551+0000", 2024-09-12T22:03:59.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0699999999999996e-07 2024-09-12T22:03:59.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.120 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.883677+0000", 2024-09-12T22:03:59.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125683 2024-09-12T22:03:59.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.120 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.883689+0000", 2024-09-12T22:03:59.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1714e-05 2024-09-12T22:03:59.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.883695+0000", 2024-09-12T22:03:59.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:03:59.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.888763+0000", 2024-09-12T22:03:59.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0050674400000000003 2024-09-12T22:03:59.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.888906+0000", 2024-09-12T22:03:59.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000143156 2024-09-12T22:03:59.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:03:59.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.889099+0000", 2024-09-12T22:03:59.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019344800000000001 2024-09-12T22:03:59.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.891253+0000", 2024-09-12T22:03:59.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021538299999999998 2024-09-12T22:03:59.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.894370+0000", 2024-09-12T22:03:59.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00311641 2024-09-12T22:03:59.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.894433+0000", 2024-09-12T22:03:59.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3037e-05 2024-09-12T22:03:59.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.894508+0000", 2024-09-12T22:03:59.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5179999999999995e-05 2024-09-12T22:03:59.123 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.123 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.123 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.124 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:24119 5.d 5:bcd78bdb:::benchmark_data_smithi043_32659_object24118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.124 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:58.981813+0000", 2024-09-12T22:03:59.124 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.031900307000000003, 2024-09-12T22:03:59.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010365589, 2024-09-12T22:03:59.124 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:03:59.124 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:03:59.124 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.124 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:03:59.124 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:03:59.124 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.124 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 24119 2024-09-12T22:03:59.124 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.124 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:03:59.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:03:59.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.981813+0000", 2024-09-12T22:03:59.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:03:59.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.981813+0000", 2024-09-12T22:03:59.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:03:59.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:03:59.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.981818+0000", 2024-09-12T22:03:59.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.814e-06 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.981904+0000", 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6416999999999996e-05 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.981921+0000", 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6439999999999998e-05 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.981927+0000", 2024-09-12T22:03:59.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2230000000000004e-06 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.982891+0000", 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00096436099999999995 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.982990+0000", 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9074999999999996e-05 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.983083+0000", 2024-09-12T22:03:59.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2329000000000003e-05 2024-09-12T22:03:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.988772+0000", 2024-09-12T22:03:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056895009999999996 2024-09-12T22:03:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:03:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.992074+0000", 2024-09-12T22:03:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033024299999999999 2024-09-12T22:03:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:03:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.992131+0000", 2024-09-12T22:03:59.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6750999999999999e-05 2024-09-12T22:03:59.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:03:59.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:03:59.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:03:59.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:58.992178+0000", 2024-09-12T22:03:59.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7247999999999999e-05 2024-09-12T22:03:59.129 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.129 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.129 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.129 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:03:59.129 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:03:59.129 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:03:59.131 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:59.129+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:59.131 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:03:59.189 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 5 16 24955 24939 311.714 260.188 0.00407096 0.00320471 2024-09-12T22:03:59.232 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:59.231+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:59.304 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:03:59.304 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T22:03:59.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.304 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:25351 5.6 5:63dd55e9:::benchmark_data_smithi043_32659_object25350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.304 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.299320+0000", 2024-09-12T22:03:59.304 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.002675387, 2024-09-12T22:03:59.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027041629999999999, 2024-09-12T22:03:59.305 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.305 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.305 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:59.305 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.305 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.305 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.305 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 25351 2024-09-12T22:03:59.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.305 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299320+0000", 2024-09-12T22:03:59.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299320+0000", 2024-09-12T22:03:59.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299321+0000", 2024-09-12T22:03:59.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0440000000000001e-06 2024-09-12T22:03:59.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299351+0000", 2024-09-12T22:03:59.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0224999999999999e-05 2024-09-12T22:03:59.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299361+0000", 2024-09-12T22:03:59.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6390000000000004e-06 2024-09-12T22:03:59.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299367+0000", 2024-09-12T22:03:59.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7349999999999999e-06 2024-09-12T22:03:59.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299449+0000", 2024-09-12T22:03:59.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1582000000000006e-05 2024-09-12T22:03:59.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299602+0000", 2024-09-12T22:03:59.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000152907 2024-09-12T22:03:59.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299726+0000", 2024-09-12T22:03:59.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124034 2024-09-12T22:03:59.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301657+0000", 2024-09-12T22:03:59.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019310429999999999 2024-09-12T22:03:59.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302018+0000", 2024-09-12T22:03:59.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036097100000000002 2024-09-12T22:03:59.309 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.309 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.309 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:25352 5.3 5:c741d9a5:::benchmark_data_smithi043_32659_object25351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.299531+0000", 2024-09-12T22:03:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.002464127, 2024-09-12T22:03:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025973580000000001, 2024-09-12T22:03:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 25352 2024-09-12T22:03:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299531+0000", 2024-09-12T22:03:59.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299531+0000", 2024-09-12T22:03:59.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299532+0000", 2024-09-12T22:03:59.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5000000000000001e-07 2024-09-12T22:03:59.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299602+0000", 2024-09-12T22:03:59.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9812000000000002e-05 2024-09-12T22:03:59.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299612+0000", 2024-09-12T22:03:59.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0217000000000001e-05 2024-09-12T22:03:59.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299618+0000", 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5629999999999997e-06 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299716+0000", 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7495000000000001e-05 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299836+0000", 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012006300000000001 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299999+0000", 2024-09-12T22:03:59.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000163203 2024-09-12T22:03:59.314 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.314 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.314 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.314 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:25354 5.c 5:3186c866:::benchmark_data_smithi043_32659_object25353:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.314 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.299771+0000", 2024-09-12T22:03:59.314 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0022245559999999999, 2024-09-12T22:03:59.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002440818, 2024-09-12T22:03:59.314 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.315 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.315 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:59.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.315 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 25354 2024-09-12T22:03:59.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.315 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299771+0000", 2024-09-12T22:03:59.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299771+0000", 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299771+0000", 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.16e-07 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299938+0000", 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000166976 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299948+0000", 2024-09-12T22:03:59.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3549999999999994e-06 2024-09-12T22:03:59.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299960+0000", 2024-09-12T22:03:59.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2269000000000001e-05 2024-09-12T22:03:59.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300027+0000", 2024-09-12T22:03:59.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7125999999999994e-05 2024-09-12T22:03:59.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300176+0000", 2024-09-12T22:03:59.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014894999999999999 2024-09-12T22:03:59.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300304+0000", 2024-09-12T22:03:59.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012769600000000001 2024-09-12T22:03:59.318 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.318 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.318 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.319 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:25350 5.2 e26/22 5:44e88d57:::benchmark_data_smithi043_32659_object25349:head v 26'1618, mlcod=26'1615)", 2024-09-12T22:03:59.319 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.299996+0000", 2024-09-12T22:03:59.319 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0019990329999999999, 2024-09-12T22:03:59.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002291726, 2024-09-12T22:03:59.319 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.319 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.319 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:59.319 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299996+0000", 2024-09-12T22:03:59.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299996+0000", 2024-09-12T22:03:59.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.299997+0000", 2024-09-12T22:03:59.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7000000000000004e-07 2024-09-12T22:03:59.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300085+0000", 2024-09-12T22:03:59.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8200000000000003e-05 2024-09-12T22:03:59.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300094+0000", 2024-09-12T22:03:59.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2469999999999997e-06 2024-09-12T22:03:59.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300100+0000", 2024-09-12T22:03:59.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6319999999999996e-06 2024-09-12T22:03:59.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300289+0000", 2024-09-12T22:03:59.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000189147 2024-09-12T22:03:59.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300307+0000", 2024-09-12T22:03:59.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7725999999999999e-05 2024-09-12T22:03:59.322 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.323 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.323 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.323 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:25349 5.7 e26/22 5:e4abd7c7:::benchmark_data_smithi043_32659_object25348:head v 26'1565, mlcod=26'1561)", 2024-09-12T22:03:59.323 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.300115+0000", 2024-09-12T22:03:59.323 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0018801480000000001, 2024-09-12T22:03:59.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002238421, 2024-09-12T22:03:59.323 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.323 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.323 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:59.323 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300115+0000", 2024-09-12T22:03:59.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300115+0000", 2024-09-12T22:03:59.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300115+0000", 2024-09-12T22:03:59.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.65e-07 2024-09-12T22:03:59.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300186+0000", 2024-09-12T22:03:59.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0967e-05 2024-09-12T22:03:59.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300196+0000", 2024-09-12T22:03:59.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3880000000000006e-06 2024-09-12T22:03:59.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300201+0000", 2024-09-12T22:03:59.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7620000000000001e-06 2024-09-12T22:03:59.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300251+0000", 2024-09-12T22:03:59.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9228999999999999e-05 2024-09-12T22:03:59.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300269+0000", 2024-09-12T22:03:59.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8609000000000001e-05 2024-09-12T22:03:59.326 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:25353 5.4 e26/22 5:29d6d962:::benchmark_data_smithi043_32659_object25352:head v 26'1622, mlcod=26'1620)", 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.300200+0000", 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.001794969, 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021861160000000001, 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300200+0000", 2024-09-12T22:03:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300200+0000", 2024-09-12T22:03:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300201+0000", 2024-09-12T22:03:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:03:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300866+0000", 2024-09-12T22:03:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00066510799999999998 2024-09-12T22:03:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300878+0000", 2024-09-12T22:03:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1955e-05 2024-09-12T22:03:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300884+0000", 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3409999999999999e-06 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301432+0000", 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00054770700000000003 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301448+0000", 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5770999999999999e-05 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:25355 5.a 5:5eac8f40:::benchmark_data_smithi043_32659_object25354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.300926+0000", 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0010690319999999999, 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001497658, 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 25355 2024-09-12T22:03:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300926+0000", 2024-09-12T22:03:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300926+0000", 2024-09-12T22:03:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300927+0000", 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.28e-06 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300956+0000", 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9087000000000001e-05 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300968+0000", 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1581e-05 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.300975+0000", 2024-09-12T22:03:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0539999999999997e-06 2024-09-12T22:03:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301051+0000", 2024-09-12T22:03:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5766000000000006e-05 2024-09-12T22:03:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301179+0000", 2024-09-12T22:03:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000128555 2024-09-12T22:03:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301319+0000", 2024-09-12T22:03:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000139748 2024-09-12T22:03:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:25357 5.3 5:c9897a57:::benchmark_data_smithi043_32659_object25356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.301249+0000", 2024-09-12T22:03:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.000745716, 2024-09-12T22:03:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00121991, 2024-09-12T22:03:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 25357 2024-09-12T22:03:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301249+0000", 2024-09-12T22:03:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301249+0000", 2024-09-12T22:03:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301250+0000", 2024-09-12T22:03:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2699999999999999e-07 2024-09-12T22:03:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301283+0000", 2024-09-12T22:03:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3377999999999998e-05 2024-09-12T22:03:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301293+0000", 2024-09-12T22:03:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2739999999999996e-06 2024-09-12T22:03:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301300+0000", 2024-09-12T22:03:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7669999999999998e-06 2024-09-12T22:03:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301349+0000", 2024-09-12T22:03:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9987000000000001e-05 2024-09-12T22:03:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301469+0000", 2024-09-12T22:03:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119502 2024-09-12T22:03:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301595+0000", 2024-09-12T22:03:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012587199999999999 2024-09-12T22:03:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:25356 5.7 e26/22 5:e0ce5534:::benchmark_data_smithi043_32659_object25355:head v 26'1566, mlcod=26'1561)", 2024-09-12T22:03:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.301264+0000", 2024-09-12T22:03:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00073098, 2024-09-12T22:03:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001255735, 2024-09-12T22:03:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301264+0000", 2024-09-12T22:03:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301264+0000", 2024-09-12T22:03:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301265+0000", 2024-09-12T22:03:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7800000000000002e-07 2024-09-12T22:03:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301345+0000", 2024-09-12T22:03:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0581999999999995e-05 2024-09-12T22:03:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301354+0000", 2024-09-12T22:03:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0159999999999997e-06 2024-09-12T22:03:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301363+0000", 2024-09-12T22:03:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8040000000000007e-06 2024-09-12T22:03:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301419+0000", 2024-09-12T22:03:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6282000000000001e-05 2024-09-12T22:03:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301437+0000", 2024-09-12T22:03:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7873999999999999e-05 2024-09-12T22:03:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop_reply(client.4514.0:25352 5.3 e26/22)", 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.301627+0000", 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00036812299999999999, 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00093232899999999997, 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301627+0000", 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301627+0000", 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301627+0000", 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4700000000000002e-07 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301630+0000", 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9069999999999999e-06 2024-09-12T22:03:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301638+0000", 2024-09-12T22:03:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3629999999999996e-06 2024-09-12T22:03:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.301643+0000", 2024-09-12T22:03:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:03:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:25360 5.2 e26/22 5:4fa5ae57:::benchmark_data_smithi043_32659_object25359:head v 26'1619, mlcod=26'1616)", 2024-09-12T22:03:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.302008+0000", 2024-09-12T22:03:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9999871, 2024-09-12T22:03:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00058878000000000001, 2024-09-12T22:03:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302008+0000", 2024-09-12T22:03:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302008+0000", 2024-09-12T22:03:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302009+0000", 2024-09-12T22:03:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:03:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302086+0000", 2024-09-12T22:03:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7323000000000005e-05 2024-09-12T22:03:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302095+0000", 2024-09-12T22:03:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7020000000000007e-06 2024-09-12T22:03:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302101+0000", 2024-09-12T22:03:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3430000000000001e-06 2024-09-12T22:03:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302161+0000", 2024-09-12T22:03:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9414999999999999e-05 2024-09-12T22:03:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302178+0000", 2024-09-12T22:03:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7527999999999999e-05 2024-09-12T22:03:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:25358 5.c 5:3ddb69d5:::benchmark_data_smithi043_32659_object25357:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.302158+0000", 2024-09-12T22:03:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9998369, 2024-09-12T22:03:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00048268699999999998, 2024-09-12T22:03:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:03:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 25358 2024-09-12T22:03:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302158+0000", 2024-09-12T22:03:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302158+0000", 2024-09-12T22:03:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302159+0000", 2024-09-12T22:03:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.068e-06 2024-09-12T22:03:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302221+0000", 2024-09-12T22:03:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2218999999999995e-05 2024-09-12T22:03:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302233+0000", 2024-09-12T22:03:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1494999999999999e-05 2024-09-12T22:03:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302240+0000", 2024-09-12T22:03:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:03:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302398+0000", 2024-09-12T22:03:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015805600000000001 2024-09-12T22:03:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302477+0000", 2024-09-12T22:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8706000000000002e-05 2024-09-12T22:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302560+0000", 2024-09-12T22:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2695999999999996e-05 2024-09-12T22:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:25361 5.3 5.8179cbd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.302258+0000", 2024-09-12T22:03:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9997373, 2024-09-12T22:03:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00043898, 2024-09-12T22:03:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T22:03:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 25361 2024-09-12T22:03:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302258+0000", 2024-09-12T22:03:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302258+0000", 2024-09-12T22:03:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302258+0000", 2024-09-12T22:03:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6599999999999996e-07 2024-09-12T22:03:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302283+0000", 2024-09-12T22:03:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5092e-05 2024-09-12T22:03:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302291+0000", 2024-09-12T22:03:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9799999999999998e-06 2024-09-12T22:03:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302297+0000", 2024-09-12T22:03:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6860000000000003e-06 2024-09-12T22:03:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:25359 5.b e26/22)", 2024-09-12T22:03:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.302320+0000", 2024-09-12T22:03:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9996748, 2024-09-12T22:03:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042900799999999998, 2024-09-12T22:03:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302320+0000", 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302320+0000", 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302321+0000", 2024-09-12T22:03:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9700000000000002e-07 2024-09-12T22:03:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302346+0000", 2024-09-12T22:03:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5208e-05 2024-09-12T22:03:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302354+0000", 2024-09-12T22:03:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5189999999999992e-06 2024-09-12T22:03:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302360+0000", 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4160000000000003e-06 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:25363 5.8 e26/22 5:1661c26a:::benchmark_data_smithi043_32659_object25362:head v 26'1559, mlcod=26'1557)", 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.302556+0000", 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9994392, 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024982500000000001, 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302556+0000", 2024-09-12T22:03:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302556+0000", 2024-09-12T22:03:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302557+0000", 2024-09-12T22:03:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:03:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302643+0000", 2024-09-12T22:03:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6174000000000005e-05 2024-09-12T22:03:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302652+0000", 2024-09-12T22:03:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2709999999999998e-06 2024-09-12T22:03:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302658+0000", 2024-09-12T22:03:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6690000000000003e-06 2024-09-12T22:03:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302706+0000", 2024-09-12T22:03:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8266999999999997e-05 2024-09-12T22:03:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.302729+0000", 2024-09-12T22:03:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2739999999999999e-05 2024-09-12T22:03:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T22:03:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 15 2024-09-12T22:03:59.367 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:03:59.368 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:03:59.367+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:03:59.369 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:03:59.469 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:59.468+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:59.542 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:03:59.542 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T22:03:59.543 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T22:03:59.543 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T22:03:59.543 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:03:59.557 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:03:59.569 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:59.568+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:59.670 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:03:59.669+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:03:59.727 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:03:59.727 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T22:03:59.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T22:03:59.728 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T22:03:59.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.728 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.728 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:03:59.728 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.27477691, 2024-09-12T22:03:59.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017423646000000001, 2024-09-12T22:03:59.728 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.728 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.728 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.728 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:03:59.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:03:59.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449728+0000", 2024-09-12T22:03:59.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:03:59.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449750+0000", 2024-09-12T22:03:59.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2391e-05 2024-09-12T22:03:59.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449775+0000", 2024-09-12T22:03:59.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4831999999999999e-05 2024-09-12T22:03:59.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449785+0000", 2024-09-12T22:03:59.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0361e-05 2024-09-12T22:03:59.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449857+0000", 2024-09-12T22:03:59.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1990999999999996e-05 2024-09-12T22:03:59.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:03:59.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449863+0000", 2024-09-12T22:03:59.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6570000000000002e-06 2024-09-12T22:03:59.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462558+0000", 2024-09-12T22:03:59.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012695032 2024-09-12T22:03:59.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462703+0000", 2024-09-12T22:03:59.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014444100000000001 2024-09-12T22:03:59.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462853+0000", 2024-09-12T22:03:59.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015042300000000001 2024-09-12T22:03:59.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465147+0000", 2024-09-12T22:03:59.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022944789999999999 2024-09-12T22:03:59.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467012+0000", 2024-09-12T22:03:59.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018646030000000001 2024-09-12T22:03:59.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467095+0000", 2024-09-12T22:03:59.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2695999999999996e-05 2024-09-12T22:03:59.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467148+0000", 2024-09-12T22:03:59.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2958999999999999e-05 2024-09-12T22:03:59.734 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.734 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.734 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.734 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.274688067, 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018410795000000001, 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:03:59.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449814+0000", 2024-09-12T22:03:59.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:03:59.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449827+0000", 2024-09-12T22:03:59.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3373000000000001e-05 2024-09-12T22:03:59.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:03:59.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.081e-06 2024-09-12T22:03:59.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449853+0000", 2024-09-12T22:03:59.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7181e-05 2024-09-12T22:03:59.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449914+0000", 2024-09-12T22:03:59.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0736000000000003e-05 2024-09-12T22:03:59.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:03:59.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449921+0000", 2024-09-12T22:03:59.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2559999999999996e-06 2024-09-12T22:03:59.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461147+0000", 2024-09-12T22:03:59.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011226211999999999 2024-09-12T22:03:59.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461353+0000", 2024-09-12T22:03:59.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000205217 2024-09-12T22:03:59.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:59.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461512+0000", 2024-09-12T22:03:59.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015960700000000001 2024-09-12T22:03:59.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464643+0000", 2024-09-12T22:03:59.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003130238 2024-09-12T22:03:59.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468132+0000", 2024-09-12T22:03:59.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0034897109999999999 2024-09-12T22:03:59.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468182+0000", 2024-09-12T22:03:59.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0209e-05 2024-09-12T22:03:59.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468224+0000", 2024-09-12T22:03:59.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1199000000000003e-05 2024-09-12T22:03:59.741 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.741 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.741 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.741 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.741 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:03:59.741 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.274630592000001, 2024-09-12T22:03:59.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017523931, 2024-09-12T22:03:59.742 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.742 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.742 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.742 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:03:59.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:03:59.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449871+0000", 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449890+0000", 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9245999999999998e-05 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449899+0000", 2024-09-12T22:03:59.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1530000000000003e-06 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449905+0000", 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8100000000000003e-06 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449942+0000", 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7119000000000002e-05 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449945+0000", 2024-09-12T22:03:59.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0529999999999998e-06 2024-09-12T22:03:59.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463125+0000", 2024-09-12T22:03:59.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013179326 2024-09-12T22:03:59.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463171+0000", 2024-09-12T22:03:59.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6455000000000002e-05 2024-09-12T22:03:59.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463242+0000", 2024-09-12T22:03:59.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0430000000000002e-05 2024-09-12T22:03:59.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465152+0000", 2024-09-12T22:03:59.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001910082 2024-09-12T22:03:59.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467291+0000", 2024-09-12T22:03:59.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021394119999999998 2024-09-12T22:03:59.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467351+0000", 2024-09-12T22:03:59.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9673999999999998e-05 2024-09-12T22:03:59.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467394+0000", 2024-09-12T22:03:59.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3477999999999999e-05 2024-09-12T22:03:59.747 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.747 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.747 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.748 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.748 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:03:59.748 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.274583485000001, 2024-09-12T22:03:59.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018417978000000002, 2024-09-12T22:03:59.748 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.748 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.748 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.748 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:03:59.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:03:59.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449918+0000", 2024-09-12T22:03:59.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:03:59.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449923+0000", 2024-09-12T22:03:59.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1959999999999999e-06 2024-09-12T22:03:59.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449928+0000", 2024-09-12T22:03:59.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3989999999999997e-06 2024-09-12T22:03:59.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449931+0000", 2024-09-12T22:03:59.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5750000000000001e-06 2024-09-12T22:03:59.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449968+0000", 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7209999999999998e-05 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449974+0000", 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9730000000000002e-06 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462282+0000", 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012308102 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462368+0000", 2024-09-12T22:03:59.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5920000000000004e-05 2024-09-12T22:03:59.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:59.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462490+0000", 2024-09-12T22:03:59.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121478 2024-09-12T22:03:59.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.752 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.752 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465141+0000", 2024-09-12T22:03:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026515990000000001 2024-09-12T22:03:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468273+0000", 2024-09-12T22:03:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003131736 2024-09-12T22:03:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468308+0000", 2024-09-12T22:03:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4572e-05 2024-09-12T22:03:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468335+0000", 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7727999999999999e-05 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.274564611999999, 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018483090000000001, 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.754 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449937+0000", 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0699999999999999e-07 2024-09-12T22:03:59.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449939+0000", 2024-09-12T22:03:59.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.853e-06 2024-09-12T22:03:59.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449943+0000", 2024-09-12T22:03:59.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8999999999999999e-06 2024-09-12T22:03:59.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449956+0000", 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2843000000000001e-05 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0277000000000002e-05 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449990+0000", 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1410000000000001e-06 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463480+0000", 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013490564 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463553+0000", 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3094000000000002e-05 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463629+0000", 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5610000000000003e-05 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465158+0000", 2024-09-12T22:03:59.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015294169999999999 2024-09-12T22:03:59.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468328+0000", 2024-09-12T22:03:59.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031699699999999998 2024-09-12T22:03:59.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468381+0000", 2024-09-12T22:03:59.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2398000000000002e-05 2024-09-12T22:03:59.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468419+0000", 2024-09-12T22:03:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8816000000000002e-05 2024-09-12T22:03:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:03:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.27453607, 2024-09-12T22:03:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017182808000000001, 2024-09-12T22:03:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2500000000000001e-07 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449968+0000", 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7140000000000002e-06 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449975+0000", 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449980+0000", 2024-09-12T22:03:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1659999999999996e-06 2024-09-12T22:03:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450048+0000", 2024-09-12T22:03:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8823000000000002e-05 2024-09-12T22:03:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:03:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450052+0000", 2024-09-12T22:03:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8689999999999997e-06 2024-09-12T22:03:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461166+0000", 2024-09-12T22:03:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011114166999999999 2024-09-12T22:03:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461279+0000", 2024-09-12T22:03:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000112212 2024-09-12T22:03:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:03:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461417+0000", 2024-09-12T22:03:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138202 2024-09-12T22:03:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463371+0000", 2024-09-12T22:03:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019543120000000001 2024-09-12T22:03:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467009+0000", 2024-09-12T22:03:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036383180000000002 2024-09-12T22:03:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467109+0000", 2024-09-12T22:03:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9601999999999999e-05 2024-09-12T22:03:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467148+0000", 2024-09-12T22:03:59.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8618000000000002e-05 2024-09-12T22:03:59.766 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.766 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.766 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.766 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.766 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:03:59.767 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.274490015000001, 2024-09-12T22:03:59.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017404473, 2024-09-12T22:03:59.767 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.767 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.767 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:59.767 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:03:59.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:03:59.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450012+0000", 2024-09-12T22:03:59.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T22:03:59.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450016+0000", 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9389999999999999e-06 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8209999999999997e-06 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450036+0000", 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0496000000000001e-05 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:03:59.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9070999999999997e-05 2024-09-12T22:03:59.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:59.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450100+0000", 2024-09-12T22:03:59.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0089999999999998e-06 2024-09-12T22:03:59.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461992+0000", 2024-09-12T22:03:59.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011891868999999999 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462124+0000", 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013271299999999999 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467415+0000", 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052909029999999996 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.274451774999999, 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018455814000000001, 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:03:59.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450050+0000", 2024-09-12T22:03:59.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2e-07 2024-09-12T22:03:59.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450053+0000", 2024-09-12T22:03:59.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0819999999999999e-06 2024-09-12T22:03:59.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450061+0000", 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8169999999999999e-06 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450080+0000", 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9219999999999999e-05 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0834000000000002e-05 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:03:59.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450123+0000", 2024-09-12T22:03:59.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5830000000000001e-06 2024-09-12T22:03:59.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464167+0000", 2024-09-12T22:03:59.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014043517 2024-09-12T22:03:59.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464298+0000", 2024-09-12T22:03:59.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013117099999999999 2024-09-12T22:03:59.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468505+0000", 2024-09-12T22:03:59.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042070700000000003 2024-09-12T22:03:59.776 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.776 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.776 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.776 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:03:59.776 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:03:59.776 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 26.274405915999999, 2024-09-12T22:03:59.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018063523000000001, 2024-09-12T22:03:59.776 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.776 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.777 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:03:59.777 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:03:59.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:03:59.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450096+0000", 2024-09-12T22:03:59.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7899999999999998e-07 2024-09-12T22:03:59.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450100+0000", 2024-09-12T22:03:59.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:03:59.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450107+0000", 2024-09-12T22:03:59.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9269999999999999e-06 2024-09-12T22:03:59.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450112+0000", 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2909999999999998e-06 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450156+0000", 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3665999999999998e-05 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450160+0000", 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.822e-06 2024-09-12T22:03:59.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.459675+0000", 2024-09-12T22:03:59.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0095155039999999993 2024-09-12T22:03:59.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.459901+0000", 2024-09-12T22:03:59.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000225419 2024-09-12T22:03:59.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468159+0000", 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082579100000000003 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:24125 5.a 5:593c7a40:::benchmark_data_smithi043_32659_object24124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:58.982608+0000", 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.74189249400000001, 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0098997440000000003, 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.781 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.782 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.782 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 24125 2024-09-12T22:03:59.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.782 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:58.982608+0000", 2024-09-12T22:03:59.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:58.982608+0000", 2024-09-12T22:03:59.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:58.982609+0000", 2024-09-12T22:03:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:03:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:58.982644+0000", 2024-09-12T22:03:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4638999999999998e-05 2024-09-12T22:03:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:58.982652+0000", 2024-09-12T22:03:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2889999999999998e-06 2024-09-12T22:03:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:58.982658+0000", 2024-09-12T22:03:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8799999999999996e-06 2024-09-12T22:03:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:58.982724+0000", 2024-09-12T22:03:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6211999999999996e-05 2024-09-12T22:03:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:58.982856+0000", 2024-09-12T22:03:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000131681 2024-09-12T22:03:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:58.982993+0000", 2024-09-12T22:03:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013672900000000001 2024-09-12T22:03:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:58.985664+0000", 2024-09-12T22:03:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026718150000000001 2024-09-12T22:03:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:58.992430+0000", 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067661359999999999 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:58.992463+0000", 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2041e-05 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:58.992508+0000", 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5639000000000001e-05 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.786 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.787 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.787 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:24946 5.a 5:50e5ee2f:::benchmark_data_smithi043_32659_object24945:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.787 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.187196+0000", 2024-09-12T22:03:59.787 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53730461799999996, 2024-09-12T22:03:59.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011742136, 2024-09-12T22:03:59.787 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.787 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.787 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.787 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.787 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.787 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.788 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 24946 2024-09-12T22:03:59.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.788 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187196+0000", 2024-09-12T22:03:59.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187196+0000", 2024-09-12T22:03:59.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187197+0000", 2024-09-12T22:03:59.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9699999999999995e-07 2024-09-12T22:03:59.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187275+0000", 2024-09-12T22:03:59.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8108999999999994e-05 2024-09-12T22:03:59.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187286+0000", 2024-09-12T22:03:59.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:03:59.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187293+0000", 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1659999999999997e-06 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188231+0000", 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00093842999999999997 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188395+0000", 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000163962 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188543+0000", 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000147978 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.192445+0000", 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039016580000000001 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.198883+0000", 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064380510000000002 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.198913+0000", 2024-09-12T22:03:59.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0294000000000002e-05 2024-09-12T22:03:59.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.198938+0000", 2024-09-12T22:03:59.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5185e-05 2024-09-12T22:03:59.792 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.792 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.792 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.792 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:24950 5.a 5:5765e396:::benchmark_data_smithi043_32659_object24949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.793 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.188315+0000", 2024-09-12T22:03:59.793 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.53618567699999997, 2024-09-12T22:03:59.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01110091, 2024-09-12T22:03:59.793 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.793 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.793 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.793 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.793 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.793 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.793 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 24950 2024-09-12T22:03:59.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.793 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188315+0000", 2024-09-12T22:03:59.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188315+0000", 2024-09-12T22:03:59.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188316+0000", 2024-09-12T22:03:59.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1659999999999999e-06 2024-09-12T22:03:59.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188434+0000", 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117615 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188444+0000", 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0369e-05 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188452+0000", 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4340000000000003e-06 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.189618+0000", 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001165763 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.189724+0000", 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000106588 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.189859+0000", 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013484599999999999 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.192449+0000", 2024-09-12T22:03:59.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025898829999999999 2024-09-12T22:03:59.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.199316+0000", 2024-09-12T22:03:59.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00686682 2024-09-12T22:03:59.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.199377+0000", 2024-09-12T22:03:59.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0931000000000003e-05 2024-09-12T22:03:59.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.199416+0000", 2024-09-12T22:03:59.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9495e-05 2024-09-12T22:03:59.798 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.798 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.798 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.798 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:24962 5.a 5:5e668ee5:::benchmark_data_smithi043_32659_object24961:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.798 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.192475+0000", 2024-09-12T22:03:59.798 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.532026153, 2024-09-12T22:03:59.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0096587080000000002, 2024-09-12T22:03:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 24962 2024-09-12T22:03:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.192475+0000", 2024-09-12T22:03:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.192475+0000", 2024-09-12T22:03:59.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.192476+0000", 2024-09-12T22:03:59.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0890000000000001e-06 2024-09-12T22:03:59.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.192547+0000", 2024-09-12T22:03:59.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0845000000000004e-05 2024-09-12T22:03:59.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.192558+0000", 2024-09-12T22:03:59.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1283e-05 2024-09-12T22:03:59.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.192566+0000", 2024-09-12T22:03:59.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4300000000000006e-06 2024-09-12T22:03:59.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.192633+0000", 2024-09-12T22:03:59.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6088999999999997e-05 2024-09-12T22:03:59.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.192782+0000", 2024-09-12T22:03:59.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000149696 2024-09-12T22:03:59.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:59.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.192875+0000", 2024-09-12T22:03:59.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2649e-05 2024-09-12T22:03:59.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.194166+0000", 2024-09-12T22:03:59.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012915730000000001 2024-09-12T22:03:59.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.202027+0000", 2024-09-12T22:03:59.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0078603200000000005 2024-09-12T22:03:59.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.202090+0000", 2024-09-12T22:03:59.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3201999999999996e-05 2024-09-12T22:03:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.202133+0000", 2024-09-12T22:03:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3532000000000003e-05 2024-09-12T22:03:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:25118 5.1 e26/22 5:8e9517b9:::benchmark_data_smithi043_32659_object25117:head v 26'1515, mlcod=26'1513)", 2024-09-12T22:03:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.236871+0000", 2024-09-12T22:03:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.48762993700000001, 2024-09-12T22:03:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0092866960000000005, 2024-09-12T22:03:59.805 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.805 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.805 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.805 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.236871+0000", 2024-09-12T22:03:59.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.236871+0000", 2024-09-12T22:03:59.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.236871+0000", 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.236898+0000", 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6874999999999999e-05 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.236907+0000", 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.054e-06 2024-09-12T22:03:59.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.236913+0000", 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.575e-06 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.236956+0000", 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2954999999999998e-05 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.236967+0000", 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1325000000000001e-05 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.246109+0000", 2024-09-12T22:03:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0091419719999999999 2024-09-12T22:03:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.246158+0000", 2024-09-12T22:03:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8473999999999997e-05 2024-09-12T22:03:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:25567 5.a 5:52d6f348:::benchmark_data_smithi043_32659_object25566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.809 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.353700+0000", 2024-09-12T22:03:59.809 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.37080077099999997, 2024-09-12T22:03:59.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0094056950000000004, 2024-09-12T22:03:59.809 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.809 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.809 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.809 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.809 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.809 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.809 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 25567 2024-09-12T22:03:59.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.809 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.353700+0000", 2024-09-12T22:03:59.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.353700+0000", 2024-09-12T22:03:59.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.353701+0000", 2024-09-12T22:03:59.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9100000000000003e-07 2024-09-12T22:03:59.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.353757+0000", 2024-09-12T22:03:59.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5893999999999997e-05 2024-09-12T22:03:59.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.353766+0000", 2024-09-12T22:03:59.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3700000000000001e-06 2024-09-12T22:03:59.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.353773+0000", 2024-09-12T22:03:59.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6340000000000003e-06 2024-09-12T22:03:59.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.353847+0000", 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3905999999999993e-05 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.353978+0000", 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000130994 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.354113+0000", 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000134952 2024-09-12T22:03:59.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.355491+0000", 2024-09-12T22:03:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013780940000000001 2024-09-12T22:03:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.363009+0000", 2024-09-12T22:03:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0075185720000000003 2024-09-12T22:03:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.363066+0000", 2024-09-12T22:03:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6739e-05 2024-09-12T22:03:59.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.363106+0000", 2024-09-12T22:03:59.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9848999999999997e-05 2024-09-12T22:03:59.814 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.814 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.814 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.814 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:26194 5.a 5:536362ae:::benchmark_data_smithi043_32659_object26193:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.814 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.521792+0000", 2024-09-12T22:03:59.814 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.202709308, 2024-09-12T22:03:59.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010458713, 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 26194 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.521792+0000", 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.521792+0000", 2024-09-12T22:03:59.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.521793+0000", 2024-09-12T22:03:59.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8100000000000001e-07 2024-09-12T22:03:59.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.521822+0000", 2024-09-12T22:03:59.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9771999999999999e-05 2024-09-12T22:03:59.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.521832+0000", 2024-09-12T22:03:59.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6379999999999999e-06 2024-09-12T22:03:59.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.521846+0000", 2024-09-12T22:03:59.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4361e-05 2024-09-12T22:03:59.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.525193+0000", 2024-09-12T22:03:59.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003346244 2024-09-12T22:03:59.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.525309+0000", 2024-09-12T22:03:59.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116944 2024-09-12T22:03:59.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:59.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.525414+0000", 2024-09-12T22:03:59.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010483 2024-09-12T22:03:59.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.531250+0000", 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058360319999999997 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.532133+0000", 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00088292199999999996 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.532207+0000", 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3539000000000002e-05 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.532250+0000", 2024-09-12T22:03:59.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3550000000000001e-05 2024-09-12T22:03:59.820 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.820 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.820 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.820 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:26196 5.a 5:58e75b84:::benchmark_data_smithi043_32659_object26195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.820 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.522099+0000", 2024-09-12T22:03:59.820 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.202401522, 2024-09-12T22:03:59.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010309375000000001, 2024-09-12T22:03:59.820 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.820 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.820 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.820 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.821 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.821 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.821 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 26196 2024-09-12T22:03:59.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.821 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.522099+0000", 2024-09-12T22:03:59.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.522099+0000", 2024-09-12T22:03:59.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.522100+0000", 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.009e-06 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.522248+0000", 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014780899999999999 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.522257+0000", 2024-09-12T22:03:59.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2970000000000004e-06 2024-09-12T22:03:59.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.522263+0000", 2024-09-12T22:03:59.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.054e-06 2024-09-12T22:03:59.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.526473+0000", 2024-09-12T22:03:59.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042101860000000003 2024-09-12T22:03:59.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.526585+0000", 2024-09-12T22:03:59.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000112693 2024-09-12T22:03:59.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:59.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.526664+0000", 2024-09-12T22:03:59.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8252999999999998e-05 2024-09-12T22:03:59.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.531253+0000", 2024-09-12T22:03:59.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045893009999999996 2024-09-12T22:03:59.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.532309+0000", 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010558469999999999 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.532359+0000", 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0083999999999997e-05 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.532409+0000", 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9842000000000002e-05 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.825 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.826 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:26733 5.a 5:5b29dc12:::benchmark_data_smithi043_32659_object26732:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:03:59.826 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.669100+0000", 2024-09-12T22:03:59.826 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.055400552999999998, 2024-09-12T22:03:59.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010697385, 2024-09-12T22:03:59.826 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.826 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.826 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.826 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:03:59.826 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:03:59.826 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:03:59.826 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 26733 2024-09-12T22:03:59.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.827 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.669100+0000", 2024-09-12T22:03:59.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.669100+0000", 2024-09-12T22:03:59.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.669101+0000", 2024-09-12T22:03:59.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2500000000000005e-07 2024-09-12T22:03:59.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.669134+0000", 2024-09-12T22:03:59.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3033e-05 2024-09-12T22:03:59.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.669142+0000", 2024-09-12T22:03:59.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.892e-06 2024-09-12T22:03:59.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.669146+0000", 2024-09-12T22:03:59.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0829999999999997e-06 2024-09-12T22:03:59.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.669191+0000", 2024-09-12T22:03:59.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5318999999999998e-05 2024-09-12T22:03:59.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.669396+0000", 2024-09-12T22:03:59.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020485699999999999 2024-09-12T22:03:59.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.669519+0000", 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012291799999999999 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.671595+0000", 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020763230000000001 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.679694+0000", 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.008098493 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.679753+0000", 2024-09-12T22:03:59.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9531999999999999e-05 2024-09-12T22:03:59.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.679798+0000", 2024-09-12T22:03:59.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4310000000000001e-05 2024-09-12T22:03:59.831 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.831 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.831 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.831 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:26828 5.1 e26/22 5:89da373a:::benchmark_data_smithi043_32659_object26827:head v 26'1618, mlcod=26'1616)", 2024-09-12T22:03:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:03:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.026647273999999999, 2024-09-12T22:03:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013883159000000001, 2024-09-12T22:03:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:03:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8500000000000001e-07 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697920+0000", 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6223000000000006e-05 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697929+0000", 2024-09-12T22:03:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2199999999999992e-06 2024-09-12T22:03:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697935+0000", 2024-09-12T22:03:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0190000000000003e-06 2024-09-12T22:03:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697982+0000", 2024-09-12T22:03:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7630000000000003e-05 2024-09-12T22:03:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.698001+0000", 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8488e-05 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.711690+0000", 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013689364000000001 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.711737+0000", 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6629999999999999e-05 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:26838 5.1 e26/22 5:878c6958:::benchmark_data_smithi043_32659_object26837:head v 26'1619, mlcod=26'1616)", 2024-09-12T22:03:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.699838+0000", 2024-09-12T22:03:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.024663207999999999, 2024-09-12T22:03:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011938512, 2024-09-12T22:03:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:03:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:03:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:03:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:03:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:03:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699838+0000", 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699838+0000", 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699843+0000", 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7679999999999997e-06 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:03:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699938+0000", 2024-09-12T22:03:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4470999999999997e-05 2024-09-12T22:03:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:03:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699953+0000", 2024-09-12T22:03:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5028000000000001e-05 2024-09-12T22:03:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:03:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699963+0000", 2024-09-12T22:03:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0118e-05 2024-09-12T22:03:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:03:59.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.700042+0000", 2024-09-12T22:03:59.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8629999999999998e-05 2024-09-12T22:03:59.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:03:59.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.700057+0000", 2024-09-12T22:03:59.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5170999999999999e-05 2024-09-12T22:03:59.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:03:59.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.711740+0000", 2024-09-12T22:03:59.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01168284 2024-09-12T22:03:59.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:03:59.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:03:59.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:03:59.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.711776+0000", 2024-09-12T22:03:59.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6486000000000003e-05 2024-09-12T22:03:59.841 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.841 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.841 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.841 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:03:59.841 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:03:59.841 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:03:59.843 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:03:59.844 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:59.841+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:03:59.944 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:03:59.942+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:00.000 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:00.000 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:00.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.001 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:27975 5.9 5:9a6f0e98:::benchmark_data_smithi043_32659_object27974:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:00.001 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:59.993878+0000", 2024-09-12T22:04:00.001 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0052885379999999997, 2024-09-12T22:04:00.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0053064460000000003, 2024-09-12T22:04:00.001 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:00.001 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:00.001 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:00.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:00.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:00.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:00.001 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 27975 2024-09-12T22:04:00.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.002 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:00.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:00.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.993878+0000", 2024-09-12T22:04:00.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:00.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:00.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.993878+0000", 2024-09-12T22:04:00.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:00.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:00.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.993879+0000", 2024-09-12T22:04:00.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9200000000000001e-07 2024-09-12T22:04:00.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:00.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.993976+0000", 2024-09-12T22:04:00.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7476e-05 2024-09-12T22:04:00.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:00.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.993993+0000", 2024-09-12T22:04:00.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7170999999999999e-05 2024-09-12T22:04:00.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:00.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.994000+0000", 2024-09-12T22:04:00.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3749999999999999e-06 2024-09-12T22:04:00.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:00.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.994071+0000", 2024-09-12T22:04:00.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1539999999999996e-05 2024-09-12T22:04:00.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:00.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.994177+0000", 2024-09-12T22:04:00.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010621299999999999 2024-09-12T22:04:00.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:00.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.994289+0000", 2024-09-12T22:04:00.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111327 2024-09-12T22:04:00.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:00.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.996733+0000", 2024-09-12T22:04:00.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024442980000000001 2024-09-12T22:04:00.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:00.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.999095+0000", 2024-09-12T22:04:00.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002362037 2024-09-12T22:04:00.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:00.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.999148+0000", 2024-09-12T22:04:00.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029000000000003e-05 2024-09-12T22:04:00.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:00.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.999185+0000", 2024-09-12T22:04:00.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6387999999999998e-05 2024-09-12T22:04:00.006 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.006 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:00.006 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.007 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:27978 5.f 5:f7f2f49f:::benchmark_data_smithi043_32659_object27977:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:00.007 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:59.994875+0000", 2024-09-12T22:04:00.007 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0042919550000000001, 2024-09-12T22:04:00.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043718610000000003, 2024-09-12T22:04:00.007 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:00.007 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:00.007 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:00.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:00.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:00.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:00.007 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 27978 2024-09-12T22:04:00.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.007 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:00.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:00.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.994875+0000", 2024-09-12T22:04:00.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:00.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:00.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.994875+0000", 2024-09-12T22:04:00.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:00.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:00.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.994875+0000", 2024-09-12T22:04:00.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5600000000000005e-07 2024-09-12T22:04:00.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:00.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.994954+0000", 2024-09-12T22:04:00.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8239999999999996e-05 2024-09-12T22:04:00.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:00.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.994963+0000", 2024-09-12T22:04:00.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8699999999999998e-06 2024-09-12T22:04:00.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:00.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.994969+0000", 2024-09-12T22:04:00.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5699999999999998e-06 2024-09-12T22:04:00.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:00.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.995592+0000", 2024-09-12T22:04:00.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00062317099999999995 2024-09-12T22:04:00.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:00.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.995706+0000", 2024-09-12T22:04:00.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113362 2024-09-12T22:04:00.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:00.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.995845+0000", 2024-09-12T22:04:00.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000139658 2024-09-12T22:04:00.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:00.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997243+0000", 2024-09-12T22:04:00.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0013981359999999999 2024-09-12T22:04:00.011 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.011 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:00.011 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.011 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:27984 5.9 5:9c19db5b:::benchmark_data_smithi043_32659_object27983:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:00.012 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:59.996845+0000", 2024-09-12T22:04:00.012 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0023212380000000002, 2024-09-12T22:04:00.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024455560000000002, 2024-09-12T22:04:00.012 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:00.012 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:00.012 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:00.012 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:00.012 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:00.012 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:00.012 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 27984 2024-09-12T22:04:00.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.012 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:00.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.996845+0000", 2024-09-12T22:04:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.996845+0000", 2024-09-12T22:04:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.996846+0000", 2024-09-12T22:04:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.23e-07 2024-09-12T22:04:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:00.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.996915+0000", 2024-09-12T22:04:00.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8709999999999998e-05 2024-09-12T22:04:00.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:00.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.996923+0000", 2024-09-12T22:04:00.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3960000000000006e-06 2024-09-12T22:04:00.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:00.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.996928+0000", 2024-09-12T22:04:00.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0679999999999996e-06 2024-09-12T22:04:00.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:00.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.996984+0000", 2024-09-12T22:04:00.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5250999999999997e-05 2024-09-12T22:04:00.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:00.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997157+0000", 2024-09-12T22:04:00.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017334800000000001 2024-09-12T22:04:00.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:00.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997308+0000", 2024-09-12T22:04:00.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000151182 2024-09-12T22:04:00.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:00.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.999263+0000", 2024-09-12T22:04:00.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019544879999999999 2024-09-12T22:04:00.016 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.016 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:00.016 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.016 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:27986 5.9 5:9407ca63:::benchmark_data_smithi043_32659_object27985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:00.016 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:59.996941+0000", 2024-09-12T22:04:00.016 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0022257549999999998, 2024-09-12T22:04:00.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023929429999999998, 2024-09-12T22:04:00.017 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:00.017 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:00.017 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:00.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:00.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:00.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:00.017 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 27986 2024-09-12T22:04:00.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.017 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:00.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:00.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.996941+0000", 2024-09-12T22:04:00.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:00.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:00.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.996941+0000", 2024-09-12T22:04:00.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:00.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:00.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.996941+0000", 2024-09-12T22:04:00.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3099999999999998e-07 2024-09-12T22:04:00.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:00.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997023+0000", 2024-09-12T22:04:00.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1567e-05 2024-09-12T22:04:00.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:00.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997028+0000", 2024-09-12T22:04:00.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0849999999999996e-06 2024-09-12T22:04:00.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:00.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997032+0000", 2024-09-12T22:04:00.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0409999999999999e-06 2024-09-12T22:04:00.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:00.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.998159+0000", 2024-09-12T22:04:00.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001126417 2024-09-12T22:04:00.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:00.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.998240+0000", 2024-09-12T22:04:00.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1904999999999996e-05 2024-09-12T22:04:00.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:00.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.998328+0000", 2024-09-12T22:04:00.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7959000000000003e-05 2024-09-12T22:04:00.020 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.021 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:00.021 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.021 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:27987 5.1 5:8997caec:::benchmark_data_smithi043_32659_object27986:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:00.021 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:59.997040+0000", 2024-09-12T22:04:00.021 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0021265360000000001, 2024-09-12T22:04:00.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002353267, 2024-09-12T22:04:00.021 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:00.021 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:00.021 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:00.021 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:00.021 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:00.022 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:00.022 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 27987 2024-09-12T22:04:00.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.022 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:00.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:00.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997040+0000", 2024-09-12T22:04:00.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:00.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:00.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997040+0000", 2024-09-12T22:04:00.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:00.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:00.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997041+0000", 2024-09-12T22:04:00.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2600000000000002e-07 2024-09-12T22:04:00.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:00.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997122+0000", 2024-09-12T22:04:00.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1700999999999996e-05 2024-09-12T22:04:00.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:00.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997127+0000", 2024-09-12T22:04:00.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8679999999999998e-06 2024-09-12T22:04:00.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:00.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997130+0000", 2024-09-12T22:04:00.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1920000000000001e-06 2024-09-12T22:04:00.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:00.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.999289+0000", 2024-09-12T22:04:00.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021582239999999998 2024-09-12T22:04:00.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:00.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.999392+0000", 2024-09-12T22:04:00.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010301099999999999 2024-09-12T22:04:00.025 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.025 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:00.025 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.025 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:27989 5.f 5:ffcc025b:::benchmark_data_smithi043_32659_object27988:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:00.025 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:59.997137+0000", 2024-09-12T22:04:00.025 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0020299210000000001, 2024-09-12T22:04:00.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023275349999999999, 2024-09-12T22:04:00.025 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:00.025 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:00.025 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:00.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 27989 2024-09-12T22:04:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997137+0000", 2024-09-12T22:04:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997137+0000", 2024-09-12T22:04:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:00.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:00.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997137+0000", 2024-09-12T22:04:00.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2300000000000002e-07 2024-09-12T22:04:00.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:00.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997235+0000", 2024-09-12T22:04:00.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7959000000000002e-05 2024-09-12T22:04:00.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:00.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997240+0000", 2024-09-12T22:04:00.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6260000000000003e-06 2024-09-12T22:04:00.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:00.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997243+0000", 2024-09-12T22:04:00.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3119999999999998e-06 2024-09-12T22:04:00.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:00.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997279+0000", 2024-09-12T22:04:00.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6411000000000001e-05 2024-09-12T22:04:00.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:00.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997367+0000", 2024-09-12T22:04:00.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8083000000000004e-05 2024-09-12T22:04:00.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:00.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.997443+0000", 2024-09-12T22:04:00.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5253000000000006e-05 2024-09-12T22:04:00.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:00.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.998391+0000", 2024-09-12T22:04:00.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00094874300000000005 2024-09-12T22:04:00.029 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.029 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:00.030 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.030 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:27991 5.3 e26/22 5:cb40d3f2:::benchmark_data_smithi043_32659_object27990:head v 26'1795, mlcod=26'1792)", 2024-09-12T22:04:00.030 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:59.998410+0000", 2024-09-12T22:04:00.030 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00075697899999999996, 2024-09-12T22:04:00.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001126103, 2024-09-12T22:04:00.030 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:00.030 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:00.030 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:00.030 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:00.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:00.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.998410+0000", 2024-09-12T22:04:00.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:00.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:00.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.998410+0000", 2024-09-12T22:04:00.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:00.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:00.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.998410+0000", 2024-09-12T22:04:00.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:04:00.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:00.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.998498+0000", 2024-09-12T22:04:00.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7724000000000002e-05 2024-09-12T22:04:00.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:00.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.998505+0000", 2024-09-12T22:04:00.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1169999999999998e-06 2024-09-12T22:04:00.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:00.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.998510+0000", 2024-09-12T22:04:00.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.339e-06 2024-09-12T22:04:00.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.998553+0000", 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2917000000000003e-05 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.998571+0000", 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7757e-05 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 7 2024-09-12T22:04:00.033 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:00.034 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:04:00.035 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:00.044 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:00.043+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:00.145 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:00.144+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:00.157 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:04:00.189 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 6 16 28734 28718 299.123 236.188 0.00301255 0.00333948 2024-09-12T22:04:00.230 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:00.230 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:00.230 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:00.230 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:00.230 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:00.243 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:00.245 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:00.245+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:00.292 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-09-12T22:04:00.292 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:04:00.313 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:00.313 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:00.331 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:00.332 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:00.346 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:00.346+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:00.439 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:00.440 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:00.447 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:00.446+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:00.454 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:00.547 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:00.547+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:00.600 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:00.600 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:00.611 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:00.648 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:00.647+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:00.749 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:00.748+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:00.801 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:00.801 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:00.815 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:00.849 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:00.848+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:00.950 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:00.949+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:00.963 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:00.963 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:00.976 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:04:01.051 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:01.049+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:01.138 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:01.138 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:01.152 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:04:01.153 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:01.151+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:01.189 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 7 16 32455 32439 289.612 232.562 0.00413469 0.0034502 2024-09-12T22:04:01.253 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:01.251+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:01.326 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-09-12T22:04:01.353 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:01.352+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:01.360 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:01.360 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:01.375 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:04:01.454 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:01.453+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:01.544 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:01.545 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:01.555 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:01.554+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:01.560 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:01.656 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:01.654+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:01.709 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:01.709 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:01.723 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:01.757 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:01.756+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:01.857 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:01.856+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:01.914 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:01.914 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:01.926 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:01.959 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:01.957+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:02.059 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:02.058+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:02.106 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:02.107 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:02.121 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:02.160 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:02.160+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:02.190 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 8 16 35992 35976 281.041 221.062 0.00362628 0.00355546 2024-09-12T22:04:02.261 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:02.259+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:02.267 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:02.267 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:02.281 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:02.344 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:04:02.362 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:02.361+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:02.463 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:02.462+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:02.473 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:02.473 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:02.480 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-09-12T22:04:02.480 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:04:02.486 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:02.500 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:02.501 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:02.521 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:02.522 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:02.565 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:02.563+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:02.633 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:02.633 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:02.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:02.633 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:02.633 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.633 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:02.633 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.451393+0000", 2024-09-12T22:04:02.633 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.178613568999999, 2024-09-12T22:04:02.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012754669999999999, 2024-09-12T22:04:02.634 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.634 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.634 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.634 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451393+0000", 2024-09-12T22:04:02.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451393+0000", 2024-09-12T22:04:02.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451408+0000", 2024-09-12T22:04:02.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5079000000000001e-05 2024-09-12T22:04:02.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451417+0000", 2024-09-12T22:04:02.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5299999999999996e-06 2024-09-12T22:04:02.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451429+0000", 2024-09-12T22:04:02.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2628e-05 2024-09-12T22:04:02.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.636 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451444+0000", 2024-09-12T22:04:02.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5105e-05 2024-09-12T22:04:02.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.636 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452220+0000", 2024-09-12T22:04:02.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077575300000000001 2024-09-12T22:04:02.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452529+0000", 2024-09-12T22:04:02.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00030873899999999999 2024-09-12T22:04:02.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.637 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:02.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452963+0000", 2024-09-12T22:04:02.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00043367699999999999 2024-09-12T22:04:02.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.637 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455843+0000", 2024-09-12T22:04:02.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028807049999999999 2024-09-12T22:04:02.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464032+0000", 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0081885159999999999 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464086+0000", 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4549999999999998e-05 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464148+0000", 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1388000000000002e-05 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.638 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.639 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.639 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:02.639 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452091+0000", 2024-09-12T22:04:02.639 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.177916020000001, 2024-09-12T22:04:02.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012037842, 2024-09-12T22:04:02.639 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.639 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.639 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.639 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452091+0000", 2024-09-12T22:04:02.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.640 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452091+0000", 2024-09-12T22:04:02.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.640 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452092+0000", 2024-09-12T22:04:02.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0899999999999999e-06 2024-09-12T22:04:02.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452100+0000", 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3499999999999997e-06 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452112+0000", 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1584e-05 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452121+0000", 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8740000000000001e-06 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.641 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452714+0000", 2024-09-12T22:04:02.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00059324400000000004 2024-09-12T22:04:02.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452838+0000", 2024-09-12T22:04:02.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012385299999999999 2024-09-12T22:04:02.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:02.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.453222+0000", 2024-09-12T22:04:02.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00038446699999999999 2024-09-12T22:04:02.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456140+0000", 2024-09-12T22:04:02.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0029179190000000002 2024-09-12T22:04:02.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464060+0000", 2024-09-12T22:04:02.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0079196160000000008 2024-09-12T22:04:02.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464089+0000", 2024-09-12T22:04:02.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9431e-05 2024-09-12T22:04:02.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464128+0000", 2024-09-12T22:04:02.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9413999999999999e-05 2024-09-12T22:04:02.644 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.644 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.644 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.644 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:02.644 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:04:02.644 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.177744021999999, 2024-09-12T22:04:02.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012474654999999999, 2024-09-12T22:04:02.645 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.645 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.645 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.645 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.645 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.645 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:04:02.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.645 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.645 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.645 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:04:02.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1500000000000003e-07 2024-09-12T22:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452268+0000", 2024-09-12T22:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8640000000000004e-06 2024-09-12T22:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452311+0000", 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2255000000000001e-05 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452326+0000", 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5209e-05 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455447+0000", 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031213209999999998 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455502+0000", 2024-09-12T22:04:02.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4925e-05 2024-09-12T22:04:02.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:02.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455592+0000", 2024-09-12T22:04:02.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9850000000000002e-05 2024-09-12T22:04:02.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.457408+0000", 2024-09-12T22:04:02.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001816018 2024-09-12T22:04:02.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.649 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464635+0000", 2024-09-12T22:04:02.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0072269350000000003 2024-09-12T22:04:02.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.649 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.649 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464682+0000", 2024-09-12T22:04:02.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7308000000000002e-05 2024-09-12T22:04:02.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.649 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.649 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464737+0000", 2024-09-12T22:04:02.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5155000000000003e-05 2024-09-12T22:04:02.649 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.650 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.650 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.650 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.650 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:02.650 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452345+0000", 2024-09-12T22:04:02.650 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.177661794999999, 2024-09-12T22:04:02.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012534264, 2024-09-12T22:04:02.650 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.650 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.650 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.650 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.650 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452345+0000", 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452345+0000", 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452346+0000", 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.212e-06 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452352+0000", 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1850000000000001e-06 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452362+0000", 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6209999999999999e-06 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452380+0000", 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7909000000000001e-05 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.652 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455611+0000", 2024-09-12T22:04:02.653 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032308889999999998 2024-09-12T22:04:02.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.653 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.653 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455675+0000", 2024-09-12T22:04:02.653 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4783999999999995e-05 2024-09-12T22:04:02.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.653 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:02.653 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455866+0000", 2024-09-12T22:04:02.653 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019059900000000001 2024-09-12T22:04:02.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.653 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.654 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.457440+0000", 2024-09-12T22:04:02.654 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015739269999999999 2024-09-12T22:04:02.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.654 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.654 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464782+0000", 2024-09-12T22:04:02.654 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0073417100000000004 2024-09-12T22:04:02.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.654 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.654 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464835+0000", 2024-09-12T22:04:02.654 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3709999999999999e-05 2024-09-12T22:04:02.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.655 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.655 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464879+0000", 2024-09-12T22:04:02.655 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3717999999999997e-05 2024-09-12T22:04:02.655 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.655 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.655 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.655 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.655 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:02.655 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452540+0000", 2024-09-12T22:04:02.655 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.177466191000001, 2024-09-12T22:04:02.655 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012490559, 2024-09-12T22:04:02.655 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.655 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452540+0000", 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452540+0000", 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452541+0000", 2024-09-12T22:04:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1299999999999999e-07 2024-09-12T22:04:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452546+0000", 2024-09-12T22:04:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.758e-06 2024-09-12T22:04:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452561+0000", 2024-09-12T22:04:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.541e-05 2024-09-12T22:04:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452570+0000", 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4309999999999994e-06 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456142+0000", 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035725409999999998 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456258+0000", 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115728 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456384+0000", 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125506 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.459667+0000", 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032833129999999999 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464968+0000", 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005300941 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.465004+0000", 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6606999999999997e-05 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.465031+0000", 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6611e-05 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:32 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452584+0000", 2024-09-12T22:04:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.177422769, 2024-09-12T22:04:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011678836999999999, 2024-09-12T22:04:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452584+0000", 2024-09-12T22:04:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452584+0000", 2024-09-12T22:04:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452584+0000", 2024-09-12T22:04:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.82e-07 2024-09-12T22:04:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452588+0000", 2024-09-12T22:04:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3069999999999998e-06 2024-09-12T22:04:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452596+0000", 2024-09-12T22:04:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2290000000000003e-06 2024-09-12T22:04:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452603+0000", 2024-09-12T22:04:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0690000000000004e-06 2024-09-12T22:04:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452704+0000", 2024-09-12T22:04:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000101339 2024-09-12T22:04:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452799+0000", 2024-09-12T22:04:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4920999999999995e-05 2024-09-12T22:04:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464263+0000", 2024-09-12T22:04:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.01146339 2024-09-12T22:04:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5133 5.e 5:731a25e2:::benchmark_data_smithi043_32659_object5132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:04:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.987886+0000", 2024-09-12T22:04:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.6421208780000001, 2024-09-12T22:04:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.01358233, 2024-09-12T22:04:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5133 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987886+0000", 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987886+0000", 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987887+0000", 2024-09-12T22:04:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987988+0000", 2024-09-12T22:04:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000101266 2024-09-12T22:04:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987996+0000", 2024-09-12T22:04:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:04:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988002+0000", 2024-09-12T22:04:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8080000000000001e-06 2024-09-12T22:04:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988196+0000", 2024-09-12T22:04:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019422999999999999 2024-09-12T22:04:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988298+0000", 2024-09-12T22:04:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010208999999999999 2024-09-12T22:04:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988420+0000", 2024-09-12T22:04:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012256499999999999 2024-09-12T22:04:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989796+0000", 2024-09-12T22:04:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001375743 2024-09-12T22:04:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001390+0000", 2024-09-12T22:04:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011594089 2024-09-12T22:04:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001433+0000", 2024-09-12T22:04:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2420999999999999e-05 2024-09-12T22:04:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001468+0000", 2024-09-12T22:04:02.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5423999999999998e-05 2024-09-12T22:04:02.671 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.671 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.671 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.671 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.671 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.671 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5136 5.b 5:de031c2e:::benchmark_data_smithi043_32659_object5135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:04:02.671 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.988747+0000", 2024-09-12T22:04:02.671 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.6412598479999998, 2024-09-12T22:04:02.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013407914999999999, 2024-09-12T22:04:02.671 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.671 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.671 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.672 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:02.672 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:02.672 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:02.672 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5136 2024-09-12T22:04:02.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.672 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.672 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988747+0000", 2024-09-12T22:04:02.672 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988747+0000", 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988748+0000", 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988848+0000", 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000100355 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988860+0000", 2024-09-12T22:04:02.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1719000000000001e-05 2024-09-12T22:04:02.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988867+0000", 2024-09-12T22:04:02.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0690000000000004e-06 2024-09-12T22:04:02.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988917+0000", 2024-09-12T22:04:02.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9777000000000001e-05 2024-09-12T22:04:02.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989021+0000", 2024-09-12T22:04:02.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010412300000000001 2024-09-12T22:04:02.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:02.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989093+0000", 2024-09-12T22:04:02.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1958999999999993e-05 2024-09-12T22:04:02.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991058+0000", 2024-09-12T22:04:02.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019651349999999998 2024-09-12T22:04:02.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.676 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.676 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002073+0000", 2024-09-12T22:04:02.676 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011014990000000001 2024-09-12T22:04:02.676 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.676 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.676 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.676 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002117+0000", 2024-09-12T22:04:02.676 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4317000000000003e-05 2024-09-12T22:04:02.676 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.676 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.676 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.676 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002155+0000", 2024-09-12T22:04:02.676 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7524999999999997e-05 2024-09-12T22:04:02.676 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.677 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.677 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.677 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.677 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.677 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5137 5.e 5:76ceaa0c:::benchmark_data_smithi043_32659_object5136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:04:02.677 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.988884+0000", 2024-09-12T22:04:02.677 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.6411223240000004, 2024-09-12T22:04:02.677 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013010671, 2024-09-12T22:04:02.677 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.677 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.677 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.677 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:02.677 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:02.677 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5137 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988884+0000", 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988884+0000", 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988885+0000", 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4000000000000001e-07 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988914+0000", 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8912999999999999e-05 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988923+0000", 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.67e-06 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988945+0000", 2024-09-12T22:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2677e-05 2024-09-12T22:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988993+0000", 2024-09-12T22:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7497999999999998e-05 2024-09-12T22:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989109+0000", 2024-09-12T22:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011662099999999999 2024-09-12T22:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989264+0000", 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015485 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990950+0000", 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0016853930000000001 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001809+0000", 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010859818 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001863+0000", 2024-09-12T22:04:02.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3736000000000002e-05 2024-09-12T22:04:02.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001895+0000", 2024-09-12T22:04:02.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1854999999999999e-05 2024-09-12T22:04:02.682 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.682 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.682 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.683 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5138 5.b 5:d969c28c:::benchmark_data_smithi043_32659_object5137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:04:02.683 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.989883+0000", 2024-09-12T22:04:02.683 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.6401240179999999, 2024-09-12T22:04:02.683 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012360691, 2024-09-12T22:04:02.683 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.683 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.683 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.683 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:02.683 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:02.683 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:02.683 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5138 2024-09-12T22:04:02.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.683 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.683 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989883+0000", 2024-09-12T22:04:02.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989883+0000", 2024-09-12T22:04:02.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989884+0000", 2024-09-12T22:04:02.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8999999999999995e-07 2024-09-12T22:04:02.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990012+0000", 2024-09-12T22:04:02.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000128245 2024-09-12T22:04:02.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990022+0000", 2024-09-12T22:04:02.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.927e-06 2024-09-12T22:04:02.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990029+0000", 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3610000000000003e-06 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990112+0000", 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3323000000000002e-05 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990249+0000", 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013706499999999999 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:02.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990426+0000", 2024-09-12T22:04:02.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017672599999999999 2024-09-12T22:04:02.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991995+0000", 2024-09-12T22:04:02.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015690579999999999 2024-09-12T22:04:02.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002163+0000", 2024-09-12T22:04:02.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010167697 2024-09-12T22:04:02.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002207+0000", 2024-09-12T22:04:02.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4030999999999999e-05 2024-09-12T22:04:02.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002243+0000", 2024-09-12T22:04:02.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6368000000000001e-05 2024-09-12T22:04:02.688 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.688 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.688 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.688 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5141 5.e 5:733a9c59:::benchmark_data_smithi043_32659_object5140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:04:02.688 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.990266+0000", 2024-09-12T22:04:02.689 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.6397408310000001, 2024-09-12T22:04:02.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011697701, 2024-09-12T22:04:02.689 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.689 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.689 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.689 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:02.689 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:02.689 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:02.689 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5141 2024-09-12T22:04:02.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.689 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.689 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990266+0000", 2024-09-12T22:04:02.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990266+0000", 2024-09-12T22:04:02.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990267+0000", 2024-09-12T22:04:02.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5799999999999998e-07 2024-09-12T22:04:02.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990333+0000", 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6358000000000004e-05 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990343+0000", 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5750000000000007e-06 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990349+0000", 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6880000000000002e-06 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990386+0000", 2024-09-12T22:04:02.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6918999999999997e-05 2024-09-12T22:04:02.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990474+0000", 2024-09-12T22:04:02.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7978000000000004e-05 2024-09-12T22:04:02.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:02.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990588+0000", 2024-09-12T22:04:02.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000113677 2024-09-12T22:04:02.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991952+0000", 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0013635520000000001 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001901+0000", 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0099496159999999997 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001936+0000", 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5163999999999997e-05 2024-09-12T22:04:02.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001964+0000", 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7216000000000002e-05 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5144 5.b 5:db6bc9e3:::benchmark_data_smithi043_32659_object5143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.990487+0000", 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.6395192309999995, 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011864091, 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.694 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.695 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:02.695 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:02.695 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:02.695 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5144 2024-09-12T22:04:02.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.695 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990487+0000", 2024-09-12T22:04:02.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990487+0000", 2024-09-12T22:04:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990488+0000", 2024-09-12T22:04:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.99e-07 2024-09-12T22:04:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990549+0000", 2024-09-12T22:04:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0695000000000001e-05 2024-09-12T22:04:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990558+0000", 2024-09-12T22:04:02.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.935e-06 2024-09-12T22:04:02.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990564+0000", 2024-09-12T22:04:02.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2840000000000003e-06 2024-09-12T22:04:02.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991093+0000", 2024-09-12T22:04:02.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00052932999999999995 2024-09-12T22:04:02.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991188+0000", 2024-09-12T22:04:02.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4613999999999999e-05 2024-09-12T22:04:02.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:02.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991265+0000", 2024-09-12T22:04:02.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7171999999999999e-05 2024-09-12T22:04:02.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.992545+0000", 2024-09-12T22:04:02.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012794379999999999 2024-09-12T22:04:02.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002259+0000", 2024-09-12T22:04:02.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0097143060000000007 2024-09-12T22:04:02.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002306+0000", 2024-09-12T22:04:02.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7017000000000001e-05 2024-09-12T22:04:02.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002352+0000", 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5600999999999999e-05 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:24954 5.8 5:13e4b48e:::benchmark_data_smithi043_32659_object24953:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:59.189050+0000", 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.440956618, 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011431101000000001, 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.700 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:02.701 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:02.701 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:02.701 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 24954 2024-09-12T22:04:02.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.701 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189050+0000", 2024-09-12T22:04:02.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189050+0000", 2024-09-12T22:04:02.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189051+0000", 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5400000000000002e-07 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189127+0000", 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6779999999999993e-05 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189132+0000", 2024-09-12T22:04:02.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.13e-06 2024-09-12T22:04:02.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189137+0000", 2024-09-12T22:04:02.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1389999999999997e-06 2024-09-12T22:04:02.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189179+0000", 2024-09-12T22:04:02.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2045999999999997e-05 2024-09-12T22:04:02.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189298+0000", 2024-09-12T22:04:02.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119237 2024-09-12T22:04:02.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:02.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189434+0000", 2024-09-12T22:04:02.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013594900000000001 2024-09-12T22:04:02.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.193158+0000", 2024-09-12T22:04:02.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037241459999999998 2024-09-12T22:04:02.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.200424+0000", 2024-09-12T22:04:02.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0072656420000000001 2024-09-12T22:04:02.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.200456+0000", 2024-09-12T22:04:02.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2728000000000002e-05 2024-09-12T22:04:02.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.200481+0000", 2024-09-12T22:04:02.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4850000000000001e-05 2024-09-12T22:04:02.706 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.706 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.706 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.706 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:24956 5.d 5:b053e4ef:::benchmark_data_smithi043_32659_object24955:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:02.706 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:59.189823+0000", 2024-09-12T22:04:02.706 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.4401834650000001, 2024-09-12T22:04:02.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012127707999999999, 2024-09-12T22:04:02.706 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.706 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.706 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.706 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:02.706 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:02.707 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:02.707 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 24956 2024-09-12T22:04:02.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.707 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189823+0000", 2024-09-12T22:04:02.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189823+0000", 2024-09-12T22:04:02.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189824+0000", 2024-09-12T22:04:02.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3500000000000005e-07 2024-09-12T22:04:02.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189899+0000", 2024-09-12T22:04:02.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4738000000000002e-05 2024-09-12T22:04:02.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189909+0000", 2024-09-12T22:04:02.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0005e-05 2024-09-12T22:04:02.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.189915+0000", 2024-09-12T22:04:02.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6980000000000001e-06 2024-09-12T22:04:02.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.193022+0000", 2024-09-12T22:04:02.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003106321 2024-09-12T22:04:02.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.193133+0000", 2024-09-12T22:04:02.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000110856 2024-09-12T22:04:02.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:02.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.193218+0000", 2024-09-12T22:04:02.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5220000000000001e-05 2024-09-12T22:04:02.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.196054+0000", 2024-09-12T22:04:02.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002835887 2024-09-12T22:04:02.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.201859+0000", 2024-09-12T22:04:02.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0058051999999999999 2024-09-12T22:04:02.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.201915+0000", 2024-09-12T22:04:02.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5631999999999999e-05 2024-09-12T22:04:02.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.201951+0000", 2024-09-12T22:04:02.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6316000000000003e-05 2024-09-12T22:04:02.711 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.712 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.712 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.712 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:27570 5.8 5:1c2e4e49:::benchmark_data_smithi043_32659_object27569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:02.712 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:59.887568+0000", 2024-09-12T22:04:02.712 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 2.742438924, 2024-09-12T22:04:02.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011856157000000001, 2024-09-12T22:04:02.712 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.712 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.712 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.712 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:02.712 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:02.713 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:02.713 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 27570 2024-09-12T22:04:02.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.713 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.713 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.713 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.887568+0000", 2024-09-12T22:04:02.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.713 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.713 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.887568+0000", 2024-09-12T22:04:02.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.887569+0000", 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9699999999999995e-07 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.887721+0000", 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000152693 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.887729+0000", 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1680000000000004e-06 2024-09-12T22:04:02.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.887736+0000", 2024-09-12T22:04:02.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6590000000000001e-06 2024-09-12T22:04:02.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.890401+0000", 2024-09-12T22:04:02.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026649629999999998 2024-09-12T22:04:02.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.890569+0000", 2024-09-12T22:04:02.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016766 2024-09-12T22:04:02.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:02.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.890697+0000", 2024-09-12T22:04:02.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012876000000000001 2024-09-12T22:04:02.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.893237+0000", 2024-09-12T22:04:02.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002539562 2024-09-12T22:04:02.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.899364+0000", 2024-09-12T22:04:02.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0061271119999999997 2024-09-12T22:04:02.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.899392+0000", 2024-09-12T22:04:02.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7382999999999999e-05 2024-09-12T22:04:02.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:59.899424+0000", 2024-09-12T22:04:02.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2400000000000001e-05 2024-09-12T22:04:02.717 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:28468 5.d 5:bc1cf8ba:::benchmark_data_smithi043_32659_object28467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:00.118580+0000", 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 2.5114271750000001, 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012256814, 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:02.718 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 28468 2024-09-12T22:04:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118580+0000", 2024-09-12T22:04:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118580+0000", 2024-09-12T22:04:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118580+0000", 2024-09-12T22:04:02.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9400000000000001e-07 2024-09-12T22:04:02.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118603+0000", 2024-09-12T22:04:02.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3176999999999998e-05 2024-09-12T22:04:02.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118610+0000", 2024-09-12T22:04:02.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.221e-06 2024-09-12T22:04:02.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118615+0000", 2024-09-12T22:04:02.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7600000000000002e-06 2024-09-12T22:04:02.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118657+0000", 2024-09-12T22:04:02.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1977999999999997e-05 2024-09-12T22:04:02.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118757+0000", 2024-09-12T22:04:02.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010042199999999999 2024-09-12T22:04:02.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:02.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118846+0000", 2024-09-12T22:04:02.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8085999999999997e-05 2024-09-12T22:04:02.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.120858+0000", 2024-09-12T22:04:02.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002012813 2024-09-12T22:04:02.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.130744+0000", 2024-09-12T22:04:02.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0098857119999999996 2024-09-12T22:04:02.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.130793+0000", 2024-09-12T22:04:02.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9128999999999997e-05 2024-09-12T22:04:02.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.130836+0000", 2024-09-12T22:04:02.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3121999999999998e-05 2024-09-12T22:04:02.723 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.723 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.723 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:28472 5.4 5:2e3a367f:::benchmark_data_smithi043_32659_object28471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:00.118848+0000", 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 2.5111588660000002, 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012051068, 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 28472 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118848+0000", 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118848+0000", 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118849+0000", 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118906+0000", 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7382e-05 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118923+0000", 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6789000000000001e-05 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118930+0000", 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3889999999999999e-06 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118988+0000", 2024-09-12T22:04:02.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7726999999999998e-05 2024-09-12T22:04:02.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119109+0000", 2024-09-12T22:04:02.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000121358 2024-09-12T22:04:02.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:02.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119238+0000", 2024-09-12T22:04:02.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012833399999999999 2024-09-12T22:04:02.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.121511+0000", 2024-09-12T22:04:02.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022729159999999998 2024-09-12T22:04:02.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.130791+0000", 2024-09-12T22:04:02.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0092802019999999995 2024-09-12T22:04:02.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.130853+0000", 2024-09-12T22:04:02.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1787999999999999e-05 2024-09-12T22:04:02.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.130899+0000", 2024-09-12T22:04:02.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6304999999999998e-05 2024-09-12T22:04:02.729 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.729 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.729 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.729 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:28473 5.e 5:70246381:::benchmark_data_smithi043_32659_object28472:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:02.729 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:00.118959+0000", 2024-09-12T22:04:02.729 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 2.5110478999999999, 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011883189000000001, 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 28473 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118959+0000", 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118959+0000", 2024-09-12T22:04:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.118959+0000", 2024-09-12T22:04:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3900000000000005e-07 2024-09-12T22:04:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119014+0000", 2024-09-12T22:04:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.427e-05 2024-09-12T22:04:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119023+0000", 2024-09-12T22:04:02.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7720000000000006e-06 2024-09-12T22:04:02.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119029+0000", 2024-09-12T22:04:02.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5679999999999999e-06 2024-09-12T22:04:02.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119078+0000", 2024-09-12T22:04:02.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9382000000000003e-05 2024-09-12T22:04:02.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119182+0000", 2024-09-12T22:04:02.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010412 2024-09-12T22:04:02.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:02.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119300+0000", 2024-09-12T22:04:02.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117775 2024-09-12T22:04:02.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.123627+0000", 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043267080000000003 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.130745+0000", 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0071185830000000004 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.130798+0000", 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2568999999999998e-05 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.130842+0000", 2024-09-12T22:04:02.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3903000000000003e-05 2024-09-12T22:04:02.735 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.735 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.735 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.735 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:28474 5.b 5:d6b6daf0:::benchmark_data_smithi043_32659_object28473:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:02.735 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:00.119054+0000", 2024-09-12T22:04:02.735 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 2.5109526280000001, 2024-09-12T22:04:02.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011812181, 2024-09-12T22:04:02.735 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.735 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.735 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.735 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:02.736 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:02.736 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:02.736 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 28474 2024-09-12T22:04:02.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.736 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.736 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119054+0000", 2024-09-12T22:04:02.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.736 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119054+0000", 2024-09-12T22:04:02.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119055+0000", 2024-09-12T22:04:02.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2399999999999998e-07 2024-09-12T22:04:02.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119091+0000", 2024-09-12T22:04:02.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6903999999999998e-05 2024-09-12T22:04:02.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119099+0000", 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4669999999999998e-06 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119104+0000", 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0309999999999998e-06 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119148+0000", 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591000000000003e-05 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119248+0000", 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000100121 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119357+0000", 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109237 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.122071+0000", 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027143720000000001 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:02.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.130762+0000", 2024-09-12T22:04:02.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0086910800000000003 2024-09-12T22:04:02.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.130808+0000", 2024-09-12T22:04:02.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5401000000000001e-05 2024-09-12T22:04:02.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.130866+0000", 2024-09-12T22:04:02.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8452999999999998e-05 2024-09-12T22:04:02.740 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.740 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.740 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.741 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:28469 5.a e26/22 5:550e9ec0:::benchmark_data_smithi043_32659_object28468:head v 26'1788, mlcod=26'1786)", 2024-09-12T22:04:02.741 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:00.119228+0000", 2024-09-12T22:04:02.741 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 2.5107785140000001, 2024-09-12T22:04:02.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011600188000000001, 2024-09-12T22:04:02.741 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:02.741 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:02.741 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.741 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:02.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:02.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119228+0000", 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119228+0000", 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119229+0000", 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:02.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119329+0000", 2024-09-12T22:04:02.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000100179 2024-09-12T22:04:02.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:02.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119337+0000", 2024-09-12T22:04:02.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:04:02.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119342+0000", 2024-09-12T22:04:02.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.366e-06 2024-09-12T22:04:02.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:02.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119413+0000", 2024-09-12T22:04:02.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0591000000000002e-05 2024-09-12T22:04:02.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:02.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.119431+0000", 2024-09-12T22:04:02.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8614000000000002e-05 2024-09-12T22:04:02.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:02.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.130785+0000", 2024-09-12T22:04:02.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011353501 2024-09-12T22:04:02.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:02.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:02.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:02.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:00.130828+0000", 2024-09-12T22:04:02.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3665000000000003e-05 2024-09-12T22:04:02.745 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.745 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.745 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.745 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:02.745 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:02.745 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:02.746 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:02.745+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:02.747 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:04:02.847 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:02.846+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:02.918 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:04:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T22:04:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:38482 5.7 e27/22 5:e1cbe704:::benchmark_data_smithi043_32659_object38481:head v 27'2408, mlcod=27'2406)", 2024-09-12T22:04:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:02.914135+0000", 2024-09-12T22:04:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.002803346, 2024-09-12T22:04:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028256209999999999, 2024-09-12T22:04:02.918 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.914135+0000", 2024-09-12T22:04:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.914135+0000", 2024-09-12T22:04:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.914136+0000", 2024-09-12T22:04:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4299999999999999e-07 2024-09-12T22:04:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.914268+0000", 2024-09-12T22:04:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013231699999999999 2024-09-12T22:04:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.914277+0000", 2024-09-12T22:04:02.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3729999999999999e-06 2024-09-12T22:04:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.914283+0000", 2024-09-12T22:04:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0449999999999997e-06 2024-09-12T22:04:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.914337+0000", 2024-09-12T22:04:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3879999999999999e-05 2024-09-12T22:04:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:02.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.914357+0000", 2024-09-12T22:04:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9811000000000001e-05 2024-09-12T22:04:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:38483 5.1 e27/22 5:8e9422f0:::benchmark_data_smithi043_32659_object38482:head v 27'2302, mlcod=27'2299)", 2024-09-12T22:04:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:02.915619+0000", 2024-09-12T22:04:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.001319429, 2024-09-12T22:04:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014149919999999999, 2024-09-12T22:04:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:02.922 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.915619+0000", 2024-09-12T22:04:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.915619+0000", 2024-09-12T22:04:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:02.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.915620+0000", 2024-09-12T22:04:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.37e-07 2024-09-12T22:04:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.915677+0000", 2024-09-12T22:04:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7493e-05 2024-09-12T22:04:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.915687+0000", 2024-09-12T22:04:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2769999999999994e-06 2024-09-12T22:04:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.915693+0000", 2024-09-12T22:04:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3400000000000003e-06 2024-09-12T22:04:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.915744+0000", 2024-09-12T22:04:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0590000000000002e-05 2024-09-12T22:04:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.915765+0000", 2024-09-12T22:04:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1047e-05 2024-09-12T22:04:02.925 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:38484 5.2 e27/22 5:4705abed:::benchmark_data_smithi043_32659_object38483:head v 27'2438, mlcod=27'2436)", 2024-09-12T22:04:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:02.916067+0000", 2024-09-12T22:04:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00087114799999999997, 2024-09-12T22:04:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001049183, 2024-09-12T22:04:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916067+0000", 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916067+0000", 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916068+0000", 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5000000000000001e-07 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916133+0000", 2024-09-12T22:04:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4729999999999999e-05 2024-09-12T22:04:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916145+0000", 2024-09-12T22:04:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1922e-05 2024-09-12T22:04:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916151+0000", 2024-09-12T22:04:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2249999999999997e-06 2024-09-12T22:04:02.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916194+0000", 2024-09-12T22:04:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2540999999999998e-05 2024-09-12T22:04:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916205+0000", 2024-09-12T22:04:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1487e-05 2024-09-12T22:04:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:38485 5.7 e27/22 5:ee263fcf:::benchmark_data_smithi043_32659_object38484:head v 27'2409, mlcod=27'2406)", 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:02.916286+0000", 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00065245600000000004, 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00088505099999999998, 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916286+0000", 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916286+0000", 2024-09-12T22:04:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916287+0000", 2024-09-12T22:04:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.75e-07 2024-09-12T22:04:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916327+0000", 2024-09-12T22:04:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9745e-05 2024-09-12T22:04:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916336+0000", 2024-09-12T22:04:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0499999999999997e-06 2024-09-12T22:04:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916342+0000", 2024-09-12T22:04:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8969999999999996e-06 2024-09-12T22:04:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916454+0000", 2024-09-12T22:04:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000112253 2024-09-12T22:04:02.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916474+0000", 2024-09-12T22:04:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0071000000000001e-05 2024-09-12T22:04:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:38487 5.c 5:39e4372e:::benchmark_data_smithi043_32659_object38486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:02.916421+0000", 2024-09-12T22:04:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00051729499999999997, 2024-09-12T22:04:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081085, 2024-09-12T22:04:02.933 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 38487 2024-09-12T22:04:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916421+0000", 2024-09-12T22:04:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916421+0000", 2024-09-12T22:04:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916422+0000", 2024-09-12T22:04:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.879999999999999e-07 2024-09-12T22:04:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916515+0000", 2024-09-12T22:04:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2625000000000002e-05 2024-09-12T22:04:02.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916524+0000", 2024-09-12T22:04:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2439999999999999e-06 2024-09-12T22:04:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916531+0000", 2024-09-12T22:04:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6120000000000004e-06 2024-09-12T22:04:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:02.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916587+0000", 2024-09-12T22:04:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6677e-05 2024-09-12T22:04:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916741+0000", 2024-09-12T22:04:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015398199999999999 2024-09-12T22:04:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916892+0000", 2024-09-12T22:04:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000150118 2024-09-12T22:04:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:02.937 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:38486 5.1 e27/22 5:87f92753:::benchmark_data_smithi043_32659_object38485:head v 27'2303, mlcod=27'2299)", 2024-09-12T22:04:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:02.916959+0000", 2024-09-12T22:04:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9999795, 2024-09-12T22:04:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000341551, 2024-09-12T22:04:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916959+0000", 2024-09-12T22:04:02.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916959+0000", 2024-09-12T22:04:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.916960+0000", 2024-09-12T22:04:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:04:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:02.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.917064+0000", 2024-09-12T22:04:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000104091 2024-09-12T22:04:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.917079+0000", 2024-09-12T22:04:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4559000000000001e-05 2024-09-12T22:04:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.917086+0000", 2024-09-12T22:04:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4479999999999997e-06 2024-09-12T22:04:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.917140+0000", 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3548000000000003e-05 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.917150+0000", 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0869999999999999e-05 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:38479 5.e e27/22 5:752d1ced:::benchmark_data_smithi043_32659_object38478:head v 27'2424, mlcod=27'2420)", 2024-09-12T22:04:02.941 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:02.913923+0000", 2024-09-12T22:04:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0030156800000000002, 2024-09-12T22:04:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0034421460000000001, 2024-09-12T22:04:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.913923+0000", 2024-09-12T22:04:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:02.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.913923+0000", 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.913924+0000", 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.08e-06 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.913962+0000", 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7982000000000003e-05 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:02.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.913973+0000", 2024-09-12T22:04:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0638e-05 2024-09-12T22:04:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.913980+0000", 2024-09-12T22:04:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1389999999999998e-06 2024-09-12T22:04:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.915034+0000", 2024-09-12T22:04:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010544179999999999 2024-09-12T22:04:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.915110+0000", 2024-09-12T22:04:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5767999999999997e-05 2024-09-12T22:04:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.917058+0000", 2024-09-12T22:04:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001948558 2024-09-12T22:04:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T22:04:02.945 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 7 2024-09-12T22:04:02.945 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:04:02.946 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:04:02.948 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:02.947+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:03.048 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:03.047+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:03.114 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:04:03.115 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T22:04:03.115 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T22:04:03.115 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T22:04:03.115 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:04:03.129 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:04:03.170 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:03.169+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:03.190 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 9 16 39402 39386 273.493 213.125 0.00590544 0.0036538 2024-09-12T22:04:03.194 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:04:03.194 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:04:03.194 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-12T22:04:03.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-12T22:04:03.251 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:03.250+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:03.341 INFO:teuthology.orchestra.run.smithi043.stderr:no valid command found; 10 closest matches: 2024-09-12T22:04:03.341 INFO:teuthology.orchestra.run.smithi043.stderr:0 2024-09-12T22:04:03.341 INFO:teuthology.orchestra.run.smithi043.stderr:1 2024-09-12T22:04:03.341 INFO:teuthology.orchestra.run.smithi043.stderr:2 2024-09-12T22:04:03.342 INFO:teuthology.orchestra.run.smithi043.stderr:abort 2024-09-12T22:04:03.342 INFO:teuthology.orchestra.run.smithi043.stderr:assert 2024-09-12T22:04:03.342 INFO:teuthology.orchestra.run.smithi043.stderr:bench [] [] [] [] 2024-09-12T22:04:03.342 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs debug_inject_read_zeros 2024-09-12T22:04:03.342 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs files list 2024-09-12T22:04:03.342 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs stats 2024-09-12T22:04:03.342 INFO:teuthology.orchestra.run.smithi043.stderr:bluestore allocator dump block 2024-09-12T22:04:03.342 INFO:teuthology.orchestra.run.smithi043.stderr:Error EINVAL: invalid command 2024-09-12T22:04:03.342 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:04:03.344 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T22:04:03.345 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T22:04:03.345 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-12T22:04:03.348 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:04:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T22:04:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T22:04:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T22:04:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:04:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.895462574, 2024-09-12T22:04:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017423646000000001, 2024-09-12T22:04:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.348 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:04:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:04:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449728+0000", 2024-09-12T22:04:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:04:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449750+0000", 2024-09-12T22:04:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2391e-05 2024-09-12T22:04:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449775+0000", 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4831999999999999e-05 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449785+0000", 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0361e-05 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449857+0000", 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1990999999999996e-05 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:03.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449863+0000", 2024-09-12T22:04:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6570000000000002e-06 2024-09-12T22:04:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462558+0000", 2024-09-12T22:04:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012695032 2024-09-12T22:04:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462703+0000", 2024-09-12T22:04:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014444100000000001 2024-09-12T22:04:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462853+0000", 2024-09-12T22:04:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015042300000000001 2024-09-12T22:04:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465147+0000", 2024-09-12T22:04:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022944789999999999 2024-09-12T22:04:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467012+0000", 2024-09-12T22:04:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018646030000000001 2024-09-12T22:04:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467095+0000", 2024-09-12T22:04:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2695999999999996e-05 2024-09-12T22:04:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467148+0000", 2024-09-12T22:04:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2958999999999999e-05 2024-09-12T22:04:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.354 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:04:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.895373730999999, 2024-09-12T22:04:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018410795000000001, 2024-09-12T22:04:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:04:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:04:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449814+0000", 2024-09-12T22:04:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:04:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449827+0000", 2024-09-12T22:04:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3373000000000001e-05 2024-09-12T22:04:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:04:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.081e-06 2024-09-12T22:04:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449853+0000", 2024-09-12T22:04:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7181e-05 2024-09-12T22:04:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449914+0000", 2024-09-12T22:04:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0736000000000003e-05 2024-09-12T22:04:03.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449921+0000", 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2559999999999996e-06 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461147+0000", 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011226211999999999 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461353+0000", 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000205217 2024-09-12T22:04:03.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461512+0000", 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015960700000000001 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464643+0000", 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003130238 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468132+0000", 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0034897109999999999 2024-09-12T22:04:03.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468182+0000", 2024-09-12T22:04:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0209e-05 2024-09-12T22:04:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468224+0000", 2024-09-12T22:04:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1199000000000003e-05 2024-09-12T22:04:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:04:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.895316256000001, 2024-09-12T22:04:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017523931, 2024-09-12T22:04:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:04:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:04:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449871+0000", 2024-09-12T22:04:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449890+0000", 2024-09-12T22:04:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9245999999999998e-05 2024-09-12T22:04:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449899+0000", 2024-09-12T22:04:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1530000000000003e-06 2024-09-12T22:04:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449905+0000", 2024-09-12T22:04:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8100000000000003e-06 2024-09-12T22:04:03.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449942+0000", 2024-09-12T22:04:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7119000000000002e-05 2024-09-12T22:04:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449945+0000", 2024-09-12T22:04:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0529999999999998e-06 2024-09-12T22:04:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463125+0000", 2024-09-12T22:04:03.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013179326 2024-09-12T22:04:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463171+0000", 2024-09-12T22:04:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6455000000000002e-05 2024-09-12T22:04:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:03.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463242+0000", 2024-09-12T22:04:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0430000000000002e-05 2024-09-12T22:04:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465152+0000", 2024-09-12T22:04:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001910082 2024-09-12T22:04:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467291+0000", 2024-09-12T22:04:03.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021394119999999998 2024-09-12T22:04:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467351+0000", 2024-09-12T22:04:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9673999999999998e-05 2024-09-12T22:04:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467394+0000", 2024-09-12T22:04:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3477999999999999e-05 2024-09-12T22:04:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.367 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:04:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.895269149000001, 2024-09-12T22:04:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018417978000000002, 2024-09-12T22:04:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:04:03.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:04:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449918+0000", 2024-09-12T22:04:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449923+0000", 2024-09-12T22:04:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1959999999999999e-06 2024-09-12T22:04:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449928+0000", 2024-09-12T22:04:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3989999999999997e-06 2024-09-12T22:04:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449931+0000", 2024-09-12T22:04:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5750000000000001e-06 2024-09-12T22:04:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449968+0000", 2024-09-12T22:04:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7209999999999998e-05 2024-09-12T22:04:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:03.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449974+0000", 2024-09-12T22:04:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9730000000000002e-06 2024-09-12T22:04:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462282+0000", 2024-09-12T22:04:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012308102 2024-09-12T22:04:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462368+0000", 2024-09-12T22:04:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5920000000000004e-05 2024-09-12T22:04:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462490+0000", 2024-09-12T22:04:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121478 2024-09-12T22:04:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465141+0000", 2024-09-12T22:04:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026515990000000001 2024-09-12T22:04:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468273+0000", 2024-09-12T22:04:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003131736 2024-09-12T22:04:03.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468308+0000", 2024-09-12T22:04:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4572e-05 2024-09-12T22:04:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468335+0000", 2024-09-12T22:04:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7727999999999999e-05 2024-09-12T22:04:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.895250275999999, 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018483090000000001, 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:04:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449937+0000", 2024-09-12T22:04:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0699999999999999e-07 2024-09-12T22:04:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449939+0000", 2024-09-12T22:04:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.853e-06 2024-09-12T22:04:03.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449943+0000", 2024-09-12T22:04:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8999999999999999e-06 2024-09-12T22:04:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449956+0000", 2024-09-12T22:04:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2843000000000001e-05 2024-09-12T22:04:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:04:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0277000000000002e-05 2024-09-12T22:04:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449990+0000", 2024-09-12T22:04:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1410000000000001e-06 2024-09-12T22:04:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463480+0000", 2024-09-12T22:04:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013490564 2024-09-12T22:04:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463553+0000", 2024-09-12T22:04:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3094000000000002e-05 2024-09-12T22:04:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463629+0000", 2024-09-12T22:04:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5610000000000003e-05 2024-09-12T22:04:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465158+0000", 2024-09-12T22:04:03.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015294169999999999 2024-09-12T22:04:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468328+0000", 2024-09-12T22:04:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031699699999999998 2024-09-12T22:04:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468381+0000", 2024-09-12T22:04:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2398000000000002e-05 2024-09-12T22:04:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468419+0000", 2024-09-12T22:04:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8816000000000002e-05 2024-09-12T22:04:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.895221734, 2024-09-12T22:04:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017182808000000001, 2024-09-12T22:04:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.381 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:03.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2500000000000001e-07 2024-09-12T22:04:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449968+0000", 2024-09-12T22:04:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7140000000000002e-06 2024-09-12T22:04:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449975+0000", 2024-09-12T22:04:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:04:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449980+0000", 2024-09-12T22:04:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1659999999999996e-06 2024-09-12T22:04:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450048+0000", 2024-09-12T22:04:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8823000000000002e-05 2024-09-12T22:04:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450052+0000", 2024-09-12T22:04:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8689999999999997e-06 2024-09-12T22:04:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461166+0000", 2024-09-12T22:04:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011114166999999999 2024-09-12T22:04:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461279+0000", 2024-09-12T22:04:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000112212 2024-09-12T22:04:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461417+0000", 2024-09-12T22:04:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138202 2024-09-12T22:04:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463371+0000", 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019543120000000001 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467009+0000", 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036383180000000002 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467109+0000", 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9601999999999999e-05 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467148+0000", 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8618000000000002e-05 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.895175679000001, 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017404473, 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.387 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450012+0000", 2024-09-12T22:04:03.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T22:04:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450016+0000", 2024-09-12T22:04:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9389999999999999e-06 2024-09-12T22:04:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:04:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8209999999999997e-06 2024-09-12T22:04:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450036+0000", 2024-09-12T22:04:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0496000000000001e-05 2024-09-12T22:04:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9070999999999997e-05 2024-09-12T22:04:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450100+0000", 2024-09-12T22:04:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0089999999999998e-06 2024-09-12T22:04:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461992+0000", 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011891868999999999 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462124+0000", 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013271299999999999 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467415+0000", 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052909029999999996 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.895137438999999, 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018455814000000001, 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:04:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450050+0000", 2024-09-12T22:04:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2e-07 2024-09-12T22:04:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450053+0000", 2024-09-12T22:04:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0819999999999999e-06 2024-09-12T22:04:03.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450061+0000", 2024-09-12T22:04:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8169999999999999e-06 2024-09-12T22:04:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450080+0000", 2024-09-12T22:04:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9219999999999999e-05 2024-09-12T22:04:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0834000000000002e-05 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450123+0000", 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5830000000000001e-06 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464167+0000", 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014043517 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464298+0000", 2024-09-12T22:04:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013117099999999999 2024-09-12T22:04:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468505+0000", 2024-09-12T22:04:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042070700000000003 2024-09-12T22:04:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:03.396 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.895091579999999, 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018063523000000001, 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:03.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450096+0000", 2024-09-12T22:04:03.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7899999999999998e-07 2024-09-12T22:04:03.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450100+0000", 2024-09-12T22:04:03.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:04:03.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450107+0000", 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9269999999999999e-06 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450112+0000", 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2909999999999998e-06 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450156+0000", 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3665999999999998e-05 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:03.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450160+0000", 2024-09-12T22:04:03.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.822e-06 2024-09-12T22:04:03.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.459675+0000", 2024-09-12T22:04:03.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0095155039999999993 2024-09-12T22:04:03.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.459901+0000", 2024-09-12T22:04:03.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000225419 2024-09-12T22:04:03.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468159+0000", 2024-09-12T22:04:03.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082579100000000003 2024-09-12T22:04:03.401 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.401 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.401 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.401 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:24946 5.a 5:50e5ee2f:::benchmark_data_smithi043_32659_object24945:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:03.401 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.187196+0000", 2024-09-12T22:04:03.401 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.1579902820000001, 2024-09-12T22:04:03.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011742136, 2024-09-12T22:04:03.401 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.401 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.402 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.402 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:03.402 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:03.402 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.402 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 24946 2024-09-12T22:04:03.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.402 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187196+0000", 2024-09-12T22:04:03.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187196+0000", 2024-09-12T22:04:03.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187197+0000", 2024-09-12T22:04:03.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9699999999999995e-07 2024-09-12T22:04:03.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187275+0000", 2024-09-12T22:04:03.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8108999999999994e-05 2024-09-12T22:04:03.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187286+0000", 2024-09-12T22:04:03.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:04:03.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187293+0000", 2024-09-12T22:04:03.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1659999999999997e-06 2024-09-12T22:04:03.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188231+0000", 2024-09-12T22:04:03.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00093842999999999997 2024-09-12T22:04:03.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188395+0000", 2024-09-12T22:04:03.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000163962 2024-09-12T22:04:03.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:03.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188543+0000", 2024-09-12T22:04:03.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000147978 2024-09-12T22:04:03.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.192445+0000", 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039016580000000001 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.198883+0000", 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064380510000000002 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.198913+0000", 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0294000000000002e-05 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.198938+0000", 2024-09-12T22:04:03.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5185e-05 2024-09-12T22:04:03.407 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.407 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.407 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.407 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:24950 5.a 5:5765e396:::benchmark_data_smithi043_32659_object24949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:03.407 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.188315+0000", 2024-09-12T22:04:03.407 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.1568713410000004, 2024-09-12T22:04:03.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01110091, 2024-09-12T22:04:03.407 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.407 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.407 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.408 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:03.408 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:03.408 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.408 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 24950 2024-09-12T22:04:03.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.408 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188315+0000", 2024-09-12T22:04:03.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188315+0000", 2024-09-12T22:04:03.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188316+0000", 2024-09-12T22:04:03.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1659999999999999e-06 2024-09-12T22:04:03.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188434+0000", 2024-09-12T22:04:03.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117615 2024-09-12T22:04:03.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188444+0000", 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0369e-05 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188452+0000", 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4340000000000003e-06 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.189618+0000", 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001165763 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.189724+0000", 2024-09-12T22:04:03.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000106588 2024-09-12T22:04:03.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:03.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.189859+0000", 2024-09-12T22:04:03.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013484599999999999 2024-09-12T22:04:03.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.192449+0000", 2024-09-12T22:04:03.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025898829999999999 2024-09-12T22:04:03.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.199316+0000", 2024-09-12T22:04:03.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00686682 2024-09-12T22:04:03.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.199377+0000", 2024-09-12T22:04:03.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0931000000000003e-05 2024-09-12T22:04:03.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.199416+0000", 2024-09-12T22:04:03.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9495e-05 2024-09-12T22:04:03.412 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.413 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.413 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.413 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:26828 5.1 e26/22 5:89da373a:::benchmark_data_smithi043_32659_object26827:head v 26'1618, mlcod=26'1616)", 2024-09-12T22:04:03.413 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:04:03.413 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.6473329379999999, 2024-09-12T22:04:03.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013883159000000001, 2024-09-12T22:04:03.413 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.413 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.413 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.413 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:04:03.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:04:03.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:04:03.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8500000000000001e-07 2024-09-12T22:04:03.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697920+0000", 2024-09-12T22:04:03.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6223000000000006e-05 2024-09-12T22:04:03.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697929+0000", 2024-09-12T22:04:03.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2199999999999992e-06 2024-09-12T22:04:03.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697935+0000", 2024-09-12T22:04:03.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0190000000000003e-06 2024-09-12T22:04:03.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697982+0000", 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7630000000000003e-05 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.698001+0000", 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8488e-05 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.711690+0000", 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013689364000000001 2024-09-12T22:04:03.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.711737+0000", 2024-09-12T22:04:03.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6629999999999999e-05 2024-09-12T22:04:03.417 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.417 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.417 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.417 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:26838 5.1 e26/22 5:878c6958:::benchmark_data_smithi043_32659_object26837:head v 26'1619, mlcod=26'1616)", 2024-09-12T22:04:03.417 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.699838+0000", 2024-09-12T22:04:03.417 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.645348872, 2024-09-12T22:04:03.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011938512, 2024-09-12T22:04:03.417 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699838+0000", 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699838+0000", 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699843+0000", 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7679999999999997e-06 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699938+0000", 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4470999999999997e-05 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699953+0000", 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5028000000000001e-05 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699963+0000", 2024-09-12T22:04:03.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0118e-05 2024-09-12T22:04:03.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.700042+0000", 2024-09-12T22:04:03.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8629999999999998e-05 2024-09-12T22:04:03.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.700057+0000", 2024-09-12T22:04:03.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5170999999999999e-05 2024-09-12T22:04:03.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.711740+0000", 2024-09-12T22:04:03.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01168284 2024-09-12T22:04:03.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.711776+0000", 2024-09-12T22:04:03.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6486000000000003e-05 2024-09-12T22:04:03.421 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.421 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.421 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.421 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:28469 5.a 5:550e9ec0:::benchmark_data_smithi043_32659_object28468:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:00.118642+0000", 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.2265444539999999, 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012491746, 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 28469 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.118642+0000", 2024-09-12T22:04:03.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.118642+0000", 2024-09-12T22:04:03.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.118643+0000", 2024-09-12T22:04:03.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.063e-06 2024-09-12T22:04:03.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.118738+0000", 2024-09-12T22:04:03.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4938999999999993e-05 2024-09-12T22:04:03.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.118749+0000", 2024-09-12T22:04:03.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0857e-05 2024-09-12T22:04:03.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.118756+0000", 2024-09-12T22:04:03.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7800000000000003e-06 2024-09-12T22:04:03.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.118846+0000", 2024-09-12T22:04:03.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0229999999999995e-05 2024-09-12T22:04:03.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.119004+0000", 2024-09-12T22:04:03.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015772 2024-09-12T22:04:03.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:03.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.119126+0000", 2024-09-12T22:04:03.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012228799999999999 2024-09-12T22:04:03.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.121099+0000", 2024-09-12T22:04:03.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019726000000000001 2024-09-12T22:04:03.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.131038+0000", 2024-09-12T22:04:03.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0099391710000000001 2024-09-12T22:04:03.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.131093+0000", 2024-09-12T22:04:03.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5291999999999998e-05 2024-09-12T22:04:03.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.131134+0000", 2024-09-12T22:04:03.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0806000000000002e-05 2024-09-12T22:04:03.427 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.427 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.427 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.427 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:38127 5.a 5:544fdd55:::benchmark_data_smithi043_32659_object38126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.427 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:02.797911+0000", 2024-09-12T22:04:03.427 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.54727518900000005, 2024-09-12T22:04:03.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013112011, 2024-09-12T22:04:03.428 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.428 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.428 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.428 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:03.428 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:03.428 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.428 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 38127 2024-09-12T22:04:03.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.428 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.797911+0000", 2024-09-12T22:04:03.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.797911+0000", 2024-09-12T22:04:03.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.797912+0000", 2024-09-12T22:04:03.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0800000000000004e-07 2024-09-12T22:04:03.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.797938+0000", 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6325999999999998e-05 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.797948+0000", 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6770000000000007e-06 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.797954+0000", 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0920000000000003e-06 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.798284+0000", 2024-09-12T22:04:03.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033005099999999999 2024-09-12T22:04:03.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.798397+0000", 2024-09-12T22:04:03.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113037 2024-09-12T22:04:03.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:03.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.798524+0000", 2024-09-12T22:04:03.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000126489 2024-09-12T22:04:03.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.800711+0000", 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002187596 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.810959+0000", 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010247744 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.810995+0000", 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6099000000000001e-05 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.811023+0000", 2024-09-12T22:04:03.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8291999999999999e-05 2024-09-12T22:04:03.433 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.433 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.433 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.433 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:38869 5.3 5:c342be80:::benchmark_data_smithi043_32659_object38868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.433 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:03.031947+0000", 2024-09-12T22:04:03.433 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.31323933300000001, 2024-09-12T22:04:03.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01317432, 2024-09-12T22:04:03.433 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.433 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 38869 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.031947+0000", 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.031947+0000", 2024-09-12T22:04:03.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.031948+0000", 2024-09-12T22:04:03.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1429999999999999e-06 2024-09-12T22:04:03.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032010+0000", 2024-09-12T22:04:03.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1927999999999994e-05 2024-09-12T22:04:03.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032020+0000", 2024-09-12T22:04:03.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6379999999999999e-06 2024-09-12T22:04:03.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032027+0000", 2024-09-12T22:04:03.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5880000000000003e-06 2024-09-12T22:04:03.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037111+0000", 2024-09-12T22:04:03.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005084028 2024-09-12T22:04:03.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037291+0000", 2024-09-12T22:04:03.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018020699999999999 2024-09-12T22:04:03.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:03.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037409+0000", 2024-09-12T22:04:03.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011785699999999999 2024-09-12T22:04:03.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.041599+0000", 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041906479999999999 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.044986+0000", 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033871769999999999 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045060+0000", 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3215999999999998e-05 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045122+0000", 2024-09-12T22:04:03.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1890000000000005e-05 2024-09-12T22:04:03.439 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.439 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.439 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.439 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:38870 5.3 5:c90bd940:::benchmark_data_smithi043_32659_object38869:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.439 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:03.032044+0000", 2024-09-12T22:04:03.439 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.313142855, 2024-09-12T22:04:03.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013248721, 2024-09-12T22:04:03.439 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.439 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.439 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.439 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:03.440 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:03.440 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.440 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 38870 2024-09-12T22:04:03.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.440 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032044+0000", 2024-09-12T22:04:03.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032044+0000", 2024-09-12T22:04:03.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032044+0000", 2024-09-12T22:04:03.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:03.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032110+0000", 2024-09-12T22:04:03.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5372999999999999e-05 2024-09-12T22:04:03.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032118+0000", 2024-09-12T22:04:03.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9209999999999992e-06 2024-09-12T22:04:03.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032123+0000", 2024-09-12T22:04:03.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T22:04:03.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.038678+0000", 2024-09-12T22:04:03.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065548400000000001 2024-09-12T22:04:03.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.038817+0000", 2024-09-12T22:04:03.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0001393 2024-09-12T22:04:03.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:03.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.038979+0000", 2024-09-12T22:04:03.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016181999999999999 2024-09-12T22:04:03.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045132+0000", 2024-09-12T22:04:03.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061531820000000001 2024-09-12T22:04:03.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045203+0000", 2024-09-12T22:04:03.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0732e-05 2024-09-12T22:04:03.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045261+0000", 2024-09-12T22:04:03.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7587000000000003e-05 2024-09-12T22:04:03.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045292+0000", 2024-09-12T22:04:03.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1701e-05 2024-09-12T22:04:03.445 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.445 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.445 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.445 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:38872 5.3 5:c859340c:::benchmark_data_smithi043_32659_object38871:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.445 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:03.032534+0000", 2024-09-12T22:04:03.445 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.31265306100000001, 2024-09-12T22:04:03.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012906792, 2024-09-12T22:04:03.445 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.445 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.445 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.445 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:03.446 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:03.446 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.446 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 38872 2024-09-12T22:04:03.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.446 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032534+0000", 2024-09-12T22:04:03.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032534+0000", 2024-09-12T22:04:03.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032534+0000", 2024-09-12T22:04:03.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1900000000000001e-07 2024-09-12T22:04:03.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032684+0000", 2024-09-12T22:04:03.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014931499999999999 2024-09-12T22:04:03.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032720+0000", 2024-09-12T22:04:03.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5756000000000001e-05 2024-09-12T22:04:03.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032727+0000", 2024-09-12T22:04:03.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4510000000000003e-06 2024-09-12T22:04:03.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.040284+0000", 2024-09-12T22:04:03.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0075574090000000002 2024-09-12T22:04:03.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.040389+0000", 2024-09-12T22:04:03.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000104719 2024-09-12T22:04:03.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:03.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.040465+0000", 2024-09-12T22:04:03.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5829999999999997e-05 2024-09-12T22:04:03.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045353+0000", 2024-09-12T22:04:03.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048878330000000003 2024-09-12T22:04:03.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045365+0000", 2024-09-12T22:04:03.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2469e-05 2024-09-12T22:04:03.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045405+0000", 2024-09-12T22:04:03.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0181e-05 2024-09-12T22:04:03.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045440+0000", 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4910000000000003e-05 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:38888 5.3 5:c746cecc:::benchmark_data_smithi043_32659_object38887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:03.037719+0000", 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.30746789400000002, 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011426568999999999, 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.451 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.452 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:03.452 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:03.452 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.452 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 38888 2024-09-12T22:04:03.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.452 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037719+0000", 2024-09-12T22:04:03.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037719+0000", 2024-09-12T22:04:03.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037720+0000", 2024-09-12T22:04:03.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:03.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037777+0000", 2024-09-12T22:04:03.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7079e-05 2024-09-12T22:04:03.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037794+0000", 2024-09-12T22:04:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6909e-05 2024-09-12T22:04:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037800+0000", 2024-09-12T22:04:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2480000000000001e-06 2024-09-12T22:04:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.043338+0000", 2024-09-12T22:04:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055382280000000001 2024-09-12T22:04:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.043498+0000", 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015976599999999999 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.043652+0000", 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015383199999999999 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045598+0000", 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019462500000000001 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.049012+0000", 2024-09-12T22:04:03.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0034139800000000001 2024-09-12T22:04:03.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.049102+0000", 2024-09-12T22:04:03.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0279999999999996e-05 2024-09-12T22:04:03.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.049145+0000", 2024-09-12T22:04:03.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2987e-05 2024-09-12T22:04:03.456 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:39403 5.3 5:c9c2ebb2:::benchmark_data_smithi043_32659_object39402:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:03.190613+0000", 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.1545733, 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011127873999999999, 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.457 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 39403 2024-09-12T22:04:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.190613+0000", 2024-09-12T22:04:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.190613+0000", 2024-09-12T22:04:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.190614+0000", 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7599999999999997e-07 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.190637+0000", 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3062e-05 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.190645+0000", 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.190652+0000", 2024-09-12T22:04:03.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5030000000000002e-06 2024-09-12T22:04:03.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:03.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.194665+0000", 2024-09-12T22:04:03.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004013417 2024-09-12T22:04:03.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:03.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.194793+0000", 2024-09-12T22:04:03.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000128181 2024-09-12T22:04:03.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:03.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.194946+0000", 2024-09-12T22:04:03.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000152872 2024-09-12T22:04:03.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:03.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.196608+0000", 2024-09-12T22:04:03.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016624109999999999 2024-09-12T22:04:03.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:03.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.201654+0000", 2024-09-12T22:04:03.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050454189999999998 2024-09-12T22:04:03.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.201703+0000", 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9044e-05 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.201741+0000", 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8315999999999997e-05 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:03.462 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:04:03.464 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:03.461+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:03.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:03.565 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:03.563+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:no valid command found; 10 closest matches: 2024-09-12T22:04:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:0 2024-09-12T22:04:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:1 2024-09-12T22:04:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:2 2024-09-12T22:04:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:abort 2024-09-12T22:04:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:assert 2024-09-12T22:04:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:bench [] [] [] [] 2024-09-12T22:04:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs debug_inject_read_zeros 2024-09-12T22:04:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs files list 2024-09-12T22:04:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs stats 2024-09-12T22:04:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:bluestore allocator dump block 2024-09-12T22:04:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:Error EINVAL: invalid command 2024-09-12T22:04:03.612 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T22:04:03.613 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T22:04:03.613 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-12T22:04:03.623 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:03.623 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:03.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.623 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:40833 5.f 5:f827513d:::benchmark_data_smithi043_32659_object40832:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.623 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.617371+0000", 2024-09-12T22:04:03.623 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0041172190000000001, 2024-09-12T22:04:03.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041471279999999999, 2024-09-12T22:04:03.623 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.624 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.624 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:03.624 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:03.624 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:03.624 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.624 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 40833 2024-09-12T22:04:03.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.624 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617371+0000", 2024-09-12T22:04:03.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617371+0000", 2024-09-12T22:04:03.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617372+0000", 2024-09-12T22:04:03.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9399999999999993e-07 2024-09-12T22:04:03.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617432+0000", 2024-09-12T22:04:03.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9261000000000001e-05 2024-09-12T22:04:03.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617439+0000", 2024-09-12T22:04:03.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8580000000000002e-06 2024-09-12T22:04:03.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617443+0000", 2024-09-12T22:04:03.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3340000000000003e-06 2024-09-12T22:04:03.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:03.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617494+0000", 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0806000000000001e-05 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617613+0000", 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011902 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617713+0000", 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9751000000000001e-05 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.628 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:40835 5.7 5:e468bfa0:::benchmark_data_smithi043_32659_object40834:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.628 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.617775+0000", 2024-09-12T22:04:03.628 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.003713666, 2024-09-12T22:04:03.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038296480000000002, 2024-09-12T22:04:03.628 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.628 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.628 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:03.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:03.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:03.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.628 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 40835 2024-09-12T22:04:03.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.628 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617775+0000", 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617775+0000", 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617776+0000", 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9899999999999999e-07 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617877+0000", 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010090999999999999 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617890+0000", 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3335e-05 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617895+0000", 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617938+0000", 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999999e-05 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.618059+0000", 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120531 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.618184+0000", 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012568 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.631 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.632 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.632 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:40836 5.2 5:45c34404:::benchmark_data_smithi043_32659_object40835:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.632 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.617906+0000", 2024-09-12T22:04:03.632 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0035828890000000001, 2024-09-12T22:04:03.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003778057, 2024-09-12T22:04:03.632 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.632 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.632 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:03.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:03.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:03.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.632 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 40836 2024-09-12T22:04:03.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.633 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617906+0000", 2024-09-12T22:04:03.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617906+0000", 2024-09-12T22:04:03.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617906+0000", 2024-09-12T22:04:03.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-09-12T22:04:03.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617955+0000", 2024-09-12T22:04:03.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8155999999999998e-05 2024-09-12T22:04:03.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617961+0000", 2024-09-12T22:04:03.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4840000000000001e-06 2024-09-12T22:04:03.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.617966+0000", 2024-09-12T22:04:03.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5950000000000001e-06 2024-09-12T22:04:03.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:03.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.618012+0000", 2024-09-12T22:04:03.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6587e-05 2024-09-12T22:04:03.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:03.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.618123+0000", 2024-09-12T22:04:03.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011052600000000001 2024-09-12T22:04:03.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:03.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.618234+0000", 2024-09-12T22:04:03.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011136700000000001 2024-09-12T22:04:03.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:03.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620255+0000", 2024-09-12T22:04:03.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020209529999999998 2024-09-12T22:04:03.636 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.636 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.636 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.637 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:40838 5.1 5:886407e3:::benchmark_data_smithi043_32659_object40837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.637 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.619420+0000", 2024-09-12T22:04:03.637 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0020690579999999999, 2024-09-12T22:04:03.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023451639999999998, 2024-09-12T22:04:03.637 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.637 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.637 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:03.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:03.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:03.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.637 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 40838 2024-09-12T22:04:03.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.637 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619420+0000", 2024-09-12T22:04:03.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619420+0000", 2024-09-12T22:04:03.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619421+0000", 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1960000000000001e-06 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619490+0000", 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8955000000000006e-05 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619500+0000", 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9469999999999998e-06 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619507+0000", 2024-09-12T22:04:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5039999999999996e-06 2024-09-12T22:04:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619599+0000", 2024-09-12T22:04:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2161000000000001e-05 2024-09-12T22:04:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619729+0000", 2024-09-12T22:04:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012983600000000001 2024-09-12T22:04:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619863+0000", 2024-09-12T22:04:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000134234 2024-09-12T22:04:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:40839 5.7 5:ee6fd646:::benchmark_data_smithi043_32659_object40838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.619544+0000", 2024-09-12T22:04:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001944594, 2024-09-12T22:04:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022894090000000001, 2024-09-12T22:04:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.642 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.642 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:03.642 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:03.642 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:03.642 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.642 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 40839 2024-09-12T22:04:03.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.642 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619544+0000", 2024-09-12T22:04:03.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619544+0000", 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619545+0000", 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8500000000000001e-07 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619579+0000", 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4054000000000003e-05 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619587+0000", 2024-09-12T22:04:03.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0269999999999995e-06 2024-09-12T22:04:03.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619593+0000", 2024-09-12T22:04:03.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8309999999999997e-06 2024-09-12T22:04:03.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:03.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619768+0000", 2024-09-12T22:04:03.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000175408 2024-09-12T22:04:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619902+0000", 2024-09-12T22:04:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013349499999999999 2024-09-12T22:04:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620096+0000", 2024-09-12T22:04:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019477599999999999 2024-09-12T22:04:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.646 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:40831 5.5 e27/22 5:ac470e19:::benchmark_data_smithi043_32659_object40830:head v 27'2613, mlcod=27'2609)", 2024-09-12T22:04:03.646 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.619617+0000", 2024-09-12T22:04:03.646 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001871819, 2024-09-12T22:04:03.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002255908, 2024-09-12T22:04:03.646 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.646 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.646 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:03.647 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619617+0000", 2024-09-12T22:04:03.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619617+0000", 2024-09-12T22:04:03.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619617+0000", 2024-09-12T22:04:03.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.34e-07 2024-09-12T22:04:03.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619644+0000", 2024-09-12T22:04:03.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6329000000000002e-05 2024-09-12T22:04:03.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619651+0000", 2024-09-12T22:04:03.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1409999999999999e-06 2024-09-12T22:04:03.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619656+0000", 2024-09-12T22:04:03.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2769999999999996e-06 2024-09-12T22:04:03.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:03.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619696+0000", 2024-09-12T22:04:03.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9677e-05 2024-09-12T22:04:03.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:03.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619718+0000", 2024-09-12T22:04:03.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2104999999999999e-05 2024-09-12T22:04:03.650 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.650 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.650 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.650 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:40840 5.9 5:947d0b9b:::benchmark_data_smithi043_32659_object40839:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.650 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.619946+0000", 2024-09-12T22:04:03.650 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001542327, 2024-09-12T22:04:03.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019727939999999999, 2024-09-12T22:04:03.651 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.651 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.651 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:03.651 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:03.651 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:03.651 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.651 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 40840 2024-09-12T22:04:03.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.651 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619946+0000", 2024-09-12T22:04:03.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619946+0000", 2024-09-12T22:04:03.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.619949+0000", 2024-09-12T22:04:03.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4099999999999998e-06 2024-09-12T22:04:03.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620017+0000", 2024-09-12T22:04:03.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8563000000000001e-05 2024-09-12T22:04:03.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620035+0000", 2024-09-12T22:04:03.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8063e-05 2024-09-12T22:04:03.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620042+0000", 2024-09-12T22:04:03.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8040000000000004e-06 2024-09-12T22:04:03.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:03.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620113+0000", 2024-09-12T22:04:03.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0925000000000003e-05 2024-09-12T22:04:03.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:03.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620234+0000", 2024-09-12T22:04:03.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012060700000000001 2024-09-12T22:04:03.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:03.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620320+0000", 2024-09-12T22:04:03.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6516999999999999e-05 2024-09-12T22:04:03.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.654 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.655 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.655 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:40841 5.2 5:44101eb4:::benchmark_data_smithi043_32659_object40840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.655 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.620335+0000", 2024-09-12T22:04:03.655 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0011540980000000001, 2024-09-12T22:04:03.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016337999999999999, 2024-09-12T22:04:03.655 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.655 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.655 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:03.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:03.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:03.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.656 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 40841 2024-09-12T22:04:03.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.656 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620335+0000", 2024-09-12T22:04:03.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620335+0000", 2024-09-12T22:04:03.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620335+0000", 2024-09-12T22:04:03.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1800000000000005e-07 2024-09-12T22:04:03.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620402+0000", 2024-09-12T22:04:03.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7020000000000005e-05 2024-09-12T22:04:03.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620411+0000", 2024-09-12T22:04:03.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9609999999999994e-06 2024-09-12T22:04:03.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620419+0000", 2024-09-12T22:04:03.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1359999999999999e-06 2024-09-12T22:04:03.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:03.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620468+0000", 2024-09-12T22:04:03.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9271999999999999e-05 2024-09-12T22:04:03.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:03.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620604+0000", 2024-09-12T22:04:03.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013586699999999999 2024-09-12T22:04:03.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:03.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620731+0000", 2024-09-12T22:04:03.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012772099999999999 2024-09-12T22:04:03.660 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.660 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.660 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.660 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:40836 5.2 e27/22)", 2024-09-12T22:04:03.660 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.620654+0000", 2024-09-12T22:04:03.661 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00083426099999999999, 2024-09-12T22:04:03.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0013523859999999999, 2024-09-12T22:04:03.661 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.661 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.661 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:03.661 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620654+0000", 2024-09-12T22:04:03.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620654+0000", 2024-09-12T22:04:03.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620655+0000", 2024-09-12T22:04:03.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2399999999999999e-07 2024-09-12T22:04:03.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620658+0000", 2024-09-12T22:04:03.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2899999999999998e-06 2024-09-12T22:04:03.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620666+0000", 2024-09-12T22:04:03.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5120000000000002e-06 2024-09-12T22:04:03.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620671+0000", 2024-09-12T22:04:03.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1270000000000002e-06 2024-09-12T22:04:03.666 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.666 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.666 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.667 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:40843 5.1 5:83f52ba6:::benchmark_data_smithi043_32659_object40842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.667 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.620620+0000", 2024-09-12T22:04:03.667 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00086874100000000002, 2024-09-12T22:04:03.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0014329659999999999, 2024-09-12T22:04:03.668 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.668 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.668 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:03.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:03.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:03.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.669 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 40843 2024-09-12T22:04:03.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.669 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620620+0000", 2024-09-12T22:04:03.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620620+0000", 2024-09-12T22:04:03.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620621+0000", 2024-09-12T22:04:03.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4000000000000001e-07 2024-09-12T22:04:03.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620705+0000", 2024-09-12T22:04:03.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3898000000000002e-05 2024-09-12T22:04:03.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620717+0000", 2024-09-12T22:04:03.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1926000000000001e-05 2024-09-12T22:04:03.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620724+0000", 2024-09-12T22:04:03.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.841e-06 2024-09-12T22:04:03.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:03.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621301+0000", 2024-09-12T22:04:03.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00057645099999999996 2024-09-12T22:04:03.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:03.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621417+0000", 2024-09-12T22:04:03.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011666 2024-09-12T22:04:03.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:03.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621558+0000", 2024-09-12T22:04:03.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014068500000000001 2024-09-12T22:04:03.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.677 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.677 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:40837 5.5 e27/22 5:a2bf0e14:::benchmark_data_smithi043_32659_object40836:head v 27'2614, mlcod=27'2611)", 2024-09-12T22:04:03.678 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.620805+0000", 2024-09-12T22:04:03.678 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00068363300000000001, 2024-09-12T22:04:03.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0013160579999999999, 2024-09-12T22:04:03.678 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.678 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.678 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:03.679 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620805+0000", 2024-09-12T22:04:03.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620805+0000", 2024-09-12T22:04:03.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620806+0000", 2024-09-12T22:04:03.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:04:03.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620870+0000", 2024-09-12T22:04:03.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4461999999999994e-05 2024-09-12T22:04:03.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620883+0000", 2024-09-12T22:04:03.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2475e-05 2024-09-12T22:04:03.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620889+0000", 2024-09-12T22:04:03.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3960000000000003e-06 2024-09-12T22:04:03.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:03.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620981+0000", 2024-09-12T22:04:03.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2249000000000004e-05 2024-09-12T22:04:03.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:03.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.620997+0000", 2024-09-12T22:04:03.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6276000000000001e-05 2024-09-12T22:04:03.686 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.686 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.686 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.687 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:40844 5.1 5.bcd7bec1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.687 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.621437+0000", 2024-09-12T22:04:03.687 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.1255000000000003e-05, 2024-09-12T22:04:03.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00072480899999999998, 2024-09-12T22:04:03.687 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.688 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.688 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:03.688 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:03.688 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:03.688 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.688 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 40844 2024-09-12T22:04:03.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.689 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621437+0000", 2024-09-12T22:04:03.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621437+0000", 2024-09-12T22:04:03.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621438+0000", 2024-09-12T22:04:03.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:04:03.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621514+0000", 2024-09-12T22:04:03.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6064999999999998e-05 2024-09-12T22:04:03.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621539+0000", 2024-09-12T22:04:03.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4814999999999999e-05 2024-09-12T22:04:03.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621546+0000", 2024-09-12T22:04:03.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1899999999999998e-06 2024-09-12T22:04:03.694 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.694 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.694 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.695 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:40845 5.2 5.bfe86e32 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.695 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.621563+0000", 2024-09-12T22:04:03.695 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999256, 2024-09-12T22:04:03.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00064248300000000001, 2024-09-12T22:04:03.695 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.696 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.696 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:03.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:03.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:03.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.696 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 40845 2024-09-12T22:04:03.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.697 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621563+0000", 2024-09-12T22:04:03.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621563+0000", 2024-09-12T22:04:03.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621564+0000", 2024-09-12T22:04:03.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:04:03.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621597+0000", 2024-09-12T22:04:03.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2916000000000001e-05 2024-09-12T22:04:03.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621604+0000", 2024-09-12T22:04:03.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4900000000000003e-06 2024-09-12T22:04:03.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621610+0000", 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:40838 5.1 e27/22)", 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.621781+0000", 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9997082, 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00045289000000000001, 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621781+0000", 2024-09-12T22:04:03.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621781+0000", 2024-09-12T22:04:03.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621781+0000", 2024-09-12T22:04:03.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2799999999999996e-07 2024-09-12T22:04:03.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621785+0000", 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621809+0000", 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4162e-05 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.621817+0000", 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4209999999999998e-06 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.702 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:40846 5.2 5.1f3b7b12 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.622023+0000", 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9994659, 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025211100000000001, 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 40846 2024-09-12T22:04:03.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.704 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:03.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:03.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.622023+0000", 2024-09-12T22:04:03.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:03.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.622023+0000", 2024-09-12T22:04:03.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.622023+0000", 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.622106+0000", 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2460999999999995e-05 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.622115+0000", 2024-09-12T22:04:03.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.268e-06 2024-09-12T22:04:03.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:03.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:03.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:03.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.622123+0000", 2024-09-12T22:04:03.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7109999999999995e-06 2024-09-12T22:04:03.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.706 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:03.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:03.706 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:03.706 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 15 2024-09-12T22:04:03.706 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:03.708 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:03.708 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:03.706+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:no valid command found; 10 closest matches: 2024-09-12T22:04:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:0 2024-09-12T22:04:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:1 2024-09-12T22:04:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:2 2024-09-12T22:04:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:abort 2024-09-12T22:04:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:assert 2024-09-12T22:04:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:bench [] [] [] [] 2024-09-12T22:04:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs debug_inject_read_zeros 2024-09-12T22:04:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs files list 2024-09-12T22:04:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs stats 2024-09-12T22:04:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:bluestore allocator dump block 2024-09-12T22:04:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:Error EINVAL: invalid command 2024-09-12T22:04:03.761 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T22:04:03.761 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T22:04:03.808 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:03.807+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:03.904 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:03.904 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:03.909 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:03.907+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:03.918 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:04.010 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:04.008+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:04.110 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:04.108+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:04.112 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:04.113 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:04.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:04.113 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:04.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.113 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.113 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:04.113 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.659654079999999, 2024-09-12T22:04:04.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018534981999999998, 2024-09-12T22:04:04.113 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.113 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.113 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.114 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:04.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:04.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449725+0000", 2024-09-12T22:04:04.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799999999999999e-06 2024-09-12T22:04:04.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449731+0000", 2024-09-12T22:04:04.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.801e-06 2024-09-12T22:04:04.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449745+0000", 2024-09-12T22:04:04.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4198e-05 2024-09-12T22:04:04.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449758+0000", 2024-09-12T22:04:04.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2858e-05 2024-09-12T22:04:04.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449815+0000", 2024-09-12T22:04:04.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6978999999999998e-05 2024-09-12T22:04:04.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:04.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:04.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2369999999999997e-06 2024-09-12T22:04:04.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457683+0000", 2024-09-12T22:04:04.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078622640000000008 2024-09-12T22:04:04.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457840+0000", 2024-09-12T22:04:04.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015715299999999999 2024-09-12T22:04:04.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457972+0000", 2024-09-12T22:04:04.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013179500000000001 2024-09-12T22:04:04.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462325+0000", 2024-09-12T22:04:04.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043526859999999997 2024-09-12T22:04:04.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468180+0000", 2024-09-12T22:04:04.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058557169999999999 2024-09-12T22:04:04.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468221+0000", 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0673000000000002e-05 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468258+0000", 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7240999999999998e-05 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:04.119 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.659601469000002, 2024-09-12T22:04:04.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018748032000000001, 2024-09-12T22:04:04.120 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.120 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.120 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.120 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:04.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:04.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449779+0000", 2024-09-12T22:04:04.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4869999999999998e-06 2024-09-12T22:04:04.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449783+0000", 2024-09-12T22:04:04.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:04:04.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449791+0000", 2024-09-12T22:04:04.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2640000000000002e-06 2024-09-12T22:04:04.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449796+0000", 2024-09-12T22:04:04.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9370000000000001e-06 2024-09-12T22:04:04.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449915+0000", 2024-09-12T22:04:04.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118559 2024-09-12T22:04:04.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:04.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449920+0000", 2024-09-12T22:04:04.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.101e-06 2024-09-12T22:04:04.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458578+0000", 2024-09-12T22:04:04.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008657662 2024-09-12T22:04:04.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458978+0000", 2024-09-12T22:04:04.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00039977399999999998 2024-09-12T22:04:04.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459130+0000", 2024-09-12T22:04:04.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000152394 2024-09-12T22:04:04.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462793+0000", 2024-09-12T22:04:04.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036628770000000001 2024-09-12T22:04:04.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468451+0000", 2024-09-12T22:04:04.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056577820000000001 2024-09-12T22:04:04.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468501+0000", 2024-09-12T22:04:04.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0609999999999998e-05 2024-09-12T22:04:04.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468524+0000", 2024-09-12T22:04:04.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2804000000000001e-05 2024-09-12T22:04:04.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.125 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.126 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.126 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:04.126 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.659566768000001, 2024-09-12T22:04:04.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018816113999999998, 2024-09-12T22:04:04.126 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.126 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.126 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.126 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:04.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3360000000000001e-06 2024-09-12T22:04:04.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449832+0000", 2024-09-12T22:04:04.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1528e-05 2024-09-12T22:04:04.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:04:04.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-12T22:04:04.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459429+0000", 2024-09-12T22:04:04.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095926970000000007 2024-09-12T22:04:04.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459597+0000", 2024-09-12T22:04:04.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000168309 2024-09-12T22:04:04.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459829+0000", 2024-09-12T22:04:04.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231158 2024-09-12T22:04:04.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462796+0000", 2024-09-12T22:04:04.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029673849999999999 2024-09-12T22:04:04.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468558+0000", 2024-09-12T22:04:04.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057621449999999998 2024-09-12T22:04:04.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468592+0000", 2024-09-12T22:04:04.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4241e-05 2024-09-12T22:04:04.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468627+0000", 2024-09-12T22:04:04.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4511999999999998e-05 2024-09-12T22:04:04.131 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.131 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.131 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.131 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.131 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:04.131 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.659499740000001, 2024-09-12T22:04:04.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018845905, 2024-09-12T22:04:04.132 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.132 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.132 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.132 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:04.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:04.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:04.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:04:04.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449881+0000", 2024-09-12T22:04:04.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.005e-06 2024-09-12T22:04:04.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449887+0000", 2024-09-12T22:04:04.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9050000000000002e-06 2024-09-12T22:04:04.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449892+0000", 2024-09-12T22:04:04.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2009999999999998e-06 2024-09-12T22:04:04.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460279+0000", 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010386808000000001 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460427+0000", 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014789 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460572+0000", 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014453099999999999 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462799+0000", 2024-09-12T22:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002227049 2024-09-12T22:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468672+0000", 2024-09-12T22:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058730060000000001 2024-09-12T22:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468704+0000", 2024-09-12T22:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2421e-05 2024-09-12T22:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468724+0000", 2024-09-12T22:04:04.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9582e-05 2024-09-12T22:04:04.137 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.137 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.137 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.137 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.137 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:04:04.137 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.659469269999999, 2024-09-12T22:04:04.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015455175, 2024-09-12T22:04:04.137 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.137 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449909+0000", 2024-09-12T22:04:04.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2099999999999997e-07 2024-09-12T22:04:04.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449912+0000", 2024-09-12T22:04:04.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1439999999999999e-06 2024-09-12T22:04:04.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449925+0000", 2024-09-12T22:04:04.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2944e-05 2024-09-12T22:04:04.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449931+0000", 2024-09-12T22:04:04.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3289999999999999e-06 2024-09-12T22:04:04.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:04:04.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:04:04.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:04.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449990+0000", 2024-09-12T22:04:04.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8090000000000004e-06 2024-09-12T22:04:04.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.455881+0000", 2024-09-12T22:04:04.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058904400000000003 2024-09-12T22:04:04.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456556+0000", 2024-09-12T22:04:04.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00067549500000000002 2024-09-12T22:04:04.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456742+0000", 2024-09-12T22:04:04.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018546799999999999 2024-09-12T22:04:04.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461053+0000", 2024-09-12T22:04:04.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043118310000000003 2024-09-12T22:04:04.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465220+0000", 2024-09-12T22:04:04.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041667750000000002 2024-09-12T22:04:04.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465316+0000", 2024-09-12T22:04:04.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5996999999999996e-05 2024-09-12T22:04:04.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465363+0000", 2024-09-12T22:04:04.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7111999999999999e-05 2024-09-12T22:04:04.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.143 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.143 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.143 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:04.143 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.659426879000002, 2024-09-12T22:04:04.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017913407999999999, 2024-09-12T22:04:04.144 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.144 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.144 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.144 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:04.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:04.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:04.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3499999999999996e-07 2024-09-12T22:04:04.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449955+0000", 2024-09-12T22:04:04.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4379999999999999e-06 2024-09-12T22:04:04.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449963+0000", 2024-09-12T22:04:04.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2719999999999997e-06 2024-09-12T22:04:04.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449970+0000", 2024-09-12T22:04:04.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5930000000000002e-06 2024-09-12T22:04:04.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450563+0000", 2024-09-12T22:04:04.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00059351900000000003 2024-09-12T22:04:04.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450570+0000", 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3900000000000004e-06 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461148+0000", 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010577354000000001 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461312+0000", 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016392300000000001 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461525+0000", 2024-09-12T22:04:04.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021282199999999999 2024-09-12T22:04:04.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464272+0000", 2024-09-12T22:04:04.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027469740000000001 2024-09-12T22:04:04.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467749+0000", 2024-09-12T22:04:04.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003477235 2024-09-12T22:04:04.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467815+0000", 2024-09-12T22:04:04.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5974000000000002e-05 2024-09-12T22:04:04.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467864+0000", 2024-09-12T22:04:04.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9279e-05 2024-09-12T22:04:04.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.149 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.150 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.150 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:04.150 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.659395412999999, 2024-09-12T22:04:04.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018827507, 2024-09-12T22:04:04.150 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.150 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.150 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.150 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:04.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:04:04.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2739999999999999e-06 2024-09-12T22:04:04.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449999+0000", 2024-09-12T22:04:04.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3349e-05 2024-09-12T22:04:04.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450005+0000", 2024-09-12T22:04:04.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.609e-06 2024-09-12T22:04:04.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461006+0000", 2024-09-12T22:04:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011000876 2024-09-12T22:04:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461236+0000", 2024-09-12T22:04:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000230301 2024-09-12T22:04:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461362+0000", 2024-09-12T22:04:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012541900000000001 2024-09-12T22:04:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464797+0000", 2024-09-12T22:04:04.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034350840000000001 2024-09-12T22:04:04.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468754+0000", 2024-09-12T22:04:04.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039576689999999996 2024-09-12T22:04:04.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468784+0000", 2024-09-12T22:04:04.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9558000000000001e-05 2024-09-12T22:04:04.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468810+0000", 2024-09-12T22:04:04.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5752e-05 2024-09-12T22:04:04.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.155 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.155 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.155 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:04.155 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.659363541000001, 2024-09-12T22:04:04.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018888559999999999, 2024-09-12T22:04:04.156 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.156 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.156 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.156 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:04.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:04.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450015+0000", 2024-09-12T22:04:04.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:04:04.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450018+0000", 2024-09-12T22:04:04.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3840000000000001e-06 2024-09-12T22:04:04.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:04:04.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8859999999999998e-06 2024-09-12T22:04:04.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450030+0000", 2024-09-12T22:04:04.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4829999999999999e-06 2024-09-12T22:04:04.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465718+0000", 2024-09-12T22:04:04.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015688163000000001 2024-09-12T22:04:04.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465793+0000", 2024-09-12T22:04:04.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4788000000000003e-05 2024-09-12T22:04:04.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466015+0000", 2024-09-12T22:04:04.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000221394 2024-09-12T22:04:04.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467628+0000", 2024-09-12T22:04:04.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016131190000000001 2024-09-12T22:04:04.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468849+0000", 2024-09-12T22:04:04.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012211699999999999 2024-09-12T22:04:04.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468878+0000", 2024-09-12T22:04:04.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8708e-05 2024-09-12T22:04:04.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468902+0000", 2024-09-12T22:04:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868e-05 2024-09-12T22:04:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:23 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.659340094000001, 2024-09-12T22:04:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021189669000000001, 2024-09-12T22:04:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450038+0000", 2024-09-12T22:04:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450042+0000", 2024-09-12T22:04:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7720000000000001e-06 2024-09-12T22:04:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450058+0000", 2024-09-12T22:04:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6379999999999999e-05 2024-09-12T22:04:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450067+0000", 2024-09-12T22:04:04.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3870000000000001e-06 2024-09-12T22:04:04.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466409+0000", 2024-09-12T22:04:04.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016341418999999999 2024-09-12T22:04:04.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466467+0000", 2024-09-12T22:04:04.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8613999999999998e-05 2024-09-12T22:04:04.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466612+0000", 2024-09-12T22:04:04.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014415000000000001 2024-09-12T22:04:04.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467856+0000", 2024-09-12T22:04:04.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012440039999999999 2024-09-12T22:04:04.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471178+0000", 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033227450000000002 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471207+0000", 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8571000000000001e-05 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471227+0000", 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0109999999999999e-05 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.659299554, 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021231197, 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:04.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450079+0000", 2024-09-12T22:04:04.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:04:04.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450083+0000", 2024-09-12T22:04:04.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1989999999999999e-06 2024-09-12T22:04:04.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450092+0000", 2024-09-12T22:04:04.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9400000000000008e-06 2024-09-12T22:04:04.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450097+0000", 2024-09-12T22:04:04.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:04:04.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466898+0000", 2024-09-12T22:04:04.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016801226999999998 2024-09-12T22:04:04.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466975+0000", 2024-09-12T22:04:04.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6197000000000002e-05 2024-09-12T22:04:04.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467158+0000", 2024-09-12T22:04:04.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183876 2024-09-12T22:04:04.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468270+0000", 2024-09-12T22:04:04.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001111229 2024-09-12T22:04:04.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471260+0000", 2024-09-12T22:04:04.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002989907 2024-09-12T22:04:04.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471289+0000", 2024-09-12T22:04:04.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9271000000000001e-05 2024-09-12T22:04:04.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471309+0000", 2024-09-12T22:04:04.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0302999999999999e-05 2024-09-12T22:04:04.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.172 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.172 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.173 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:04.173 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.659272952999999, 2024-09-12T22:04:04.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018145809999999998, 2024-09-12T22:04:04.173 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.173 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.173 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.173 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:04.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:04.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:04.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:04.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450114+0000", 2024-09-12T22:04:04.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1849999999999993e-06 2024-09-12T22:04:04.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:04:04.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1350000000000003e-06 2024-09-12T22:04:04.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450128+0000", 2024-09-12T22:04:04.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2040000000000002e-06 2024-09-12T22:04:04.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454085+0000", 2024-09-12T22:04:04.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00395736 2024-09-12T22:04:04.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:04.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454090+0000", 2024-09-12T22:04:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.378e-06 2024-09-12T22:04:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457076+0000", 2024-09-12T22:04:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002985747 2024-09-12T22:04:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457178+0000", 2024-09-12T22:04:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010242 2024-09-12T22:04:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457452+0000", 2024-09-12T22:04:04.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027313000000000001 2024-09-12T22:04:04.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462024+0000", 2024-09-12T22:04:04.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045727040000000004 2024-09-12T22:04:04.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468161+0000", 2024-09-12T22:04:04.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061372019999999996 2024-09-12T22:04:04.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468212+0000", 2024-09-12T22:04:04.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0707000000000001e-05 2024-09-12T22:04:04.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468250+0000", 2024-09-12T22:04:04.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8148000000000001e-05 2024-09-12T22:04:04.181 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.181 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.181 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.181 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.181 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:04:04.181 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.658681576999999, 2024-09-12T22:04:04.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017301410999999999, 2024-09-12T22:04:04.182 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.182 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.182 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.182 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:04:04.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:04:04.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450699+0000", 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0019999999999998e-06 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450705+0000", 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3199999999999996e-06 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450717+0000", 2024-09-12T22:04:04.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2069000000000001e-05 2024-09-12T22:04:04.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450726+0000", 2024-09-12T22:04:04.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2840000000000006e-06 2024-09-12T22:04:04.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454318+0000", 2024-09-12T22:04:04.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035919580000000001 2024-09-12T22:04:04.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:04.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454323+0000", 2024-09-12T22:04:04.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2490000000000001e-06 2024-09-12T22:04:04.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462054+0000", 2024-09-12T22:04:04.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0077311319999999999 2024-09-12T22:04:04.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462135+0000", 2024-09-12T22:04:04.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1558999999999996e-05 2024-09-12T22:04:04.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462273+0000", 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013781000000000001 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464587+0000", 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023134319999999998 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467908+0000", 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033211310000000002 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467960+0000", 2024-09-12T22:04:04.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2537000000000002e-05 2024-09-12T22:04:04.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467997+0000", 2024-09-12T22:04:04.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6928000000000003e-05 2024-09-12T22:04:04.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.187 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.187 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.187 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:04.188 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.658585398, 2024-09-12T22:04:04.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020127506999999999, 2024-09-12T22:04:04.188 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.188 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.188 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.188 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:04.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:04.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450793+0000", 2024-09-12T22:04:04.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2800000000000005e-07 2024-09-12T22:04:04.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450813+0000", 2024-09-12T22:04:04.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0063000000000001e-05 2024-09-12T22:04:04.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450847+0000", 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3973000000000002e-05 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450862+0000", 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5358000000000001e-05 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454355+0000", 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003492841 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:04.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454359+0000", 2024-09-12T22:04:04.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-09-12T22:04:04.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458704+0000", 2024-09-12T22:04:04.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043452459999999997 2024-09-12T22:04:04.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459009+0000", 2024-09-12T22:04:04.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030526199999999999 2024-09-12T22:04:04.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459143+0000", 2024-09-12T22:04:04.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013375 2024-09-12T22:04:04.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462690+0000", 2024-09-12T22:04:04.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035466579999999998 2024-09-12T22:04:04.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470863+0000", 2024-09-12T22:04:04.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0081734089999999995 2024-09-12T22:04:04.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470898+0000", 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4445e-05 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470920+0000", 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1844e-05 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.193 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.194 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:04.194 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.657055279000001, 2024-09-12T22:04:04.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018704596, 2024-09-12T22:04:04.194 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.194 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.194 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.194 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:04.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452323+0000", 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452337+0000", 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452489+0000", 2024-09-12T22:04:04.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015167699999999999 2024-09-12T22:04:04.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452498+0000", 2024-09-12T22:04:04.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9709999999999993e-06 2024-09-12T22:04:04.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454393+0000", 2024-09-12T22:04:04.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001895171 2024-09-12T22:04:04.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454397+0000", 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4470000000000002e-06 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459570+0000", 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051728160000000002 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459718+0000", 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014857800000000001 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459920+0000", 2024-09-12T22:04:04.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000202043 2024-09-12T22:04:04.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462696+0000", 2024-09-12T22:04:04.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027756299999999999 2024-09-12T22:04:04.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470963+0000", 2024-09-12T22:04:04.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082671359999999996 2024-09-12T22:04:04.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471000+0000", 2024-09-12T22:04:04.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6748999999999997e-05 2024-09-12T22:04:04.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471027+0000", 2024-09-12T22:04:04.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7118e-05 2024-09-12T22:04:04.199 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.199 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.199 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.200 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.200 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:04:04.200 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.656129601, 2024-09-12T22:04:04.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017680218000000001, 2024-09-12T22:04:04.200 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.200 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.200 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.200 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:04:04.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:04:04.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453249+0000", 2024-09-12T22:04:04.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:04:04.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453253+0000", 2024-09-12T22:04:04.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3630000000000004e-06 2024-09-12T22:04:04.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453261+0000", 2024-09-12T22:04:04.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9319999999999996e-06 2024-09-12T22:04:04.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453267+0000", 2024-09-12T22:04:04.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7989999999999999e-06 2024-09-12T22:04:04.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454995+0000", 2024-09-12T22:04:04.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001727793 2024-09-12T22:04:04.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:04.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.455000+0000", 2024-09-12T22:04:04.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0289999999999996e-06 2024-09-12T22:04:04.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461445+0000", 2024-09-12T22:04:04.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064456870000000003 2024-09-12T22:04:04.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461546+0000", 2024-09-12T22:04:04.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101036 2024-09-12T22:04:04.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461680+0000", 2024-09-12T22:04:04.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013407299999999999 2024-09-12T22:04:04.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464622+0000", 2024-09-12T22:04:04.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029413379999999999 2024-09-12T22:04:04.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470850+0000", 2024-09-12T22:04:04.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.006227977 2024-09-12T22:04:04.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470902+0000", 2024-09-12T22:04:04.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1916000000000002e-05 2024-09-12T22:04:04.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470928+0000", 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.65e-05 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.656098005, 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017838390999999999, 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:04.206 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453280+0000", 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:04:04.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453284+0000", 2024-09-12T22:04:04.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.194e-06 2024-09-12T22:04:04.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453337+0000", 2024-09-12T22:04:04.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2330999999999998e-05 2024-09-12T22:04:04.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453353+0000", 2024-09-12T22:04:04.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6001000000000001e-05 2024-09-12T22:04:04.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454421+0000", 2024-09-12T22:04:04.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010681009999999999 2024-09-12T22:04:04.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:04.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454424+0000", 2024-09-12T22:04:04.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2550000000000002e-06 2024-09-12T22:04:04.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460376+0000", 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059517770000000001 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460536+0000", 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015984699999999999 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471118+0000", 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010582322999999999 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:26828 5.1 5:89da373a:::benchmark_data_smithi043_32659_object26827:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:59.697444+0000", 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.4119332099999999, 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014705924, 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26828 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697444+0000", 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697444+0000", 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697445+0000", 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4099999999999997e-07 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697518+0000", 2024-09-12T22:04:04.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2889e-05 2024-09-12T22:04:04.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697529+0000", 2024-09-12T22:04:04.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1409999999999999e-05 2024-09-12T22:04:04.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697536+0000", 2024-09-12T22:04:04.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8079999999999999e-06 2024-09-12T22:04:04.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697584+0000", 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7871999999999998e-05 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697672+0000", 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7467999999999997e-05 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697755+0000", 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3492999999999995e-05 2024-09-12T22:04:04.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.698921+0000", 2024-09-12T22:04:04.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011660220000000001 2024-09-12T22:04:04.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.712052+0000", 2024-09-12T22:04:04.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013131115 2024-09-12T22:04:04.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.712108+0000", 2024-09-12T22:04:04.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5461999999999999e-05 2024-09-12T22:04:04.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.712150+0000", 2024-09-12T22:04:04.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2543999999999998e-05 2024-09-12T22:04:04.216 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.216 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.216 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.216 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:38135 5.f 5:f52e53c3:::benchmark_data_smithi043_32659_object38134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:04.216 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:02.800531+0000", 2024-09-12T22:04:04.216 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 1.3088469540000001, 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014922509, 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38135 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800531+0000", 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800531+0000", 2024-09-12T22:04:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800531+0000", 2024-09-12T22:04:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-09-12T22:04:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800644+0000", 2024-09-12T22:04:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011280100000000001 2024-09-12T22:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800656+0000", 2024-09-12T22:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1522000000000001e-05 2024-09-12T22:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800663+0000", 2024-09-12T22:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.131e-06 2024-09-12T22:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.801533+0000", 2024-09-12T22:04:04.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00087044599999999998 2024-09-12T22:04:04.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.801643+0000", 2024-09-12T22:04:04.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109948 2024-09-12T22:04:04.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.801772+0000", 2024-09-12T22:04:04.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000128577 2024-09-12T22:04:04.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.803660+0000", 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018880769999999999 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.815367+0000", 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011707235 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.815417+0000", 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9490000000000002e-05 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.815453+0000", 2024-09-12T22:04:04.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6448000000000001e-05 2024-09-12T22:04:04.222 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.222 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.222 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.222 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:39890 5.1 5:84fdb806:::benchmark_data_smithi043_32659_object39889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:04.222 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.345310+0000", 2024-09-12T22:04:04.222 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.76406739700000004, 2024-09-12T22:04:04.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014939364, 2024-09-12T22:04:04.222 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.222 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.222 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39890 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345310+0000", 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345310+0000", 2024-09-12T22:04:04.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345311+0000", 2024-09-12T22:04:04.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.68e-07 2024-09-12T22:04:04.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345341+0000", 2024-09-12T22:04:04.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0358e-05 2024-09-12T22:04:04.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345350+0000", 2024-09-12T22:04:04.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4940000000000003e-06 2024-09-12T22:04:04.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345355+0000", 2024-09-12T22:04:04.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:04:04.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345393+0000", 2024-09-12T22:04:04.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7874999999999999e-05 2024-09-12T22:04:04.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345474+0000", 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1110000000000001e-05 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345548+0000", 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4277999999999996e-05 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.347374+0000", 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001825929 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.360138+0000", 2024-09-12T22:04:04.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012763943999999999 2024-09-12T22:04:04.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.360196+0000", 2024-09-12T22:04:04.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7584999999999998e-05 2024-09-12T22:04:04.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.360249+0000", 2024-09-12T22:04:04.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3860999999999998e-05 2024-09-12T22:04:04.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.227 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.228 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.228 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:41412 5.f 5:f1014cb9:::benchmark_data_smithi043_32659_object41411:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:04.228 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.788465+0000", 2024-09-12T22:04:04.228 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.32091294300000001, 2024-09-12T22:04:04.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014703363000000001, 2024-09-12T22:04:04.228 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:04.228 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:04.228 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:04.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:04.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.228 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 41412 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.788465+0000", 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.788465+0000", 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:04.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.788465+0000", 2024-09-12T22:04:04.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4600000000000004e-07 2024-09-12T22:04:04.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:04.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.788530+0000", 2024-09-12T22:04:04.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5096000000000002e-05 2024-09-12T22:04:04.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:04.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.788539+0000", 2024-09-12T22:04:04.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8279999999999992e-06 2024-09-12T22:04:04.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.788546+0000", 2024-09-12T22:04:04.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.443e-06 2024-09-12T22:04:04.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:04.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.797692+0000", 2024-09-12T22:04:04.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0091461479999999998 2024-09-12T22:04:04.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:04.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.797796+0000", 2024-09-12T22:04:04.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010439599999999999 2024-09-12T22:04:04.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:04.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.797917+0000", 2024-09-12T22:04:04.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012084899999999999 2024-09-12T22:04:04.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.801346+0000", 2024-09-12T22:04:04.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034293980000000002 2024-09-12T22:04:04.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:04.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.803079+0000", 2024-09-12T22:04:04.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017324020000000001 2024-09-12T22:04:04.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:04.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.803134+0000", 2024-09-12T22:04:04.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5653999999999999e-05 2024-09-12T22:04:04.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:04.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:04.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:04.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.803168+0000", 2024-09-12T22:04:04.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3402999999999999e-05 2024-09-12T22:04:04.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.233 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:04.233 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:04.234 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:04.234 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 10 16 42720 42704 266.88 207.375 0.00424127 0.00374423 2024-09-12T22:04:04.235 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:04.236 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:04.233+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:04.331 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-09-12T22:04:04.335 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:04.334+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:04.384 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:04.384 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:04.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.384 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:43333 5.0 5:0c7a09e5:::benchmark_data_smithi043_32659_object43332:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:04.385 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.380897+0000", 2024-09-12T22:04:04.385 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0025715159999999998, 2024-09-12T22:04:04.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025916239999999998, 2024-09-12T22:04:04.385 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.385 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.385 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:04.385 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.385 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.385 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.385 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 43333 2024-09-12T22:04:04.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.385 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380897+0000", 2024-09-12T22:04:04.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380897+0000", 2024-09-12T22:04:04.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380897+0000", 2024-09-12T22:04:04.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:04:04.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380978+0000", 2024-09-12T22:04:04.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0882000000000003e-05 2024-09-12T22:04:04.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380986+0000", 2024-09-12T22:04:04.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7980000000000006e-06 2024-09-12T22:04:04.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380991+0000", 2024-09-12T22:04:04.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.493e-06 2024-09-12T22:04:04.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381383+0000", 2024-09-12T22:04:04.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00039198999999999999 2024-09-12T22:04:04.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381468+0000", 2024-09-12T22:04:04.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5872999999999996e-05 2024-09-12T22:04:04.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381586+0000", 2024-09-12T22:04:04.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117397 2024-09-12T22:04:04.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.383097+0000", 2024-09-12T22:04:04.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015107289999999999 2024-09-12T22:04:04.389 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.389 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.389 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.389 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:43337 5.e 5:7b405e0b:::benchmark_data_smithi043_32659_object43336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:04.389 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.381542+0000", 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001926393, 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019961100000000002, 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 43337 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381542+0000", 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381542+0000", 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381543+0000", 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4200000000000005e-07 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381613+0000", 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0129000000000006e-05 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381624+0000", 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.058e-05 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381630+0000", 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8709999999999999e-06 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381673+0000", 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2320000000000001e-05 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381747+0000", 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4295000000000006e-05 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381828+0000", 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0932000000000004e-05 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:43339 5.e 5:7a81508d:::benchmark_data_smithi043_32659_object43338:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:04.393 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.381838+0000", 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001630205, 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001752247, 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 43339 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381838+0000", 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381838+0000", 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381839+0000", 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.85e-07 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381883+0000", 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4359e-05 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381895+0000", 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.164e-05 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.381902+0000", 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6710000000000002e-06 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.383095+0000", 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011934039999999999 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.383178+0000", 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3023999999999997e-05 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.383254+0000", 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5731999999999999e-05 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:43335 5.a e28/22 5:59acc5ed:::benchmark_data_smithi043_32659_object43334:head v 28'2712, mlcod=28'2710)", 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.382292+0000", 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001176762, 2024-09-12T22:04:04.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001338183, 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.382292+0000", 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.382292+0000", 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.382292+0000", 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.382384+0000", 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1279999999999993e-05 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.382392+0000", 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7620000000000001e-06 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.382398+0000", 2024-09-12T22:04:04.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0170000000000002e-06 2024-09-12T22:04:04.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.382441+0000", 2024-09-12T22:04:04.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2425000000000001e-05 2024-09-12T22:04:04.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.382459+0000", 2024-09-12T22:04:04.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8493999999999999e-05 2024-09-12T22:04:04.400 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.400 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.400 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.401 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:43342 5.4 5.f7249ea4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:04.401 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.383521+0000", 2024-09-12T22:04:04.401 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.999948, 2024-09-12T22:04:04.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000155169, 2024-09-12T22:04:04.401 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.401 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.401 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:04.401 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.401 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.401 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.401 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 43342 2024-09-12T22:04:04.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.383521+0000", 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.383521+0000", 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.383522+0000", 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.083e-06 2024-09-12T22:04:04.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.383605+0000", 2024-09-12T22:04:04.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2924999999999996e-05 2024-09-12T22:04:04.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.383619+0000", 2024-09-12T22:04:04.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4618e-05 2024-09-12T22:04:04.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.383627+0000", 2024-09-12T22:04:04.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9009999999999994e-06 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.383683+0000", 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5798999999999999e-05 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:43332 5.0 5:0fe7fe4f:::benchmark_data_smithi043_32659_object43331:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.380084+0000", 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0033847119999999998, 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0036560379999999999, 2024-09-12T22:04:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.405 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.405 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:04.405 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.405 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.405 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.405 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 43332 2024-09-12T22:04:04.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.405 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380084+0000", 2024-09-12T22:04:04.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380084+0000", 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380085+0000", 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.029e-06 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380179+0000", 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4129999999999995e-05 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380189+0000", 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0138e-05 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380196+0000", 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9580000000000001e-06 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380240+0000", 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3891999999999999e-05 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380318+0000", 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8401999999999999e-05 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.380403+0000", 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4902999999999997e-05 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.382398+0000", 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001994675 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.408 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:04.409 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 6 2024-09-12T22:04:04.409 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:04.409 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:04.436 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:04.435+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:04.534 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:04:04.537 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:04.536+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:04.559 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:04.559 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:04.559 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:04.559 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:04.560 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:04.572 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:04.662 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-09-12T22:04:04.662 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:04:04.680 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:04.680 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:04.694 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:04.694 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:04.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:04.694 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:04.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.694 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.695 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.451393+0000", 2024-09-12T22:04:04.695 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 31.240671460000002, 2024-09-12T22:04:04.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012754669999999999, 2024-09-12T22:04:04.695 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.695 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.695 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.695 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451393+0000", 2024-09-12T22:04:04.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451393+0000", 2024-09-12T22:04:04.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.696 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451408+0000", 2024-09-12T22:04:04.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5079000000000001e-05 2024-09-12T22:04:04.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.696 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451417+0000", 2024-09-12T22:04:04.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5299999999999996e-06 2024-09-12T22:04:04.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451429+0000", 2024-09-12T22:04:04.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2628e-05 2024-09-12T22:04:04.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.451444+0000", 2024-09-12T22:04:04.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5105e-05 2024-09-12T22:04:04.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452220+0000", 2024-09-12T22:04:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077575300000000001 2024-09-12T22:04:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452529+0000", 2024-09-12T22:04:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00030873899999999999 2024-09-12T22:04:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452963+0000", 2024-09-12T22:04:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00043367699999999999 2024-09-12T22:04:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455843+0000", 2024-09-12T22:04:04.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028807049999999999 2024-09-12T22:04:04.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464032+0000", 2024-09-12T22:04:04.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0081885159999999999 2024-09-12T22:04:04.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464086+0000", 2024-09-12T22:04:04.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4549999999999998e-05 2024-09-12T22:04:04.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464148+0000", 2024-09-12T22:04:04.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1388000000000002e-05 2024-09-12T22:04:04.700 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.700 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.700 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.700 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.700 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:04:04.700 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 31.239801913000001, 2024-09-12T22:04:04.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012474654999999999, 2024-09-12T22:04:04.700 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.701 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.701 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.701 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:04:04.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:04:04.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452263+0000", 2024-09-12T22:04:04.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1500000000000003e-07 2024-09-12T22:04:04.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452268+0000", 2024-09-12T22:04:04.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8640000000000004e-06 2024-09-12T22:04:04.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452311+0000", 2024-09-12T22:04:04.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2255000000000001e-05 2024-09-12T22:04:04.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452326+0000", 2024-09-12T22:04:04.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5209e-05 2024-09-12T22:04:04.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455447+0000", 2024-09-12T22:04:04.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031213209999999998 2024-09-12T22:04:04.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455502+0000", 2024-09-12T22:04:04.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4925e-05 2024-09-12T22:04:04.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:04.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455592+0000", 2024-09-12T22:04:04.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9850000000000002e-05 2024-09-12T22:04:04.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.457408+0000", 2024-09-12T22:04:04.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001816018 2024-09-12T22:04:04.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464635+0000", 2024-09-12T22:04:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0072269350000000003 2024-09-12T22:04:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464682+0000", 2024-09-12T22:04:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7308000000000002e-05 2024-09-12T22:04:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464737+0000", 2024-09-12T22:04:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5155000000000003e-05 2024-09-12T22:04:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452345+0000", 2024-09-12T22:04:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 31.239719686000001, 2024-09-12T22:04:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012534264, 2024-09-12T22:04:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452345+0000", 2024-09-12T22:04:04.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452345+0000", 2024-09-12T22:04:04.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452346+0000", 2024-09-12T22:04:04.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.212e-06 2024-09-12T22:04:04.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452352+0000", 2024-09-12T22:04:04.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1850000000000001e-06 2024-09-12T22:04:04.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452362+0000", 2024-09-12T22:04:04.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6209999999999999e-06 2024-09-12T22:04:04.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452380+0000", 2024-09-12T22:04:04.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7909000000000001e-05 2024-09-12T22:04:04.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455611+0000", 2024-09-12T22:04:04.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032308889999999998 2024-09-12T22:04:04.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455675+0000", 2024-09-12T22:04:04.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4783999999999995e-05 2024-09-12T22:04:04.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:04.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.455866+0000", 2024-09-12T22:04:04.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019059900000000001 2024-09-12T22:04:04.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.457440+0000", 2024-09-12T22:04:04.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015739269999999999 2024-09-12T22:04:04.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464782+0000", 2024-09-12T22:04:04.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0073417100000000004 2024-09-12T22:04:04.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464835+0000", 2024-09-12T22:04:04.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3709999999999999e-05 2024-09-12T22:04:04.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464879+0000", 2024-09-12T22:04:04.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3717999999999997e-05 2024-09-12T22:04:04.711 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.711 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.711 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.711 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:04.711 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:33.452540+0000", 2024-09-12T22:04:04.712 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 31.239524081999999, 2024-09-12T22:04:04.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012490559, 2024-09-12T22:04:04.712 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.712 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.712 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.712 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452540+0000", 2024-09-12T22:04:04.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452540+0000", 2024-09-12T22:04:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452541+0000", 2024-09-12T22:04:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1299999999999999e-07 2024-09-12T22:04:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452546+0000", 2024-09-12T22:04:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.758e-06 2024-09-12T22:04:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452561+0000", 2024-09-12T22:04:04.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.541e-05 2024-09-12T22:04:04.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.452570+0000", 2024-09-12T22:04:04.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4309999999999994e-06 2024-09-12T22:04:04.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456142+0000", 2024-09-12T22:04:04.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035725409999999998 2024-09-12T22:04:04.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456258+0000", 2024-09-12T22:04:04.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115728 2024-09-12T22:04:04.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:04.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.456384+0000", 2024-09-12T22:04:04.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125506 2024-09-12T22:04:04.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.459667+0000", 2024-09-12T22:04:04.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032833129999999999 2024-09-12T22:04:04.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.464968+0000", 2024-09-12T22:04:04.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005300941 2024-09-12T22:04:04.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.465004+0000", 2024-09-12T22:04:04.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6606999999999997e-05 2024-09-12T22:04:04.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:33.465031+0000", 2024-09-12T22:04:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6611e-05 2024-09-12T22:04:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5133 5.e 5:731a25e2:::benchmark_data_smithi043_32659_object5132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:04:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.987886+0000", 2024-09-12T22:04:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7041787690000003, 2024-09-12T22:04:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.01358233, 2024-09-12T22:04:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.718 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.718 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.718 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.718 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5133 2024-09-12T22:04:04.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.718 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987886+0000", 2024-09-12T22:04:04.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987886+0000", 2024-09-12T22:04:04.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987887+0000", 2024-09-12T22:04:04.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:04.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987988+0000", 2024-09-12T22:04:04.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000101266 2024-09-12T22:04:04.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.987996+0000", 2024-09-12T22:04:04.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:04:04.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988002+0000", 2024-09-12T22:04:04.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8080000000000001e-06 2024-09-12T22:04:04.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988196+0000", 2024-09-12T22:04:04.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019422999999999999 2024-09-12T22:04:04.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988298+0000", 2024-09-12T22:04:04.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010208999999999999 2024-09-12T22:04:04.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988420+0000", 2024-09-12T22:04:04.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012256499999999999 2024-09-12T22:04:04.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989796+0000", 2024-09-12T22:04:04.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001375743 2024-09-12T22:04:04.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001390+0000", 2024-09-12T22:04:04.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011594089 2024-09-12T22:04:04.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001433+0000", 2024-09-12T22:04:04.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2420999999999999e-05 2024-09-12T22:04:04.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001468+0000", 2024-09-12T22:04:04.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5423999999999998e-05 2024-09-12T22:04:04.723 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.723 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.723 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.723 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5136 5.b 5:de031c2e:::benchmark_data_smithi043_32659_object5135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:04:04.723 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.988747+0000", 2024-09-12T22:04:04.723 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7033177389999992, 2024-09-12T22:04:04.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013407914999999999, 2024-09-12T22:04:04.723 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.723 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.723 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.724 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.724 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.724 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.724 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5136 2024-09-12T22:04:04.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.724 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988747+0000", 2024-09-12T22:04:04.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988747+0000", 2024-09-12T22:04:04.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988748+0000", 2024-09-12T22:04:04.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:04:04.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988848+0000", 2024-09-12T22:04:04.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000100355 2024-09-12T22:04:04.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988860+0000", 2024-09-12T22:04:04.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1719000000000001e-05 2024-09-12T22:04:04.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988867+0000", 2024-09-12T22:04:04.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0690000000000004e-06 2024-09-12T22:04:04.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988917+0000", 2024-09-12T22:04:04.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9777000000000001e-05 2024-09-12T22:04:04.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989021+0000", 2024-09-12T22:04:04.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010412300000000001 2024-09-12T22:04:04.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989093+0000", 2024-09-12T22:04:04.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1958999999999993e-05 2024-09-12T22:04:04.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991058+0000", 2024-09-12T22:04:04.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019651349999999998 2024-09-12T22:04:04.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002073+0000", 2024-09-12T22:04:04.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011014990000000001 2024-09-12T22:04:04.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002117+0000", 2024-09-12T22:04:04.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4317000000000003e-05 2024-09-12T22:04:04.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002155+0000", 2024-09-12T22:04:04.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7524999999999997e-05 2024-09-12T22:04:04.729 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.729 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.729 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.729 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5137 5.e 5:76ceaa0c:::benchmark_data_smithi043_32659_object5136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:04:04.729 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.988884+0000", 2024-09-12T22:04:04.729 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7031802149999997, 2024-09-12T22:04:04.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013010671, 2024-09-12T22:04:04.729 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.729 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.730 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.730 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.730 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.730 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.730 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5137 2024-09-12T22:04:04.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.730 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988884+0000", 2024-09-12T22:04:04.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988884+0000", 2024-09-12T22:04:04.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988885+0000", 2024-09-12T22:04:04.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4000000000000001e-07 2024-09-12T22:04:04.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988914+0000", 2024-09-12T22:04:04.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8912999999999999e-05 2024-09-12T22:04:04.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988923+0000", 2024-09-12T22:04:04.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.67e-06 2024-09-12T22:04:04.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988945+0000", 2024-09-12T22:04:04.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2677e-05 2024-09-12T22:04:04.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.988993+0000", 2024-09-12T22:04:04.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7497999999999998e-05 2024-09-12T22:04:04.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989109+0000", 2024-09-12T22:04:04.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011662099999999999 2024-09-12T22:04:04.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989264+0000", 2024-09-12T22:04:04.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015485 2024-09-12T22:04:04.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990950+0000", 2024-09-12T22:04:04.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0016853930000000001 2024-09-12T22:04:04.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001809+0000", 2024-09-12T22:04:04.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010859818 2024-09-12T22:04:04.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001863+0000", 2024-09-12T22:04:04.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3736000000000002e-05 2024-09-12T22:04:04.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.001895+0000", 2024-09-12T22:04:04.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1854999999999999e-05 2024-09-12T22:04:04.735 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.735 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.735 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.735 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:5138 5.b 5:d969c28c:::benchmark_data_smithi043_32659_object5137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T22:04:04.735 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:03:54.989883+0000", 2024-09-12T22:04:04.735 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7021819090000001, 2024-09-12T22:04:04.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012360691, 2024-09-12T22:04:04.735 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.735 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.736 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.736 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.736 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.736 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.736 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 5138 2024-09-12T22:04:04.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.736 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.736 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989883+0000", 2024-09-12T22:04:04.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989883+0000", 2024-09-12T22:04:04.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.989884+0000", 2024-09-12T22:04:04.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8999999999999995e-07 2024-09-12T22:04:04.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990012+0000", 2024-09-12T22:04:04.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000128245 2024-09-12T22:04:04.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990022+0000", 2024-09-12T22:04:04.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.927e-06 2024-09-12T22:04:04.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990029+0000", 2024-09-12T22:04:04.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3610000000000003e-06 2024-09-12T22:04:04.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990112+0000", 2024-09-12T22:04:04.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3323000000000002e-05 2024-09-12T22:04:04.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990249+0000", 2024-09-12T22:04:04.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013706499999999999 2024-09-12T22:04:04.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.990426+0000", 2024-09-12T22:04:04.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017672599999999999 2024-09-12T22:04:04.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:54.991995+0000", 2024-09-12T22:04:04.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015690579999999999 2024-09-12T22:04:04.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002163+0000", 2024-09-12T22:04:04.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010167697 2024-09-12T22:04:04.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002207+0000", 2024-09-12T22:04:04.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4030999999999999e-05 2024-09-12T22:04:04.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:03:55.002243+0000", 2024-09-12T22:04:04.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6368000000000001e-05 2024-09-12T22:04:04.741 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.741 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.741 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.741 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:38128 5.0 5:09e598e6:::benchmark_data_smithi043_32659_object38127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:04.741 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:02.797628+0000", 2024-09-12T22:04:04.741 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 1.894436139, 2024-09-12T22:04:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013169442999999999, 2024-09-12T22:04:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 38128 2024-09-12T22:04:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.797628+0000", 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.797628+0000", 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.797629+0000", 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.797689+0000", 2024-09-12T22:04:04.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9645999999999998e-05 2024-09-12T22:04:04.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.797698+0000", 2024-09-12T22:04:04.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7069999999999998e-06 2024-09-12T22:04:04.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.797703+0000", 2024-09-12T22:04:04.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1800000000000004e-06 2024-09-12T22:04:04.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.797742+0000", 2024-09-12T22:04:04.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8733999999999999e-05 2024-09-12T22:04:04.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.797839+0000", 2024-09-12T22:04:04.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6923999999999996e-05 2024-09-12T22:04:04.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.797943+0000", 2024-09-12T22:04:04.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010425399999999999 2024-09-12T22:04:04.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801038+0000", 2024-09-12T22:04:04.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003095577 2024-09-12T22:04:04.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.810703+0000", 2024-09-12T22:04:04.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0096643230000000007 2024-09-12T22:04:04.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.810754+0000", 2024-09-12T22:04:04.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1193000000000003e-05 2024-09-12T22:04:04.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.810798+0000", 2024-09-12T22:04:04.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3976e-05 2024-09-12T22:04:04.747 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.747 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.747 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.747 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:38136 5.e 5:72957ccd:::benchmark_data_smithi043_32659_object38135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:04.747 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:02.800520+0000", 2024-09-12T22:04:04.747 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 1.891545034, 2024-09-12T22:04:04.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014739538999999999, 2024-09-12T22:04:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 38136 2024-09-12T22:04:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.800520+0000", 2024-09-12T22:04:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.800520+0000", 2024-09-12T22:04:04.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.800520+0000", 2024-09-12T22:04:04.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4199999999999995e-07 2024-09-12T22:04:04.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.800702+0000", 2024-09-12T22:04:04.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018172500000000001 2024-09-12T22:04:04.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.800711+0000", 2024-09-12T22:04:04.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1409999999999994e-06 2024-09-12T22:04:04.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.800721+0000", 2024-09-12T22:04:04.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3910000000000004e-06 2024-09-12T22:04:04.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.800766+0000", 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5828000000000002e-05 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.800865+0000", 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8669e-05 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.800942+0000", 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7281999999999996e-05 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.802964+0000", 2024-09-12T22:04:04.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020214159999999998 2024-09-12T22:04:04.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.815173+0000", 2024-09-12T22:04:04.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012208953 2024-09-12T22:04:04.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.815217+0000", 2024-09-12T22:04:04.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4719999999999999e-05 2024-09-12T22:04:04.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.815259+0000", 2024-09-12T22:04:04.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1671999999999997e-05 2024-09-12T22:04:04.753 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.753 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.753 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.753 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:38138 5.8 5:11eab752:::benchmark_data_smithi043_32659_object38137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:04.753 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:02.800888+0000", 2024-09-12T22:04:04.754 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 1.8911764309999999, 2024-09-12T22:04:04.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014388852000000001, 2024-09-12T22:04:04.754 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.754 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.754 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.754 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.754 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.754 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.754 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 38138 2024-09-12T22:04:04.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.754 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.800888+0000", 2024-09-12T22:04:04.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.800888+0000", 2024-09-12T22:04:04.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.800889+0000", 2024-09-12T22:04:04.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9999999999999996e-07 2024-09-12T22:04:04.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.800993+0000", 2024-09-12T22:04:04.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010425900000000001 2024-09-12T22:04:04.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801004+0000", 2024-09-12T22:04:04.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0920999999999999e-05 2024-09-12T22:04:04.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801011+0000", 2024-09-12T22:04:04.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0049999999999998e-06 2024-09-12T22:04:04.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801059+0000", 2024-09-12T22:04:04.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7432000000000003e-05 2024-09-12T22:04:04.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801177+0000", 2024-09-12T22:04:04.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118155 2024-09-12T22:04:04.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801300+0000", 2024-09-12T22:04:04.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012372899999999999 2024-09-12T22:04:04.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.804873+0000", 2024-09-12T22:04:04.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035729849999999999 2024-09-12T22:04:04.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.815189+0000", 2024-09-12T22:04:04.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010315707 2024-09-12T22:04:04.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.815241+0000", 2024-09-12T22:04:04.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1493999999999999e-05 2024-09-12T22:04:04.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.815277+0000", 2024-09-12T22:04:04.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6365000000000002e-05 2024-09-12T22:04:04.759 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.759 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.759 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.759 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:38140 5.0 5:0930d96c:::benchmark_data_smithi043_32659_object38139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:04.759 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:02.801436+0000", 2024-09-12T22:04:04.760 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 1.890628352, 2024-09-12T22:04:04.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013934344, 2024-09-12T22:04:04.760 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.760 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.760 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.760 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.760 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.760 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.760 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 38140 2024-09-12T22:04:04.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.760 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801436+0000", 2024-09-12T22:04:04.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801436+0000", 2024-09-12T22:04:04.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801437+0000", 2024-09-12T22:04:04.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.99e-07 2024-09-12T22:04:04.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801518+0000", 2024-09-12T22:04:04.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1176999999999999e-05 2024-09-12T22:04:04.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801527+0000", 2024-09-12T22:04:04.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.772e-06 2024-09-12T22:04:04.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801532+0000", 2024-09-12T22:04:04.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7049999999999998e-06 2024-09-12T22:04:04.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801572+0000", 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0031999999999999e-05 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801707+0000", 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013566500000000001 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801875+0000", 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016761799999999999 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.807840+0000", 2024-09-12T22:04:04.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0059649589999999997 2024-09-12T22:04:04.764 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.815285+0000", 2024-09-12T22:04:04.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0074450580000000001 2024-09-12T22:04:04.764 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.815333+0000", 2024-09-12T22:04:04.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7880000000000002e-05 2024-09-12T22:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.815371+0000", 2024-09-12T22:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7778999999999999e-05 2024-09-12T22:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:38135 5.f e27/22 5:f52e53c3:::benchmark_data_smithi043_32659_object38134:head v 27'2393, mlcod=27'2389)", 2024-09-12T22:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:02.801876+0000", 2024-09-12T22:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 1.890188813, 2024-09-12T22:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013384469, 2024-09-12T22:04:04.766 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.766 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.766 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.766 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801876+0000", 2024-09-12T22:04:04.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801876+0000", 2024-09-12T22:04:04.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801876+0000", 2024-09-12T22:04:04.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0800000000000001e-07 2024-09-12T22:04:04.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801968+0000", 2024-09-12T22:04:04.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1990000000000005e-05 2024-09-12T22:04:04.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801976+0000", 2024-09-12T22:04:04.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:04:04.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801982+0000", 2024-09-12T22:04:04.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3229999999999997e-06 2024-09-12T22:04:04.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.802022+0000", 2024-09-12T22:04:04.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0030999999999997e-05 2024-09-12T22:04:04.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.802044+0000", 2024-09-12T22:04:04.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2135999999999999e-05 2024-09-12T22:04:04.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.815210+0000", 2024-09-12T22:04:04.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013165786000000001 2024-09-12T22:04:04.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.815260+0000", 2024-09-12T22:04:04.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0584000000000002e-05 2024-09-12T22:04:04.769 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.769 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:38142 5.0 5:00c5d85e:::benchmark_data_smithi043_32659_object38141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:02.801903+0000", 2024-09-12T22:04:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 1.890161644, 2024-09-12T22:04:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013533164, 2024-09-12T22:04:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 38142 2024-09-12T22:04:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801903+0000", 2024-09-12T22:04:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801903+0000", 2024-09-12T22:04:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.801904+0000", 2024-09-12T22:04:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:04:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.802012+0000", 2024-09-12T22:04:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010816599999999999 2024-09-12T22:04:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.802023+0000", 2024-09-12T22:04:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0626e-05 2024-09-12T22:04:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.802035+0000", 2024-09-12T22:04:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2646999999999999e-05 2024-09-12T22:04:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.807892+0000", 2024-09-12T22:04:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0058564259999999996 2024-09-12T22:04:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.808022+0000", 2024-09-12T22:04:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013004100000000001 2024-09-12T22:04:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.808155+0000", 2024-09-12T22:04:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013307099999999999 2024-09-12T22:04:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.811909+0000", 2024-09-12T22:04:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003754687 2024-09-12T22:04:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.815377+0000", 2024-09-12T22:04:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034678489999999998 2024-09-12T22:04:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.815418+0000", 2024-09-12T22:04:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0355999999999998e-05 2024-09-12T22:04:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.815436+0000", 2024-09-12T22:04:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8442999999999999e-05 2024-09-12T22:04:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:38145 5.0 5:0935047d:::benchmark_data_smithi043_32659_object38144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:02.804103+0000", 2024-09-12T22:04:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 1.8879611999999999, 2024-09-12T22:04:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013147838, 2024-09-12T22:04:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 38145 2024-09-12T22:04:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.804103+0000", 2024-09-12T22:04:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.804103+0000", 2024-09-12T22:04:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.804104+0000", 2024-09-12T22:04:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4700000000000001e-07 2024-09-12T22:04:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.804204+0000", 2024-09-12T22:04:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9926000000000005e-05 2024-09-12T22:04:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.804210+0000", 2024-09-12T22:04:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.511e-06 2024-09-12T22:04:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.804214+0000", 2024-09-12T22:04:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:04:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.810851+0000", 2024-09-12T22:04:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.006637235 2024-09-12T22:04:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.810972+0000", 2024-09-12T22:04:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000121296 2024-09-12T22:04:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.811084+0000", 2024-09-12T22:04:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011132 2024-09-12T22:04:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.813502+0000", 2024-09-12T22:04:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002418945 2024-09-12T22:04:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.817163+0000", 2024-09-12T22:04:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0036608729999999998 2024-09-12T22:04:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.817212+0000", 2024-09-12T22:04:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8636e-05 2024-09-12T22:04:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:02.817251+0000", 2024-09-12T22:04:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9214000000000001e-05 2024-09-12T22:04:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:39690 5.0 5:0ed327fd:::benchmark_data_smithi043_32659_object39689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:03.281423+0000", 2024-09-12T22:04:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 1.410641104, 2024-09-12T22:04:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012358239, 2024-09-12T22:04:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 39690 2024-09-12T22:04:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.281423+0000", 2024-09-12T22:04:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.281423+0000", 2024-09-12T22:04:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.281424+0000", 2024-09-12T22:04:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:04:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.281481+0000", 2024-09-12T22:04:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7166999999999997e-05 2024-09-12T22:04:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.281489+0000", 2024-09-12T22:04:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4499999999999998e-06 2024-09-12T22:04:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.281494+0000", 2024-09-12T22:04:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3870000000000003e-06 2024-09-12T22:04:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.284116+0000", 2024-09-12T22:04:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026222749999999999 2024-09-12T22:04:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.284234+0000", 2024-09-12T22:04:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117549 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.284374+0000", 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014027399999999999 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.290908+0000", 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0065337809999999998 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.293688+0000", 2024-09-12T22:04:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002779672 2024-09-12T22:04:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.293744+0000", 2024-09-12T22:04:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6669999999999998e-05 2024-09-12T22:04:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.293782+0000", 2024-09-12T22:04:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7292000000000001e-05 2024-09-12T22:04:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:41223 5.8 5:1bd97d66:::benchmark_data_smithi043_32659_object41222:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:03.730727+0000", 2024-09-12T22:04:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.96133754100000002, 2024-09-12T22:04:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012801117000000001, 2024-09-12T22:04:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 41223 2024-09-12T22:04:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.730727+0000", 2024-09-12T22:04:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.730727+0000", 2024-09-12T22:04:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.730728+0000", 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6499999999999999e-07 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.730762+0000", 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4345999999999999e-05 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.730767+0000", 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2900000000000002e-06 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.730771+0000", 2024-09-12T22:04:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3900000000000002e-06 2024-09-12T22:04:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.732649+0000", 2024-09-12T22:04:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001878172 2024-09-12T22:04:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.732759+0000", 2024-09-12T22:04:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109893 2024-09-12T22:04:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.732883+0000", 2024-09-12T22:04:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012454799999999999 2024-09-12T22:04:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.738151+0000", 2024-09-12T22:04:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0052672040000000002 2024-09-12T22:04:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.743409+0000", 2024-09-12T22:04:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005258235 2024-09-12T22:04:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.743462+0000", 2024-09-12T22:04:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2905000000000003e-05 2024-09-12T22:04:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.743528+0000", 2024-09-12T22:04:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6469000000000003e-05 2024-09-12T22:04:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:41717 5.e 5:7c593ccd:::benchmark_data_smithi043_32659_object41716:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:03.881554+0000", 2024-09-12T22:04:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.81051054499999997, 2024-09-12T22:04:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012476368999999999, 2024-09-12T22:04:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 41717 2024-09-12T22:04:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.881554+0000", 2024-09-12T22:04:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.881554+0000", 2024-09-12T22:04:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.881554+0000", 2024-09-12T22:04:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6699999999999999e-07 2024-09-12T22:04:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.881631+0000", 2024-09-12T22:04:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6638999999999996e-05 2024-09-12T22:04:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.881639+0000", 2024-09-12T22:04:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.881645+0000", 2024-09-12T22:04:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6200000000000004e-06 2024-09-12T22:04:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.883226+0000", 2024-09-12T22:04:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015816300000000001 2024-09-12T22:04:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.883339+0000", 2024-09-12T22:04:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112243 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.883488+0000", 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000149429 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.885973+0000", 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002485321 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.893939+0000", 2024-09-12T22:04:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0079652430000000003 2024-09-12T22:04:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.893992+0000", 2024-09-12T22:04:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3025999999999997e-05 2024-09-12T22:04:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:03.894030+0000", 2024-09-12T22:04:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8677999999999998e-05 2024-09-12T22:04:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:42147 5.8 5:1ad24f19:::benchmark_data_smithi043_32659_object42146:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.013886+0000", 2024-09-12T22:04:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.67817885, 2024-09-12T22:04:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012614480000000001, 2024-09-12T22:04:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 42147 2024-09-12T22:04:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.013886+0000", 2024-09-12T22:04:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.013886+0000", 2024-09-12T22:04:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.013886+0000", 2024-09-12T22:04:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0299999999999999e-07 2024-09-12T22:04:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.013986+0000", 2024-09-12T22:04:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9771000000000004e-05 2024-09-12T22:04:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.013995+0000", 2024-09-12T22:04:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7520000000000002e-06 2024-09-12T22:04:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.014001+0000", 2024-09-12T22:04:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.195e-06 2024-09-12T22:04:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.016172+0000", 2024-09-12T22:04:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021705409999999998 2024-09-12T22:04:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.016295+0000", 2024-09-12T22:04:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000123602 2024-09-12T22:04:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.016395+0000", 2024-09-12T22:04:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9607999999999999e-05 2024-09-12T22:04:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.021453+0000", 2024-09-12T22:04:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0050586210000000001 2024-09-12T22:04:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.026446+0000", 2024-09-12T22:04:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049922660000000004 2024-09-12T22:04:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.026474+0000", 2024-09-12T22:04:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8813e-05 2024-09-12T22:04:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.026500+0000", 2024-09-12T22:04:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5707999999999998e-05 2024-09-12T22:04:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44049 5.0 5:08facf57:::benchmark_data_smithi043_32659_object44048:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.606648+0000", 2024-09-12T22:04:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.085416539, 2024-09-12T22:04:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012378538, 2024-09-12T22:04:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44049 2024-09-12T22:04:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.606648+0000", 2024-09-12T22:04:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.606648+0000", 2024-09-12T22:04:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.606649+0000", 2024-09-12T22:04:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5499999999999998e-07 2024-09-12T22:04:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.606702+0000", 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3155000000000002e-05 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.606710+0000", 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.371e-06 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.606715+0000", 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4070000000000003e-06 2024-09-12T22:04:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.607775+0000", 2024-09-12T22:04:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001060117 2024-09-12T22:04:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.607902+0000", 2024-09-12T22:04:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000127639 2024-09-12T22:04:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.608034+0000", 2024-09-12T22:04:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013170599999999999 2024-09-12T22:04:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.610761+0000", 2024-09-12T22:04:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027265929999999998 2024-09-12T22:04:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.618925+0000", 2024-09-12T22:04:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0081640020000000001 2024-09-12T22:04:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.618979+0000", 2024-09-12T22:04:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4571999999999999e-05 2024-09-12T22:04:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.619027+0000", 2024-09-12T22:04:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7321000000000003e-05 2024-09-12T22:04:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:04.811 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:04.812 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:04.813 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:04.635+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:04.814 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:04:04.814 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:04.815 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:04.811+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:04.914 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:04.912+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:04.975 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:04.975 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:04.991 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:04:05.032 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:05.031+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:05.115 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:05.113+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:05.190 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 11 16 45590 45574 258.924 179.375 0.00619294 0.00385933 2024-09-12T22:04:05.200 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:05.200 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:05.214 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:04:05.216 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:05.214+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:05.317 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:05.316+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:05.385 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:05.385 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:05.398 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:05.443 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:05.441+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:05.519 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:05.518+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:05.554 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:05.554 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:05.567 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:05.651 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:05.650+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:05.721 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:05.719+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:05.758 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:05.758 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:05.770 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:05.854 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:05.853+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:05.923 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:05.922+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:05.938 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:05.938 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:05.947 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:06.025 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:06.023+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:06.085 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:06.085 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:06.097 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:06.127 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:06.125+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:06.190 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 12 16 48372 48356 251.835 173.875 0.00403331 0.00396781 2024-09-12T22:04:06.227 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:06.226+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:06.283 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:06.283 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:06.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:06.328 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:06.327+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:06.347 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:04:06.429 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:06.428+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:06.445 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:06.445 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:06.457 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:04:06.530 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:06.529+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:06.625 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:06.625 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:06.631 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:06.630+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:06.639 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:04:06.732 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:06.730+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:06.809 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:06.809 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:06.815 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:04:06.823 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:04:06.867 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:06.866+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:06.934 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:06.933+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:06.943 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-09-12T22:04:06.943 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:04:06.962 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:06.962 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:06.980 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:06.980 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:06.997 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:04:06.997 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T22:04:06.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T22:04:06.998 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T22:04:06.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:06.998 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:06.998 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:04:06.998 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.544333299999998, 2024-09-12T22:04:06.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017423646000000001, 2024-09-12T22:04:06.998 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:06.998 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:06.998 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:06.998 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:06.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:06.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:06.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:04:06.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:06.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:06.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:06.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:06.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:04:06.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:06.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:06.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:06.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:06.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449728+0000", 2024-09-12T22:04:06.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:04:06.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:06.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:06.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:06.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449750+0000", 2024-09-12T22:04:07.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2391e-05 2024-09-12T22:04:07.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449775+0000", 2024-09-12T22:04:07.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4831999999999999e-05 2024-09-12T22:04:07.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449785+0000", 2024-09-12T22:04:07.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0361e-05 2024-09-12T22:04:07.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449857+0000", 2024-09-12T22:04:07.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1990999999999996e-05 2024-09-12T22:04:07.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:07.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449863+0000", 2024-09-12T22:04:07.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6570000000000002e-06 2024-09-12T22:04:07.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462558+0000", 2024-09-12T22:04:07.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012695032 2024-09-12T22:04:07.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462703+0000", 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014444100000000001 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462853+0000", 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015042300000000001 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465147+0000", 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022944789999999999 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467012+0000", 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018646030000000001 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467095+0000", 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2695999999999996e-05 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467148+0000", 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2958999999999999e-05 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:04:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.544244456999998, 2024-09-12T22:04:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018410795000000001, 2024-09-12T22:04:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:04:07.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:04:07.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449814+0000", 2024-09-12T22:04:07.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:04:07.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449827+0000", 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3373000000000001e-05 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.081e-06 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449853+0000", 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7181e-05 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449914+0000", 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0736000000000003e-05 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449921+0000", 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2559999999999996e-06 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461147+0000", 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011226211999999999 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461353+0000", 2024-09-12T22:04:07.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000205217 2024-09-12T22:04:07.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461512+0000", 2024-09-12T22:04:07.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015960700000000001 2024-09-12T22:04:07.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:07.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464643+0000", 2024-09-12T22:04:07.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003130238 2024-09-12T22:04:07.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468132+0000", 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0034897109999999999 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468182+0000", 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0209e-05 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468224+0000", 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1199000000000003e-05 2024-09-12T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.544186981999999, 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017523931, 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:04:07.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:04:07.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449871+0000", 2024-09-12T22:04:07.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:07.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449890+0000", 2024-09-12T22:04:07.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9245999999999998e-05 2024-09-12T22:04:07.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449899+0000", 2024-09-12T22:04:07.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1530000000000003e-06 2024-09-12T22:04:07.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449905+0000", 2024-09-12T22:04:07.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8100000000000003e-06 2024-09-12T22:04:07.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449942+0000", 2024-09-12T22:04:07.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7119000000000002e-05 2024-09-12T22:04:07.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:07.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449945+0000", 2024-09-12T22:04:07.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0529999999999998e-06 2024-09-12T22:04:07.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463125+0000", 2024-09-12T22:04:07.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013179326 2024-09-12T22:04:07.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463171+0000", 2024-09-12T22:04:07.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6455000000000002e-05 2024-09-12T22:04:07.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:07.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463242+0000", 2024-09-12T22:04:07.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0430000000000002e-05 2024-09-12T22:04:07.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:07.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465152+0000", 2024-09-12T22:04:07.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001910082 2024-09-12T22:04:07.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467291+0000", 2024-09-12T22:04:07.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021394119999999998 2024-09-12T22:04:07.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467351+0000", 2024-09-12T22:04:07.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9673999999999998e-05 2024-09-12T22:04:07.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467394+0000", 2024-09-12T22:04:07.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3477999999999999e-05 2024-09-12T22:04:07.016 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.016 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.016 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.016 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.016 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:04:07.016 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.544139874999999, 2024-09-12T22:04:07.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018417978000000002, 2024-09-12T22:04:07.016 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.016 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.016 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.017 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:04:07.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:04:07.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449918+0000", 2024-09-12T22:04:07.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:07.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449923+0000", 2024-09-12T22:04:07.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1959999999999999e-06 2024-09-12T22:04:07.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449928+0000", 2024-09-12T22:04:07.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3989999999999997e-06 2024-09-12T22:04:07.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449931+0000", 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5750000000000001e-06 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449968+0000", 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7209999999999998e-05 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449974+0000", 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9730000000000002e-06 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462282+0000", 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012308102 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462368+0000", 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5920000000000004e-05 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462490+0000", 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121478 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:07.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465141+0000", 2024-09-12T22:04:07.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026515990000000001 2024-09-12T22:04:07.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468273+0000", 2024-09-12T22:04:07.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003131736 2024-09-12T22:04:07.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468308+0000", 2024-09-12T22:04:07.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4572e-05 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468335+0000", 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7727999999999999e-05 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.544121001999997, 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018483090000000001, 2024-09-12T22:04:07.022 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449937+0000", 2024-09-12T22:04:07.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0699999999999999e-07 2024-09-12T22:04:07.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449939+0000", 2024-09-12T22:04:07.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.853e-06 2024-09-12T22:04:07.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449943+0000", 2024-09-12T22:04:07.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8999999999999999e-06 2024-09-12T22:04:07.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449956+0000", 2024-09-12T22:04:07.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2843000000000001e-05 2024-09-12T22:04:07.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:04:07.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0277000000000002e-05 2024-09-12T22:04:07.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:07.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449990+0000", 2024-09-12T22:04:07.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1410000000000001e-06 2024-09-12T22:04:07.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463480+0000", 2024-09-12T22:04:07.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013490564 2024-09-12T22:04:07.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463553+0000", 2024-09-12T22:04:07.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3094000000000002e-05 2024-09-12T22:04:07.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:07.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463629+0000", 2024-09-12T22:04:07.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5610000000000003e-05 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465158+0000", 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015294169999999999 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468328+0000", 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031699699999999998 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468381+0000", 2024-09-12T22:04:07.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2398000000000002e-05 2024-09-12T22:04:07.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468419+0000", 2024-09-12T22:04:07.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8816000000000002e-05 2024-09-12T22:04:07.028 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.028 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.028 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.029 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.029 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:07.029 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.544092460000002, 2024-09-12T22:04:07.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017182808000000001, 2024-09-12T22:04:07.029 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.029 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.029 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.029 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:07.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2500000000000001e-07 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449968+0000", 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7140000000000002e-06 2024-09-12T22:04:07.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449975+0000", 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449980+0000", 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1659999999999996e-06 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450048+0000", 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8823000000000002e-05 2024-09-12T22:04:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:07.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450052+0000", 2024-09-12T22:04:07.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8689999999999997e-06 2024-09-12T22:04:07.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461166+0000", 2024-09-12T22:04:07.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011114166999999999 2024-09-12T22:04:07.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461279+0000", 2024-09-12T22:04:07.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000112212 2024-09-12T22:04:07.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:07.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461417+0000", 2024-09-12T22:04:07.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138202 2024-09-12T22:04:07.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:07.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463371+0000", 2024-09-12T22:04:07.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019543120000000001 2024-09-12T22:04:07.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467009+0000", 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036383180000000002 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467109+0000", 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9601999999999999e-05 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467148+0000", 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8618000000000002e-05 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.034 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.035 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.035 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:04:07.035 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.544046405000003, 2024-09-12T22:04:07.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017404473, 2024-09-12T22:04:07.035 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.035 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.035 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:07.035 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:04:07.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:04:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450012+0000", 2024-09-12T22:04:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T22:04:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450016+0000", 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9389999999999999e-06 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8209999999999997e-06 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450036+0000", 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0496000000000001e-05 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9070999999999997e-05 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450100+0000", 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0089999999999998e-06 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461992+0000", 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011891868999999999 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462124+0000", 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013271299999999999 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467415+0000", 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052909029999999996 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.544008165000001, 2024-09-12T22:04:07.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018455814000000001, 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450050+0000", 2024-09-12T22:04:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2e-07 2024-09-12T22:04:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450053+0000", 2024-09-12T22:04:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0819999999999999e-06 2024-09-12T22:04:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450061+0000", 2024-09-12T22:04:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8169999999999999e-06 2024-09-12T22:04:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450080+0000", 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9219999999999999e-05 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0834000000000002e-05 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450123+0000", 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5830000000000001e-06 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464167+0000", 2024-09-12T22:04:07.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014043517 2024-09-12T22:04:07.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464298+0000", 2024-09-12T22:04:07.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013117099999999999 2024-09-12T22:04:07.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468505+0000", 2024-09-12T22:04:07.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042070700000000003 2024-09-12T22:04:07.045 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.045 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.045 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.045 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.045 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:07.045 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.543962305999997, 2024-09-12T22:04:07.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018063523000000001, 2024-09-12T22:04:07.045 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.046 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.046 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:07.046 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:07.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:07.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450096+0000", 2024-09-12T22:04:07.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7899999999999998e-07 2024-09-12T22:04:07.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450100+0000", 2024-09-12T22:04:07.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:04:07.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450107+0000", 2024-09-12T22:04:07.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9269999999999999e-06 2024-09-12T22:04:07.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450112+0000", 2024-09-12T22:04:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2909999999999998e-06 2024-09-12T22:04:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450156+0000", 2024-09-12T22:04:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3665999999999998e-05 2024-09-12T22:04:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450160+0000", 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.822e-06 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.459675+0000", 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0095155039999999993 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.459901+0000", 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000225419 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468159+0000", 2024-09-12T22:04:07.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082579100000000003 2024-09-12T22:04:07.050 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.050 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.050 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.050 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:24946 5.a 5:50e5ee2f:::benchmark_data_smithi043_32659_object24945:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:07.050 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.187196+0000", 2024-09-12T22:04:07.050 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 7.8068610080000003, 2024-09-12T22:04:07.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011742136, 2024-09-12T22:04:07.050 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.050 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.050 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 24946 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187196+0000", 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187196+0000", 2024-09-12T22:04:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187197+0000", 2024-09-12T22:04:07.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9699999999999995e-07 2024-09-12T22:04:07.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187275+0000", 2024-09-12T22:04:07.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8108999999999994e-05 2024-09-12T22:04:07.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187286+0000", 2024-09-12T22:04:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:04:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.187293+0000", 2024-09-12T22:04:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1659999999999997e-06 2024-09-12T22:04:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188231+0000", 2024-09-12T22:04:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00093842999999999997 2024-09-12T22:04:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188395+0000", 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000163962 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.188543+0000", 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000147978 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.192445+0000", 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039016580000000001 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.198883+0000", 2024-09-12T22:04:07.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064380510000000002 2024-09-12T22:04:07.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.198913+0000", 2024-09-12T22:04:07.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0294000000000002e-05 2024-09-12T22:04:07.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.198938+0000", 2024-09-12T22:04:07.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5185e-05 2024-09-12T22:04:07.055 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.055 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.056 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.056 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:26828 5.1 e26/22 5:89da373a:::benchmark_data_smithi043_32659_object26827:head v 26'1618, mlcod=26'1616)", 2024-09-12T22:04:07.056 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:04:07.056 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 7.2962036640000001, 2024-09-12T22:04:07.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013883159000000001, 2024-09-12T22:04:07.056 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.056 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.056 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.056 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:04:07.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:04:07.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:04:07.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8500000000000001e-07 2024-09-12T22:04:07.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697920+0000", 2024-09-12T22:04:07.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6223000000000006e-05 2024-09-12T22:04:07.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697929+0000", 2024-09-12T22:04:07.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2199999999999992e-06 2024-09-12T22:04:07.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697935+0000", 2024-09-12T22:04:07.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0190000000000003e-06 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697982+0000", 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7630000000000003e-05 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.698001+0000", 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8488e-05 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.711690+0000", 2024-09-12T22:04:07.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013689364000000001 2024-09-12T22:04:07.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.711737+0000", 2024-09-12T22:04:07.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6629999999999999e-05 2024-09-12T22:04:07.060 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.060 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.060 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.060 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:26838 5.1 e26/22 5:878c6958:::benchmark_data_smithi043_32659_object26837:head v 26'1619, mlcod=26'1616)", 2024-09-12T22:04:07.060 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.699838+0000", 2024-09-12T22:04:07.060 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 7.2942195979999997, 2024-09-12T22:04:07.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011938512, 2024-09-12T22:04:07.061 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.061 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.061 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.061 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699838+0000", 2024-09-12T22:04:07.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699838+0000", 2024-09-12T22:04:07.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699843+0000", 2024-09-12T22:04:07.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7679999999999997e-06 2024-09-12T22:04:07.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699938+0000", 2024-09-12T22:04:07.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4470999999999997e-05 2024-09-12T22:04:07.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699953+0000", 2024-09-12T22:04:07.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5028000000000001e-05 2024-09-12T22:04:07.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.699963+0000", 2024-09-12T22:04:07.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0118e-05 2024-09-12T22:04:07.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.700042+0000", 2024-09-12T22:04:07.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8629999999999998e-05 2024-09-12T22:04:07.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.700057+0000", 2024-09-12T22:04:07.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5170999999999999e-05 2024-09-12T22:04:07.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.711740+0000", 2024-09-12T22:04:07.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01168284 2024-09-12T22:04:07.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.711776+0000", 2024-09-12T22:04:07.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6486000000000003e-05 2024-09-12T22:04:07.065 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.065 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.065 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.065 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:28469 5.a 5:550e9ec0:::benchmark_data_smithi043_32659_object28468:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:07.065 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:00.118642+0000", 2024-09-12T22:04:07.065 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.8754151800000001, 2024-09-12T22:04:07.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012491746, 2024-09-12T22:04:07.065 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.065 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.065 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.065 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:07.065 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:07.066 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.066 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 28469 2024-09-12T22:04:07.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.066 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.118642+0000", 2024-09-12T22:04:07.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.118642+0000", 2024-09-12T22:04:07.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.118643+0000", 2024-09-12T22:04:07.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.063e-06 2024-09-12T22:04:07.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.118738+0000", 2024-09-12T22:04:07.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4938999999999993e-05 2024-09-12T22:04:07.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.118749+0000", 2024-09-12T22:04:07.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0857e-05 2024-09-12T22:04:07.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.118756+0000", 2024-09-12T22:04:07.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7800000000000003e-06 2024-09-12T22:04:07.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.118846+0000", 2024-09-12T22:04:07.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0229999999999995e-05 2024-09-12T22:04:07.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.119004+0000", 2024-09-12T22:04:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015772 2024-09-12T22:04:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.119126+0000", 2024-09-12T22:04:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012228799999999999 2024-09-12T22:04:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.121099+0000", 2024-09-12T22:04:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019726000000000001 2024-09-12T22:04:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.131038+0000", 2024-09-12T22:04:07.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0099391710000000001 2024-09-12T22:04:07.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.131093+0000", 2024-09-12T22:04:07.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5291999999999998e-05 2024-09-12T22:04:07.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:00.131134+0000", 2024-09-12T22:04:07.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0806000000000002e-05 2024-09-12T22:04:07.070 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:38127 5.a 5:544fdd55:::benchmark_data_smithi043_32659_object38126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:02.797911+0000", 2024-09-12T22:04:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.1961459149999998, 2024-09-12T22:04:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013112011, 2024-09-12T22:04:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:07.072 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.072 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 38127 2024-09-12T22:04:07.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.072 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.797911+0000", 2024-09-12T22:04:07.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.797911+0000", 2024-09-12T22:04:07.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.797912+0000", 2024-09-12T22:04:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0800000000000004e-07 2024-09-12T22:04:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.797938+0000", 2024-09-12T22:04:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6325999999999998e-05 2024-09-12T22:04:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.797948+0000", 2024-09-12T22:04:07.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6770000000000007e-06 2024-09-12T22:04:07.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.797954+0000", 2024-09-12T22:04:07.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0920000000000003e-06 2024-09-12T22:04:07.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.798284+0000", 2024-09-12T22:04:07.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033005099999999999 2024-09-12T22:04:07.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.798397+0000", 2024-09-12T22:04:07.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113037 2024-09-12T22:04:07.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.798524+0000", 2024-09-12T22:04:07.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000126489 2024-09-12T22:04:07.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:07.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.800711+0000", 2024-09-12T22:04:07.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002187596 2024-09-12T22:04:07.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.810959+0000", 2024-09-12T22:04:07.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010247744 2024-09-12T22:04:07.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.810995+0000", 2024-09-12T22:04:07.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6099000000000001e-05 2024-09-12T22:04:07.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:02.811023+0000", 2024-09-12T22:04:07.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8291999999999999e-05 2024-09-12T22:04:07.076 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.077 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.077 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.077 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:38869 5.3 5:c342be80:::benchmark_data_smithi043_32659_object38868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:07.077 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:03.031947+0000", 2024-09-12T22:04:07.077 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.962110059, 2024-09-12T22:04:07.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01317432, 2024-09-12T22:04:07.077 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.077 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.077 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.077 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:07.077 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:07.077 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 38869 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.031947+0000", 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.031947+0000", 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.031948+0000", 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1429999999999999e-06 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032010+0000", 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1927999999999994e-05 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032020+0000", 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6379999999999999e-06 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032027+0000", 2024-09-12T22:04:07.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5880000000000003e-06 2024-09-12T22:04:07.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037111+0000", 2024-09-12T22:04:07.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005084028 2024-09-12T22:04:07.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037291+0000", 2024-09-12T22:04:07.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018020699999999999 2024-09-12T22:04:07.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:07.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037409+0000", 2024-09-12T22:04:07.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011785699999999999 2024-09-12T22:04:07.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.041599+0000", 2024-09-12T22:04:07.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041906479999999999 2024-09-12T22:04:07.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:07.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.044986+0000", 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033871769999999999 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045060+0000", 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3215999999999998e-05 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045122+0000", 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1890000000000005e-05 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:38870 5.3 5:c90bd940:::benchmark_data_smithi043_32659_object38869:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:03.032044+0000", 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.9620135809999999, 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013248721, 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 38870 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032044+0000", 2024-09-12T22:04:07.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032044+0000", 2024-09-12T22:04:07.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032044+0000", 2024-09-12T22:04:07.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:07.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032110+0000", 2024-09-12T22:04:07.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5372999999999999e-05 2024-09-12T22:04:07.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.085 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.085 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032118+0000", 2024-09-12T22:04:07.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9209999999999992e-06 2024-09-12T22:04:07.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.085 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.085 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032123+0000", 2024-09-12T22:04:07.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5720000000000002e-06 2024-09-12T22:04:07.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.085 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.038678+0000", 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065548400000000001 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.038817+0000", 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0001393 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.038979+0000", 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016181999999999999 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045132+0000", 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061531820000000001 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045203+0000", 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0732e-05 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045261+0000", 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7587000000000003e-05 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045292+0000", 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1701e-05 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:38872 5.3 5:c859340c:::benchmark_data_smithi043_32659_object38871:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:03.032534+0000", 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.961523787, 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012906792, 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.088 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 38872 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032534+0000", 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032534+0000", 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032534+0000", 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1900000000000001e-07 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032684+0000", 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014931499999999999 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032720+0000", 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5756000000000001e-05 2024-09-12T22:04:07.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.032727+0000", 2024-09-12T22:04:07.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4510000000000003e-06 2024-09-12T22:04:07.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.040284+0000", 2024-09-12T22:04:07.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0075574090000000002 2024-09-12T22:04:07.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.040389+0000", 2024-09-12T22:04:07.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000104719 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.040465+0000", 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5829999999999997e-05 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045353+0000", 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048878330000000003 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045365+0000", 2024-09-12T22:04:07.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2469e-05 2024-09-12T22:04:07.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045405+0000", 2024-09-12T22:04:07.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0181e-05 2024-09-12T22:04:07.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045440+0000", 2024-09-12T22:04:07.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4910000000000003e-05 2024-09-12T22:04:07.093 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.093 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.093 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:38888 5.3 5:c746cecc:::benchmark_data_smithi043_32659_object38887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:03.037719+0000", 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.9563386199999999, 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011426568999999999, 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 38888 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.094 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037719+0000", 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037719+0000", 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037720+0000", 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037777+0000", 2024-09-12T22:04:07.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7079e-05 2024-09-12T22:04:07.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037794+0000", 2024-09-12T22:04:07.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6909e-05 2024-09-12T22:04:07.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.037800+0000", 2024-09-12T22:04:07.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2480000000000001e-06 2024-09-12T22:04:07.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.043338+0000", 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055382280000000001 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.043498+0000", 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015976599999999999 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.043652+0000", 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015383199999999999 2024-09-12T22:04:07.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.045598+0000", 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019462500000000001 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.049012+0000", 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0034139800000000001 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.049102+0000", 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0279999999999996e-05 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.049145+0000", 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2987e-05 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:39403 5.3 5:c9c2ebb2:::benchmark_data_smithi043_32659_object39402:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:03.190613+0000", 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.8034440260000002, 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011127873999999999, 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.100 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:07.100 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:07.100 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.100 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 39403 2024-09-12T22:04:07.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.100 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.190613+0000", 2024-09-12T22:04:07.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.190613+0000", 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.190614+0000", 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7599999999999997e-07 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.190637+0000", 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3062e-05 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.190645+0000", 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.190652+0000", 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5030000000000002e-06 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.194665+0000", 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004013417 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.194793+0000", 2024-09-12T22:04:07.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000128181 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.194946+0000", 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000152872 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.196608+0000", 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016624109999999999 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.201654+0000", 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050454189999999998 2024-09-12T22:04:07.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.201703+0000", 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9044e-05 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.201741+0000", 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8315999999999997e-05 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.104 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:39890 5.1 e27/22 5:84fdb806:::benchmark_data_smithi043_32659_object39889:head v 27'2392, mlcod=27'2390)", 2024-09-12T22:04:07.105 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:03.345620+0000", 2024-09-12T22:04:07.105 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.6484372249999999, 2024-09-12T22:04:07.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014286792, 2024-09-12T22:04:07.105 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:07.105 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:07.105 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345620+0000", 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345620+0000", 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345621+0000", 2024-09-12T22:04:07.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.75e-07 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345765+0000", 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000144504 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345777+0000", 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1625e-05 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345783+0000", 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345846+0000", 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2347999999999993e-05 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345867+0000", 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1365e-05 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.359855+0000", 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013987512000000001 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:07.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:07.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:07.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.359907+0000", 2024-09-12T22:04:07.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2204999999999999e-05 2024-09-12T22:04:07.109 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.109 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.109 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.109 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:07.109 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:07.109 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:04:07.111 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:07.111 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:07.109+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:07.190 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 13 16 51257 51241 246.332 180.312 0.00360195 0.00405627 2024-09-12T22:04:07.211 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:07.210+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:07.258 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:07.259 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:07.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.259 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:51451 5.1 5:8b07c9f2:::benchmark_data_smithi043_32659_object51450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:07.259 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:07.255639+0000", 2024-09-12T22:04:07.259 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0022204239999999999, 2024-09-12T22:04:07.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002244916, 2024-09-12T22:04:07.259 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.259 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.259 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:07.259 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:07.259 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:07.259 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.259 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 51451 2024-09-12T22:04:07.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.260 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.255639+0000", 2024-09-12T22:04:07.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.255639+0000", 2024-09-12T22:04:07.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.255640+0000", 2024-09-12T22:04:07.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.195e-06 2024-09-12T22:04:07.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.255684+0000", 2024-09-12T22:04:07.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3350000000000003e-05 2024-09-12T22:04:07.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.255698+0000", 2024-09-12T22:04:07.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4174e-05 2024-09-12T22:04:07.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.255705+0000", 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2230000000000001e-06 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.256075+0000", 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037007000000000001 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.256174+0000", 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:07.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.256273+0000", 2024-09-12T22:04:07.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8683000000000004e-05 2024-09-12T22:04:07.263 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.263 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.263 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.263 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:51452 5.1 5:80532293:::benchmark_data_smithi043_32659_object51451:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:07.263 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:07.255718+0000", 2024-09-12T22:04:07.263 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0021414860000000002, 2024-09-12T22:04:07.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022434109999999998, 2024-09-12T22:04:07.263 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.263 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.264 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:07.264 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:07.264 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:07.264 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.264 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 51452 2024-09-12T22:04:07.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.264 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.255718+0000", 2024-09-12T22:04:07.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.255718+0000", 2024-09-12T22:04:07.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.255719+0000", 2024-09-12T22:04:07.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5300000000000004e-07 2024-09-12T22:04:07.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.255754+0000", 2024-09-12T22:04:07.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5182999999999998e-05 2024-09-12T22:04:07.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.255763+0000", 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9500000000000007e-06 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.255769+0000", 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8780000000000003e-06 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257757+0000", 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019885770000000001 2024-09-12T22:04:07.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257886+0000", 2024-09-12T22:04:07.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012829399999999999 2024-09-12T22:04:07.267 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.267 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.267 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.267 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:51455 5.6 e28/22 5:63acb2c1:::benchmark_data_smithi043_32659_object51454:head v 28'3094, mlcod=28'3092)", 2024-09-12T22:04:07.267 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:07.257152+0000", 2024-09-12T22:04:07.267 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00070757199999999995, 2024-09-12T22:04:07.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00087960499999999999, 2024-09-12T22:04:07.267 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.268 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.268 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:07.268 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257152+0000", 2024-09-12T22:04:07.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257152+0000", 2024-09-12T22:04:07.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257153+0000", 2024-09-12T22:04:07.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7899999999999999e-07 2024-09-12T22:04:07.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257230+0000", 2024-09-12T22:04:07.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7637000000000002e-05 2024-09-12T22:04:07.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257238+0000", 2024-09-12T22:04:07.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.43e-06 2024-09-12T22:04:07.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257242+0000", 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4170000000000002e-06 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257284+0000", 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2249000000000002e-05 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257302+0000", 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7923000000000001e-05 2024-09-12T22:04:07.270 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:51458 5.1 5.cf00c501 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:07.257225+0000", 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00063494599999999995, 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00086421899999999995, 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.271 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 51458 2024-09-12T22:04:07.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.272 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257225+0000", 2024-09-12T22:04:07.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257225+0000", 2024-09-12T22:04:07.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257225+0000", 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257288+0000", 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2633999999999997e-05 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257296+0000", 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7740000000000004e-06 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257301+0000", 2024-09-12T22:04:07.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8500000000000002e-06 2024-09-12T22:04:07.274 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.274 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.274 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.274 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:51457 5.d e28/22 5:b522c16b:::benchmark_data_smithi043_32659_object51456:head v 28'3203, mlcod=28'3201)", 2024-09-12T22:04:07.274 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:07.257521+0000", 2024-09-12T22:04:07.274 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00033890800000000002, 2024-09-12T22:04:07.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00061855000000000005, 2024-09-12T22:04:07.274 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.274 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257521+0000", 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257521+0000", 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257521+0000", 2024-09-12T22:04:07.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8599999999999998e-07 2024-09-12T22:04:07.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257579+0000", 2024-09-12T22:04:07.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7398000000000002e-05 2024-09-12T22:04:07.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257586+0000", 2024-09-12T22:04:07.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0500000000000003e-06 2024-09-12T22:04:07.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257589+0000", 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4130000000000002e-06 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257625+0000", 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5831000000000003e-05 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:07.257636+0000", 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1433999999999999e-05 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.277 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.278 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.278 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:07.278 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 5 2024-09-12T22:04:07.278 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:07.279 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:07.312 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:07.310+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:07.336 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-09-12T22:04:07.414 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:07.413+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:07.465 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:07.466 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:07.466 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:07.466 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:07.466 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:07.478 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:07.521 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:07.520+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:07.615 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:07.614+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:07.637 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:07.637 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:07.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:07.637 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:07.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.637 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.637 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:07.637 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.184127326999999, 2024-09-12T22:04:07.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018534981999999998, 2024-09-12T22:04:07.637 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.637 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449725+0000", 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799999999999999e-06 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449731+0000", 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.801e-06 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449745+0000", 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4198e-05 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449758+0000", 2024-09-12T22:04:07.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2858e-05 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449815+0000", 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6978999999999998e-05 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2369999999999997e-06 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457683+0000", 2024-09-12T22:04:07.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078622640000000008 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457840+0000", 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015715299999999999 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457972+0000", 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013179500000000001 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462325+0000", 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043526859999999997 2024-09-12T22:04:07.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468180+0000", 2024-09-12T22:04:07.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058557169999999999 2024-09-12T22:04:07.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468221+0000", 2024-09-12T22:04:07.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0673000000000002e-05 2024-09-12T22:04:07.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468258+0000", 2024-09-12T22:04:07.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7240999999999998e-05 2024-09-12T22:04:07.643 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.643 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.643 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.643 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.643 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:07.643 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.184074715999998, 2024-09-12T22:04:07.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018748032000000001, 2024-09-12T22:04:07.643 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.643 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.643 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.643 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:07.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:07.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449779+0000", 2024-09-12T22:04:07.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4869999999999998e-06 2024-09-12T22:04:07.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449783+0000", 2024-09-12T22:04:07.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:04:07.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449791+0000", 2024-09-12T22:04:07.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2640000000000002e-06 2024-09-12T22:04:07.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449796+0000", 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9370000000000001e-06 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449915+0000", 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118559 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449920+0000", 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.101e-06 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458578+0000", 2024-09-12T22:04:07.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008657662 2024-09-12T22:04:07.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458978+0000", 2024-09-12T22:04:07.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00039977399999999998 2024-09-12T22:04:07.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459130+0000", 2024-09-12T22:04:07.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000152394 2024-09-12T22:04:07.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462793+0000", 2024-09-12T22:04:07.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036628770000000001 2024-09-12T22:04:07.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468451+0000", 2024-09-12T22:04:07.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056577820000000001 2024-09-12T22:04:07.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468501+0000", 2024-09-12T22:04:07.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0609999999999998e-05 2024-09-12T22:04:07.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468524+0000", 2024-09-12T22:04:07.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2804000000000001e-05 2024-09-12T22:04:07.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.649 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.649 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.649 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:07.649 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.184040015000001, 2024-09-12T22:04:07.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018816113999999998, 2024-09-12T22:04:07.649 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.650 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.650 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.650 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:07.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:07.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:07.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-09-12T22:04:07.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:07.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3360000000000001e-06 2024-09-12T22:04:07.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449832+0000", 2024-09-12T22:04:07.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1528e-05 2024-09-12T22:04:07.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:04:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-12T22:04:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459429+0000", 2024-09-12T22:04:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095926970000000007 2024-09-12T22:04:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459597+0000", 2024-09-12T22:04:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000168309 2024-09-12T22:04:07.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459829+0000", 2024-09-12T22:04:07.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231158 2024-09-12T22:04:07.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462796+0000", 2024-09-12T22:04:07.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029673849999999999 2024-09-12T22:04:07.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468558+0000", 2024-09-12T22:04:07.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057621449999999998 2024-09-12T22:04:07.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468592+0000", 2024-09-12T22:04:07.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4241e-05 2024-09-12T22:04:07.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468627+0000", 2024-09-12T22:04:07.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4511999999999998e-05 2024-09-12T22:04:07.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.654 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.655 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.655 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:07.655 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.183972986999997, 2024-09-12T22:04:07.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018845905, 2024-09-12T22:04:07.655 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.655 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.655 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.655 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:07.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449881+0000", 2024-09-12T22:04:07.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.005e-06 2024-09-12T22:04:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449887+0000", 2024-09-12T22:04:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9050000000000002e-06 2024-09-12T22:04:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449892+0000", 2024-09-12T22:04:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2009999999999998e-06 2024-09-12T22:04:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460279+0000", 2024-09-12T22:04:07.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010386808000000001 2024-09-12T22:04:07.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460427+0000", 2024-09-12T22:04:07.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014789 2024-09-12T22:04:07.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460572+0000", 2024-09-12T22:04:07.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014453099999999999 2024-09-12T22:04:07.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462799+0000", 2024-09-12T22:04:07.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002227049 2024-09-12T22:04:07.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468672+0000", 2024-09-12T22:04:07.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058730060000000001 2024-09-12T22:04:07.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468704+0000", 2024-09-12T22:04:07.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2421e-05 2024-09-12T22:04:07.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468724+0000", 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9582e-05 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.183942516999998, 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015455175, 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.662 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449909+0000", 2024-09-12T22:04:07.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2099999999999997e-07 2024-09-12T22:04:07.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449912+0000", 2024-09-12T22:04:07.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1439999999999999e-06 2024-09-12T22:04:07.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449925+0000", 2024-09-12T22:04:07.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2944e-05 2024-09-12T22:04:07.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449931+0000", 2024-09-12T22:04:07.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3289999999999999e-06 2024-09-12T22:04:07.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:04:07.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:04:07.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:07.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449990+0000", 2024-09-12T22:04:07.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8090000000000004e-06 2024-09-12T22:04:07.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.455881+0000", 2024-09-12T22:04:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058904400000000003 2024-09-12T22:04:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456556+0000", 2024-09-12T22:04:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00067549500000000002 2024-09-12T22:04:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456742+0000", 2024-09-12T22:04:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018546799999999999 2024-09-12T22:04:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461053+0000", 2024-09-12T22:04:07.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043118310000000003 2024-09-12T22:04:07.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465220+0000", 2024-09-12T22:04:07.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041667750000000002 2024-09-12T22:04:07.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465316+0000", 2024-09-12T22:04:07.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5996999999999996e-05 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465363+0000", 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7111999999999999e-05 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.183900125999997, 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017913407999999999, 2024-09-12T22:04:07.668 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.669 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.669 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.669 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:07.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:07.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:07.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3499999999999996e-07 2024-09-12T22:04:07.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449955+0000", 2024-09-12T22:04:07.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4379999999999999e-06 2024-09-12T22:04:07.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449963+0000", 2024-09-12T22:04:07.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2719999999999997e-06 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449970+0000", 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5930000000000002e-06 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450563+0000", 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00059351900000000003 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450570+0000", 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3900000000000004e-06 2024-09-12T22:04:07.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461148+0000", 2024-09-12T22:04:07.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010577354000000001 2024-09-12T22:04:07.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461312+0000", 2024-09-12T22:04:07.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016392300000000001 2024-09-12T22:04:07.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:07.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461525+0000", 2024-09-12T22:04:07.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021282199999999999 2024-09-12T22:04:07.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464272+0000", 2024-09-12T22:04:07.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027469740000000001 2024-09-12T22:04:07.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467749+0000", 2024-09-12T22:04:07.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003477235 2024-09-12T22:04:07.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467815+0000", 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5974000000000002e-05 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467864+0000", 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9279e-05 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.674 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.183868660000002, 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018827507, 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:07.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2739999999999999e-06 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449999+0000", 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3349e-05 2024-09-12T22:04:07.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450005+0000", 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.609e-06 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461006+0000", 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011000876 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461236+0000", 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000230301 2024-09-12T22:04:07.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461362+0000", 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012541900000000001 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464797+0000", 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034350840000000001 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468754+0000", 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039576689999999996 2024-09-12T22:04:07.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468784+0000", 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9558000000000001e-05 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468810+0000", 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5752e-05 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.679 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.680 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:07.680 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.183836788000001, 2024-09-12T22:04:07.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018888559999999999, 2024-09-12T22:04:07.680 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.680 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.680 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.680 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:07.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450015+0000", 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450018+0000", 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3840000000000001e-06 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:04:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8859999999999998e-06 2024-09-12T22:04:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450030+0000", 2024-09-12T22:04:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4829999999999999e-06 2024-09-12T22:04:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465718+0000", 2024-09-12T22:04:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015688163000000001 2024-09-12T22:04:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465793+0000", 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4788000000000003e-05 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466015+0000", 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000221394 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467628+0000", 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016131190000000001 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468849+0000", 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012211699999999999 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468878+0000", 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8708e-05 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468902+0000", 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868e-05 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:23 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.183813340999997, 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021189669000000001, 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:07.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450038+0000", 2024-09-12T22:04:07.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:07.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450042+0000", 2024-09-12T22:04:07.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7720000000000001e-06 2024-09-12T22:04:07.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450058+0000", 2024-09-12T22:04:07.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6379999999999999e-05 2024-09-12T22:04:07.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450067+0000", 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3870000000000001e-06 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466409+0000", 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016341418999999999 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466467+0000", 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8613999999999998e-05 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466612+0000", 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014415000000000001 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467856+0000", 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012440039999999999 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471178+0000", 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033227450000000002 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471207+0000", 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8571000000000001e-05 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471227+0000", 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0109999999999999e-05 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.183772801000003, 2024-09-12T22:04:07.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021231197, 2024-09-12T22:04:07.691 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.691 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.691 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.691 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:07.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:07.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450079+0000", 2024-09-12T22:04:07.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:04:07.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450083+0000", 2024-09-12T22:04:07.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1989999999999999e-06 2024-09-12T22:04:07.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450092+0000", 2024-09-12T22:04:07.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9400000000000008e-06 2024-09-12T22:04:07.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450097+0000", 2024-09-12T22:04:07.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:04:07.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466898+0000", 2024-09-12T22:04:07.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016801226999999998 2024-09-12T22:04:07.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466975+0000", 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6197000000000002e-05 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467158+0000", 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183876 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468270+0000", 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001111229 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471260+0000", 2024-09-12T22:04:07.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002989907 2024-09-12T22:04:07.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471289+0000", 2024-09-12T22:04:07.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9271000000000001e-05 2024-09-12T22:04:07.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471309+0000", 2024-09-12T22:04:07.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0302999999999999e-05 2024-09-12T22:04:07.695 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.695 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.695 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.183746200000002, 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018145809999999998, 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:07.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:07.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:07.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450114+0000", 2024-09-12T22:04:07.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1849999999999993e-06 2024-09-12T22:04:07.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:04:07.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1350000000000003e-06 2024-09-12T22:04:07.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450128+0000", 2024-09-12T22:04:07.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2040000000000002e-06 2024-09-12T22:04:07.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454085+0000", 2024-09-12T22:04:07.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00395736 2024-09-12T22:04:07.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:07.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454090+0000", 2024-09-12T22:04:07.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.378e-06 2024-09-12T22:04:07.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457076+0000", 2024-09-12T22:04:07.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002985747 2024-09-12T22:04:07.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457178+0000", 2024-09-12T22:04:07.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010242 2024-09-12T22:04:07.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457452+0000", 2024-09-12T22:04:07.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027313000000000001 2024-09-12T22:04:07.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462024+0000", 2024-09-12T22:04:07.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045727040000000004 2024-09-12T22:04:07.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468161+0000", 2024-09-12T22:04:07.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061372019999999996 2024-09-12T22:04:07.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468212+0000", 2024-09-12T22:04:07.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0707000000000001e-05 2024-09-12T22:04:07.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468250+0000", 2024-09-12T22:04:07.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8148000000000001e-05 2024-09-12T22:04:07.701 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.701 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.183154823999999, 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017301410999999999, 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450699+0000", 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0019999999999998e-06 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450705+0000", 2024-09-12T22:04:07.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3199999999999996e-06 2024-09-12T22:04:07.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450717+0000", 2024-09-12T22:04:07.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2069000000000001e-05 2024-09-12T22:04:07.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450726+0000", 2024-09-12T22:04:07.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2840000000000006e-06 2024-09-12T22:04:07.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454318+0000", 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035919580000000001 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454323+0000", 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2490000000000001e-06 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462054+0000", 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0077311319999999999 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462135+0000", 2024-09-12T22:04:07.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1558999999999996e-05 2024-09-12T22:04:07.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:07.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462273+0000", 2024-09-12T22:04:07.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013781000000000001 2024-09-12T22:04:07.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464587+0000", 2024-09-12T22:04:07.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023134319999999998 2024-09-12T22:04:07.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467908+0000", 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033211310000000002 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467960+0000", 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2537000000000002e-05 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467997+0000", 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6928000000000003e-05 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.707 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.183058645000003, 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020127506999999999, 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450793+0000", 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2800000000000005e-07 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450813+0000", 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0063000000000001e-05 2024-09-12T22:04:07.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450847+0000", 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3973000000000002e-05 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450862+0000", 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5358000000000001e-05 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454355+0000", 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003492841 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454359+0000", 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458704+0000", 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043452459999999997 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459009+0000", 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030526199999999999 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459143+0000", 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013375 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462690+0000", 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035466579999999998 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470863+0000", 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0081734089999999995 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470898+0000", 2024-09-12T22:04:07.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4445e-05 2024-09-12T22:04:07.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470920+0000", 2024-09-12T22:04:07.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1844e-05 2024-09-12T22:04:07.713 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.713 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.713 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.713 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.713 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:07.713 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.181528526000001, 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018704596, 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452323+0000", 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452337+0000", 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452489+0000", 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015167699999999999 2024-09-12T22:04:07.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452498+0000", 2024-09-12T22:04:07.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9709999999999993e-06 2024-09-12T22:04:07.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454393+0000", 2024-09-12T22:04:07.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001895171 2024-09-12T22:04:07.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:07.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454397+0000", 2024-09-12T22:04:07.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4470000000000002e-06 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459570+0000", 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051728160000000002 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459718+0000", 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014857800000000001 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459920+0000", 2024-09-12T22:04:07.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000202043 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462696+0000", 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027756299999999999 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470963+0000", 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082671359999999996 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471000+0000", 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6748999999999997e-05 2024-09-12T22:04:07.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471027+0000", 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7118e-05 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.180602847999999, 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017680218000000001, 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.719 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453249+0000", 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:04:07.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453253+0000", 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3630000000000004e-06 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453261+0000", 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9319999999999996e-06 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453267+0000", 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7989999999999999e-06 2024-09-12T22:04:07.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454995+0000", 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001727793 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.455000+0000", 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0289999999999996e-06 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461445+0000", 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064456870000000003 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461546+0000", 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101036 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461680+0000", 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013407299999999999 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464622+0000", 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029413379999999999 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470850+0000", 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.006227977 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470902+0000", 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1916000000000002e-05 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470928+0000", 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.65e-05 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.725 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:07.725 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:07.725 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.180571252, 2024-09-12T22:04:07.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017838390999999999, 2024-09-12T22:04:07.725 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.725 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.725 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:07.725 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:07.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453280+0000", 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453284+0000", 2024-09-12T22:04:07.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.194e-06 2024-09-12T22:04:07.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453337+0000", 2024-09-12T22:04:07.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2330999999999998e-05 2024-09-12T22:04:07.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453353+0000", 2024-09-12T22:04:07.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6001000000000001e-05 2024-09-12T22:04:07.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454421+0000", 2024-09-12T22:04:07.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010681009999999999 2024-09-12T22:04:07.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:07.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454424+0000", 2024-09-12T22:04:07.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2550000000000002e-06 2024-09-12T22:04:07.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460376+0000", 2024-09-12T22:04:07.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059517770000000001 2024-09-12T22:04:07.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460536+0000", 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015984699999999999 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471118+0000", 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010582322999999999 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:26828 5.1 5:89da373a:::benchmark_data_smithi043_32659_object26827:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:59.697444+0000", 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.9364064570000004, 2024-09-12T22:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014705924, 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26828 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697444+0000", 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697444+0000", 2024-09-12T22:04:07.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697445+0000", 2024-09-12T22:04:07.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4099999999999997e-07 2024-09-12T22:04:07.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697518+0000", 2024-09-12T22:04:07.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2889e-05 2024-09-12T22:04:07.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697529+0000", 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1409999999999999e-05 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697536+0000", 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8079999999999999e-06 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697584+0000", 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7871999999999998e-05 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697672+0000", 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7467999999999997e-05 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.697755+0000", 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3492999999999995e-05 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.698921+0000", 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011660220000000001 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.712052+0000", 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013131115 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.712108+0000", 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5461999999999999e-05 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:59.712150+0000", 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2543999999999998e-05 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:38135 5.f 5:f52e53c3:::benchmark_data_smithi043_32659_object38134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:02.800531+0000", 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8333202010000003, 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014922509, 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38135 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.735 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800531+0000", 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800531+0000", 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800531+0000", 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800644+0000", 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011280100000000001 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800656+0000", 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1522000000000001e-05 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800663+0000", 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.131e-06 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.801533+0000", 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00087044599999999998 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.801643+0000", 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109948 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.801772+0000", 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000128577 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.803660+0000", 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018880769999999999 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.815367+0000", 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011707235 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.815417+0000", 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9490000000000002e-05 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.815453+0000", 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6448000000000001e-05 2024-09-12T22:04:07.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:39890 5.1 5:84fdb806:::benchmark_data_smithi043_32659_object39889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.345310+0000", 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.2885406440000002, 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014939364, 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.740 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39890 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345310+0000", 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345310+0000", 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345311+0000", 2024-09-12T22:04:07.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.68e-07 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345341+0000", 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0358e-05 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345350+0000", 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4940000000000003e-06 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345355+0000", 2024-09-12T22:04:07.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345393+0000", 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7874999999999999e-05 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345474+0000", 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1110000000000001e-05 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345548+0000", 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4277999999999996e-05 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.347374+0000", 2024-09-12T22:04:07.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001825929 2024-09-12T22:04:07.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.360138+0000", 2024-09-12T22:04:07.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012763943999999999 2024-09-12T22:04:07.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.360196+0000", 2024-09-12T22:04:07.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7584999999999998e-05 2024-09-12T22:04:07.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.360249+0000", 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3860999999999998e-05 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.0005529399999999, 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:07.745 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:07.746 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:07.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:07.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:07.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.746 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:07.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.746 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:07.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:07.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:07.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:07.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:07.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:07.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:07.750 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:07.752 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:07.752 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:07.750+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:07.853 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:07.851+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:07.893 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:07.893 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:07.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.893 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:53273 5.0 5:00077111:::benchmark_data_smithi043_32659_object53272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:07.894 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:07.891535+0000", 2024-09-12T22:04:07.894 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001168844, 2024-09-12T22:04:07.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001192731, 2024-09-12T22:04:07.894 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:07.894 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:07.894 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:07.894 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:07.894 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:07.894 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.894 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 53273 2024-09-12T22:04:07.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.894 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:07.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:07.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.891535+0000", 2024-09-12T22:04:07.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:07.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:07.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.891535+0000", 2024-09-12T22:04:07.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:07.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:07.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.891536+0000", 2024-09-12T22:04:07.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0499999999999999e-06 2024-09-12T22:04:07.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:07.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.891571+0000", 2024-09-12T22:04:07.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4975000000000003e-05 2024-09-12T22:04:07.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:07.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.891582+0000", 2024-09-12T22:04:07.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1021e-05 2024-09-12T22:04:07.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.891589+0000", 2024-09-12T22:04:07.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.985e-06 2024-09-12T22:04:07.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:07.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.891705+0000", 2024-09-12T22:04:07.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115609 2024-09-12T22:04:07.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:07.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.891781+0000", 2024-09-12T22:04:07.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6407000000000002e-05 2024-09-12T22:04:07.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:07.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.891868+0000", 2024-09-12T22:04:07.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6510999999999999e-05 2024-09-12T22:04:07.898 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:07.898 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:07.898 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:07.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.898 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:53277 5.0 5.208aa800 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:07.898 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:07.892427+0000", 2024-09-12T22:04:07.898 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000277185, 2024-09-12T22:04:07.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000345886, 2024-09-12T22:04:07.899 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:07.899 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:07.899 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:07.899 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:07.899 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:07.899 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:07.899 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 53277 2024-09-12T22:04:07.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.899 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:07.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:07.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.892427+0000", 2024-09-12T22:04:07.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:07.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:07.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.892427+0000", 2024-09-12T22:04:07.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:07.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:07.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.892428+0000", 2024-09-12T22:04:07.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9999999999999996e-07 2024-09-12T22:04:07.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:07.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.892484+0000", 2024-09-12T22:04:07.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6079000000000003e-05 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.892496+0000", 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.199e-05 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.892504+0000", 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0949999999999996e-06 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.902 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:53275 5.a e29/22 5:52acb2f4:::benchmark_data_smithi043_32659_object53274:head v 29'3309, mlcod=29'3307)", 2024-09-12T22:04:07.902 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:07.892594+0000", 2024-09-12T22:04:07.902 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000110679, 2024-09-12T22:04:07.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000211077, 2024-09-12T22:04:07.902 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:07.902 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:07.902 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:07.902 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:07.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:07.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.892594+0000", 2024-09-12T22:04:07.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:07.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.892594+0000", 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.892594+0000", 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7e-07 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.892668+0000", 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3597999999999996e-05 2024-09-12T22:04:07.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.892676+0000", 2024-09-12T22:04:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8489999999999995e-06 2024-09-12T22:04:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.892682+0000", 2024-09-12T22:04:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:04:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.892725+0000", 2024-09-12T22:04:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3495999999999998e-05 2024-09-12T22:04:07.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:07.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:07.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:07.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:07.892738+0000", 2024-09-12T22:04:07.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2731000000000001e-05 2024-09-12T22:04:07.905 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:07.905 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:07.905 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:07.905 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:07.905 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:07.905 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 3 2024-09-12T22:04:07.906 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:07.907 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:07.953 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:07.952+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:08.054 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:08.053+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:08.095 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:08.095 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:08.095 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:08.095 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:08.095 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:08.107 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:08.156 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:08.153+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:08.190 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 14 16 54144 54128 241.624 180.438 0.00506482 0.00413577 2024-09-12T22:04:08.256 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:08.255+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:08.257 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:08.257 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:08.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:08.257 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:08.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.257 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44102 5.0 5:0d5aa1ff:::benchmark_data_smithi043_32659_object44101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.257 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.6294008189999998, 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051636015, 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44102 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:08.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:08.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624875+0000", 2024-09-12T22:04:08.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:04:08.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624930+0000", 2024-09-12T22:04:08.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5256000000000001e-05 2024-09-12T22:04:08.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624951+0000", 2024-09-12T22:04:08.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0551999999999999e-05 2024-09-12T22:04:08.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624958+0000", 2024-09-12T22:04:08.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1849999999999998e-06 2024-09-12T22:04:08.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629885+0000", 2024-09-12T22:04:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049266120000000004 2024-09-12T22:04:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629999+0000", 2024-09-12T22:04:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011385 2024-09-12T22:04:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630125+0000", 2024-09-12T22:04:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012640500000000001 2024-09-12T22:04:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633338+0000", 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032135559999999998 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676425+0000", 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043086753999999998 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676472+0000", 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6971999999999997e-05 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676510+0000", 2024-09-12T22:04:08.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8096999999999998e-05 2024-09-12T22:04:08.263 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.263 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.263 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.263 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44103 5.8 5:170742c6:::benchmark_data_smithi043_32659_object44102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.263 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:08.263 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.6292776679999998, 2024-09-12T22:04:08.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051500936999999997, 2024-09-12T22:04:08.263 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.264 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.264 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.264 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.264 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.264 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.264 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44103 2024-09-12T22:04:08.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.264 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:08.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:08.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624998+0000", 2024-09-12T22:04:08.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:08.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625061+0000", 2024-09-12T22:04:08.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2667000000000002e-05 2024-09-12T22:04:08.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625069+0000", 2024-09-12T22:04:08.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999993e-06 2024-09-12T22:04:08.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625077+0000", 2024-09-12T22:04:08.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0090000000000007e-06 2024-09-12T22:04:08.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629869+0000", 2024-09-12T22:04:08.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047921769999999999 2024-09-12T22:04:08.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629938+0000", 2024-09-12T22:04:08.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9542000000000006e-05 2024-09-12T22:04:08.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630010+0000", 2024-09-12T22:04:08.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1795e-05 2024-09-12T22:04:08.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676348+0000", 2024-09-12T22:04:08.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.046337830000000003 2024-09-12T22:04:08.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676399+0000", 2024-09-12T22:04:08.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1150000000000003e-05 2024-09-12T22:04:08.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676460+0000", 2024-09-12T22:04:08.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1142999999999994e-05 2024-09-12T22:04:08.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676498+0000", 2024-09-12T22:04:08.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8111000000000002e-05 2024-09-12T22:04:08.269 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.269 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.269 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.269 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.269 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:08.269 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.627979243, 2024-09-12T22:04:08.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:08.269 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.269 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.270 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.270 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.270 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.270 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.270 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:08.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.270 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:08.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:08.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:08.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:08.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:08.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:08.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:08.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:08.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:08.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:08.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:08.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44115 5.0 5:0ee09c30:::benchmark_data_smithi043_32659_object44114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.6252065660000001, 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082887358999999994, 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.275 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44115 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629070+0000", 2024-09-12T22:04:08.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1209999999999999e-06 2024-09-12T22:04:08.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629132+0000", 2024-09-12T22:04:08.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2557000000000004e-05 2024-09-12T22:04:08.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629147+0000", 2024-09-12T22:04:08.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4491999999999999e-05 2024-09-12T22:04:08.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629156+0000", 2024-09-12T22:04:08.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7089999999999997e-06 2024-09-12T22:04:08.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631865+0000", 2024-09-12T22:04:08.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00270835 2024-09-12T22:04:08.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631932+0000", 2024-09-12T22:04:08.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7322000000000004e-05 2024-09-12T22:04:08.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632095+0000", 2024-09-12T22:04:08.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016314699999999999 2024-09-12T22:04:08.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676360+0000", 2024-09-12T22:04:08.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044264756000000002 2024-09-12T22:04:08.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711854+0000", 2024-09-12T22:04:08.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.03549389 2024-09-12T22:04:08.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711919+0000", 2024-09-12T22:04:08.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5024000000000006e-05 2024-09-12T22:04:08.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711956+0000", 2024-09-12T22:04:08.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6990999999999999e-05 2024-09-12T22:04:08.281 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.281 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.281 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.281 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44117 5.8 5:1ecb02e0:::benchmark_data_smithi043_32659_object44116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.281 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:08.281 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.6250617460000001, 2024-09-12T22:04:08.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082354986000000005, 2024-09-12T22:04:08.281 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.281 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.281 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.281 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.282 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.282 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.282 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44117 2024-09-12T22:04:08.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.282 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:08.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:08.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629214+0000", 2024-09-12T22:04:08.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:08.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629315+0000", 2024-09-12T22:04:08.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010045800000000001 2024-09-12T22:04:08.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629328+0000", 2024-09-12T22:04:08.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3016e-05 2024-09-12T22:04:08.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629336+0000", 2024-09-12T22:04:08.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7229999999999993e-06 2024-09-12T22:04:08.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631856+0000", 2024-09-12T22:04:08.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025199300000000001 2024-09-12T22:04:08.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631954+0000", 2024-09-12T22:04:08.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7565999999999994e-05 2024-09-12T22:04:08.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632073+0000", 2024-09-12T22:04:08.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119677 2024-09-12T22:04:08.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676523+0000", 2024-09-12T22:04:08.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044449163 2024-09-12T22:04:08.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676612+0000", 2024-09-12T22:04:08.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9579000000000004e-05 2024-09-12T22:04:08.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711509+0000", 2024-09-12T22:04:08.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.034897125000000001 2024-09-12T22:04:08.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711568+0000", 2024-09-12T22:04:08.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8996999999999998e-05 2024-09-12T22:04:08.289 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.289 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.289 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.290 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44120 5.b 5:df1f2c5f:::benchmark_data_smithi043_32659_object44119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.290 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:08.290 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.6228860850000002, 2024-09-12T22:04:08.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043861974999999997, 2024-09-12T22:04:08.290 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.290 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.290 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.291 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.291 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.291 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.291 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44120 2024-09-12T22:04:08.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.291 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:08.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:08.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631390+0000", 2024-09-12T22:04:08.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:04:08.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631444+0000", 2024-09-12T22:04:08.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-12T22:04:08.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631452+0000", 2024-09-12T22:04:08.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4610000000000008e-06 2024-09-12T22:04:08.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631458+0000", 2024-09-12T22:04:08.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:04:08.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631509+0000", 2024-09-12T22:04:08.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1442e-05 2024-09-12T22:04:08.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631627+0000", 2024-09-12T22:04:08.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011796800000000001 2024-09-12T22:04:08.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631814+0000", 2024-09-12T22:04:08.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018735400000000001 2024-09-12T22:04:08.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674612+0000", 2024-09-12T22:04:08.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042797287000000003 2024-09-12T22:04:08.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675160+0000", 2024-09-12T22:04:08.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000548187 2024-09-12T22:04:08.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675207+0000", 2024-09-12T22:04:08.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6833999999999999e-05 2024-09-12T22:04:08.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675251+0000", 2024-09-12T22:04:08.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4348000000000003e-05 2024-09-12T22:04:08.297 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.298 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.298 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.298 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.298 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:08.298 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.6225783030000001, 2024-09-12T22:04:08.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:08.298 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.298 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.298 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.298 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.298 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.299 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.299 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:08.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.299 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:08.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:08.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:08.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:08.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:08.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:08.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:08.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:08.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:08.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:08.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:08.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:08.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:08.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:08.304 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.304 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.304 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.304 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44122 5.d 5:bfd04815:::benchmark_data_smithi043_32659_object44121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.304 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:08.304 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.6224802509999998, 2024-09-12T22:04:08.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.080166395000000001, 2024-09-12T22:04:08.304 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.304 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.304 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.304 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44122 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:08.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:04:08.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631853+0000", 2024-09-12T22:04:08.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7209000000000001e-05 2024-09-12T22:04:08.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631858+0000", 2024-09-12T22:04:08.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:04:08.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631862+0000", 2024-09-12T22:04:08.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.692e-06 2024-09-12T22:04:08.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631905+0000", 2024-09-12T22:04:08.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3135e-05 2024-09-12T22:04:08.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632032+0000", 2024-09-12T22:04:08.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012740900000000001 2024-09-12T22:04:08.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:08.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632166+0000", 2024-09-12T22:04:08.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013318800000000001 2024-09-12T22:04:08.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674894+0000", 2024-09-12T22:04:08.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042728690999999999 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711875+0000", 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036980631 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711923+0000", 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8180000000000003e-05 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711961+0000", 2024-09-12T22:04:08.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8142000000000002e-05 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44123 5.e 5:7d83ca89:::benchmark_data_smithi043_32659_object44122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.6223484830000001, 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043329329, 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.310 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44123 2024-09-12T22:04:08.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.311 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:08.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:08.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631928+0000", 2024-09-12T22:04:08.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2699999999999998e-07 2024-09-12T22:04:08.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631996+0000", 2024-09-12T22:04:08.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8141999999999999e-05 2024-09-12T22:04:08.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632004+0000", 2024-09-12T22:04:08.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7600000000000008e-06 2024-09-12T22:04:08.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632010+0000", 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632069+0000", 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8260000000000001e-05 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632226+0000", 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015702199999999999 2024-09-12T22:04:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632337+0000", 2024-09-12T22:04:08.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111069 2024-09-12T22:04:08.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674909+0000", 2024-09-12T22:04:08.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042571854999999999 2024-09-12T22:04:08.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675184+0000", 2024-09-12T22:04:08.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027561399999999998 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675222+0000", 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7710999999999999e-05 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675256+0000", 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4014000000000003e-05 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.315 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.316 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:08.316 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.6216370360000001, 2024-09-12T22:04:08.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:08.316 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.316 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.316 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.316 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.316 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.316 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.316 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:08.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.316 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:08.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:08.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:08.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:08.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:08.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:08.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:08.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:08.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:08.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:08.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:08.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:08.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:08.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:08.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:08.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:08.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:08.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:08.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:08.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:08.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:08.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:08.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:08.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:08.321 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.321 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.322 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.322 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44098 5.0 e28/22 ondisk, result = 0)", 2024-09-12T22:04:08.322 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:08.322 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.6212462209999998, 2024-09-12T22:04:08.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043332180999999997, 2024-09-12T22:04:08.322 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.322 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.322 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:08.322 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633030+0000", 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633035+0000", 2024-09-12T22:04:08.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:04:08.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633043+0000", 2024-09-12T22:04:08.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:08.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633048+0000", 2024-09-12T22:04:08.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5439999999999998e-06 2024-09-12T22:04:08.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633362+0000", 2024-09-12T22:04:08.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031397400000000001 2024-09-12T22:04:08.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633369+0000", 2024-09-12T22:04:08.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:04:08.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676361+0000", 2024-09-12T22:04:08.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042991954999999998 2024-09-12T22:04:08.325 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.326 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.326 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.326 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.326 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:08.326 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.620639116, 2024-09-12T22:04:08.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:08.326 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.326 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.326 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.326 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.326 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.326 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:44125 5.9 e28/22 5:9022696f:::benchmark_data_smithi043_32659_object44124:head v 28'2753, mlcod=28'2751)", 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.6206002509999999, 2024-09-12T22:04:08.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042744011999999998, 2024-09-12T22:04:08.332 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.332 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.332 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.332 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:08.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:08.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633676+0000", 2024-09-12T22:04:08.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.44e-07 2024-09-12T22:04:08.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633755+0000", 2024-09-12T22:04:08.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9629000000000006e-05 2024-09-12T22:04:08.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674386+0000", 2024-09-12T22:04:08.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631364000000003 2024-09-12T22:04:08.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674399+0000", 2024-09-12T22:04:08.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2047e-05 2024-09-12T22:04:08.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674453+0000", 2024-09-12T22:04:08.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4453999999999997e-05 2024-09-12T22:04:08.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674479+0000", 2024-09-12T22:04:08.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6064999999999999e-05 2024-09-12T22:04:08.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676381+0000", 2024-09-12T22:04:08.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001901874 2024-09-12T22:04:08.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676419+0000", 2024-09-12T22:04:08.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7935000000000002e-05 2024-09-12T22:04:08.336 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.336 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.336 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.336 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44103 5.8 e28/22 ondisk, result = 0)", 2024-09-12T22:04:08.337 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:08.337 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.6200942830000002, 2024-09-12T22:04:08.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042322950999999998, 2024-09-12T22:04:08.337 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.337 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.337 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:08.337 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:08.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634184+0000", 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7690000000000001e-06 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674407+0000", 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040222750000000002 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674417+0000", 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0125e-05 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676387+0000", 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001970112 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676394+0000", 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676504+0000", 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109621 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44128 5.d 5:b9a92891:::benchmark_data_smithi043_32659_object44127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.5798414940000001, 2024-09-12T22:04:08.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040118138999999997, 2024-09-12T22:04:08.341 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.341 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.341 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.341 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.341 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.341 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.341 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44128 2024-09-12T22:04:08.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.341 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:08.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:08.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674435+0000", 2024-09-12T22:04:08.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5960000000000001e-06 2024-09-12T22:04:08.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674485+0000", 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0021000000000001e-05 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674495+0000", 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5189999999999998e-06 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674500+0000", 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:04:08.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674923+0000", 2024-09-12T22:04:08.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000423304 2024-09-12T22:04:08.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675027+0000", 2024-09-12T22:04:08.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103399 2024-09-12T22:04:08.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:08.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675141+0000", 2024-09-12T22:04:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114274 2024-09-12T22:04:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711649+0000", 2024-09-12T22:04:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036508011999999999 2024-09-12T22:04:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714466+0000", 2024-09-12T22:04:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028167370000000001 2024-09-12T22:04:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714508+0000", 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2679000000000003e-05 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714552+0000", 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3528000000000001e-05 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44129 5.0 5:0f626cda:::benchmark_data_smithi043_32659_object44128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:08.346 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.5797659890000002, 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042846404999999997, 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44129 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674510+0000", 2024-09-12T22:04:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1600000000000002e-07 2024-09-12T22:04:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674548+0000", 2024-09-12T22:04:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8075999999999999e-05 2024-09-12T22:04:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674689+0000", 2024-09-12T22:04:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014141499999999999 2024-09-12T22:04:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674696+0000", 2024-09-12T22:04:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4619999999999999e-06 2024-09-12T22:04:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713666+0000", 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.038969072 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713752+0000", 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6768999999999995e-05 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713835+0000", 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2774000000000004e-05 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717212+0000", 2024-09-12T22:04:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033769389999999998 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717259+0000", 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7218000000000001e-05 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717310+0000", 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1156999999999998e-05 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717356+0000", 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5107e-05 2024-09-12T22:04:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44130 5.4 5:27857918:::benchmark_data_smithi043_32659_object44129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.5795681350000002, 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039844412000000003, 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44130 2024-09-12T22:04:08.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.353 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:08.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:08.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674708+0000", 2024-09-12T22:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4300000000000003e-07 2024-09-12T22:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674749+0000", 2024-09-12T22:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1254999999999997e-05 2024-09-12T22:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674756+0000", 2024-09-12T22:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3289999999999996e-06 2024-09-12T22:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674762+0000", 2024-09-12T22:04:08.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.852e-06 2024-09-12T22:04:08.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:08.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9573999999999995e-05 2024-09-12T22:04:08.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674954+0000", 2024-09-12T22:04:08.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012254200000000001 2024-09-12T22:04:08.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675033+0000", 2024-09-12T22:04:08.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8707000000000004e-05 2024-09-12T22:04:08.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714381+0000", 2024-09-12T22:04:08.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039348053000000001 2024-09-12T22:04:08.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714477+0000", 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5650999999999996e-05 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714516+0000", 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9158e-05 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714551+0000", 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5648000000000002e-05 2024-09-12T22:04:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44131 5.0 5:013256f7:::benchmark_data_smithi043_32659_object44130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.5794956679999999, 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043388599, 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.358 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44131 2024-09-12T22:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674780+0000", 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674817+0000", 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6859000000000001e-05 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.501e-05 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674838+0000", 2024-09-12T22:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-06 2024-09-12T22:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715161+0000", 2024-09-12T22:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.04032285 2024-09-12T22:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715317+0000", 2024-09-12T22:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015649199999999999 2024-09-12T22:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715463+0000", 2024-09-12T22:04:08.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145704 2024-09-12T22:04:08.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717480+0000", 2024-09-12T22:04:08.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020168220000000001 2024-09-12T22:04:08.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718079+0000", 2024-09-12T22:04:08.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000599115 2024-09-12T22:04:08.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718134+0000", 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718168+0000", 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4301000000000002e-05 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.363 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44132 5.e 5:7634b859:::benchmark_data_smithi043_32659_object44131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.364 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:08.364 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.578828428, 2024-09-12T22:04:08.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039558587999999999, 2024-09-12T22:04:08.364 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.364 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.364 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.364 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.364 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.364 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.364 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44132 2024-09-12T22:04:08.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.364 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:08.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:08.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675448+0000", 2024-09-12T22:04:08.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3699999999999999e-07 2024-09-12T22:04:08.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675552+0000", 2024-09-12T22:04:08.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104294 2024-09-12T22:04:08.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675562+0000", 2024-09-12T22:04:08.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9629999999999993e-06 2024-09-12T22:04:08.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675569+0000", 2024-09-12T22:04:08.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8809999999999998e-06 2024-09-12T22:04:08.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675612+0000", 2024-09-12T22:04:08.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591000000000003e-05 2024-09-12T22:04:08.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675717+0000", 2024-09-12T22:04:08.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010497099999999999 2024-09-12T22:04:08.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675835+0000", 2024-09-12T22:04:08.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011793799999999999 2024-09-12T22:04:08.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713616+0000", 2024-09-12T22:04:08.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037781032999999999 2024-09-12T22:04:08.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714911+0000", 2024-09-12T22:04:08.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001294604 2024-09-12T22:04:08.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714964+0000", 2024-09-12T22:04:08.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3408000000000001e-05 2024-09-12T22:04:08.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715005+0000", 2024-09-12T22:04:08.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0967999999999998e-05 2024-09-12T22:04:08.369 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.370 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.370 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.370 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44133 5.b 5:d0a59edd:::benchmark_data_smithi043_32659_object44132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:08.370 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:08.370 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.5786906480000003, 2024-09-12T22:04:08.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039513020000000003, 2024-09-12T22:04:08.370 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:08.370 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:08.370 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.370 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:08.370 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:08.370 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.371 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44133 2024-09-12T22:04:08.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.371 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:08.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:08.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:08.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:08.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:08.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:08.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675585+0000", 2024-09-12T22:04:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5499999999999998e-07 2024-09-12T22:04:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675634+0000", 2024-09-12T22:04:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8520999999999998e-05 2024-09-12T22:04:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675641+0000", 2024-09-12T22:04:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4440000000000002e-06 2024-09-12T22:04:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675646+0000", 2024-09-12T22:04:08.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2660000000000001e-06 2024-09-12T22:04:08.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:08.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675692+0000", 2024-09-12T22:04:08.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5915999999999999e-05 2024-09-12T22:04:08.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:08.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675812+0000", 2024-09-12T22:04:08.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119419 2024-09-12T22:04:08.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:08.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675950+0000", 2024-09-12T22:04:08.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013831499999999999 2024-09-12T22:04:08.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:08.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713574+0000", 2024-09-12T22:04:08.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037623801999999998 2024-09-12T22:04:08.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:08.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715015+0000", 2024-09-12T22:04:08.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014410720000000001 2024-09-12T22:04:08.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:08.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715059+0000", 2024-09-12T22:04:08.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:04:08.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:08.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:08.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:08.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715097+0000", 2024-09-12T22:04:08.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8519000000000002e-05 2024-09-12T22:04:08.375 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.375 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.375 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.376 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:08.376 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:08.376 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:08.377 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:08.376+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:08.378 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:04:08.477 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:08.476+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:08.547 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:04:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T22:04:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:55103 5.0 e29/22 5:07063b9b:::benchmark_data_smithi043_32659_object55102:head v 29'3519, mlcod=29'3517)", 2024-09-12T22:04:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.540814+0000", 2024-09-12T22:04:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0050176769999999999, 2024-09-12T22:04:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050458179999999997, 2024-09-12T22:04:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.540814+0000", 2024-09-12T22:04:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.540814+0000", 2024-09-12T22:04:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.540815+0000", 2024-09-12T22:04:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6300000000000005e-07 2024-09-12T22:04:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.540853+0000", 2024-09-12T22:04:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8401e-05 2024-09-12T22:04:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.540864+0000", 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1148999999999999e-05 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.540872+0000", 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1130000000000003e-06 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.540950+0000", 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8930999999999994e-05 2024-09-12T22:04:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.540968+0000", 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.772e-05 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.545811+0000", 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048428919999999997 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:55109 5.1 e29/22 5:887e8b7a:::benchmark_data_smithi043_32659_object55108:head v 29'3325, mlcod=29'3323)", 2024-09-12T22:04:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.542630+0000", 2024-09-12T22:04:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0032016549999999999, 2024-09-12T22:04:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003312012, 2024-09-12T22:04:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.542630+0000", 2024-09-12T22:04:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.542630+0000", 2024-09-12T22:04:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.542631+0000", 2024-09-12T22:04:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7700000000000003e-07 2024-09-12T22:04:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.542702+0000", 2024-09-12T22:04:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0951000000000006e-05 2024-09-12T22:04:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.542713+0000", 2024-09-12T22:04:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.076e-05 2024-09-12T22:04:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.542721+0000", 2024-09-12T22:04:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0180000000000001e-06 2024-09-12T22:04:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.542790+0000", 2024-09-12T22:04:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9366e-05 2024-09-12T22:04:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.542809+0000", 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8723e-05 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:55107 5.0 e29/22 5:0f5ade9e:::benchmark_data_smithi043_32659_object55106:head v 29'3520, mlcod=29'3517)", 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.542479+0000", 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0033528529999999998, 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035215419999999999, 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.542479+0000", 2024-09-12T22:04:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.542479+0000", 2024-09-12T22:04:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.542480+0000", 2024-09-12T22:04:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:04:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.543249+0000", 2024-09-12T22:04:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076954499999999995 2024-09-12T22:04:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.543258+0000", 2024-09-12T22:04:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650000000000005e-06 2024-09-12T22:04:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.543264+0000", 2024-09-12T22:04:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9349999999999999e-06 2024-09-12T22:04:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.543306+0000", 2024-09-12T22:04:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1706999999999999e-05 2024-09-12T22:04:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.543323+0000", 2024-09-12T22:04:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7258999999999999e-05 2024-09-12T22:04:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:55113 5.8 e29/22 5:1ceee440:::benchmark_data_smithi043_32659_object55112:head v 29'3386, mlcod=29'3384)", 2024-09-12T22:04:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.544201+0000", 2024-09-12T22:04:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.001630598, 2024-09-12T22:04:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001856861, 2024-09-12T22:04:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544201+0000", 2024-09-12T22:04:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544201+0000", 2024-09-12T22:04:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544202+0000", 2024-09-12T22:04:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7800000000000001e-07 2024-09-12T22:04:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544254+0000", 2024-09-12T22:04:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1622000000000001e-05 2024-09-12T22:04:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544263+0000", 2024-09-12T22:04:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2669999999999995e-06 2024-09-12T22:04:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544269+0000", 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3230000000000003e-06 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544309+0000", 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9920999999999999e-05 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544321+0000", 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1719000000000001e-05 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:55116 5.3 5:cf437ffd:::benchmark_data_smithi043_32659_object55115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.544413+0000", 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.001419011, 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001708155, 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 55116 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544413+0000", 2024-09-12T22:04:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544413+0000", 2024-09-12T22:04:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544414+0000", 2024-09-12T22:04:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1209999999999999e-06 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544576+0000", 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000161846 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544585+0000", 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6080000000000002e-06 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544593+0000", 2024-09-12T22:04:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6820000000000003e-06 2024-09-12T22:04:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544646+0000", 2024-09-12T22:04:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2608999999999997e-05 2024-09-12T22:04:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544795+0000", 2024-09-12T22:04:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000149739 2024-09-12T22:04:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544999+0000", 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000203282 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:55119 5.6 5:67f72c89:::benchmark_data_smithi043_32659_object55118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.544610+0000", 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0012218039999999999, 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015846860000000001, 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 55119 2024-09-12T22:04:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544610+0000", 2024-09-12T22:04:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544610+0000", 2024-09-12T22:04:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544611+0000", 2024-09-12T22:04:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:04:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544646+0000", 2024-09-12T22:04:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5388000000000001e-05 2024-09-12T22:04:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544653+0000", 2024-09-12T22:04:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2119999999999997e-06 2024-09-12T22:04:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544659+0000", 2024-09-12T22:04:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3700000000000003e-06 2024-09-12T22:04:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544711+0000", 2024-09-12T22:04:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2327999999999998e-05 2024-09-12T22:04:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544830+0000", 2024-09-12T22:04:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119376 2024-09-12T22:04:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544958+0000", 2024-09-12T22:04:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012755700000000001 2024-09-12T22:04:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:55111 5.1 e29/22 5:82b5672d:::benchmark_data_smithi043_32659_object55110:head v 29'3326, mlcod=29'3323)", 2024-09-12T22:04:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.544583+0000", 2024-09-12T22:04:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.001248706, 2024-09-12T22:04:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001677539, 2024-09-12T22:04:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544583+0000", 2024-09-12T22:04:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544583+0000", 2024-09-12T22:04:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544584+0000", 2024-09-12T22:04:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.47e-07 2024-09-12T22:04:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544678+0000", 2024-09-12T22:04:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3708999999999993e-05 2024-09-12T22:04:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544688+0000", 2024-09-12T22:04:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:04:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544695+0000", 2024-09-12T22:04:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1779999999999997e-06 2024-09-12T22:04:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544754+0000", 2024-09-12T22:04:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9070000000000002e-05 2024-09-12T22:04:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544770+0000", 2024-09-12T22:04:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6239000000000002e-05 2024-09-12T22:04:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:55115 5.2 e29/22 5:4e672136:::benchmark_data_smithi043_32659_object55114:head v 29'3489, mlcod=29'3487)", 2024-09-12T22:04:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.544837+0000", 2024-09-12T22:04:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.00099498800000000004, 2024-09-12T22:04:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001481617, 2024-09-12T22:04:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544837+0000", 2024-09-12T22:04:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544837+0000", 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544838+0000", 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544947+0000", 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010933399999999999 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544957+0000", 2024-09-12T22:04:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0308e-05 2024-09-12T22:04:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.544964+0000", 2024-09-12T22:04:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.516e-06 2024-09-12T22:04:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.545096+0000", 2024-09-12T22:04:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013246699999999999 2024-09-12T22:04:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.545115+0000", 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9114999999999999e-05 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:55117 5.e e29/22 5:743d30de:::benchmark_data_smithi043_32659_object55116:head v 29'3434, mlcod=29'3432)", 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.545922+0000", 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9999099, 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000450772, 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.545922+0000", 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.545922+0000", 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.545923+0000", 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1699999999999998e-07 2024-09-12T22:04:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.545950+0000", 2024-09-12T22:04:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7250000000000002e-05 2024-09-12T22:04:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.545959+0000", 2024-09-12T22:04:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8629999999999997e-06 2024-09-12T22:04:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.545967+0000", 2024-09-12T22:04:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9780000000000005e-06 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.546179+0000", 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000211955 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.546198+0000", 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9511999999999999e-05 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:55121 5.a 5.de97e73a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.545997+0000", 2024-09-12T22:04:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9998345, 2024-09-12T22:04:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042952499999999999, 2024-09-12T22:04:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 55121 2024-09-12T22:04:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.545997+0000", 2024-09-12T22:04:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.545997+0000", 2024-09-12T22:04:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.545998+0000", 2024-09-12T22:04:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0699999999999996e-07 2024-09-12T22:04:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.546031+0000", 2024-09-12T22:04:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3241999999999998e-05 2024-09-12T22:04:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.546040+0000", 2024-09-12T22:04:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4919999999999993e-06 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.546046+0000", 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3729999999999998e-06 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.546430+0000", 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038389099999999997 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:55122 5.c 5.615ec3cc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.546060+0000", 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9997716, 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042983300000000002, 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 55122 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.546060+0000", 2024-09-12T22:04:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.546060+0000", 2024-09-12T22:04:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.546061+0000", 2024-09-12T22:04:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1500000000000005e-07 2024-09-12T22:04:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.546090+0000", 2024-09-12T22:04:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9696000000000002e-05 2024-09-12T22:04:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.546165+0000", 2024-09-12T22:04:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4621000000000003e-05 2024-09-12T22:04:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.546257+0000", 2024-09-12T22:04:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2002000000000004e-05 2024-09-12T22:04:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T22:04:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 11 2024-09-12T22:04:08.590 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:04:08.591 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:08.589+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:08.592 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:04:08.692 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:08.691+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:08.761 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:04:08.762 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:04:08.762 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-12T22:04:08.762 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T22:04:08.762 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T22:04:08.762 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-12T22:04:08.792 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:08.791+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:08.805 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:04:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T22:04:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T22:04:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T22:04:08.805 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:04:08.819 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:04:08.893 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:08.892+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:08.901 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:08.901 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T22:04:08.901 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:08.992 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:04:08.993 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:08.992+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:09.032 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:04:09.032 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T22:04:09.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T22:04:09.032 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T22:04:09.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.032 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:09.032 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:04:09.032 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.579397804000003, 2024-09-12T22:04:09.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017423646000000001, 2024-09-12T22:04:09.032 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.033 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.033 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.033 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:04:09.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:04:09.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449728+0000", 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449750+0000", 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2391e-05 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449775+0000", 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4831999999999999e-05 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449785+0000", 2024-09-12T22:04:09.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0361e-05 2024-09-12T22:04:09.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449857+0000", 2024-09-12T22:04:09.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1990999999999996e-05 2024-09-12T22:04:09.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:09.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449863+0000", 2024-09-12T22:04:09.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6570000000000002e-06 2024-09-12T22:04:09.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462558+0000", 2024-09-12T22:04:09.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012695032 2024-09-12T22:04:09.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462703+0000", 2024-09-12T22:04:09.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014444100000000001 2024-09-12T22:04:09.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:09.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462853+0000", 2024-09-12T22:04:09.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015042300000000001 2024-09-12T22:04:09.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465147+0000", 2024-09-12T22:04:09.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022944789999999999 2024-09-12T22:04:09.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467012+0000", 2024-09-12T22:04:09.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018646030000000001 2024-09-12T22:04:09.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467095+0000", 2024-09-12T22:04:09.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2695999999999996e-05 2024-09-12T22:04:09.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467148+0000", 2024-09-12T22:04:09.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2958999999999999e-05 2024-09-12T22:04:09.038 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.038 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.039 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.039 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:09.039 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:04:09.039 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.579308961000002, 2024-09-12T22:04:09.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018410795000000001, 2024-09-12T22:04:09.039 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.039 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.039 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.039 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:04:09.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:04:09.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449814+0000", 2024-09-12T22:04:09.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:04:09.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449827+0000", 2024-09-12T22:04:09.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3373000000000001e-05 2024-09-12T22:04:09.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:04:09.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.081e-06 2024-09-12T22:04:09.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449853+0000", 2024-09-12T22:04:09.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7181e-05 2024-09-12T22:04:09.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449914+0000", 2024-09-12T22:04:09.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0736000000000003e-05 2024-09-12T22:04:09.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:09.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449921+0000", 2024-09-12T22:04:09.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2559999999999996e-06 2024-09-12T22:04:09.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461147+0000", 2024-09-12T22:04:09.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011226211999999999 2024-09-12T22:04:09.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461353+0000", 2024-09-12T22:04:09.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000205217 2024-09-12T22:04:09.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:09.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461512+0000", 2024-09-12T22:04:09.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015960700000000001 2024-09-12T22:04:09.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464643+0000", 2024-09-12T22:04:09.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003130238 2024-09-12T22:04:09.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468132+0000", 2024-09-12T22:04:09.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0034897109999999999 2024-09-12T22:04:09.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468182+0000", 2024-09-12T22:04:09.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0209e-05 2024-09-12T22:04:09.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468224+0000", 2024-09-12T22:04:09.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1199000000000003e-05 2024-09-12T22:04:09.045 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.045 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.045 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.045 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:09.045 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:04:09.045 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.579251485999997, 2024-09-12T22:04:09.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017523931, 2024-09-12T22:04:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:04:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:04:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449871+0000", 2024-09-12T22:04:09.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:09.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449890+0000", 2024-09-12T22:04:09.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9245999999999998e-05 2024-09-12T22:04:09.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449899+0000", 2024-09-12T22:04:09.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1530000000000003e-06 2024-09-12T22:04:09.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449905+0000", 2024-09-12T22:04:09.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8100000000000003e-06 2024-09-12T22:04:09.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449942+0000", 2024-09-12T22:04:09.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7119000000000002e-05 2024-09-12T22:04:09.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449945+0000", 2024-09-12T22:04:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0529999999999998e-06 2024-09-12T22:04:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463125+0000", 2024-09-12T22:04:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013179326 2024-09-12T22:04:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463171+0000", 2024-09-12T22:04:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6455000000000002e-05 2024-09-12T22:04:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463242+0000", 2024-09-12T22:04:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0430000000000002e-05 2024-09-12T22:04:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465152+0000", 2024-09-12T22:04:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001910082 2024-09-12T22:04:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467291+0000", 2024-09-12T22:04:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021394119999999998 2024-09-12T22:04:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467351+0000", 2024-09-12T22:04:09.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9673999999999998e-05 2024-09-12T22:04:09.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467394+0000", 2024-09-12T22:04:09.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3477999999999999e-05 2024-09-12T22:04:09.051 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.051 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.051 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.052 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:09.052 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:04:09.052 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.579204378999997, 2024-09-12T22:04:09.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018417978000000002, 2024-09-12T22:04:09.052 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.052 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.052 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.052 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:04:09.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:04:09.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449918+0000", 2024-09-12T22:04:09.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:09.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449923+0000", 2024-09-12T22:04:09.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1959999999999999e-06 2024-09-12T22:04:09.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449928+0000", 2024-09-12T22:04:09.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3989999999999997e-06 2024-09-12T22:04:09.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449931+0000", 2024-09-12T22:04:09.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5750000000000001e-06 2024-09-12T22:04:09.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449968+0000", 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7209999999999998e-05 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449974+0000", 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9730000000000002e-06 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462282+0000", 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012308102 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462368+0000", 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5920000000000004e-05 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462490+0000", 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121478 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465141+0000", 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026515990000000001 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468273+0000", 2024-09-12T22:04:09.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003131736 2024-09-12T22:04:09.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468308+0000", 2024-09-12T22:04:09.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4572e-05 2024-09-12T22:04:09.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468335+0000", 2024-09-12T22:04:09.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7727999999999999e-05 2024-09-12T22:04:09.057 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.057 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.057 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.058 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:09.058 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:04:09.058 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.579185506000002, 2024-09-12T22:04:09.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018483090000000001, 2024-09-12T22:04:09.058 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.058 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.058 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.058 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:04:09.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449937+0000", 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0699999999999999e-07 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449939+0000", 2024-09-12T22:04:09.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.853e-06 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449943+0000", 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8999999999999999e-06 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449956+0000", 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2843000000000001e-05 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:04:09.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0277000000000002e-05 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449990+0000", 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1410000000000001e-06 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463480+0000", 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013490564 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463553+0000", 2024-09-12T22:04:09.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3094000000000002e-05 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463629+0000", 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5610000000000003e-05 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465158+0000", 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015294169999999999 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468328+0000", 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031699699999999998 2024-09-12T22:04:09.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468381+0000", 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2398000000000002e-05 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468419+0000", 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8816000000000002e-05 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.063 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.579156963999999, 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017182808000000001, 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:09.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:09.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2500000000000001e-07 2024-09-12T22:04:09.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449968+0000", 2024-09-12T22:04:09.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7140000000000002e-06 2024-09-12T22:04:09.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449975+0000", 2024-09-12T22:04:09.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:04:09.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449980+0000", 2024-09-12T22:04:09.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1659999999999996e-06 2024-09-12T22:04:09.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450048+0000", 2024-09-12T22:04:09.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8823000000000002e-05 2024-09-12T22:04:09.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:09.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450052+0000", 2024-09-12T22:04:09.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8689999999999997e-06 2024-09-12T22:04:09.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461166+0000", 2024-09-12T22:04:09.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011114166999999999 2024-09-12T22:04:09.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461279+0000", 2024-09-12T22:04:09.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000112212 2024-09-12T22:04:09.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:09.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461417+0000", 2024-09-12T22:04:09.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138202 2024-09-12T22:04:09.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463371+0000", 2024-09-12T22:04:09.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019543120000000001 2024-09-12T22:04:09.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467009+0000", 2024-09-12T22:04:09.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036383180000000002 2024-09-12T22:04:09.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467109+0000", 2024-09-12T22:04:09.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9601999999999999e-05 2024-09-12T22:04:09.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467148+0000", 2024-09-12T22:04:09.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8618000000000002e-05 2024-09-12T22:04:09.069 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.069 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.069 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.070 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:09.070 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:04:09.070 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.579110909000001, 2024-09-12T22:04:09.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017404473, 2024-09-12T22:04:09.070 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.070 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.070 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:09.070 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450012+0000", 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450016+0000", 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9389999999999999e-06 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8209999999999997e-06 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450036+0000", 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0496000000000001e-05 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9070999999999997e-05 2024-09-12T22:04:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450100+0000", 2024-09-12T22:04:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0089999999999998e-06 2024-09-12T22:04:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461992+0000", 2024-09-12T22:04:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011891868999999999 2024-09-12T22:04:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462124+0000", 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013271299999999999 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467415+0000", 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052909029999999996 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:04:09.074 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.579072668999999, 2024-09-12T22:04:09.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018455814000000001, 2024-09-12T22:04:09.075 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.075 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.075 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:09.075 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:04:09.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:04:09.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450050+0000", 2024-09-12T22:04:09.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2e-07 2024-09-12T22:04:09.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450053+0000", 2024-09-12T22:04:09.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0819999999999999e-06 2024-09-12T22:04:09.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450061+0000", 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8169999999999999e-06 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450080+0000", 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9219999999999999e-05 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0834000000000002e-05 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450123+0000", 2024-09-12T22:04:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5830000000000001e-06 2024-09-12T22:04:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464167+0000", 2024-09-12T22:04:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014043517 2024-09-12T22:04:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464298+0000", 2024-09-12T22:04:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013117099999999999 2024-09-12T22:04:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468505+0000", 2024-09-12T22:04:09.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042070700000000003 2024-09-12T22:04:09.079 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.079 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.079 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.079 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:09.079 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:09.079 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.579026810000002, 2024-09-12T22:04:09.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018063523000000001, 2024-09-12T22:04:09.079 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.080 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.080 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:09.080 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:09.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:09.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450096+0000", 2024-09-12T22:04:09.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7899999999999998e-07 2024-09-12T22:04:09.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450100+0000", 2024-09-12T22:04:09.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:04:09.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450107+0000", 2024-09-12T22:04:09.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9269999999999999e-06 2024-09-12T22:04:09.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450112+0000", 2024-09-12T22:04:09.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2909999999999998e-06 2024-09-12T22:04:09.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450156+0000", 2024-09-12T22:04:09.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3665999999999998e-05 2024-09-12T22:04:09.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:09.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450160+0000", 2024-09-12T22:04:09.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.822e-06 2024-09-12T22:04:09.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.459675+0000", 2024-09-12T22:04:09.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0095155039999999993 2024-09-12T22:04:09.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.459901+0000", 2024-09-12T22:04:09.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000225419 2024-09-12T22:04:09.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468159+0000", 2024-09-12T22:04:09.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082579100000000003 2024-09-12T22:04:09.084 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.084 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.084 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.084 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:26828 5.1 e26/22 5:89da373a:::benchmark_data_smithi043_32659_object26827:head v 26'1618, mlcod=26'1616)", 2024-09-12T22:04:09.084 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:04:09.084 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.3312681679999994, 2024-09-12T22:04:09.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013883159000000001, 2024-09-12T22:04:09.084 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.084 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.085 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.085 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.085 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.085 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:04:09.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.088 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:04:09.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697854+0000", 2024-09-12T22:04:09.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8500000000000001e-07 2024-09-12T22:04:09.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697920+0000", 2024-09-12T22:04:09.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6223000000000006e-05 2024-09-12T22:04:09.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697929+0000", 2024-09-12T22:04:09.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2199999999999992e-06 2024-09-12T22:04:09.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697935+0000", 2024-09-12T22:04:09.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0190000000000003e-06 2024-09-12T22:04:09.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.697982+0000", 2024-09-12T22:04:09.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7630000000000003e-05 2024-09-12T22:04:09.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.698001+0000", 2024-09-12T22:04:09.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8488e-05 2024-09-12T22:04:09.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.711690+0000", 2024-09-12T22:04:09.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013689364000000001 2024-09-12T22:04:09.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:59.711737+0000", 2024-09-12T22:04:09.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6629999999999999e-05 2024-09-12T22:04:09.091 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:39890 5.1 e27/22 5:84fdb806:::benchmark_data_smithi043_32659_object39889:head v 27'2392, mlcod=27'2390)", 2024-09-12T22:04:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:03.345620+0000", 2024-09-12T22:04:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.6835017289999996, 2024-09-12T22:04:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014286792, 2024-09-12T22:04:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345620+0000", 2024-09-12T22:04:09.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345620+0000", 2024-09-12T22:04:09.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345621+0000", 2024-09-12T22:04:09.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.75e-07 2024-09-12T22:04:09.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345765+0000", 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000144504 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345777+0000", 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1625e-05 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345783+0000", 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:04:09.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345846+0000", 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2347999999999993e-05 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.345867+0000", 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1365e-05 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.359855+0000", 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013987512000000001 2024-09-12T22:04:09.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:03.359907+0000", 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2204999999999999e-05 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:51616 5.3 5:cff7572e:::benchmark_data_smithi043_32659_object51615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:07.312520+0000", 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.716601995, 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013915301999999999, 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.096 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 51616 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.312520+0000", 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.312520+0000", 2024-09-12T22:04:09.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.312521+0000", 2024-09-12T22:04:09.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:09.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.312604+0000", 2024-09-12T22:04:09.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3636999999999999e-05 2024-09-12T22:04:09.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.312616+0000", 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1771e-05 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.312623+0000", 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8109999999999997e-06 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.319534+0000", 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0069107730000000003 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.319707+0000", 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000173258 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.319835+0000", 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012837600000000001 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.324831+0000", 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0049955030000000001 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.326289+0000", 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014577450000000001 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.326392+0000", 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000103693 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.326435+0000", 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2749e-05 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:51741 5.3 5:cf99c5ea:::benchmark_data_smithi043_32659_object51740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:07.357302+0000", 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.671820061, 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014352165, 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 51741 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.357302+0000", 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.357302+0000", 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.357302+0000", 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3499999999999996e-07 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.357331+0000", 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8506000000000001e-05 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.357339+0000", 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3189999999999995e-06 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.357345+0000", 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1160000000000004e-06 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.363496+0000", 2024-09-12T22:04:09.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.006150445 2024-09-12T22:04:09.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.363619+0000", 2024-09-12T22:04:09.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012336899999999999 2024-09-12T22:04:09.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:09.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.363751+0000", 2024-09-12T22:04:09.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013229600000000001 2024-09-12T22:04:09.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.365972+0000", 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022205839999999998 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.371554+0000", 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055818999999999999 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.371617+0000", 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3306999999999995e-05 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.371654+0000", 2024-09-12T22:04:09.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6687999999999998e-05 2024-09-12T22:04:09.107 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.107 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.107 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.107 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:53288 5.6 5:64cbbf57:::benchmark_data_smithi043_32659_object53287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:09.107 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:07.896158+0000", 2024-09-12T22:04:09.107 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.1329639359999999, 2024-09-12T22:04:09.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013456516999999999, 2024-09-12T22:04:09.107 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.107 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.107 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.107 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:09.107 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:09.108 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:09.108 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 53288 2024-09-12T22:04:09.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.108 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.896158+0000", 2024-09-12T22:04:09.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.896158+0000", 2024-09-12T22:04:09.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.896159+0000", 2024-09-12T22:04:09.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1310000000000001e-06 2024-09-12T22:04:09.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.896205+0000", 2024-09-12T22:04:09.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6087000000000001e-05 2024-09-12T22:04:09.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.896218+0000", 2024-09-12T22:04:09.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3021e-05 2024-09-12T22:04:09.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.896225+0000", 2024-09-12T22:04:09.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7000000000000002e-06 2024-09-12T22:04:09.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.901160+0000", 2024-09-12T22:04:09.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0049347210000000004 2024-09-12T22:04:09.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.901351+0000", 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000191647 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.901483+0000", 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013155900000000001 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.905034+0000", 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035512909999999998 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.909531+0000", 2024-09-12T22:04:09.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044970160000000004 2024-09-12T22:04:09.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.909577+0000", 2024-09-12T22:04:09.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6341999999999998e-05 2024-09-12T22:04:09.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.909614+0000", 2024-09-12T22:04:09.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7002000000000002e-05 2024-09-12T22:04:09.112 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.112 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.112 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.113 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:54742 5.a 5:50885ce8:::benchmark_data_smithi043_32659_object54741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:09.113 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.403677+0000", 2024-09-12T22:04:09.113 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.62544474999999999, 2024-09-12T22:04:09.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014287298, 2024-09-12T22:04:09.113 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.113 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.113 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.113 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:09.113 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:09.113 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:09.113 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 54742 2024-09-12T22:04:09.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.114 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.403677+0000", 2024-09-12T22:04:09.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.403677+0000", 2024-09-12T22:04:09.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.403678+0000", 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.204e-06 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.403752+0000", 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3264999999999997e-05 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.403761+0000", 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4669999999999993e-06 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.403767+0000", 2024-09-12T22:04:09.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1249999999999998e-06 2024-09-12T22:04:09.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.404275+0000", 2024-09-12T22:04:09.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00050768500000000002 2024-09-12T22:04:09.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.404468+0000", 2024-09-12T22:04:09.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0001928 2024-09-12T22:04:09.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.404651+0000", 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000183315 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.409611+0000", 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0049604929999999998 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.417895+0000", 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082836809999999993 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.417924+0000", 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8515999999999999e-05 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.417964+0000", 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0747000000000001e-05 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:55510 5.c 5:3d86645e:::benchmark_data_smithi043_32659_object55509:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:09.118 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.680883+0000", 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.34823870099999998, 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014259078, 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 55510 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.680883+0000", 2024-09-12T22:04:09.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.680883+0000", 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.680884+0000", 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0070000000000001e-06 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.681010+0000", 2024-09-12T22:04:09.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012569100000000001 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.681019+0000", 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4860000000000003e-06 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.681026+0000", 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5420000000000002e-06 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.686633+0000", 2024-09-12T22:04:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056070099999999999 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.686815+0000", 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018254499999999999 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.688386+0000", 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015701650000000001 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.695032+0000", 2024-09-12T22:04:09.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066463449999999997 2024-09-12T22:04:09.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.695048+0000", 2024-09-12T22:04:09.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5753e-05 2024-09-12T22:04:09.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.695103+0000", 2024-09-12T22:04:09.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5009999999999997e-05 2024-09-12T22:04:09.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.695142+0000", 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9524000000000003e-05 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:55515 5.c 5:3b513521:::benchmark_data_smithi043_32659_object55514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.682703+0000", 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.34641902600000002, 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014862965000000001, 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:09.124 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:09.125 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:09.125 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 55515 2024-09-12T22:04:09.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.125 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.682703+0000", 2024-09-12T22:04:09.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.682703+0000", 2024-09-12T22:04:09.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.682704+0000", 2024-09-12T22:04:09.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0599999999999999e-07 2024-09-12T22:04:09.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.682768+0000", 2024-09-12T22:04:09.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4703999999999996e-05 2024-09-12T22:04:09.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.682778+0000", 2024-09-12T22:04:09.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8130000000000007e-06 2024-09-12T22:04:09.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.682785+0000", 2024-09-12T22:04:09.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7959999999999998e-06 2024-09-12T22:04:09.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.690556+0000", 2024-09-12T22:04:09.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0077704890000000002 2024-09-12T22:04:09.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.127 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.127 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.690677+0000", 2024-09-12T22:04:09.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121048 2024-09-12T22:04:09.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:09.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.690830+0000", 2024-09-12T22:04:09.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000153358 2024-09-12T22:04:09.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.695205+0000", 2024-09-12T22:04:09.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004374607 2024-09-12T22:04:09.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.697472+0000", 2024-09-12T22:04:09.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002267659 2024-09-12T22:04:09.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.697525+0000", 2024-09-12T22:04:09.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2729999999999998e-05 2024-09-12T22:04:09.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.697566+0000", 2024-09-12T22:04:09.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0855000000000001e-05 2024-09-12T22:04:09.129 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.129 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:55516 5.c 5:3ec68024:::benchmark_data_smithi043_32659_object55515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.683362+0000", 2024-09-12T22:04:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.34576016500000001, 2024-09-12T22:04:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014288011, 2024-09-12T22:04:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 55516 2024-09-12T22:04:09.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.131 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683362+0000", 2024-09-12T22:04:09.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683362+0000", 2024-09-12T22:04:09.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683363+0000", 2024-09-12T22:04:09.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2200000000000002e-07 2024-09-12T22:04:09.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683418+0000", 2024-09-12T22:04:09.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5682e-05 2024-09-12T22:04:09.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683428+0000", 2024-09-12T22:04:09.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:04:09.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683435+0000", 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7839999999999998e-06 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.692975+0000", 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0095404010000000004 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.693098+0000", 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012256499999999999 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:09.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.693229+0000", 2024-09-12T22:04:09.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013103499999999999 2024-09-12T22:04:09.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.695246+0000", 2024-09-12T22:04:09.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002017816 2024-09-12T22:04:09.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.697576+0000", 2024-09-12T22:04:09.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023292209999999998 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.697616+0000", 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0200999999999997e-05 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.697650+0000", 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3859000000000002e-05 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.136 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:55520 5.c 5:3c5c78a8:::benchmark_data_smithi043_32659_object55519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:09.136 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.683898+0000", 2024-09-12T22:04:09.136 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.34522408999999998, 2024-09-12T22:04:09.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014823622999999999, 2024-09-12T22:04:09.136 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.136 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.136 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.136 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:09.136 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:09.136 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:09.136 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 55520 2024-09-12T22:04:09.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.137 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683898+0000", 2024-09-12T22:04:09.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683898+0000", 2024-09-12T22:04:09.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683899+0000", 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7499999999999998e-07 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683972+0000", 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2929000000000006e-05 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683983+0000", 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1518999999999999e-05 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683991+0000", 2024-09-12T22:04:09.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2050000000000002e-06 2024-09-12T22:04:09.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.139 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.695278+0000", 2024-09-12T22:04:09.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011286865 2024-09-12T22:04:09.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.139 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.695453+0000", 2024-09-12T22:04:09.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017522300000000001 2024-09-12T22:04:09.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:09.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.695579+0000", 2024-09-12T22:04:09.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012582000000000001 2024-09-12T22:04:09.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.698176+0000", 2024-09-12T22:04:09.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002597046 2024-09-12T22:04:09.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.698646+0000", 2024-09-12T22:04:09.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046971099999999999 2024-09-12T22:04:09.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.698688+0000", 2024-09-12T22:04:09.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1587e-05 2024-09-12T22:04:09.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.698721+0000", 2024-09-12T22:04:09.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3742999999999999e-05 2024-09-12T22:04:09.141 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.141 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.141 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.141 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:56072 5.c 5:348ae42b:::benchmark_data_smithi043_32659_object56071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:09.142 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.894332+0000", 2024-09-12T22:04:09.142 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.13479015899999999, 2024-09-12T22:04:09.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014078204, 2024-09-12T22:04:09.142 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:09.142 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:09.142 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:09.142 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:09.142 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:09.142 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:09.142 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 56072 2024-09-12T22:04:09.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.142 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:09.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:09.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.894332+0000", 2024-09-12T22:04:09.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:09.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.894332+0000", 2024-09-12T22:04:09.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:09.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:09.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.894332+0000", 2024-09-12T22:04:09.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T22:04:09.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:09.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.894369+0000", 2024-09-12T22:04:09.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6847000000000001e-05 2024-09-12T22:04:09.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:09.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.894377+0000", 2024-09-12T22:04:09.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9810000000000003e-06 2024-09-12T22:04:09.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:09.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.894383+0000", 2024-09-12T22:04:09.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2979999999999997e-06 2024-09-12T22:04:09.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:09.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.897502+0000", 2024-09-12T22:04:09.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003118137 2024-09-12T22:04:09.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:09.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.897643+0000", 2024-09-12T22:04:09.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141111 2024-09-12T22:04:09.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:09.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.897789+0000", 2024-09-12T22:04:09.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014614599999999999 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.903448+0000", 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056589609999999997 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.908334+0000", 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048865569999999997 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.908375+0000", 2024-09-12T22:04:09.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0803999999999998e-05 2024-09-12T22:04:09.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:09.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:09.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:09.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.908410+0000", 2024-09-12T22:04:09.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4709999999999998e-05 2024-09-12T22:04:09.147 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.147 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.147 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.147 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:09.147 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:09.147 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:04:09.148 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-09-12T22:04:09.149 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:04:09.149 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:09.150 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:09.150 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:09.150 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:09.147+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:09.160 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:09.161 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:09.190 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 15 16 56872 56856 236.881 170.5 0.00586273 0.00421899 2024-09-12T22:04:09.250 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:09.248+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:09.303 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:09.303 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:09.317 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:09.351 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:04:09.358 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:09.357+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:09.451 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:09.450+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:09.504 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:09.505 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:09.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:09.551 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:09.550+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:09.652 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:09.650+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:09.669 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:09.670 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:09.683 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:09.753 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:09.752+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:09.832 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:09.832 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:09.845 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:09.854 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:09.853+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:09.955 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:09.953+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:10.005 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:10.090 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:10.088+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:10.156 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:10.155+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:10.188 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:10.189 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:10.190 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 16 16 59597 59581 232.719 170.312 0.0042473 0.00429399 2024-09-12T22:04:10.200 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:04:10.257 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:10.256+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:10.346 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-09-12T22:04:10.357 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:10.356+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:10.377 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:10.377 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:10.390 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:04:10.459 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:10.457+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:10.559 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:10.558+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:10.560 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:10.560 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:10.575 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:04:10.660 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:10.659+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:10.761 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:10.760+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:10.782 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:10.783 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:10.796 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:10.861 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:10.860+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:10.945 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:10.945 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:10.955 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:10.962 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:10.961+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:11.063 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:11.062+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:11.145 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:11.145 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:11.156 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:11.164 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:11.163+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:11.172 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:04:11.190 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 17 16 62215 62199 228.654 163.625 0.00681548 0.00437074 2024-09-12T22:04:11.265 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:11.264+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:11.302 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:11.302 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:11.304 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-09-12T22:04:11.305 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:04:11.316 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:11.324 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:11.324 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:11.342 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:11.342 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:11.365 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:11.364+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:11.455 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:11.456 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:11.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.456 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:62899 5.a e30/22 5:53dd8548:::benchmark_data_smithi043_32659_object62898:head v 30'3909, mlcod=30'3907)", 2024-09-12T22:04:11.456 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:11.447539+0000", 2024-09-12T22:04:11.456 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0067609669999999997, 2024-09-12T22:04:11.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0067791329999999997, 2024-09-12T22:04:11.456 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.456 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.456 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:11.456 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.447539+0000", 2024-09-12T22:04:11.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.447539+0000", 2024-09-12T22:04:11.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.447539+0000", 2024-09-12T22:04:11.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4700000000000002e-07 2024-09-12T22:04:11.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.447566+0000", 2024-09-12T22:04:11.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7030999999999999e-05 2024-09-12T22:04:11.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.447572+0000", 2024-09-12T22:04:11.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:11.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.447575+0000", 2024-09-12T22:04:11.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3459999999999998e-06 2024-09-12T22:04:11.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.447610+0000", 2024-09-12T22:04:11.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5253000000000003e-05 2024-09-12T22:04:11.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.447628+0000", 2024-09-12T22:04:11.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7540000000000001e-05 2024-09-12T22:04:11.460 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.460 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.460 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.460 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:62903 5.4 5:28349118:::benchmark_data_smithi043_32659_object62902:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:11.460 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:11.447981+0000", 2024-09-12T22:04:11.460 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0063183470000000002, 2024-09-12T22:04:11.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.006376184, 2024-09-12T22:04:11.460 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.460 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.461 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:11.461 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.461 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.461 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.461 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 62903 2024-09-12T22:04:11.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.461 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.447981+0000", 2024-09-12T22:04:11.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.447981+0000", 2024-09-12T22:04:11.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.447982+0000", 2024-09-12T22:04:11.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4200000000000005e-07 2024-09-12T22:04:11.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.448052+0000", 2024-09-12T22:04:11.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9709999999999995e-05 2024-09-12T22:04:11.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.448061+0000", 2024-09-12T22:04:11.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0210000000000005e-06 2024-09-12T22:04:11.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.448065+0000", 2024-09-12T22:04:11.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5079999999999999e-06 2024-09-12T22:04:11.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.448112+0000", 2024-09-12T22:04:11.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6898999999999999e-05 2024-09-12T22:04:11.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.448229+0000", 2024-09-12T22:04:11.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116638 2024-09-12T22:04:11.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.448372+0000", 2024-09-12T22:04:11.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000143032 2024-09-12T22:04:11.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.454047+0000", 2024-09-12T22:04:11.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056755620000000003 2024-09-12T22:04:11.465 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.466 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.466 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.466 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:62906 5.b 5:d5cb9317:::benchmark_data_smithi043_32659_object62905:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:11.466 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:11.449568+0000", 2024-09-12T22:04:11.466 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0047311039999999999, 2024-09-12T22:04:11.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0048351590000000003, 2024-09-12T22:04:11.466 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.466 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.466 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:11.467 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.467 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.467 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.467 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 62906 2024-09-12T22:04:11.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.467 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.449568+0000", 2024-09-12T22:04:11.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.449568+0000", 2024-09-12T22:04:11.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.449569+0000", 2024-09-12T22:04:11.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6799999999999999e-07 2024-09-12T22:04:11.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.449617+0000", 2024-09-12T22:04:11.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8195999999999997e-05 2024-09-12T22:04:11.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.449628+0000", 2024-09-12T22:04:11.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0871e-05 2024-09-12T22:04:11.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.449634+0000", 2024-09-12T22:04:11.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1800000000000004e-06 2024-09-12T22:04:11.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.449673+0000", 2024-09-12T22:04:11.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9391999999999998e-05 2024-09-12T22:04:11.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.449760+0000", 2024-09-12T22:04:11.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7207999999999996e-05 2024-09-12T22:04:11.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.471 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.449845+0000", 2024-09-12T22:04:11.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5019999999999996e-05 2024-09-12T22:04:11.471 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.471 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.471 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.471 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:62908 5.8 5:1b92a5f5:::benchmark_data_smithi043_32659_object62907:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:11.471 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:11.450956+0000", 2024-09-12T22:04:11.471 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0033430619999999999, 2024-09-12T22:04:11.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034866390000000001, 2024-09-12T22:04:11.471 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.472 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.472 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:11.472 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.472 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.472 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.472 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 62908 2024-09-12T22:04:11.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.472 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.472 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.450956+0000", 2024-09-12T22:04:11.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.450956+0000", 2024-09-12T22:04:11.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.450957+0000", 2024-09-12T22:04:11.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:04:11.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.451020+0000", 2024-09-12T22:04:11.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3125000000000003e-05 2024-09-12T22:04:11.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.451028+0000", 2024-09-12T22:04:11.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2239999999999995e-06 2024-09-12T22:04:11.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.451033+0000", 2024-09-12T22:04:11.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4399999999999998e-06 2024-09-12T22:04:11.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.451076+0000", 2024-09-12T22:04:11.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3167999999999997e-05 2024-09-12T22:04:11.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.451195+0000", 2024-09-12T22:04:11.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118876 2024-09-12T22:04:11.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.451327+0000", 2024-09-12T22:04:11.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013220899999999999 2024-09-12T22:04:11.476 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.476 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.476 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.476 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:62910 5.e 5:7faefad3:::benchmark_data_smithi043_32659_object62909:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:11.476 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:11.451934+0000", 2024-09-12T22:04:11.477 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0023653290000000002, 2024-09-12T22:04:11.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002546853, 2024-09-12T22:04:11.477 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.477 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.477 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:11.477 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.477 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.477 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.477 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 62910 2024-09-12T22:04:11.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.477 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.451934+0000", 2024-09-12T22:04:11.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.451934+0000", 2024-09-12T22:04:11.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.451935+0000", 2024-09-12T22:04:11.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1999999999999998e-07 2024-09-12T22:04:11.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.451996+0000", 2024-09-12T22:04:11.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:04:11.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.480 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452015+0000", 2024-09-12T22:04:11.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9159000000000001e-05 2024-09-12T22:04:11.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.480 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.480 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452023+0000", 2024-09-12T22:04:11.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5809999999999999e-06 2024-09-12T22:04:11.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.480 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.480 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452064+0000", 2024-09-12T22:04:11.481 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1492000000000002e-05 2024-09-12T22:04:11.481 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.481 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.481 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.481 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452141+0000", 2024-09-12T22:04:11.481 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6834000000000003e-05 2024-09-12T22:04:11.481 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.481 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.481 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.481 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452217+0000", 2024-09-12T22:04:11.481 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6403999999999996e-05 2024-09-12T22:04:11.481 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.482 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.482 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.482 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:62911 5.b 5:d1515342:::benchmark_data_smithi043_32659_object62910:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:11.482 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:11.452040+0000", 2024-09-12T22:04:11.482 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0022592469999999998, 2024-09-12T22:04:11.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002478545, 2024-09-12T22:04:11.482 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.482 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.482 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:11.482 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.483 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.483 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.483 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 62911 2024-09-12T22:04:11.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.483 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452040+0000", 2024-09-12T22:04:11.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452040+0000", 2024-09-12T22:04:11.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452041+0000", 2024-09-12T22:04:11.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9599999999999999e-07 2024-09-12T22:04:11.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452072+0000", 2024-09-12T22:04:11.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0997000000000002e-05 2024-09-12T22:04:11.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452080+0000", 2024-09-12T22:04:11.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5950000000000001e-06 2024-09-12T22:04:11.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452086+0000", 2024-09-12T22:04:11.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1e-06 2024-09-12T22:04:11.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452119+0000", 2024-09-12T22:04:11.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3664999999999997e-05 2024-09-12T22:04:11.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452196+0000", 2024-09-12T22:04:11.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6902000000000003e-05 2024-09-12T22:04:11.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.487 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452271+0000", 2024-09-12T22:04:11.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5155999999999997e-05 2024-09-12T22:04:11.487 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.487 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.487 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.487 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:62914 5.b 5.f6b78fcb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:11.487 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:11.452376+0000", 2024-09-12T22:04:11.487 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001923992, 2024-09-12T22:04:11.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002178499, 2024-09-12T22:04:11.487 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.488 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.488 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:11.488 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.488 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.488 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.488 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 62914 2024-09-12T22:04:11.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.488 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452376+0000", 2024-09-12T22:04:11.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452376+0000", 2024-09-12T22:04:11.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452376+0000", 2024-09-12T22:04:11.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.47e-07 2024-09-12T22:04:11.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452437+0000", 2024-09-12T22:04:11.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0680999999999997e-05 2024-09-12T22:04:11.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452449+0000", 2024-09-12T22:04:11.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1436e-05 2024-09-12T22:04:11.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452455+0000", 2024-09-12T22:04:11.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6209999999999998e-06 2024-09-12T22:04:11.491 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.491 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.491 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.491 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:62915 5.d 5:bf274124:::benchmark_data_smithi043_32659_object62914:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:11.491 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:11.452682+0000", 2024-09-12T22:04:11.491 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0016172109999999999, 2024-09-12T22:04:11.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001902967, 2024-09-12T22:04:11.491 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.492 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.492 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:11.492 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.492 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.492 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.492 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 62915 2024-09-12T22:04:11.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.492 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452682+0000", 2024-09-12T22:04:11.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452682+0000", 2024-09-12T22:04:11.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452683+0000", 2024-09-12T22:04:11.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4600000000000004e-07 2024-09-12T22:04:11.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452758+0000", 2024-09-12T22:04:11.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5394000000000004e-05 2024-09-12T22:04:11.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452768+0000", 2024-09-12T22:04:11.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7119999999999995e-06 2024-09-12T22:04:11.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452774+0000", 2024-09-12T22:04:11.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5500000000000002e-06 2024-09-12T22:04:11.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452831+0000", 2024-09-12T22:04:11.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6889999999999999e-05 2024-09-12T22:04:11.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452961+0000", 2024-09-12T22:04:11.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000130209 2024-09-12T22:04:11.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:11.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.453101+0000", 2024-09-12T22:04:11.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000139822 2024-09-12T22:04:11.496 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.496 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.496 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.496 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:62912 5.9 e30/22 5:9cfb558a:::benchmark_data_smithi043_32659_object62911:head v 30'3900, mlcod=30'3898)", 2024-09-12T22:04:11.496 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:11.452833+0000", 2024-09-12T22:04:11.496 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001466207, 2024-09-12T22:04:11.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017901390000000001, 2024-09-12T22:04:11.497 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.497 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.497 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:11.497 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452833+0000", 2024-09-12T22:04:11.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.498 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452833+0000", 2024-09-12T22:04:11.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.498 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.498 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452834+0000", 2024-09-12T22:04:11.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3399999999999998e-07 2024-09-12T22:04:11.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.498 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.498 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452880+0000", 2024-09-12T22:04:11.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6078000000000002e-05 2024-09-12T22:04:11.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452888+0000", 2024-09-12T22:04:11.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:04:11.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452893+0000", 2024-09-12T22:04:11.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9509999999999997e-06 2024-09-12T22:04:11.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452941+0000", 2024-09-12T22:04:11.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8174000000000003e-05 2024-09-12T22:04:11.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.452960+0000", 2024-09-12T22:04:11.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8915000000000001e-05 2024-09-12T22:04:11.501 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.501 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.501 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.501 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:62908 5.8 e30/22)", 2024-09-12T22:04:11.501 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:11.453784+0000", 2024-09-12T22:04:11.502 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00051558300000000001, 2024-09-12T22:04:11.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00087284799999999996, 2024-09-12T22:04:11.502 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.502 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.502 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:11.502 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.453784+0000", 2024-09-12T22:04:11.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.453784+0000", 2024-09-12T22:04:11.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.453785+0000", 2024-09-12T22:04:11.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2699999999999999e-07 2024-09-12T22:04:11.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.453788+0000", 2024-09-12T22:04:11.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.693e-06 2024-09-12T22:04:11.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.453796+0000", 2024-09-12T22:04:11.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9580000000000007e-06 2024-09-12T22:04:11.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:11.453801+0000", 2024-09-12T22:04:11.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6020000000000002e-06 2024-09-12T22:04:11.505 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.505 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.505 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.505 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.505 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:11.505 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 10 2024-09-12T22:04:11.505 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:11.506 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:11.505+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:11.507 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:11.607 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:11.605+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:11.651 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:11.651 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:11.651 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:11.651 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:11.651 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:11.663 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:11.707 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:11.706+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:11.808 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:11.807+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:11.847 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:11.847 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:11.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:11.847 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:11.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.848 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44102 5.0 5:0d5aa1ff:::benchmark_data_smithi043_32659_object44101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.848 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:11.848 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.2200152759999998, 2024-09-12T22:04:11.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051636015, 2024-09-12T22:04:11.848 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.848 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.848 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.848 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.848 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.848 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.848 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44102 2024-09-12T22:04:11.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.849 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:11.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:11.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.850 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.850 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624875+0000", 2024-09-12T22:04:11.850 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:04:11.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.850 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.850 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624930+0000", 2024-09-12T22:04:11.850 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5256000000000001e-05 2024-09-12T22:04:11.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.851 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.851 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624951+0000", 2024-09-12T22:04:11.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0551999999999999e-05 2024-09-12T22:04:11.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.851 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.851 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624958+0000", 2024-09-12T22:04:11.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1849999999999998e-06 2024-09-12T22:04:11.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.851 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.851 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629885+0000", 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049266120000000004 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629999+0000", 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011385 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630125+0000", 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012640500000000001 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633338+0000", 2024-09-12T22:04:11.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032135559999999998 2024-09-12T22:04:11.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676425+0000", 2024-09-12T22:04:11.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043086753999999998 2024-09-12T22:04:11.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676472+0000", 2024-09-12T22:04:11.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6971999999999997e-05 2024-09-12T22:04:11.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676510+0000", 2024-09-12T22:04:11.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8096999999999998e-05 2024-09-12T22:04:11.854 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.854 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.854 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.854 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44103 5.8 5:170742c6:::benchmark_data_smithi043_32659_object44102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.854 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:11.854 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.2198921250000003, 2024-09-12T22:04:11.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051500936999999997, 2024-09-12T22:04:11.854 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.854 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.854 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44103 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:11.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624998+0000", 2024-09-12T22:04:11.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:11.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625061+0000", 2024-09-12T22:04:11.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2667000000000002e-05 2024-09-12T22:04:11.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625069+0000", 2024-09-12T22:04:11.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999993e-06 2024-09-12T22:04:11.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625077+0000", 2024-09-12T22:04:11.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0090000000000007e-06 2024-09-12T22:04:11.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629869+0000", 2024-09-12T22:04:11.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047921769999999999 2024-09-12T22:04:11.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.858 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629938+0000", 2024-09-12T22:04:11.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9542000000000006e-05 2024-09-12T22:04:11.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.858 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.858 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.858 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630010+0000", 2024-09-12T22:04:11.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1795e-05 2024-09-12T22:04:11.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.858 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.858 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.858 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676348+0000", 2024-09-12T22:04:11.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.046337830000000003 2024-09-12T22:04:11.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676399+0000", 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1150000000000003e-05 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676460+0000", 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1142999999999994e-05 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676498+0000", 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8111000000000002e-05 2024-09-12T22:04:11.859 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.860 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.860 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.860 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.860 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:11.860 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.2185936999999996, 2024-09-12T22:04:11.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:11.861 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.861 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.861 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.861 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.861 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.861 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.861 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:11.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.861 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:11.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.862 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:11.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.862 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:11.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:11.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:11.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:11.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:11.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:11.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:11.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:11.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:11.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.865 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.865 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:11.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:11.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.865 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.865 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:11.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:11.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:11.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:11.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:11.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:11.866 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.866 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.866 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.866 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44115 5.0 5:0ee09c30:::benchmark_data_smithi043_32659_object44114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.2158210230000002, 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082887358999999994, 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44115 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:11.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:11.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629070+0000", 2024-09-12T22:04:11.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1209999999999999e-06 2024-09-12T22:04:11.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629132+0000", 2024-09-12T22:04:11.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2557000000000004e-05 2024-09-12T22:04:11.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629147+0000", 2024-09-12T22:04:11.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4491999999999999e-05 2024-09-12T22:04:11.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629156+0000", 2024-09-12T22:04:11.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7089999999999997e-06 2024-09-12T22:04:11.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631865+0000", 2024-09-12T22:04:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00270835 2024-09-12T22:04:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631932+0000", 2024-09-12T22:04:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7322000000000004e-05 2024-09-12T22:04:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632095+0000", 2024-09-12T22:04:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016314699999999999 2024-09-12T22:04:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676360+0000", 2024-09-12T22:04:11.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044264756000000002 2024-09-12T22:04:11.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711854+0000", 2024-09-12T22:04:11.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.03549389 2024-09-12T22:04:11.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711919+0000", 2024-09-12T22:04:11.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5024000000000006e-05 2024-09-12T22:04:11.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711956+0000", 2024-09-12T22:04:11.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6990999999999999e-05 2024-09-12T22:04:11.874 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.874 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.874 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.874 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44117 5.8 5:1ecb02e0:::benchmark_data_smithi043_32659_object44116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.874 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:11.874 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.2156762030000001, 2024-09-12T22:04:11.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082354986000000005, 2024-09-12T22:04:11.874 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.874 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44117 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:11.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629214+0000", 2024-09-12T22:04:11.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:11.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629315+0000", 2024-09-12T22:04:11.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010045800000000001 2024-09-12T22:04:11.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629328+0000", 2024-09-12T22:04:11.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3016e-05 2024-09-12T22:04:11.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629336+0000", 2024-09-12T22:04:11.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7229999999999993e-06 2024-09-12T22:04:11.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631856+0000", 2024-09-12T22:04:11.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025199300000000001 2024-09-12T22:04:11.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631954+0000", 2024-09-12T22:04:11.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7565999999999994e-05 2024-09-12T22:04:11.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632073+0000", 2024-09-12T22:04:11.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119677 2024-09-12T22:04:11.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.879 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676523+0000", 2024-09-12T22:04:11.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044449163 2024-09-12T22:04:11.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.879 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676612+0000", 2024-09-12T22:04:11.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9579000000000004e-05 2024-09-12T22:04:11.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.879 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711509+0000", 2024-09-12T22:04:11.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.034897125000000001 2024-09-12T22:04:11.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711568+0000", 2024-09-12T22:04:11.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8996999999999998e-05 2024-09-12T22:04:11.880 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.880 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.880 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.880 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44120 5.b 5:df1f2c5f:::benchmark_data_smithi043_32659_object44119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.880 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:11.881 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.2135005420000002, 2024-09-12T22:04:11.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043861974999999997, 2024-09-12T22:04:11.881 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.881 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.881 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.881 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.881 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.881 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.881 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44120 2024-09-12T22:04:11.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.881 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:11.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:11.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631390+0000", 2024-09-12T22:04:11.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:04:11.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631444+0000", 2024-09-12T22:04:11.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-12T22:04:11.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631452+0000", 2024-09-12T22:04:11.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4610000000000008e-06 2024-09-12T22:04:11.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631458+0000", 2024-09-12T22:04:11.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:04:11.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631509+0000", 2024-09-12T22:04:11.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1442e-05 2024-09-12T22:04:11.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631627+0000", 2024-09-12T22:04:11.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011796800000000001 2024-09-12T22:04:11.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631814+0000", 2024-09-12T22:04:11.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018735400000000001 2024-09-12T22:04:11.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674612+0000", 2024-09-12T22:04:11.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042797287000000003 2024-09-12T22:04:11.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675160+0000", 2024-09-12T22:04:11.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000548187 2024-09-12T22:04:11.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675207+0000", 2024-09-12T22:04:11.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6833999999999999e-05 2024-09-12T22:04:11.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675251+0000", 2024-09-12T22:04:11.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4348000000000003e-05 2024-09-12T22:04:11.886 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.886 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.886 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.886 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.2131927600000001, 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:11.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:11.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:11.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:11.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:11.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:11.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:11.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:11.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:11.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:11.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:11.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:11.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:11.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:11.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:11.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:11.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:11.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:11.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:11.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:11.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:11.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:11.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:11.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:11.894 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.894 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.894 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.894 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44122 5.d 5:bfd04815:::benchmark_data_smithi043_32659_object44121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.894 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:11.894 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.2130947079999999, 2024-09-12T22:04:11.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.080166395000000001, 2024-09-12T22:04:11.894 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.895 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.895 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.895 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.895 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.895 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.895 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44122 2024-09-12T22:04:11.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.895 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:11.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:11.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:11.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:04:11.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631853+0000", 2024-09-12T22:04:11.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7209000000000001e-05 2024-09-12T22:04:11.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631858+0000", 2024-09-12T22:04:11.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:04:11.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631862+0000", 2024-09-12T22:04:11.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.692e-06 2024-09-12T22:04:11.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631905+0000", 2024-09-12T22:04:11.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3135e-05 2024-09-12T22:04:11.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632032+0000", 2024-09-12T22:04:11.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012740900000000001 2024-09-12T22:04:11.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:11.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632166+0000", 2024-09-12T22:04:11.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013318800000000001 2024-09-12T22:04:11.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674894+0000", 2024-09-12T22:04:11.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042728690999999999 2024-09-12T22:04:11.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711875+0000", 2024-09-12T22:04:11.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036980631 2024-09-12T22:04:11.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711923+0000", 2024-09-12T22:04:11.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8180000000000003e-05 2024-09-12T22:04:11.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711961+0000", 2024-09-12T22:04:11.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8142000000000002e-05 2024-09-12T22:04:11.901 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.901 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.901 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.902 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44123 5.e 5:7d83ca89:::benchmark_data_smithi043_32659_object44122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.902 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:11.903 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.2129629399999997, 2024-09-12T22:04:11.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043329329, 2024-09-12T22:04:11.903 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.903 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.903 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.903 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.903 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.903 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.903 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44123 2024-09-12T22:04:11.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.903 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:11.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:11.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631928+0000", 2024-09-12T22:04:11.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2699999999999998e-07 2024-09-12T22:04:11.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631996+0000", 2024-09-12T22:04:11.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8141999999999999e-05 2024-09-12T22:04:11.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632004+0000", 2024-09-12T22:04:11.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7600000000000008e-06 2024-09-12T22:04:11.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632010+0000", 2024-09-12T22:04:11.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:04:11.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632069+0000", 2024-09-12T22:04:11.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8260000000000001e-05 2024-09-12T22:04:11.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632226+0000", 2024-09-12T22:04:11.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015702199999999999 2024-09-12T22:04:11.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632337+0000", 2024-09-12T22:04:11.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111069 2024-09-12T22:04:11.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674909+0000", 2024-09-12T22:04:11.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042571854999999999 2024-09-12T22:04:11.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675184+0000", 2024-09-12T22:04:11.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027561399999999998 2024-09-12T22:04:11.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675222+0000", 2024-09-12T22:04:11.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7710999999999999e-05 2024-09-12T22:04:11.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675256+0000", 2024-09-12T22:04:11.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4014000000000003e-05 2024-09-12T22:04:11.909 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.909 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.909 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.910 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.910 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:11.910 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.2122514930000001, 2024-09-12T22:04:11.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:11.910 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.910 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.910 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.910 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.910 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.910 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.910 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:11.910 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.911 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.911 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.911 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:11.911 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.911 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.911 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:11.911 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.911 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:11.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:11.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:11.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:11.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:11.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:11.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:11.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:11.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:11.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:11.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:11.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:11.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:11.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:11.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:11.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:11.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:11.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:11.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:11.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:11.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.916 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.916 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:11.916 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:11.916 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.916 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.916 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.916 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.916 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44098 5.0 e28/22 ondisk, result = 0)", 2024-09-12T22:04:11.917 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:11.917 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.2118606779999999, 2024-09-12T22:04:11.917 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043332180999999997, 2024-09-12T22:04:11.917 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.917 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.917 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:11.917 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.917 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.917 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.917 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:11.917 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.917 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:11.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633030+0000", 2024-09-12T22:04:11.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:11.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633035+0000", 2024-09-12T22:04:11.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:04:11.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633043+0000", 2024-09-12T22:04:11.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:11.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.920 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633048+0000", 2024-09-12T22:04:11.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5439999999999998e-06 2024-09-12T22:04:11.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.920 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.920 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633362+0000", 2024-09-12T22:04:11.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031397400000000001 2024-09-12T22:04:11.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.920 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.920 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633369+0000", 2024-09-12T22:04:11.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:04:11.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.921 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.921 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676361+0000", 2024-09-12T22:04:11.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042991954999999998 2024-09-12T22:04:11.921 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.921 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.921 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.922 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.922 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:11.922 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.2112535729999996, 2024-09-12T22:04:11.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:11.922 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.922 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.922 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.922 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.922 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.922 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.923 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:11.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.923 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.923 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.923 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.923 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:11.923 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.923 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.923 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.923 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:11.923 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.924 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.924 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:11.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:11.924 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.924 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:11.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:11.924 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:11.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:11.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:11.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:11.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:11.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:11.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:11.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:11.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:11.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:11.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:11.927 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:11.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:11.927 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:11.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.928 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.928 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:11.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:11.928 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.928 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.928 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.928 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:11.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:11.928 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.928 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.928 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.929 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:44125 5.9 e28/22 5:9022696f:::benchmark_data_smithi043_32659_object44124:head v 28'2753, mlcod=28'2751)", 2024-09-12T22:04:11.929 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:11.929 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.211214708, 2024-09-12T22:04:11.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042744011999999998, 2024-09-12T22:04:11.929 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.929 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.929 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.929 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:11.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:11.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633676+0000", 2024-09-12T22:04:11.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.44e-07 2024-09-12T22:04:11.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.931 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633755+0000", 2024-09-12T22:04:11.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9629000000000006e-05 2024-09-12T22:04:11.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.931 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674386+0000", 2024-09-12T22:04:11.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631364000000003 2024-09-12T22:04:11.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674399+0000", 2024-09-12T22:04:11.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2047e-05 2024-09-12T22:04:11.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.932 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674453+0000", 2024-09-12T22:04:11.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4453999999999997e-05 2024-09-12T22:04:11.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.932 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674479+0000", 2024-09-12T22:04:11.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6064999999999999e-05 2024-09-12T22:04:11.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.933 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676381+0000", 2024-09-12T22:04:11.933 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001901874 2024-09-12T22:04:11.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.933 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676419+0000", 2024-09-12T22:04:11.933 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7935000000000002e-05 2024-09-12T22:04:11.933 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.933 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.933 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.934 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44103 5.8 e28/22 ondisk, result = 0)", 2024-09-12T22:04:11.934 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:11.934 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.2107087400000003, 2024-09-12T22:04:11.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042322950999999998, 2024-09-12T22:04:11.934 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.934 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.934 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:11.934 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:11.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:11.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:11.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:04:11.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634184+0000", 2024-09-12T22:04:11.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7690000000000001e-06 2024-09-12T22:04:11.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674407+0000", 2024-09-12T22:04:11.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040222750000000002 2024-09-12T22:04:11.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674417+0000", 2024-09-12T22:04:11.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0125e-05 2024-09-12T22:04:11.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.939 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676387+0000", 2024-09-12T22:04:11.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001970112 2024-09-12T22:04:11.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.939 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676394+0000", 2024-09-12T22:04:11.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:04:11.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676504+0000", 2024-09-12T22:04:11.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109621 2024-09-12T22:04:11.940 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.940 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.940 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.941 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44128 5.d 5:b9a92891:::benchmark_data_smithi043_32659_object44127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.941 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:11.941 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.1704559510000001, 2024-09-12T22:04:11.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040118138999999997, 2024-09-12T22:04:11.941 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.941 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.941 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.941 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.941 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.941 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.941 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44128 2024-09-12T22:04:11.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.942 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:11.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:11.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674435+0000", 2024-09-12T22:04:11.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5960000000000001e-06 2024-09-12T22:04:11.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674485+0000", 2024-09-12T22:04:11.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0021000000000001e-05 2024-09-12T22:04:11.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674495+0000", 2024-09-12T22:04:11.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5189999999999998e-06 2024-09-12T22:04:11.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674500+0000", 2024-09-12T22:04:11.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:04:11.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674923+0000", 2024-09-12T22:04:11.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000423304 2024-09-12T22:04:11.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675027+0000", 2024-09-12T22:04:11.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103399 2024-09-12T22:04:11.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:11.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675141+0000", 2024-09-12T22:04:11.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114274 2024-09-12T22:04:11.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711649+0000", 2024-09-12T22:04:11.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036508011999999999 2024-09-12T22:04:11.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714466+0000", 2024-09-12T22:04:11.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028167370000000001 2024-09-12T22:04:11.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.947 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.947 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714508+0000", 2024-09-12T22:04:11.947 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2679000000000003e-05 2024-09-12T22:04:11.947 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.947 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.947 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714552+0000", 2024-09-12T22:04:11.947 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3528000000000001e-05 2024-09-12T22:04:11.947 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.947 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.948 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.948 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44129 5.0 5:0f626cda:::benchmark_data_smithi043_32659_object44128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.948 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:11.948 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.1703804460000002, 2024-09-12T22:04:11.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042846404999999997, 2024-09-12T22:04:11.948 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.948 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.948 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.948 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.949 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.949 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.949 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44129 2024-09-12T22:04:11.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.949 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:11.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:11.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674510+0000", 2024-09-12T22:04:11.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1600000000000002e-07 2024-09-12T22:04:11.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674548+0000", 2024-09-12T22:04:11.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8075999999999999e-05 2024-09-12T22:04:11.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674689+0000", 2024-09-12T22:04:11.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014141499999999999 2024-09-12T22:04:11.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674696+0000", 2024-09-12T22:04:11.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4619999999999999e-06 2024-09-12T22:04:11.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713666+0000", 2024-09-12T22:04:11.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.038969072 2024-09-12T22:04:11.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713752+0000", 2024-09-12T22:04:11.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6768999999999995e-05 2024-09-12T22:04:11.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713835+0000", 2024-09-12T22:04:11.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2774000000000004e-05 2024-09-12T22:04:11.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717212+0000", 2024-09-12T22:04:11.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033769389999999998 2024-09-12T22:04:11.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717259+0000", 2024-09-12T22:04:11.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7218000000000001e-05 2024-09-12T22:04:11.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717310+0000", 2024-09-12T22:04:11.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1156999999999998e-05 2024-09-12T22:04:11.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717356+0000", 2024-09-12T22:04:11.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5107e-05 2024-09-12T22:04:11.954 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.955 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.955 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.955 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44130 5.4 5:27857918:::benchmark_data_smithi043_32659_object44129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.955 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:11.955 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.1701825919999997, 2024-09-12T22:04:11.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039844412000000003, 2024-09-12T22:04:11.955 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.955 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.955 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.956 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.956 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.956 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.956 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44130 2024-09-12T22:04:11.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.956 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:11.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:11.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674708+0000", 2024-09-12T22:04:11.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4300000000000003e-07 2024-09-12T22:04:11.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674749+0000", 2024-09-12T22:04:11.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1254999999999997e-05 2024-09-12T22:04:11.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674756+0000", 2024-09-12T22:04:11.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3289999999999996e-06 2024-09-12T22:04:11.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674762+0000", 2024-09-12T22:04:11.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.852e-06 2024-09-12T22:04:11.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:11.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9573999999999995e-05 2024-09-12T22:04:11.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674954+0000", 2024-09-12T22:04:11.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012254200000000001 2024-09-12T22:04:11.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675033+0000", 2024-09-12T22:04:11.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8707000000000004e-05 2024-09-12T22:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714381+0000", 2024-09-12T22:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039348053000000001 2024-09-12T22:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714477+0000", 2024-09-12T22:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5650999999999996e-05 2024-09-12T22:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714516+0000", 2024-09-12T22:04:11.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9158e-05 2024-09-12T22:04:11.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714551+0000", 2024-09-12T22:04:11.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5648000000000002e-05 2024-09-12T22:04:11.961 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.961 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.961 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.961 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44131 5.0 5:013256f7:::benchmark_data_smithi043_32659_object44130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.962 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:11.962 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.1701101249999999, 2024-09-12T22:04:11.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043388599, 2024-09-12T22:04:11.962 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.962 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.962 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.962 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.962 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.962 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.962 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44131 2024-09-12T22:04:11.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.962 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:11.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:11.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674780+0000", 2024-09-12T22:04:11.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:11.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674817+0000", 2024-09-12T22:04:11.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6859000000000001e-05 2024-09-12T22:04:11.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:11.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.501e-05 2024-09-12T22:04:11.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674838+0000", 2024-09-12T22:04:11.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-06 2024-09-12T22:04:11.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715161+0000", 2024-09-12T22:04:11.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.04032285 2024-09-12T22:04:11.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715317+0000", 2024-09-12T22:04:11.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015649199999999999 2024-09-12T22:04:11.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715463+0000", 2024-09-12T22:04:11.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145704 2024-09-12T22:04:11.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717480+0000", 2024-09-12T22:04:11.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020168220000000001 2024-09-12T22:04:11.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718079+0000", 2024-09-12T22:04:11.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000599115 2024-09-12T22:04:11.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718134+0000", 2024-09-12T22:04:11.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:04:11.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718168+0000", 2024-09-12T22:04:11.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4301000000000002e-05 2024-09-12T22:04:11.968 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.968 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.968 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.968 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44132 5.e 5:7634b859:::benchmark_data_smithi043_32659_object44131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.968 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:11.968 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.1694428849999996, 2024-09-12T22:04:11.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039558587999999999, 2024-09-12T22:04:11.969 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.969 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.969 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.969 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.969 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.969 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.969 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44132 2024-09-12T22:04:11.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.969 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:11.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:11.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675448+0000", 2024-09-12T22:04:11.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3699999999999999e-07 2024-09-12T22:04:11.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675552+0000", 2024-09-12T22:04:11.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104294 2024-09-12T22:04:11.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675562+0000", 2024-09-12T22:04:11.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9629999999999993e-06 2024-09-12T22:04:11.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675569+0000", 2024-09-12T22:04:11.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8809999999999998e-06 2024-09-12T22:04:11.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675612+0000", 2024-09-12T22:04:11.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591000000000003e-05 2024-09-12T22:04:11.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675717+0000", 2024-09-12T22:04:11.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010497099999999999 2024-09-12T22:04:11.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675835+0000", 2024-09-12T22:04:11.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011793799999999999 2024-09-12T22:04:11.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713616+0000", 2024-09-12T22:04:11.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037781032999999999 2024-09-12T22:04:11.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714911+0000", 2024-09-12T22:04:11.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001294604 2024-09-12T22:04:11.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714964+0000", 2024-09-12T22:04:11.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3408000000000001e-05 2024-09-12T22:04:11.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715005+0000", 2024-09-12T22:04:11.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0967999999999998e-05 2024-09-12T22:04:11.975 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.975 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.975 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.975 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44133 5.b 5:d0a59edd:::benchmark_data_smithi043_32659_object44132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:11.975 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:11.975 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.1693051050000003, 2024-09-12T22:04:11.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039513020000000003, 2024-09-12T22:04:11.975 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:11.976 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:11.976 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:11.976 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:11.976 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:11.976 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:11.976 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44133 2024-09-12T22:04:11.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.976 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:11.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:11.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:11.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:11.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:11.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:11.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:11.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675585+0000", 2024-09-12T22:04:11.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5499999999999998e-07 2024-09-12T22:04:11.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:11.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675634+0000", 2024-09-12T22:04:11.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8520999999999998e-05 2024-09-12T22:04:11.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:11.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675641+0000", 2024-09-12T22:04:11.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4440000000000002e-06 2024-09-12T22:04:11.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:11.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675646+0000", 2024-09-12T22:04:11.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2660000000000001e-06 2024-09-12T22:04:11.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:11.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675692+0000", 2024-09-12T22:04:11.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5915999999999999e-05 2024-09-12T22:04:11.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:11.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675812+0000", 2024-09-12T22:04:11.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119419 2024-09-12T22:04:11.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:11.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675950+0000", 2024-09-12T22:04:11.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013831499999999999 2024-09-12T22:04:11.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:11.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713574+0000", 2024-09-12T22:04:11.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037623801999999998 2024-09-12T22:04:11.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:11.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715015+0000", 2024-09-12T22:04:11.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014410720000000001 2024-09-12T22:04:11.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:11.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715059+0000", 2024-09-12T22:04:11.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:04:11.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:11.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:11.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:11.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715097+0000", 2024-09-12T22:04:11.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8519000000000002e-05 2024-09-12T22:04:11.981 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.981 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.981 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.982 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:11.982 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:11.982 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:11.983 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:11.982+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:11.984 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:04:12.084 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:12.082+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:12.158 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:04:12.158 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T22:04:12.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.158 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:64749 5.b e30/22 5:d5ab6230:::benchmark_data_smithi043_32659_object64748:head v 30'4008, mlcod=30'4006)", 2024-09-12T22:04:12.158 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.152277+0000", 2024-09-12T22:04:12.158 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0034278220000000001, 2024-09-12T22:04:12.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0034503979999999999, 2024-09-12T22:04:12.158 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.158 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.159 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:12.159 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152277+0000", 2024-09-12T22:04:12.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152277+0000", 2024-09-12T22:04:12.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152277+0000", 2024-09-12T22:04:12.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7800000000000002e-07 2024-09-12T22:04:12.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152342+0000", 2024-09-12T22:04:12.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4381999999999994e-05 2024-09-12T22:04:12.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152352+0000", 2024-09-12T22:04:12.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0478e-05 2024-09-12T22:04:12.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152359+0000", 2024-09-12T22:04:12.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3080000000000004e-06 2024-09-12T22:04:12.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152413+0000", 2024-09-12T22:04:12.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4197999999999998e-05 2024-09-12T22:04:12.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152429+0000", 2024-09-12T22:04:12.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5841999999999998e-05 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:64750 5.c 5:3f5d4a86:::benchmark_data_smithi043_32659_object64749:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.152605+0000", 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0031002360000000001, 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003195051, 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:12.162 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 64750 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152605+0000", 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152605+0000", 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152606+0000", 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.223e-06 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152636+0000", 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0496000000000001e-05 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152645+0000", 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0680000000000003e-06 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152652+0000", 2024-09-12T22:04:12.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6109999999999999e-06 2024-09-12T22:04:12.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152753+0000", 2024-09-12T22:04:12.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101347 2024-09-12T22:04:12.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152870+0000", 2024-09-12T22:04:12.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116409 2024-09-12T22:04:12.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:12.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152998+0000", 2024-09-12T22:04:12.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000128207 2024-09-12T22:04:12.166 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.166 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.166 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.166 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:64751 5.c 5.d388e38c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:12.167 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.152670+0000", 2024-09-12T22:04:12.167 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0030351169999999999, 2024-09-12T22:04:12.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032136759999999999, 2024-09-12T22:04:12.167 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.167 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.167 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:12.167 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:12.167 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:12.167 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.167 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 64751 2024-09-12T22:04:12.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.168 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152670+0000", 2024-09-12T22:04:12.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152670+0000", 2024-09-12T22:04:12.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152670+0000", 2024-09-12T22:04:12.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:12.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152698+0000", 2024-09-12T22:04:12.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7250000000000002e-05 2024-09-12T22:04:12.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152705+0000", 2024-09-12T22:04:12.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3749999999999997e-06 2024-09-12T22:04:12.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152711+0000", 2024-09-12T22:04:12.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1460000000000001e-06 2024-09-12T22:04:12.171 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.171 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.171 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.171 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop_reply(client.4514.0:64739 5.c e30/22)", 2024-09-12T22:04:12.171 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.152825+0000", 2024-09-12T22:04:12.171 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0028799329999999999, 2024-09-12T22:04:12.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031138089999999999, 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152825+0000", 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152825+0000", 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152826+0000", 2024-09-12T22:04:12.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.37e-07 2024-09-12T22:04:12.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152830+0000", 2024-09-12T22:04:12.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.07e-06 2024-09-12T22:04:12.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152844+0000", 2024-09-12T22:04:12.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.411e-05 2024-09-12T22:04:12.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.152851+0000", 2024-09-12T22:04:12.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8650000000000003e-06 2024-09-12T22:04:12.174 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.174 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.174 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.174 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:64752 5.6 5:67db6465:::benchmark_data_smithi043_32659_object64751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:12.174 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.153442+0000", 2024-09-12T22:04:12.175 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0022627049999999998, 2024-09-12T22:04:12.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025594979999999999, 2024-09-12T22:04:12.175 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.175 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.175 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:12.175 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:12.175 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:12.175 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.176 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 64752 2024-09-12T22:04:12.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.176 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.153442+0000", 2024-09-12T22:04:12.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.153442+0000", 2024-09-12T22:04:12.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.153443+0000", 2024-09-12T22:04:12.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6199999999999996e-07 2024-09-12T22:04:12.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.153504+0000", 2024-09-12T22:04:12.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0906999999999998e-05 2024-09-12T22:04:12.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.153515+0000", 2024-09-12T22:04:12.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0536e-05 2024-09-12T22:04:12.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.153521+0000", 2024-09-12T22:04:12.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.426e-06 2024-09-12T22:04:12.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.153576+0000", 2024-09-12T22:04:12.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5238999999999997e-05 2024-09-12T22:04:12.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.153695+0000", 2024-09-12T22:04:12.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011888 2024-09-12T22:04:12.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:12.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.153818+0000", 2024-09-12T22:04:12.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012331000000000001 2024-09-12T22:04:12.181 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.181 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.181 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.181 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:64753 5.b e30/22 5:d27ef657:::benchmark_data_smithi043_32659_object64752:head v 30'4009, mlcod=30'4006)", 2024-09-12T22:04:12.181 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.154147+0000", 2024-09-12T22:04:12.181 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.001558151, 2024-09-12T22:04:12.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001930232, 2024-09-12T22:04:12.181 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.181 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154147+0000", 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154147+0000", 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154147+0000", 2024-09-12T22:04:12.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7199999999999998e-07 2024-09-12T22:04:12.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154193+0000", 2024-09-12T22:04:12.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6057000000000003e-05 2024-09-12T22:04:12.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154202+0000", 2024-09-12T22:04:12.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7709999999999995e-06 2024-09-12T22:04:12.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154209+0000", 2024-09-12T22:04:12.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2820000000000002e-06 2024-09-12T22:04:12.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154976+0000", 2024-09-12T22:04:12.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076758600000000001 2024-09-12T22:04:12.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154993+0000", 2024-09-12T22:04:12.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6402e-05 2024-09-12T22:04:12.184 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.185 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.185 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.185 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:64755 5.4 e30/22 5:211f849a:::benchmark_data_smithi043_32659_object64754:head v 30'4098, mlcod=30'4095)", 2024-09-12T22:04:12.185 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.154412+0000", 2024-09-12T22:04:12.185 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0012926159999999999, 2024-09-12T22:04:12.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017232580000000001, 2024-09-12T22:04:12.185 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.185 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.185 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:12.185 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154412+0000", 2024-09-12T22:04:12.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154412+0000", 2024-09-12T22:04:12.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154413+0000", 2024-09-12T22:04:12.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3200000000000005e-07 2024-09-12T22:04:12.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154532+0000", 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118755 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154562+0000", 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9859e-05 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154568+0000", 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.241e-06 2024-09-12T22:04:12.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154829+0000", 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026144299999999998 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154850+0000", 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1263999999999998e-05 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.188 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:64756 5.1 e30/22 5:86e10bfa:::benchmark_data_smithi043_32659_object64755:head v 30'3937, mlcod=30'3935)", 2024-09-12T22:04:12.189 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.154457+0000", 2024-09-12T22:04:12.189 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0012474949999999999, 2024-09-12T22:04:12.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017389110000000001, 2024-09-12T22:04:12.189 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.189 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.189 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:12.189 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154457+0000", 2024-09-12T22:04:12.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154457+0000", 2024-09-12T22:04:12.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154458+0000", 2024-09-12T22:04:12.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6000000000000003e-07 2024-09-12T22:04:12.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154545+0000", 2024-09-12T22:04:12.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6738999999999997e-05 2024-09-12T22:04:12.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154568+0000", 2024-09-12T22:04:12.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3229000000000001e-05 2024-09-12T22:04:12.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154584+0000", 2024-09-12T22:04:12.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6055000000000001e-05 2024-09-12T22:04:12.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154643+0000", 2024-09-12T22:04:12.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:04:12.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154664+0000", 2024-09-12T22:04:12.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1467e-05 2024-09-12T22:04:12.195 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.195 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.195 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.195 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:64758 5.e e30/22 5:7fb965bf:::benchmark_data_smithi043_32659_object64757:head v 30'4054, mlcod=30'4052)", 2024-09-12T22:04:12.195 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.154586+0000", 2024-09-12T22:04:12.196 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0011185909999999999, 2024-09-12T22:04:12.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001672109, 2024-09-12T22:04:12.196 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.196 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.196 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:12.196 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154586+0000", 2024-09-12T22:04:12.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154586+0000", 2024-09-12T22:04:12.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154587+0000", 2024-09-12T22:04:12.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4199999999999996e-07 2024-09-12T22:04:12.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154647+0000", 2024-09-12T22:04:12.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0377999999999997e-05 2024-09-12T22:04:12.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154653+0000", 2024-09-12T22:04:12.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6380000000000001e-06 2024-09-12T22:04:12.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154656+0000", 2024-09-12T22:04:12.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4489999999999999e-06 2024-09-12T22:04:12.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154693+0000", 2024-09-12T22:04:12.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6646000000000001e-05 2024-09-12T22:04:12.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154711+0000", 2024-09-12T22:04:12.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7620000000000001e-05 2024-09-12T22:04:12.199 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.199 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.199 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.200 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:64757 5.7 e30/22 5:e5c7193f:::benchmark_data_smithi043_32659_object64756:head v 30'4053, mlcod=30'4051)", 2024-09-12T22:04:12.200 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.154613+0000", 2024-09-12T22:04:12.200 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0010921800000000001, 2024-09-12T22:04:12.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017053470000000001, 2024-09-12T22:04:12.200 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.200 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.200 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:12.200 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154613+0000", 2024-09-12T22:04:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154613+0000", 2024-09-12T22:04:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154613+0000", 2024-09-12T22:04:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1699999999999999e-07 2024-09-12T22:04:12.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154664+0000", 2024-09-12T22:04:12.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0541999999999998e-05 2024-09-12T22:04:12.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154672+0000", 2024-09-12T22:04:12.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1810000000000001e-06 2024-09-12T22:04:12.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154678+0000", 2024-09-12T22:04:12.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8270000000000003e-06 2024-09-12T22:04:12.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154715+0000", 2024-09-12T22:04:12.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7051000000000002e-05 2024-09-12T22:04:12.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154730+0000", 2024-09-12T22:04:12.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5427999999999999e-05 2024-09-12T22:04:12.204 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.204 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.204 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.204 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop_reply(client.4514.0:64750 5.c e30/22 ondisk, result = 0)", 2024-09-12T22:04:12.205 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.154759+0000", 2024-09-12T22:04:12.205 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.000946192, 2024-09-12T22:04:12.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001616585, 2024-09-12T22:04:12.205 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.205 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.205 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:12.205 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154759+0000", 2024-09-12T22:04:12.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154759+0000", 2024-09-12T22:04:12.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154759+0000", 2024-09-12T22:04:12.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0999999999999998e-07 2024-09-12T22:04:12.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154762+0000", 2024-09-12T22:04:12.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0429999999999999e-06 2024-09-12T22:04:12.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154770+0000", 2024-09-12T22:04:12.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4070000000000004e-06 2024-09-12T22:04:12.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.154775+0000", 2024-09-12T22:04:12.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3260000000000003e-06 2024-09-12T22:04:12.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.156239+0000", 2024-09-12T22:04:12.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001463724 2024-09-12T22:04:12.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.156245+0000", 2024-09-12T22:04:12.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:04:12.208 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.208 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.208 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.209 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:64760 5.2 e30/22 5:427c273c:::benchmark_data_smithi043_32659_object64759:head v 30'4118, mlcod=30'4116)", 2024-09-12T22:04:12.209 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.155969+0000", 2024-09-12T22:04:12.209 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9997358, 2024-09-12T22:04:12.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046759900000000002, 2024-09-12T22:04:12.209 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.209 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.209 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:12.209 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.155969+0000", 2024-09-12T22:04:12.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.155969+0000", 2024-09-12T22:04:12.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.155969+0000", 2024-09-12T22:04:12.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4400000000000001e-07 2024-09-12T22:04:12.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.155998+0000", 2024-09-12T22:04:12.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8844999999999999e-05 2024-09-12T22:04:12.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.156020+0000", 2024-09-12T22:04:12.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1365999999999998e-05 2024-09-12T22:04:12.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.156026+0000", 2024-09-12T22:04:12.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4799999999999998e-06 2024-09-12T22:04:12.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.156086+0000", 2024-09-12T22:04:12.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9483e-05 2024-09-12T22:04:12.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.156102+0000", 2024-09-12T22:04:12.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6572999999999999e-05 2024-09-12T22:04:12.212 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.212 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.213 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.213 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:64759 5.e e30/22)", 2024-09-12T22:04:12.213 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.156277+0000", 2024-09-12T22:04:12.213 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4294967295.9994283, 2024-09-12T22:04:12.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000217378, 2024-09-12T22:04:12.213 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.213 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.213 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:12.213 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.156277+0000", 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.156277+0000", 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.156277+0000", 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.156305+0000", 2024-09-12T22:04:12.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7441999999999999e-05 2024-09-12T22:04:12.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.156313+0000", 2024-09-12T22:04:12.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2139999999999996e-06 2024-09-12T22:04:12.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.156319+0000", 2024-09-12T22:04:12.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6910000000000002e-06 2024-09-12T22:04:12.215 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.215 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.216 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.216 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:64733 5.4 e30/22 5:2e608990:::benchmark_data_smithi043_32659_object64732:head v 30'4097, mlcod=30'4095)", 2024-09-12T22:04:12.216 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.149037+0000", 2024-09-12T22:04:12.216 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0066683589999999996, 2024-09-12T22:04:12.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0075127589999999999, 2024-09-12T22:04:12.216 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.216 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.216 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:12.216 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.149037+0000", 2024-09-12T22:04:12.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.149037+0000", 2024-09-12T22:04:12.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.149037+0000", 2024-09-12T22:04:12.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0999999999999998e-07 2024-09-12T22:04:12.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.149075+0000", 2024-09-12T22:04:12.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7790000000000002e-05 2024-09-12T22:04:12.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.149087+0000", 2024-09-12T22:04:12.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1647999999999999e-05 2024-09-12T22:04:12.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.149093+0000", 2024-09-12T22:04:12.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6189999999999996e-06 2024-09-12T22:04:12.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.150100+0000", 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010070529999999999 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.150119+0000", 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8346999999999999e-05 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 14 2024-09-12T22:04:12.219 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:04:12.221 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 18 16 64843 64827 225.076 164.25 0.00990606 0.00443997 2024-09-12T22:04:12.221 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:12.219+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:12.222 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:04:12.321 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:12.319+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:12.360 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:04:12.391 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:04:12.391 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T22:04:12.391 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T22:04:12.391 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T22:04:12.391 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:04:12.405 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:04:12.450 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:12.449+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:12.523 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:12.522+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:12.573 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:04:12.573 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T22:04:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T22:04:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T22:04:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:04:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.120735934999999, 2024-09-12T22:04:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017423646000000001, 2024-09-12T22:04:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449724+0000", 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449728+0000", 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449750+0000", 2024-09-12T22:04:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2391e-05 2024-09-12T22:04:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449775+0000", 2024-09-12T22:04:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4831999999999999e-05 2024-09-12T22:04:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449785+0000", 2024-09-12T22:04:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0361e-05 2024-09-12T22:04:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449857+0000", 2024-09-12T22:04:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1990999999999996e-05 2024-09-12T22:04:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449863+0000", 2024-09-12T22:04:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6570000000000002e-06 2024-09-12T22:04:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462558+0000", 2024-09-12T22:04:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012695032 2024-09-12T22:04:12.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462703+0000", 2024-09-12T22:04:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014444100000000001 2024-09-12T22:04:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462853+0000", 2024-09-12T22:04:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015042300000000001 2024-09-12T22:04:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465147+0000", 2024-09-12T22:04:12.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022944789999999999 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467012+0000", 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018646030000000001 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467095+0000", 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2695999999999996e-05 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467148+0000", 2024-09-12T22:04:12.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2958999999999999e-05 2024-09-12T22:04:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:04:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.120647091999999, 2024-09-12T22:04:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018410795000000001, 2024-09-12T22:04:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:04:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449813+0000", 2024-09-12T22:04:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449814+0000", 2024-09-12T22:04:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:04:12.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449827+0000", 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3373000000000001e-05 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.081e-06 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449853+0000", 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7181e-05 2024-09-12T22:04:12.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449914+0000", 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.0736000000000003e-05 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449921+0000", 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2559999999999996e-06 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461147+0000", 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011226211999999999 2024-09-12T22:04:12.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461353+0000", 2024-09-12T22:04:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000205217 2024-09-12T22:04:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461512+0000", 2024-09-12T22:04:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015960700000000001 2024-09-12T22:04:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:12.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464643+0000", 2024-09-12T22:04:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003130238 2024-09-12T22:04:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468132+0000", 2024-09-12T22:04:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0034897109999999999 2024-09-12T22:04:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468182+0000", 2024-09-12T22:04:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0209e-05 2024-09-12T22:04:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468224+0000", 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1199000000000003e-05 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.120589617, 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017523931, 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.586 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:04:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449870+0000", 2024-09-12T22:04:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449871+0000", 2024-09-12T22:04:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449890+0000", 2024-09-12T22:04:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9245999999999998e-05 2024-09-12T22:04:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449899+0000", 2024-09-12T22:04:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1530000000000003e-06 2024-09-12T22:04:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449905+0000", 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8100000000000003e-06 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449942+0000", 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7119000000000002e-05 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449945+0000", 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0529999999999998e-06 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463125+0000", 2024-09-12T22:04:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013179326 2024-09-12T22:04:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463171+0000", 2024-09-12T22:04:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6455000000000002e-05 2024-09-12T22:04:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463242+0000", 2024-09-12T22:04:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0430000000000002e-05 2024-09-12T22:04:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465152+0000", 2024-09-12T22:04:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001910082 2024-09-12T22:04:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467291+0000", 2024-09-12T22:04:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021394119999999998 2024-09-12T22:04:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467351+0000", 2024-09-12T22:04:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9673999999999998e-05 2024-09-12T22:04:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467394+0000", 2024-09-12T22:04:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3477999999999999e-05 2024-09-12T22:04:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:04:12.592 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.12054251, 2024-09-12T22:04:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018417978000000002, 2024-09-12T22:04:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:04:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449917+0000", 2024-09-12T22:04:12.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449918+0000", 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449923+0000", 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1959999999999999e-06 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449928+0000", 2024-09-12T22:04:12.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3989999999999997e-06 2024-09-12T22:04:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449931+0000", 2024-09-12T22:04:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5750000000000001e-06 2024-09-12T22:04:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449968+0000", 2024-09-12T22:04:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7209999999999998e-05 2024-09-12T22:04:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:12.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449974+0000", 2024-09-12T22:04:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9730000000000002e-06 2024-09-12T22:04:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462282+0000", 2024-09-12T22:04:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012308102 2024-09-12T22:04:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462368+0000", 2024-09-12T22:04:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5920000000000004e-05 2024-09-12T22:04:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462490+0000", 2024-09-12T22:04:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121478 2024-09-12T22:04:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465141+0000", 2024-09-12T22:04:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026515990000000001 2024-09-12T22:04:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468273+0000", 2024-09-12T22:04:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003131736 2024-09-12T22:04:12.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468308+0000", 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4572e-05 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468335+0000", 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7727999999999999e-05 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.598 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.120523636999998, 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018483090000000001, 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449936+0000", 2024-09-12T22:04:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449937+0000", 2024-09-12T22:04:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0699999999999999e-07 2024-09-12T22:04:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449939+0000", 2024-09-12T22:04:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.853e-06 2024-09-12T22:04:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449943+0000", 2024-09-12T22:04:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8999999999999999e-06 2024-09-12T22:04:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449956+0000", 2024-09-12T22:04:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2843000000000001e-05 2024-09-12T22:04:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:04:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0277000000000002e-05 2024-09-12T22:04:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449990+0000", 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1410000000000001e-06 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463480+0000", 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013490564 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463553+0000", 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3094000000000002e-05 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463629+0000", 2024-09-12T22:04:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5610000000000003e-05 2024-09-12T22:04:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.465158+0000", 2024-09-12T22:04:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015294169999999999 2024-09-12T22:04:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468328+0000", 2024-09-12T22:04:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031699699999999998 2024-09-12T22:04:12.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468381+0000", 2024-09-12T22:04:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2398000000000002e-05 2024-09-12T22:04:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468419+0000", 2024-09-12T22:04:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8816000000000002e-05 2024-09-12T22:04:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.120495095000003, 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017182808000000001, 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449965+0000", 2024-09-12T22:04:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2500000000000001e-07 2024-09-12T22:04:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449968+0000", 2024-09-12T22:04:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7140000000000002e-06 2024-09-12T22:04:12.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449975+0000", 2024-09-12T22:04:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:04:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.449980+0000", 2024-09-12T22:04:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1659999999999996e-06 2024-09-12T22:04:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450048+0000", 2024-09-12T22:04:12.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8823000000000002e-05 2024-09-12T22:04:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450052+0000", 2024-09-12T22:04:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8689999999999997e-06 2024-09-12T22:04:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461166+0000", 2024-09-12T22:04:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011114166999999999 2024-09-12T22:04:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461279+0000", 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000112212 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461417+0000", 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000138202 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.463371+0000", 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019543120000000001 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467009+0000", 2024-09-12T22:04:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036383180000000002 2024-09-12T22:04:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467109+0000", 2024-09-12T22:04:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9601999999999999e-05 2024-09-12T22:04:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467148+0000", 2024-09-12T22:04:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8618000000000002e-05 2024-09-12T22:04:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:33 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.120449039999997, 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017404473, 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450011+0000", 2024-09-12T22:04:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450012+0000", 2024-09-12T22:04:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999996e-07 2024-09-12T22:04:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450016+0000", 2024-09-12T22:04:12.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9389999999999999e-06 2024-09-12T22:04:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:04:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8209999999999997e-06 2024-09-12T22:04:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450036+0000", 2024-09-12T22:04:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0496000000000001e-05 2024-09-12T22:04:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9070999999999997e-05 2024-09-12T22:04:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450100+0000", 2024-09-12T22:04:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0089999999999998e-06 2024-09-12T22:04:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.461992+0000", 2024-09-12T22:04:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011891868999999999 2024-09-12T22:04:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.462124+0000", 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013271299999999999 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.467415+0000", 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052909029999999996 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:04:12.615 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.120410800000002, 2024-09-12T22:04:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018455814000000001, 2024-09-12T22:04:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:04:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450049+0000", 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450050+0000", 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2e-07 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450053+0000", 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0819999999999999e-06 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450061+0000", 2024-09-12T22:04:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8169999999999999e-06 2024-09-12T22:04:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450080+0000", 2024-09-12T22:04:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9219999999999999e-05 2024-09-12T22:04:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:04:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0834000000000002e-05 2024-09-12T22:04:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450123+0000", 2024-09-12T22:04:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5830000000000001e-06 2024-09-12T22:04:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464167+0000", 2024-09-12T22:04:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014043517 2024-09-12T22:04:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.464298+0000", 2024-09-12T22:04:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013117099999999999 2024-09-12T22:04:12.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468505+0000", 2024-09-12T22:04:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042070700000000003 2024-09-12T22:04:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.120364940999998, 2024-09-12T22:04:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018063523000000001, 2024-09-12T22:04:12.620 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "started", 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450095+0000", 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450096+0000", 2024-09-12T22:04:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7899999999999998e-07 2024-09-12T22:04:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450100+0000", 2024-09-12T22:04:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:04:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450107+0000", 2024-09-12T22:04:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9269999999999999e-06 2024-09-12T22:04:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450112+0000", 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2909999999999998e-06 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450156+0000", 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3665999999999998e-05 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.450160+0000", 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.822e-06 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.459675+0000", 2024-09-12T22:04:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0095155039999999993 2024-09-12T22:04:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.459901+0000", 2024-09-12T22:04:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000225419 2024-09-12T22:04:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:03:33.468159+0000", 2024-09-12T22:04:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082579100000000003 2024-09-12T22:04:12.624 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:51741 5.3 5:cf99c5ea:::benchmark_data_smithi043_32659_object51740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:07.357302+0000", 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.2131581919999999, 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014352165, 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.625 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 51741 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.357302+0000", 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.357302+0000", 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.357302+0000", 2024-09-12T22:04:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3499999999999996e-07 2024-09-12T22:04:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.357331+0000", 2024-09-12T22:04:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8506000000000001e-05 2024-09-12T22:04:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.357339+0000", 2024-09-12T22:04:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3189999999999995e-06 2024-09-12T22:04:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.357345+0000", 2024-09-12T22:04:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1160000000000004e-06 2024-09-12T22:04:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.363496+0000", 2024-09-12T22:04:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.006150445 2024-09-12T22:04:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.363619+0000", 2024-09-12T22:04:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012336899999999999 2024-09-12T22:04:12.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.363751+0000", 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013229600000000001 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.365972+0000", 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022205839999999998 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.371554+0000", 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055818999999999999 2024-09-12T22:04:12.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.371617+0000", 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3306999999999995e-05 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:07.371654+0000", 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6687999999999998e-05 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.630 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:55515 5.c 5:3b513521:::benchmark_data_smithi043_32659_object55514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.682703+0000", 2024-09-12T22:04:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.8877571570000002, 2024-09-12T22:04:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014862965000000001, 2024-09-12T22:04:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 55515 2024-09-12T22:04:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.682703+0000", 2024-09-12T22:04:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.682703+0000", 2024-09-12T22:04:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.682704+0000", 2024-09-12T22:04:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0599999999999999e-07 2024-09-12T22:04:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.682768+0000", 2024-09-12T22:04:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4703999999999996e-05 2024-09-12T22:04:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.682778+0000", 2024-09-12T22:04:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8130000000000007e-06 2024-09-12T22:04:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.682785+0000", 2024-09-12T22:04:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7959999999999998e-06 2024-09-12T22:04:12.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.690556+0000", 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0077704890000000002 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.690677+0000", 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121048 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.690830+0000", 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000153358 2024-09-12T22:04:12.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:12.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.695205+0000", 2024-09-12T22:04:12.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004374607 2024-09-12T22:04:12.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:12.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.697472+0000", 2024-09-12T22:04:12.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002267659 2024-09-12T22:04:12.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.697525+0000", 2024-09-12T22:04:12.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2729999999999998e-05 2024-09-12T22:04:12.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.697566+0000", 2024-09-12T22:04:12.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0855000000000001e-05 2024-09-12T22:04:12.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.636 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.636 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:55520 5.c 5:3c5c78a8:::benchmark_data_smithi043_32659_object55519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T22:04:12.636 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:08.683898+0000", 2024-09-12T22:04:12.636 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.8865622210000002, 2024-09-12T22:04:12.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014823622999999999, 2024-09-12T22:04:12.637 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.637 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.637 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.637 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:12.637 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:12.637 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.637 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 55520 2024-09-12T22:04:12.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.637 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683898+0000", 2024-09-12T22:04:12.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683898+0000", 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683899+0000", 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7499999999999998e-07 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683972+0000", 2024-09-12T22:04:12.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2929000000000006e-05 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683983+0000", 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1518999999999999e-05 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.683991+0000", 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2050000000000002e-06 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.695278+0000", 2024-09-12T22:04:12.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011286865 2024-09-12T22:04:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.695453+0000", 2024-09-12T22:04:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017522300000000001 2024-09-12T22:04:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.695579+0000", 2024-09-12T22:04:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012582000000000001 2024-09-12T22:04:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.698176+0000", 2024-09-12T22:04:12.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002597046 2024-09-12T22:04:12.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:12.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.698646+0000", 2024-09-12T22:04:12.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046971099999999999 2024-09-12T22:04:12.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.698688+0000", 2024-09-12T22:04:12.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1587e-05 2024-09-12T22:04:12.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:08.698721+0000", 2024-09-12T22:04:12.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3742999999999999e-05 2024-09-12T22:04:12.642 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.642 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.642 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.642 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:62947 5.a 5:51181ed5:::benchmark_data_smithi043_32659_object62946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:12.642 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:11.465485+0000", 2024-09-12T22:04:12.642 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.104975016, 2024-09-12T22:04:12.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01456548, 2024-09-12T22:04:12.642 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.642 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.642 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.643 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:12.643 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:12.643 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.643 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 62947 2024-09-12T22:04:12.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.643 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.465485+0000", 2024-09-12T22:04:12.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.465485+0000", 2024-09-12T22:04:12.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.465486+0000", 2024-09-12T22:04:12.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7100000000000011e-07 2024-09-12T22:04:12.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.465517+0000", 2024-09-12T22:04:12.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1581999999999997e-05 2024-09-12T22:04:12.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.465528+0000", 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0489000000000001e-05 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.465546+0000", 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.465594+0000", 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8115999999999998e-05 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.465694+0000", 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.9508999999999999e-05 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.465808+0000", 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000114337 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.468685+0000", 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028772099999999998 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.479942+0000", 2024-09-12T22:04:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011256812 2024-09-12T22:04:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.479999+0000", 2024-09-12T22:04:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6759000000000003e-05 2024-09-12T22:04:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.480050+0000", 2024-09-12T22:04:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1406000000000002e-05 2024-09-12T22:04:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.648 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.648 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:63200 5.a 5:52cd6b86:::benchmark_data_smithi043_32659_object63199:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:12.648 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:11.560014+0000", 2024-09-12T22:04:12.648 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.0104463429999999, 2024-09-12T22:04:12.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01596477, 2024-09-12T22:04:12.648 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.648 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.648 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.648 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:12.648 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:12.648 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.648 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 63200 2024-09-12T22:04:12.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.649 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.560014+0000", 2024-09-12T22:04:12.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.560014+0000", 2024-09-12T22:04:12.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.560014+0000", 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.06e-07 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.560045+0000", 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1090000000000002e-05 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.560055+0000", 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0054000000000001e-05 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.560062+0000", 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7329999999999997e-06 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.563952+0000", 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038894469999999999 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.564041+0000", 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9043999999999997e-05 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:12.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.564138+0000", 2024-09-12T22:04:12.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7354000000000003e-05 2024-09-12T22:04:12.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:12.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.566351+0000", 2024-09-12T22:04:12.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022131049999999999 2024-09-12T22:04:12.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:12.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.575891+0000", 2024-09-12T22:04:12.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0095397699999999995 2024-09-12T22:04:12.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.575940+0000", 2024-09-12T22:04:12.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8701e-05 2024-09-12T22:04:12.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:11.575978+0000", 2024-09-12T22:04:12.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8766000000000001e-05 2024-09-12T22:04:12.653 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.653 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.653 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.653 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:64631 5.0 e30/22 5:0e3068d4:::benchmark_data_smithi043_32659_object64630:head v 30'4105, mlcod=30'4100)", 2024-09-12T22:04:12.654 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.106891+0000", 2024-09-12T22:04:12.654 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.463569069, 2024-09-12T22:04:12.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016382087, 2024-09-12T22:04:12.654 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.654 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.654 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.654 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.106891+0000", 2024-09-12T22:04:12.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.106891+0000", 2024-09-12T22:04:12.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.106891+0000", 2024-09-12T22:04:12.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:04:12.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.106933+0000", 2024-09-12T22:04:12.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1458999999999997e-05 2024-09-12T22:04:12.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.106940+0000", 2024-09-12T22:04:12.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6120000000000001e-06 2024-09-12T22:04:12.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.106958+0000", 2024-09-12T22:04:12.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7628000000000001e-05 2024-09-12T22:04:12.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.108384+0000", 2024-09-12T22:04:12.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014255699999999999 2024-09-12T22:04:12.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.108401+0000", 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7212000000000001e-05 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.123217+0000", 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014815849000000001 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.123273+0000", 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6332000000000002e-05 2024-09-12T22:04:12.657 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.658 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.658 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.658 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:64634 5.8 e30/22 5:13c0f2f8:::benchmark_data_smithi043_32659_object64633:head v 30'3990, mlcod=30'3988)", 2024-09-12T22:04:12.658 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.106973+0000", 2024-09-12T22:04:12.658 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.46348719599999999, 2024-09-12T22:04:12.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014609218, 2024-09-12T22:04:12.658 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.658 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.658 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.658 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.106973+0000", 2024-09-12T22:04:12.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.106973+0000", 2024-09-12T22:04:12.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.106973+0000", 2024-09-12T22:04:12.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.34e-07 2024-09-12T22:04:12.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.107007+0000", 2024-09-12T22:04:12.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4220000000000001e-05 2024-09-12T22:04:12.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.107015+0000", 2024-09-12T22:04:12.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:04:12.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.107020+0000", 2024-09-12T22:04:12.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1599999999999997e-06 2024-09-12T22:04:12.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.108392+0000", 2024-09-12T22:04:12.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013720150000000001 2024-09-12T22:04:12.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.108410+0000", 2024-09-12T22:04:12.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8023e-05 2024-09-12T22:04:12.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.121535+0000", 2024-09-12T22:04:12.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013124800000000001 2024-09-12T22:04:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.121582+0000", 2024-09-12T22:04:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6907999999999999e-05 2024-09-12T22:04:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4514.0:64638 5.0 e30/22 5:0352d717:::benchmark_data_smithi043_32659_object64637:head v 30'4106, mlcod=30'4100)", 2024-09-12T22:04:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.108302+0000", 2024-09-12T22:04:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.46215794199999999, 2024-09-12T22:04:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015015175, 2024-09-12T22:04:12.663 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.663 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.663 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.663 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.108302+0000", 2024-09-12T22:04:12.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.108302+0000", 2024-09-12T22:04:12.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.108303+0000", 2024-09-12T22:04:12.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:12.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.108353+0000", 2024-09-12T22:04:12.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0257999999999999e-05 2024-09-12T22:04:12.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.108365+0000", 2024-09-12T22:04:12.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2425999999999999e-05 2024-09-12T22:04:12.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.108371+0000", 2024-09-12T22:04:12.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1240000000000002e-06 2024-09-12T22:04:12.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.110413+0000", 2024-09-12T22:04:12.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020418649999999999 2024-09-12T22:04:12.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.110430+0000", 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6634e-05 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.123276+0000", 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012846445999999999 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.123317+0000", 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0769000000000002e-05 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.667 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:65390 5.3 5:c8ecfab3:::benchmark_data_smithi043_32659_object65389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:12.667 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.400462+0000", 2024-09-12T22:04:12.667 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.169998184, 2024-09-12T22:04:12.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014352811, 2024-09-12T22:04:12.667 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.667 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.667 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.667 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:12.667 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:12.667 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.667 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 65390 2024-09-12T22:04:12.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.667 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.400462+0000", 2024-09-12T22:04:12.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.400462+0000", 2024-09-12T22:04:12.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.400462+0000", 2024-09-12T22:04:12.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6599999999999996e-07 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.400544+0000", 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1508999999999995e-05 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.400556+0000", 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2354999999999999e-05 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.400564+0000", 2024-09-12T22:04:12.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6620000000000005e-06 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.407285+0000", 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067208459999999999 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.407442+0000", 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015758300000000001 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.407586+0000", 2024-09-12T22:04:12.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014333099999999999 2024-09-12T22:04:12.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:12.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.412400+0000", 2024-09-12T22:04:12.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048145669999999996 2024-09-12T22:04:12.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:12.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.414674+0000", 2024-09-12T22:04:12.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022735049999999999 2024-09-12T22:04:12.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.414761+0000", 2024-09-12T22:04:12.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7294999999999997e-05 2024-09-12T22:04:12.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.414815+0000", 2024-09-12T22:04:12.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3492000000000002e-05 2024-09-12T22:04:12.672 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.672 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.672 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.672 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:65410 5.c 5:3d550a55:::benchmark_data_smithi043_32659_object65409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.410173+0000", 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.16028714799999999, 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014409346, 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 65410 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.410173+0000", 2024-09-12T22:04:12.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.410173+0000", 2024-09-12T22:04:12.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.410174+0000", 2024-09-12T22:04:12.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2699999999999999e-06 2024-09-12T22:04:12.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.410211+0000", 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6782000000000001e-05 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.410220+0000", 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1719999999999996e-06 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.410226+0000", 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4620000000000001e-06 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.412880+0000", 2024-09-12T22:04:12.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026538809999999999 2024-09-12T22:04:12.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.413002+0000", 2024-09-12T22:04:12.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012144799999999999 2024-09-12T22:04:12.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:12.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.413132+0000", 2024-09-12T22:04:12.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012984199999999999 2024-09-12T22:04:12.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.417488+0000", 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043559410000000003 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.424440+0000", 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0069523950000000001 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.424538+0000", 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7664999999999994e-05 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.424582+0000", 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4487999999999998e-05 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4514.0:65519 5.3 5:c79e646f:::benchmark_data_smithi043_32659_object65518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T22:04:12.454948+0000", 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.11551212199999999, 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014462271000000001, 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T22:04:12.678 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:12.679 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T22:04:12.679 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4514", 2024-09-12T22:04:12.679 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.679 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 65519 2024-09-12T22:04:12.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.679 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T22:04:12.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T22:04:12.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.454948+0000", 2024-09-12T22:04:12.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T22:04:12.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.454948+0000", 2024-09-12T22:04:12.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T22:04:12.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T22:04:12.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.454949+0000", 2024-09-12T22:04:12.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.066e-06 2024-09-12T22:04:12.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T22:04:12.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.454980+0000", 2024-09-12T22:04:12.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0611999999999998e-05 2024-09-12T22:04:12.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.454989+0000", 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5899999999999997e-06 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.454996+0000", 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7309999999999996e-06 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.457780+0000", 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027840450000000002 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.457896+0000", 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116296 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.458023+0000", 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012665800000000001 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.464565+0000", 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065417069999999999 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.469314+0000", 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047499150000000004 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.469369+0000", 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4134e-05 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T22:04:12.469410+0000", 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1517000000000002e-05 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.683 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.684 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T22:04:12.684 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T22:04:12.684 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:04:12.685 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:12.686 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:12.684+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:12.786 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:12.785+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:12.835 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:12.836 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:12.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.836 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:66477 5.2 5:4c8a970b:::benchmark_data_smithi043_32659_object66476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:12.836 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:12.822387+0000", 2024-09-12T22:04:12.836 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.011834338, 2024-09-12T22:04:12.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011861007, 2024-09-12T22:04:12.836 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:12.836 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:12.836 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:12.836 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:12.836 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:12.836 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.837 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 66477 2024-09-12T22:04:12.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.837 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:12.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:12.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.822387+0000", 2024-09-12T22:04:12.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:12.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.822387+0000", 2024-09-12T22:04:12.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:12.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.822388+0000", 2024-09-12T22:04:12.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4600000000000005e-07 2024-09-12T22:04:12.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:12.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.822417+0000", 2024-09-12T22:04:12.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9422999999999999e-05 2024-09-12T22:04:12.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:12.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.822424+0000", 2024-09-12T22:04:12.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9450000000000004e-06 2024-09-12T22:04:12.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.822430+0000", 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.502e-06 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.823248+0000", 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081785400000000002 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.823365+0000", 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117018 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:12.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.823492+0000", 2024-09-12T22:04:12.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012699799999999999 2024-09-12T22:04:12.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:12.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.825004+0000", 2024-09-12T22:04:12.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015122650000000001 2024-09-12T22:04:12.840 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.840 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:12.840 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.840 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:66497 5.2 5:4703802b:::benchmark_data_smithi043_32659_object66496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:12.840 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:12.830125+0000", 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0040971089999999998, 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042083679999999997, 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 66497 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830125+0000", 2024-09-12T22:04:12.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:12.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830125+0000", 2024-09-12T22:04:12.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:12.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830126+0000", 2024-09-12T22:04:12.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5600000000000004e-07 2024-09-12T22:04:12.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:12.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830229+0000", 2024-09-12T22:04:12.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010387600000000001 2024-09-12T22:04:12.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:12.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830241+0000", 2024-09-12T22:04:12.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1219e-05 2024-09-12T22:04:12.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830247+0000", 2024-09-12T22:04:12.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4910000000000002e-06 2024-09-12T22:04:12.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:12.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830289+0000", 2024-09-12T22:04:12.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1814000000000003e-05 2024-09-12T22:04:12.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:12.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830436+0000", 2024-09-12T22:04:12.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014734399999999999 2024-09-12T22:04:12.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:12.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830567+0000", 2024-09-12T22:04:12.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013105300000000001 2024-09-12T22:04:12.844 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.845 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:12.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.845 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:66499 5.f 5:f3fbad14:::benchmark_data_smithi043_32659_object66498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:12.845 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:12.830311+0000", 2024-09-12T22:04:12.845 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0039104109999999999, 2024-09-12T22:04:12.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040914870000000004, 2024-09-12T22:04:12.845 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:12.845 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:12.845 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:12.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:12.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:12.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.846 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 66499 2024-09-12T22:04:12.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.846 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:12.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:12.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830311+0000", 2024-09-12T22:04:12.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:12.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830311+0000", 2024-09-12T22:04:12.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:12.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830312+0000", 2024-09-12T22:04:12.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0999999999999998e-07 2024-09-12T22:04:12.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:12.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830443+0000", 2024-09-12T22:04:12.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013102200000000001 2024-09-12T22:04:12.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:12.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830451+0000", 2024-09-12T22:04:12.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9160000000000001e-06 2024-09-12T22:04:12.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830457+0000", 2024-09-12T22:04:12.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5690000000000004e-06 2024-09-12T22:04:12.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:12.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830498+0000", 2024-09-12T22:04:12.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1607999999999999e-05 2024-09-12T22:04:12.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:12.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830613+0000", 2024-09-12T22:04:12.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115158 2024-09-12T22:04:12.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:12.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.830733+0000", 2024-09-12T22:04:12.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119753 2024-09-12T22:04:12.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.849 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:12.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.849 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:66502 5.f 5:f112d875:::benchmark_data_smithi043_32659_object66501:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:12.849 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:12.832512+0000", 2024-09-12T22:04:12.849 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0017101009999999999, 2024-09-12T22:04:12.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019492190000000001, 2024-09-12T22:04:12.850 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:12.850 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:12.850 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:12.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:12.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:12.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.850 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 66502 2024-09-12T22:04:12.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.850 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:12.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:12.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832512+0000", 2024-09-12T22:04:12.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832512+0000", 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832513+0000", 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.198e-06 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832561+0000", 2024-09-12T22:04:12.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7824999999999997e-05 2024-09-12T22:04:12.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:12.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832572+0000", 2024-09-12T22:04:12.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1221e-05 2024-09-12T22:04:12.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832578+0000", 2024-09-12T22:04:12.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4409999999999998e-06 2024-09-12T22:04:12.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:12.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832634+0000", 2024-09-12T22:04:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5281999999999997e-05 2024-09-12T22:04:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832795+0000", 2024-09-12T22:04:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016138400000000001 2024-09-12T22:04:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832946+0000", 2024-09-12T22:04:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015060599999999999 2024-09-12T22:04:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:66503 5.2 5:4e6ce8db:::benchmark_data_smithi043_32659_object66502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:12.832695+0000", 2024-09-12T22:04:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0015269890000000001, 2024-09-12T22:04:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001838831, 2024-09-12T22:04:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 66503 2024-09-12T22:04:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832695+0000", 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832695+0000", 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832696+0000", 2024-09-12T22:04:12.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6000000000000003e-07 2024-09-12T22:04:12.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:12.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832753+0000", 2024-09-12T22:04:12.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.787e-05 2024-09-12T22:04:12.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:12.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832762+0000", 2024-09-12T22:04:12.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4200000000000007e-06 2024-09-12T22:04:12.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832768+0000", 2024-09-12T22:04:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6879999999999996e-06 2024-09-12T22:04:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832813+0000", 2024-09-12T22:04:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4994000000000003e-05 2024-09-12T22:04:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.832928+0000", 2024-09-12T22:04:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115103 2024-09-12T22:04:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833079+0000", 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015098800000000001 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:66477 5.2 e30/22 ondisk, result = 0)", 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:12.833343+0000", 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00087861600000000003, 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001270445, 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:12.858 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:12.859 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:12.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:12.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833343+0000", 2024-09-12T22:04:12.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:12.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833343+0000", 2024-09-12T22:04:12.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:12.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833344+0000", 2024-09-12T22:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833347+0000", 2024-09-12T22:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9189999999999999e-06 2024-09-12T22:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833354+0000", 2024-09-12T22:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2110000000000001e-06 2024-09-12T22:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833360+0000", 2024-09-12T22:04:12.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1580000000000002e-06 2024-09-12T22:04:12.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:12.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.834503+0000", 2024-09-12T22:04:12.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001142597 2024-09-12T22:04:12.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:12.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.834510+0000", 2024-09-12T22:04:12.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3690000000000001e-06 2024-09-12T22:04:12.861 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.861 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:66506 5.7 5:e8fb6ee0:::benchmark_data_smithi043_32659_object66505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:12.833567+0000", 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00065444099999999996, 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001114865, 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 66506 2024-09-12T22:04:12.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.863 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:12.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:12.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833567+0000", 2024-09-12T22:04:12.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:12.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833567+0000", 2024-09-12T22:04:12.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:12.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833568+0000", 2024-09-12T22:04:12.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3e-07 2024-09-12T22:04:12.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:12.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833675+0000", 2024-09-12T22:04:12.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010650999999999999 2024-09-12T22:04:12.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:12.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833683+0000", 2024-09-12T22:04:12.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6319999999999997e-06 2024-09-12T22:04:12.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833690+0000", 2024-09-12T22:04:12.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4500000000000001e-06 2024-09-12T22:04:12.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:12.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.834652+0000", 2024-09-12T22:04:12.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00096205900000000003 2024-09-12T22:04:12.865 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.865 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:12.865 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.865 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:66505 5.c e30/22 5:319022bb:::benchmark_data_smithi043_32659_object66504:head v 30'4169, mlcod=30'4167)", 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:12.833559+0000", 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00066306199999999996, 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001188581, 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833559+0000", 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:12.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833559+0000", 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833559+0000", 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7800000000000001e-07 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833685+0000", 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012567899999999999 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:12.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833693+0000", 2024-09-12T22:04:12.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5220000000000001e-06 2024-09-12T22:04:12.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:12.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833698+0000", 2024-09-12T22:04:12.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:04:12.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:12.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833747+0000", 2024-09-12T22:04:12.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9029000000000001e-05 2024-09-12T22:04:12.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:12.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:12.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:12.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.833767+0000", 2024-09-12T22:04:12.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9959999999999999e-05 2024-09-12T22:04:12.869 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.869 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:12.869 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.869 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:12.869 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:12.869 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 8 2024-09-12T22:04:12.869 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:12.870 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:12.911 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:12.910+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:12.989 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:12.988+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:13.053 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:13.053 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:13.053 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:13.053 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:13.053 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:13.065 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:13.089 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:13.088+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:13.192 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 19 16 67446 67430 221.791 162.688 0.00387059 0.00450613 2024-09-12T22:04:13.193 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:13.191+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:13.215 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:13.215 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:13.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:13.215 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:13.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.216 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.216 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:13.216 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.762447326, 2024-09-12T22:04:13.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018534981999999998, 2024-09-12T22:04:13.216 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.216 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.216 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.216 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:13.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:13.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449725+0000", 2024-09-12T22:04:13.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799999999999999e-06 2024-09-12T22:04:13.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449731+0000", 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.801e-06 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449745+0000", 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4198e-05 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449758+0000", 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2858e-05 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449815+0000", 2024-09-12T22:04:13.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6978999999999998e-05 2024-09-12T22:04:13.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:13.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:13.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2369999999999997e-06 2024-09-12T22:04:13.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457683+0000", 2024-09-12T22:04:13.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078622640000000008 2024-09-12T22:04:13.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457840+0000", 2024-09-12T22:04:13.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015715299999999999 2024-09-12T22:04:13.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457972+0000", 2024-09-12T22:04:13.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013179500000000001 2024-09-12T22:04:13.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462325+0000", 2024-09-12T22:04:13.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043526859999999997 2024-09-12T22:04:13.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468180+0000", 2024-09-12T22:04:13.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058557169999999999 2024-09-12T22:04:13.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468221+0000", 2024-09-12T22:04:13.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0673000000000002e-05 2024-09-12T22:04:13.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468258+0000", 2024-09-12T22:04:13.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7240999999999998e-05 2024-09-12T22:04:13.221 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.762394714999999, 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018748032000000001, 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449779+0000", 2024-09-12T22:04:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4869999999999998e-06 2024-09-12T22:04:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449783+0000", 2024-09-12T22:04:13.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:04:13.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449791+0000", 2024-09-12T22:04:13.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2640000000000002e-06 2024-09-12T22:04:13.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449796+0000", 2024-09-12T22:04:13.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9370000000000001e-06 2024-09-12T22:04:13.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449915+0000", 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118559 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449920+0000", 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.101e-06 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458578+0000", 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008657662 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458978+0000", 2024-09-12T22:04:13.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00039977399999999998 2024-09-12T22:04:13.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459130+0000", 2024-09-12T22:04:13.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000152394 2024-09-12T22:04:13.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462793+0000", 2024-09-12T22:04:13.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036628770000000001 2024-09-12T22:04:13.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468451+0000", 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056577820000000001 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468501+0000", 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0609999999999998e-05 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468524+0000", 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2804000000000001e-05 2024-09-12T22:04:13.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.228 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.228 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.228 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.228 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:13.228 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.762360014000002, 2024-09-12T22:04:13.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018816113999999998, 2024-09-12T22:04:13.228 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.228 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.228 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.228 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-09-12T22:04:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3360000000000001e-06 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449832+0000", 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1528e-05 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459429+0000", 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095926970000000007 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459597+0000", 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000168309 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459829+0000", 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231158 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462796+0000", 2024-09-12T22:04:13.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029673849999999999 2024-09-12T22:04:13.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468558+0000", 2024-09-12T22:04:13.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057621449999999998 2024-09-12T22:04:13.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468592+0000", 2024-09-12T22:04:13.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4241e-05 2024-09-12T22:04:13.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468627+0000", 2024-09-12T22:04:13.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4511999999999998e-05 2024-09-12T22:04:13.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.233 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.233 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.233 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:13.233 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.762292985999999, 2024-09-12T22:04:13.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018845905, 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:13.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:04:13.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449881+0000", 2024-09-12T22:04:13.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.005e-06 2024-09-12T22:04:13.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449887+0000", 2024-09-12T22:04:13.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9050000000000002e-06 2024-09-12T22:04:13.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449892+0000", 2024-09-12T22:04:13.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2009999999999998e-06 2024-09-12T22:04:13.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460279+0000", 2024-09-12T22:04:13.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010386808000000001 2024-09-12T22:04:13.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460427+0000", 2024-09-12T22:04:13.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014789 2024-09-12T22:04:13.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460572+0000", 2024-09-12T22:04:13.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014453099999999999 2024-09-12T22:04:13.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462799+0000", 2024-09-12T22:04:13.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002227049 2024-09-12T22:04:13.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468672+0000", 2024-09-12T22:04:13.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058730060000000001 2024-09-12T22:04:13.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468704+0000", 2024-09-12T22:04:13.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2421e-05 2024-09-12T22:04:13.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468724+0000", 2024-09-12T22:04:13.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9582e-05 2024-09-12T22:04:13.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.239 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.239 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.239 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:04:13.239 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.762262516, 2024-09-12T22:04:13.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015455175, 2024-09-12T22:04:13.239 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.239 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.239 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.239 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:04:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:04:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449909+0000", 2024-09-12T22:04:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2099999999999997e-07 2024-09-12T22:04:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449912+0000", 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1439999999999999e-06 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449925+0000", 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2944e-05 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449931+0000", 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3289999999999999e-06 2024-09-12T22:04:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:04:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:04:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449990+0000", 2024-09-12T22:04:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8090000000000004e-06 2024-09-12T22:04:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.455881+0000", 2024-09-12T22:04:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058904400000000003 2024-09-12T22:04:13.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456556+0000", 2024-09-12T22:04:13.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00067549500000000002 2024-09-12T22:04:13.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456742+0000", 2024-09-12T22:04:13.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018546799999999999 2024-09-12T22:04:13.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461053+0000", 2024-09-12T22:04:13.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043118310000000003 2024-09-12T22:04:13.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465220+0000", 2024-09-12T22:04:13.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041667750000000002 2024-09-12T22:04:13.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465316+0000", 2024-09-12T22:04:13.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5996999999999996e-05 2024-09-12T22:04:13.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465363+0000", 2024-09-12T22:04:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7111999999999999e-05 2024-09-12T22:04:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.762220124999999, 2024-09-12T22:04:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017913407999999999, 2024-09-12T22:04:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.246 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:13.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:13.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:13.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3499999999999996e-07 2024-09-12T22:04:13.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449955+0000", 2024-09-12T22:04:13.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4379999999999999e-06 2024-09-12T22:04:13.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449963+0000", 2024-09-12T22:04:13.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2719999999999997e-06 2024-09-12T22:04:13.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449970+0000", 2024-09-12T22:04:13.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5930000000000002e-06 2024-09-12T22:04:13.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450563+0000", 2024-09-12T22:04:13.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00059351900000000003 2024-09-12T22:04:13.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:13.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450570+0000", 2024-09-12T22:04:13.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3900000000000004e-06 2024-09-12T22:04:13.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461148+0000", 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010577354000000001 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461312+0000", 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016392300000000001 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461525+0000", 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021282199999999999 2024-09-12T22:04:13.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464272+0000", 2024-09-12T22:04:13.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027469740000000001 2024-09-12T22:04:13.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467749+0000", 2024-09-12T22:04:13.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003477235 2024-09-12T22:04:13.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467815+0000", 2024-09-12T22:04:13.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5974000000000002e-05 2024-09-12T22:04:13.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467864+0000", 2024-09-12T22:04:13.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9279e-05 2024-09-12T22:04:13.251 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.251 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.251 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.251 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.251 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:13.251 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.762188659000003, 2024-09-12T22:04:13.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018827507, 2024-09-12T22:04:13.252 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.252 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.252 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.252 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:13.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:13.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2739999999999999e-06 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449999+0000", 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3349e-05 2024-09-12T22:04:13.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450005+0000", 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.609e-06 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461006+0000", 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011000876 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461236+0000", 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000230301 2024-09-12T22:04:13.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461362+0000", 2024-09-12T22:04:13.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012541900000000001 2024-09-12T22:04:13.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464797+0000", 2024-09-12T22:04:13.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034350840000000001 2024-09-12T22:04:13.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468754+0000", 2024-09-12T22:04:13.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039576689999999996 2024-09-12T22:04:13.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468784+0000", 2024-09-12T22:04:13.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9558000000000001e-05 2024-09-12T22:04:13.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468810+0000", 2024-09-12T22:04:13.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5752e-05 2024-09-12T22:04:13.256 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.256 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.256 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.257 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.257 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:13.257 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.762156787000002, 2024-09-12T22:04:13.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018888559999999999, 2024-09-12T22:04:13.257 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.257 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.257 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.257 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:13.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450015+0000", 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450018+0000", 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3840000000000001e-06 2024-09-12T22:04:13.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8859999999999998e-06 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450030+0000", 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4829999999999999e-06 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465718+0000", 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015688163000000001 2024-09-12T22:04:13.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465793+0000", 2024-09-12T22:04:13.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4788000000000003e-05 2024-09-12T22:04:13.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466015+0000", 2024-09-12T22:04:13.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000221394 2024-09-12T22:04:13.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467628+0000", 2024-09-12T22:04:13.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016131190000000001 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468849+0000", 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012211699999999999 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468878+0000", 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8708e-05 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468902+0000", 2024-09-12T22:04:13.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868e-05 2024-09-12T22:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:23 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.762133339999998, 2024-09-12T22:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021189669000000001, 2024-09-12T22:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:13.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:13.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450038+0000", 2024-09-12T22:04:13.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:13.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450042+0000", 2024-09-12T22:04:13.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7720000000000001e-06 2024-09-12T22:04:13.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450058+0000", 2024-09-12T22:04:13.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6379999999999999e-05 2024-09-12T22:04:13.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450067+0000", 2024-09-12T22:04:13.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3870000000000001e-06 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466409+0000", 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016341418999999999 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466467+0000", 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8613999999999998e-05 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466612+0000", 2024-09-12T22:04:13.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014415000000000001 2024-09-12T22:04:13.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467856+0000", 2024-09-12T22:04:13.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012440039999999999 2024-09-12T22:04:13.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471178+0000", 2024-09-12T22:04:13.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033227450000000002 2024-09-12T22:04:13.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471207+0000", 2024-09-12T22:04:13.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8571000000000001e-05 2024-09-12T22:04:13.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471227+0000", 2024-09-12T22:04:13.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0109999999999999e-05 2024-09-12T22:04:13.267 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.267 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.267 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.267 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.267 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:13.267 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.762092799999998, 2024-09-12T22:04:13.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021231197, 2024-09-12T22:04:13.268 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.268 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.268 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.268 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:13.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:13.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450079+0000", 2024-09-12T22:04:13.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:04:13.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450083+0000", 2024-09-12T22:04:13.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1989999999999999e-06 2024-09-12T22:04:13.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450092+0000", 2024-09-12T22:04:13.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9400000000000008e-06 2024-09-12T22:04:13.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450097+0000", 2024-09-12T22:04:13.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:04:13.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466898+0000", 2024-09-12T22:04:13.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016801226999999998 2024-09-12T22:04:13.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466975+0000", 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6197000000000002e-05 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467158+0000", 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183876 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468270+0000", 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001111229 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471260+0000", 2024-09-12T22:04:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002989907 2024-09-12T22:04:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471289+0000", 2024-09-12T22:04:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9271000000000001e-05 2024-09-12T22:04:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471309+0000", 2024-09-12T22:04:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0302999999999999e-05 2024-09-12T22:04:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.273 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.273 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.273 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:13.273 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.762066199000003, 2024-09-12T22:04:13.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018145809999999998, 2024-09-12T22:04:13.273 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.273 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.273 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.273 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:13.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:13.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:13.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:13.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450114+0000", 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1849999999999993e-06 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1350000000000003e-06 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450128+0000", 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2040000000000002e-06 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454085+0000", 2024-09-12T22:04:13.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00395736 2024-09-12T22:04:13.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:13.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454090+0000", 2024-09-12T22:04:13.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.378e-06 2024-09-12T22:04:13.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457076+0000", 2024-09-12T22:04:13.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002985747 2024-09-12T22:04:13.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457178+0000", 2024-09-12T22:04:13.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010242 2024-09-12T22:04:13.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457452+0000", 2024-09-12T22:04:13.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027313000000000001 2024-09-12T22:04:13.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462024+0000", 2024-09-12T22:04:13.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045727040000000004 2024-09-12T22:04:13.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468161+0000", 2024-09-12T22:04:13.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061372019999999996 2024-09-12T22:04:13.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468212+0000", 2024-09-12T22:04:13.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0707000000000001e-05 2024-09-12T22:04:13.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468250+0000", 2024-09-12T22:04:13.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8148000000000001e-05 2024-09-12T22:04:13.279 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.279 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.279 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.279 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.279 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:04:13.279 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.761474823, 2024-09-12T22:04:13.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017301410999999999, 2024-09-12T22:04:13.279 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.279 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.279 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.279 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:04:13.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:04:13.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450699+0000", 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0019999999999998e-06 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450705+0000", 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3199999999999996e-06 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450717+0000", 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2069000000000001e-05 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450726+0000", 2024-09-12T22:04:13.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2840000000000006e-06 2024-09-12T22:04:13.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454318+0000", 2024-09-12T22:04:13.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035919580000000001 2024-09-12T22:04:13.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:13.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454323+0000", 2024-09-12T22:04:13.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2490000000000001e-06 2024-09-12T22:04:13.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462054+0000", 2024-09-12T22:04:13.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0077311319999999999 2024-09-12T22:04:13.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462135+0000", 2024-09-12T22:04:13.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1558999999999996e-05 2024-09-12T22:04:13.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:13.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462273+0000", 2024-09-12T22:04:13.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013781000000000001 2024-09-12T22:04:13.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464587+0000", 2024-09-12T22:04:13.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023134319999999998 2024-09-12T22:04:13.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467908+0000", 2024-09-12T22:04:13.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033211310000000002 2024-09-12T22:04:13.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467960+0000", 2024-09-12T22:04:13.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2537000000000002e-05 2024-09-12T22:04:13.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467997+0000", 2024-09-12T22:04:13.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6928000000000003e-05 2024-09-12T22:04:13.285 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.285 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.285 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.285 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.285 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:13.285 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.761378643999997, 2024-09-12T22:04:13.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020127506999999999, 2024-09-12T22:04:13.285 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.286 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.286 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.286 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:13.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:13.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450793+0000", 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2800000000000005e-07 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450813+0000", 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0063000000000001e-05 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450847+0000", 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3973000000000002e-05 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450862+0000", 2024-09-12T22:04:13.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5358000000000001e-05 2024-09-12T22:04:13.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454355+0000", 2024-09-12T22:04:13.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003492841 2024-09-12T22:04:13.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:13.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454359+0000", 2024-09-12T22:04:13.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-09-12T22:04:13.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458704+0000", 2024-09-12T22:04:13.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043452459999999997 2024-09-12T22:04:13.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459009+0000", 2024-09-12T22:04:13.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030526199999999999 2024-09-12T22:04:13.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459143+0000", 2024-09-12T22:04:13.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013375 2024-09-12T22:04:13.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462690+0000", 2024-09-12T22:04:13.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035466579999999998 2024-09-12T22:04:13.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470863+0000", 2024-09-12T22:04:13.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0081734089999999995 2024-09-12T22:04:13.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470898+0000", 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4445e-05 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470920+0000", 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1844e-05 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.759848525000002, 2024-09-12T22:04:13.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018704596, 2024-09-12T22:04:13.292 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.292 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.292 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.292 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:13.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:13.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452323+0000", 2024-09-12T22:04:13.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:04:13.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452337+0000", 2024-09-12T22:04:13.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:04:13.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452489+0000", 2024-09-12T22:04:13.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015167699999999999 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452498+0000", 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9709999999999993e-06 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454393+0000", 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001895171 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454397+0000", 2024-09-12T22:04:13.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4470000000000002e-06 2024-09-12T22:04:13.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459570+0000", 2024-09-12T22:04:13.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051728160000000002 2024-09-12T22:04:13.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459718+0000", 2024-09-12T22:04:13.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014857800000000001 2024-09-12T22:04:13.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459920+0000", 2024-09-12T22:04:13.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000202043 2024-09-12T22:04:13.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462696+0000", 2024-09-12T22:04:13.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027756299999999999 2024-09-12T22:04:13.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470963+0000", 2024-09-12T22:04:13.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082671359999999996 2024-09-12T22:04:13.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471000+0000", 2024-09-12T22:04:13.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6748999999999997e-05 2024-09-12T22:04:13.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471027+0000", 2024-09-12T22:04:13.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7118e-05 2024-09-12T22:04:13.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.297 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.298 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.298 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:04:13.298 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.758922847000001, 2024-09-12T22:04:13.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017680218000000001, 2024-09-12T22:04:13.298 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.298 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.298 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.298 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:04:13.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453249+0000", 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453253+0000", 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3630000000000004e-06 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453261+0000", 2024-09-12T22:04:13.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9319999999999996e-06 2024-09-12T22:04:13.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453267+0000", 2024-09-12T22:04:13.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7989999999999999e-06 2024-09-12T22:04:13.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454995+0000", 2024-09-12T22:04:13.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001727793 2024-09-12T22:04:13.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.455000+0000", 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0289999999999996e-06 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461445+0000", 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064456870000000003 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461546+0000", 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101036 2024-09-12T22:04:13.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461680+0000", 2024-09-12T22:04:13.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013407299999999999 2024-09-12T22:04:13.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464622+0000", 2024-09-12T22:04:13.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029413379999999999 2024-09-12T22:04:13.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470850+0000", 2024-09-12T22:04:13.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.006227977 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470902+0000", 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1916000000000002e-05 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470928+0000", 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.65e-05 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.304 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:13.304 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:13.304 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.758891251000001, 2024-09-12T22:04:13.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017838390999999999, 2024-09-12T22:04:13.304 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.304 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.304 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:13.304 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:13.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:13.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453280+0000", 2024-09-12T22:04:13.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:04:13.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453284+0000", 2024-09-12T22:04:13.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.194e-06 2024-09-12T22:04:13.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453337+0000", 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2330999999999998e-05 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453353+0000", 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6001000000000001e-05 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454421+0000", 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010681009999999999 2024-09-12T22:04:13.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:13.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454424+0000", 2024-09-12T22:04:13.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2550000000000002e-06 2024-09-12T22:04:13.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460376+0000", 2024-09-12T22:04:13.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059517770000000001 2024-09-12T22:04:13.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460536+0000", 2024-09-12T22:04:13.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015984699999999999 2024-09-12T22:04:13.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471118+0000", 2024-09-12T22:04:13.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010582322999999999 2024-09-12T22:04:13.308 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.308 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.308 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.309 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:38135 5.f 5:f52e53c3:::benchmark_data_smithi043_32659_object38134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:13.309 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:02.800531+0000", 2024-09-12T22:04:13.309 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.411640200000001, 2024-09-12T22:04:13.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014922509, 2024-09-12T22:04:13.309 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.309 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.309 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.309 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:13.309 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:13.309 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.309 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38135 2024-09-12T22:04:13.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.309 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800531+0000", 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800531+0000", 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800531+0000", 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-09-12T22:04:13.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800644+0000", 2024-09-12T22:04:13.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011280100000000001 2024-09-12T22:04:13.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800656+0000", 2024-09-12T22:04:13.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1522000000000001e-05 2024-09-12T22:04:13.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.800663+0000", 2024-09-12T22:04:13.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.131e-06 2024-09-12T22:04:13.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.801533+0000", 2024-09-12T22:04:13.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00087044599999999998 2024-09-12T22:04:13.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.801643+0000", 2024-09-12T22:04:13.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109948 2024-09-12T22:04:13.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.801772+0000", 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000128577 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.803660+0000", 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018880769999999999 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.815367+0000", 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011707235 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.815417+0000", 2024-09-12T22:04:13.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9490000000000002e-05 2024-09-12T22:04:13.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:02.815453+0000", 2024-09-12T22:04:13.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6448000000000001e-05 2024-09-12T22:04:13.314 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.314 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.314 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.314 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:39890 5.1 5:84fdb806:::benchmark_data_smithi043_32659_object39889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T22:04:13.314 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:03.345310+0000", 2024-09-12T22:04:13.314 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.8668606430000008, 2024-09-12T22:04:13.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014939364, 2024-09-12T22:04:13.315 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.315 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.315 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.315 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:13.315 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:13.315 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.315 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39890 2024-09-12T22:04:13.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.315 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345310+0000", 2024-09-12T22:04:13.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345310+0000", 2024-09-12T22:04:13.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345311+0000", 2024-09-12T22:04:13.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.68e-07 2024-09-12T22:04:13.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345341+0000", 2024-09-12T22:04:13.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0358e-05 2024-09-12T22:04:13.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345350+0000", 2024-09-12T22:04:13.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4940000000000003e-06 2024-09-12T22:04:13.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345355+0000", 2024-09-12T22:04:13.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:04:13.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345393+0000", 2024-09-12T22:04:13.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7874999999999999e-05 2024-09-12T22:04:13.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345474+0000", 2024-09-12T22:04:13.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1110000000000001e-05 2024-09-12T22:04:13.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:13.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.345548+0000", 2024-09-12T22:04:13.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4277999999999996e-05 2024-09-12T22:04:13.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.347374+0000", 2024-09-12T22:04:13.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001825929 2024-09-12T22:04:13.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.360138+0000", 2024-09-12T22:04:13.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012763943999999999 2024-09-12T22:04:13.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.360196+0000", 2024-09-12T22:04:13.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7584999999999998e-05 2024-09-12T22:04:13.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:03.360249+0000", 2024-09-12T22:04:13.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3860999999999998e-05 2024-09-12T22:04:13.320 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.320 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.320 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.320 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:13.320 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:13.320 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.578872939, 2024-09-12T22:04:13.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:13.320 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:13.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:13.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:13.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:13.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:13.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:13.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:13.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:13.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:13.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:13.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:13.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:13.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:13.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:13.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:13.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:13.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:13.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:13.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:65637 5.2 5:496bd980:::benchmark_data_smithi043_32659_object65636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:12.501459+0000", 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.71071126299999998, 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015326876, 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.327 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 65637 2024-09-12T22:04:13.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.327 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:13.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:13.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.501459+0000", 2024-09-12T22:04:13.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:13.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.501459+0000", 2024-09-12T22:04:13.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:13.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:13.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.501460+0000", 2024-09-12T22:04:13.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0699999999999996e-07 2024-09-12T22:04:13.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:13.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.501528+0000", 2024-09-12T22:04:13.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7331999999999998e-05 2024-09-12T22:04:13.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:13.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.501537+0000", 2024-09-12T22:04:13.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9719999999999998e-06 2024-09-12T22:04:13.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.501543+0000", 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4060000000000002e-06 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.502723+0000", 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001179841 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.502853+0000", 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013057100000000001 2024-09-12T22:04:13.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.503010+0000", 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015690600000000001 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.504422+0000", 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001412188 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.516711+0000", 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012288953 2024-09-12T22:04:13.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.516750+0000", 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8396000000000003e-05 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.516786+0000", 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6504000000000002e-05 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:13.331 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:13.333 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:13.333 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:13.331+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:13.349 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-09-12T22:04:13.355 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:04:13.434 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:13.432+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:13.482 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:13.483 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:13.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.483 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:68195 5.4 5:2aa7d3ce:::benchmark_data_smithi043_32659_object68194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:13.483 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.474196+0000", 2024-09-12T22:04:13.483 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0059431579999999996, 2024-09-12T22:04:13.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0059689449999999998, 2024-09-12T22:04:13.483 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.483 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.483 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:13.483 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:13.483 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:13.484 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.484 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 68195 2024-09-12T22:04:13.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.484 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474196+0000", 2024-09-12T22:04:13.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474196+0000", 2024-09-12T22:04:13.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474197+0000", 2024-09-12T22:04:13.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.009e-06 2024-09-12T22:04:13.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474229+0000", 2024-09-12T22:04:13.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1673e-05 2024-09-12T22:04:13.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474240+0000", 2024-09-12T22:04:13.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0844e-05 2024-09-12T22:04:13.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.487 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.487 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474247+0000", 2024-09-12T22:04:13.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.469e-06 2024-09-12T22:04:13.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.487 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:13.487 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477927+0000", 2024-09-12T22:04:13.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0036799240000000002 2024-09-12T22:04:13.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.487 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:13.487 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.478069+0000", 2024-09-12T22:04:13.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014196799999999999 2024-09-12T22:04:13.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:13.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.478223+0000", 2024-09-12T22:04:13.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015413499999999999 2024-09-12T22:04:13.488 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.488 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.488 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.488 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:68196 5.0 5:057ae75a:::benchmark_data_smithi043_32659_object68195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:13.488 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.474261+0000", 2024-09-12T22:04:13.489 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.005878042, 2024-09-12T22:04:13.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0059820769999999997, 2024-09-12T22:04:13.489 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.489 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.489 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:13.489 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:13.489 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:13.489 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.489 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 68196 2024-09-12T22:04:13.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.489 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474261+0000", 2024-09-12T22:04:13.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474261+0000", 2024-09-12T22:04:13.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474262+0000", 2024-09-12T22:04:13.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7199999999999999e-07 2024-09-12T22:04:13.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474290+0000", 2024-09-12T22:04:13.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8031999999999999e-05 2024-09-12T22:04:13.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474297+0000", 2024-09-12T22:04:13.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5669999999999997e-06 2024-09-12T22:04:13.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474304+0000", 2024-09-12T22:04:13.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4869999999999999e-06 2024-09-12T22:04:13.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:13.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474521+0000", 2024-09-12T22:04:13.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00021705199999999999 2024-09-12T22:04:13.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:13.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474744+0000", 2024-09-12T22:04:13.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022302699999999999 2024-09-12T22:04:13.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:13.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.475031+0000", 2024-09-12T22:04:13.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00028677800000000001 2024-09-12T22:04:13.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:13.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.479737+0000", 2024-09-12T22:04:13.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047062509999999998 2024-09-12T22:04:13.493 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.493 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.493 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.493 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:68199 5.d 5:bb3d7c61:::benchmark_data_smithi043_32659_object68198:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:13.493 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.474520+0000", 2024-09-12T22:04:13.493 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0056190609999999998, 2024-09-12T22:04:13.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0058079280000000004, 2024-09-12T22:04:13.494 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.494 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.494 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:13.494 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:13.494 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:13.494 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.494 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 68199 2024-09-12T22:04:13.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.494 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474520+0000", 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474520+0000", 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474521+0000", 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1999999999999998e-07 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474664+0000", 2024-09-12T22:04:13.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000142676 2024-09-12T22:04:13.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474675+0000", 2024-09-12T22:04:13.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0927000000000001e-05 2024-09-12T22:04:13.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474683+0000", 2024-09-12T22:04:13.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3659999999999992e-06 2024-09-12T22:04:13.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:13.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474731+0000", 2024-09-12T22:04:13.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7817e-05 2024-09-12T22:04:13.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:13.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.474864+0000", 2024-09-12T22:04:13.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013315700000000001 2024-09-12T22:04:13.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:13.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.475033+0000", 2024-09-12T22:04:13.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016933599999999999 2024-09-12T22:04:13.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.498 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.498 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.478889+0000", 2024-09-12T22:04:13.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038551610000000002 2024-09-12T22:04:13.498 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.498 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.498 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.498 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:68201 5.d 5:b0052515:::benchmark_data_smithi043_32659_object68200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:13.498 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.475519+0000", 2024-09-12T22:04:13.498 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.004620547, 2024-09-12T22:04:13.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004893629, 2024-09-12T22:04:13.498 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.498 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 68201 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.475519+0000", 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.475519+0000", 2024-09-12T22:04:13.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.475520+0000", 2024-09-12T22:04:13.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.47e-07 2024-09-12T22:04:13.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.475594+0000", 2024-09-12T22:04:13.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3994999999999999e-05 2024-09-12T22:04:13.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.475620+0000", 2024-09-12T22:04:13.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6259999999999999e-05 2024-09-12T22:04:13.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.475628+0000", 2024-09-12T22:04:13.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7239999999999992e-06 2024-09-12T22:04:13.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:13.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.476997+0000", 2024-09-12T22:04:13.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001369753 2024-09-12T22:04:13.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:13.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477117+0000", 2024-09-12T22:04:13.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011978500000000001 2024-09-12T22:04:13.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:13.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477246+0000", 2024-09-12T22:04:13.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012847100000000001 2024-09-12T22:04:13.502 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.502 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.502 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.502 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:68203 5.4 5:263b0af1:::benchmark_data_smithi043_32659_object68202:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:13.503 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.476834+0000", 2024-09-12T22:04:13.503 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0033053869999999999, 2024-09-12T22:04:13.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0036523409999999999, 2024-09-12T22:04:13.503 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.503 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.503 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:13.503 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:13.503 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:13.503 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.503 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 68203 2024-09-12T22:04:13.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.503 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.476834+0000", 2024-09-12T22:04:13.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.476834+0000", 2024-09-12T22:04:13.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.476835+0000", 2024-09-12T22:04:13.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1519999999999999e-06 2024-09-12T22:04:13.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.476865+0000", 2024-09-12T22:04:13.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.023e-05 2024-09-12T22:04:13.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.476876+0000", 2024-09-12T22:04:13.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0288999999999999e-05 2024-09-12T22:04:13.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.476897+0000", 2024-09-12T22:04:13.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1671999999999999e-05 2024-09-12T22:04:13.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480292+0000", 2024-09-12T22:04:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033943770000000001 2024-09-12T22:04:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480431+0000", 2024-09-12T22:04:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013933199999999999 2024-09-12T22:04:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.507 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:68204 5.d 5:bcfd49a5:::benchmark_data_smithi043_32659_object68203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:13.507 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.477383+0000", 2024-09-12T22:04:13.507 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0027558750000000001, 2024-09-12T22:04:13.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031732710000000001, 2024-09-12T22:04:13.507 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.507 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.507 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:13.507 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:13.507 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:13.507 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.507 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 68204 2024-09-12T22:04:13.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.508 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477383+0000", 2024-09-12T22:04:13.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477383+0000", 2024-09-12T22:04:13.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.509 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477384+0000", 2024-09-12T22:04:13.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7899999999999997e-07 2024-09-12T22:04:13.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.509 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477520+0000", 2024-09-12T22:04:13.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135482 2024-09-12T22:04:13.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477532+0000", 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1919999999999999e-05 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477539+0000", 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.478917+0000", 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0013783580000000001 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.478985+0000", 2024-09-12T22:04:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7923999999999995e-05 2024-09-12T22:04:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.479070+0000", 2024-09-12T22:04:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4524000000000006e-05 2024-09-12T22:04:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:68206 5.0 5:0b8142c0:::benchmark_data_smithi043_32659_object68205:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.477553+0000", 2024-09-12T22:04:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002586554, 2024-09-12T22:04:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030847740000000002, 2024-09-12T22:04:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 68206 2024-09-12T22:04:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477553+0000", 2024-09-12T22:04:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477553+0000", 2024-09-12T22:04:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477553+0000", 2024-09-12T22:04:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3099999999999998e-07 2024-09-12T22:04:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477592+0000", 2024-09-12T22:04:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8757999999999997e-05 2024-09-12T22:04:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477599+0000", 2024-09-12T22:04:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7660000000000001e-06 2024-09-12T22:04:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477604+0000", 2024-09-12T22:04:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4399999999999996e-06 2024-09-12T22:04:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477641+0000", 2024-09-12T22:04:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6881999999999997e-05 2024-09-12T22:04:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477723+0000", 2024-09-12T22:04:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2013000000000002e-05 2024-09-12T22:04:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.477819+0000", 2024-09-12T22:04:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5548000000000001e-05 2024-09-12T22:04:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480040+0000", 2024-09-12T22:04:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022212579999999998 2024-09-12T22:04:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:68208 5.9 e31/22 5:9127095d:::benchmark_data_smithi043_32659_object68207:head v 31'4232, mlcod=31'4230)", 2024-09-12T22:04:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.478058+0000", 2024-09-12T22:04:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002081435, 2024-09-12T22:04:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026571070000000001, 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.478058+0000", 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.478058+0000", 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.478059+0000", 2024-09-12T22:04:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3200000000000004e-07 2024-09-12T22:04:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.478106+0000", 2024-09-12T22:04:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7237000000000002e-05 2024-09-12T22:04:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.478121+0000", 2024-09-12T22:04:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4986e-05 2024-09-12T22:04:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.478128+0000", 2024-09-12T22:04:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2729999999999997e-06 2024-09-12T22:04:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.478196+0000", 2024-09-12T22:04:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7605000000000001e-05 2024-09-12T22:04:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.478215+0000", 2024-09-12T22:04:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9191e-05 2024-09-12T22:04:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:68210 5.b 5:daf15947:::benchmark_data_smithi043_32659_object68209:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.480376+0000", 2024-09-12T22:04:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.999763, 2024-09-12T22:04:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00040275700000000001, 2024-09-12T22:04:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 68210 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480376+0000", 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480376+0000", 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480377+0000", 2024-09-12T22:04:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.114e-06 2024-09-12T22:04:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480403+0000", 2024-09-12T22:04:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6067e-05 2024-09-12T22:04:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480419+0000", 2024-09-12T22:04:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5281000000000002e-05 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480424+0000", 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9209999999999997e-06 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480476+0000", 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1926999999999999e-05 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480588+0000", 2024-09-12T22:04:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011165799999999999 2024-09-12T22:04:13.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:13.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480726+0000", 2024-09-12T22:04:13.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000137541 2024-09-12T22:04:13.524 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.524 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.524 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.524 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:68212 5.8 5:16dc4c8d:::benchmark_data_smithi043_32659_object68211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:13.524 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.480439+0000", 2024-09-12T22:04:13.524 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.999701, 2024-09-12T22:04:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000421617, 2024-09-12T22:04:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 68212 2024-09-12T22:04:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480439+0000", 2024-09-12T22:04:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480439+0000", 2024-09-12T22:04:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480439+0000", 2024-09-12T22:04:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5999999999999999e-07 2024-09-12T22:04:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480457+0000", 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8258999999999999e-05 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480462+0000", 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8010000000000003e-06 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480465+0000", 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3110000000000001e-06 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:13.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480505+0000", 2024-09-12T22:04:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9338999999999997e-05 2024-09-12T22:04:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480598+0000", 2024-09-12T22:04:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3209999999999997e-05 2024-09-12T22:04:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480730+0000", 2024-09-12T22:04:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013247700000000001 2024-09-12T22:04:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:68193 5.4 e31/22)", 2024-09-12T22:04:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.480488+0000", 2024-09-12T22:04:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.999651, 2024-09-12T22:04:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00044090999999999998, 2024-09-12T22:04:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480488+0000", 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480488+0000", 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480489+0000", 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5600000000000001e-07 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480492+0000", 2024-09-12T22:04:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.399e-06 2024-09-12T22:04:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480500+0000", 2024-09-12T22:04:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.841e-06 2024-09-12T22:04:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480506+0000", 2024-09-12T22:04:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9120000000000003e-06 2024-09-12T22:04:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:68211 5.9 e31/22 5:926df8f1:::benchmark_data_smithi043_32659_object68210:head v 31'4233, mlcod=31'4230)", 2024-09-12T22:04:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.480727+0000", 2024-09-12T22:04:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9994121, 2024-09-12T22:04:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025114700000000001, 2024-09-12T22:04:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480727+0000", 2024-09-12T22:04:13.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480727+0000", 2024-09-12T22:04:13.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480728+0000", 2024-09-12T22:04:13.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0800000000000004e-07 2024-09-12T22:04:13.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480829+0000", 2024-09-12T22:04:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000100807 2024-09-12T22:04:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480839+0000", 2024-09-12T22:04:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0091e-05 2024-09-12T22:04:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480874+0000", 2024-09-12T22:04:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5352000000000003e-05 2024-09-12T22:04:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480950+0000", 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5438999999999994e-05 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480970+0000", 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0000000000000002e-05 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:68214 5.b 5.8259e2ab (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.480815+0000", 2024-09-12T22:04:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9993248, 2024-09-12T22:04:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00021875900000000001, 2024-09-12T22:04:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 68214 2024-09-12T22:04:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480815+0000", 2024-09-12T22:04:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480815+0000", 2024-09-12T22:04:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480816+0000", 2024-09-12T22:04:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8000000000000004e-07 2024-09-12T22:04:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480899+0000", 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3523999999999995e-05 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480910+0000", 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1164e-05 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480917+0000", 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5740000000000001e-06 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.538 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:68215 5.8 5.ded8f858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.480953+0000", 2024-09-12T22:04:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9991865, 2024-09-12T22:04:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013806300000000001, 2024-09-12T22:04:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 68215 2024-09-12T22:04:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480953+0000", 2024-09-12T22:04:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480953+0000", 2024-09-12T22:04:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480953+0000", 2024-09-12T22:04:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9500000000000002e-07 2024-09-12T22:04:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480984+0000", 2024-09-12T22:04:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0518999999999997e-05 2024-09-12T22:04:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480992+0000", 2024-09-12T22:04:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3340000000000002e-06 2024-09-12T22:04:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.481004+0000", 2024-09-12T22:04:13.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2011000000000001e-05 2024-09-12T22:04:13.542 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.542 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.542 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.542 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:68206 5.0 e31/22)", 2024-09-12T22:04:13.542 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.481014+0000", 2024-09-12T22:04:13.542 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9991255, 2024-09-12T22:04:13.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012813200000000001, 2024-09-12T22:04:13.542 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.542 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.543 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:13.543 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.481014+0000", 2024-09-12T22:04:13.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.481014+0000", 2024-09-12T22:04:13.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.481014+0000", 2024-09-12T22:04:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3200000000000005e-07 2024-09-12T22:04:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.481021+0000", 2024-09-12T22:04:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5230000000000001e-06 2024-09-12T22:04:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.481030+0000", 2024-09-12T22:04:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0259999999999996e-06 2024-09-12T22:04:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.481036+0000", 2024-09-12T22:04:13.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2790000000000004e-06 2024-09-12T22:04:13.545 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.545 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.545 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.545 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:68191 5.4 5:2d8384ec:::benchmark_data_smithi043_32659_object68190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:13.545 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.472118+0000", 2024-09-12T22:04:13.545 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0080217299999999995, 2024-09-12T22:04:13.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0090756039999999993, 2024-09-12T22:04:13.545 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.545 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 68191 2024-09-12T22:04:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.472118+0000", 2024-09-12T22:04:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.472118+0000", 2024-09-12T22:04:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.472119+0000", 2024-09-12T22:04:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6200000000000006e-07 2024-09-12T22:04:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.472319+0000", 2024-09-12T22:04:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019995500000000001 2024-09-12T22:04:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.472329+0000", 2024-09-12T22:04:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0779e-05 2024-09-12T22:04:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.472337+0000", 2024-09-12T22:04:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3130000000000001e-06 2024-09-12T22:04:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.472392+0000", 2024-09-12T22:04:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5427999999999999e-05 2024-09-12T22:04:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.472652+0000", 2024-09-12T22:04:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025966800000000001 2024-09-12T22:04:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.473079+0000", 2024-09-12T22:04:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000427205 2024-09-12T22:04:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.480254+0000", 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0071754849999999997 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:68193 5.4 5:2e54c450:::benchmark_data_smithi043_32659_object68192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:13.472637+0000", 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0075018539999999996, 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0086111369999999996, 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:13.551 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:13.551 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 68193 2024-09-12T22:04:13.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.551 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:13.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.472637+0000", 2024-09-12T22:04:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.472637+0000", 2024-09-12T22:04:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.472638+0000", 2024-09-12T22:04:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2799999999999996e-07 2024-09-12T22:04:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.472753+0000", 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115217 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.472763+0000", 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3899999999999999e-06 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.472768+0000", 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4439999999999999e-06 2024-09-12T22:04:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.475595+0000", 2024-09-12T22:04:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028270600000000002 2024-09-12T22:04:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.475704+0000", 2024-09-12T22:04:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000108657 2024-09-12T22:04:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:13.475833+0000", 2024-09-12T22:04:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012891899999999999 2024-09-12T22:04:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 17 2024-09-12T22:04:13.555 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:13.556 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-09-12T22:04:13.556 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:04:13.557 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:13.557 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:13.558 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:13.558 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:13.559 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:13.559 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:04:13.554+0000 7f46df587640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30571) UID: 0 2024-09-12T22:04:13.657 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:13.656+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:13.705 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:13.705 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:13.717 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:13.761 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:13.760+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:13.857 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:13.857 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:13.858 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:13.857+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:13.871 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:04:13.913 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:04:13.913 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:04:13.913 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2] 2024-09-12T22:04:13.913 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T22:04:13.913 INFO:teuthology.orchestra.console.smithi047:Power off 2024-09-12T22:04:13.914 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-09-12T22:04:13.938 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-09-12T22:04:13.960 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:13.959+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:14.030 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:14.030 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:14.045 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:04:14.061 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:14.060+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:14.162 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:14.161+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:14.191 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:2024-09-12T22:04:14.190837+0000 min lat: 0.00121163 max lat: 0.0954156 avg lat: 0.00456456 2024-09-12T22:04:14.191 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T22:04:14.191 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 20 16 70080 70064 218.932 164.625 0.00683612 0.00456456 2024-09-12T22:04:14.211 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:14.211 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:14.224 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:04:14.263 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:14.262+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:14.365 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:14.363+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:14.390 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:14.390 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:14.403 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:14.465 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:14.464+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:14.555 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:14.555 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:14.566 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:14.565+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:14.567 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:14.666 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:14.665+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:14.750 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:14.750 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:14.762 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:14.767 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:14.766+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:14.869 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:14.867+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:14.906 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:14.906 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:14.920 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:14.970 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:14.968+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:15.068 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:15.068 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:15.070 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:15.069+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:15.080 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:15.171 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:15.170+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:15.191 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 21 16 72666 72650 216.203 161.625 0.00722703 0.00462242 2024-09-12T22:04:15.266 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:15.266 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:15.272 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:15.271+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:15.279 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:15.364 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:04:15.372 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:15.371+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:15.461 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:15.462 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:15.473 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:15.474 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:15.472+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:15.560 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:04:15.574 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:15.573+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:15.622 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:15.622 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:15.637 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:15.675 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:15.674+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:15.693 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-09-12T22:04:15.693 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:04:15.711 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:15.711 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:15.730 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:15.730 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:15.777 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:15.776+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:15.819 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:15.820 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:15.820 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:15.820 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:15.820 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:15.832 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:15.917 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:15.916+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:15.978 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:15.977+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:16.021 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:16.021 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:16.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:16.021 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:16.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.022 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44102 5.0 5:0d5aa1ff:::benchmark_data_smithi043_32659_object44101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.022 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:16.022 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.393529790000001, 2024-09-12T22:04:16.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051636015, 2024-09-12T22:04:16.022 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.022 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.022 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.022 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.022 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.022 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.022 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44102 2024-09-12T22:04:16.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.022 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:16.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:16.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624875+0000", 2024-09-12T22:04:16.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:04:16.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624930+0000", 2024-09-12T22:04:16.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5256000000000001e-05 2024-09-12T22:04:16.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624951+0000", 2024-09-12T22:04:16.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0551999999999999e-05 2024-09-12T22:04:16.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624958+0000", 2024-09-12T22:04:16.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1849999999999998e-06 2024-09-12T22:04:16.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629885+0000", 2024-09-12T22:04:16.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049266120000000004 2024-09-12T22:04:16.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629999+0000", 2024-09-12T22:04:16.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011385 2024-09-12T22:04:16.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630125+0000", 2024-09-12T22:04:16.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012640500000000001 2024-09-12T22:04:16.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633338+0000", 2024-09-12T22:04:16.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032135559999999998 2024-09-12T22:04:16.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676425+0000", 2024-09-12T22:04:16.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043086753999999998 2024-09-12T22:04:16.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676472+0000", 2024-09-12T22:04:16.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6971999999999997e-05 2024-09-12T22:04:16.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676510+0000", 2024-09-12T22:04:16.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8096999999999998e-05 2024-09-12T22:04:16.027 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.027 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.027 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.028 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44103 5.8 5:170742c6:::benchmark_data_smithi043_32659_object44102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.028 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:16.029 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.393406639, 2024-09-12T22:04:16.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051500936999999997, 2024-09-12T22:04:16.029 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.029 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.029 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.029 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.029 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.029 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.029 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44103 2024-09-12T22:04:16.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.030 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:16.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:16.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624998+0000", 2024-09-12T22:04:16.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:16.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625061+0000", 2024-09-12T22:04:16.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2667000000000002e-05 2024-09-12T22:04:16.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625069+0000", 2024-09-12T22:04:16.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999993e-06 2024-09-12T22:04:16.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625077+0000", 2024-09-12T22:04:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0090000000000007e-06 2024-09-12T22:04:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629869+0000", 2024-09-12T22:04:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047921769999999999 2024-09-12T22:04:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629938+0000", 2024-09-12T22:04:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9542000000000006e-05 2024-09-12T22:04:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630010+0000", 2024-09-12T22:04:16.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1795e-05 2024-09-12T22:04:16.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676348+0000", 2024-09-12T22:04:16.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.046337830000000003 2024-09-12T22:04:16.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676399+0000", 2024-09-12T22:04:16.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1150000000000003e-05 2024-09-12T22:04:16.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676460+0000", 2024-09-12T22:04:16.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1142999999999994e-05 2024-09-12T22:04:16.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676498+0000", 2024-09-12T22:04:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8111000000000002e-05 2024-09-12T22:04:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.392108214, 2024-09-12T22:04:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.036 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.036 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.036 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.036 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.036 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.036 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:16.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.036 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:16.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:16.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:16.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:16.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:16.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:16.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:16.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:16.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:16.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:16.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:16.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:16.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:16.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:16.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:16.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:16.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:16.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:16.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:16.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:16.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:16.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:16.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:16.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:16.041 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.041 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.041 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.041 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44115 5.0 5:0ee09c30:::benchmark_data_smithi043_32659_object44114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.041 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:16.041 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.389335537000001, 2024-09-12T22:04:16.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082887358999999994, 2024-09-12T22:04:16.041 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.041 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.042 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.042 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.042 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.042 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.042 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44115 2024-09-12T22:04:16.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.042 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:16.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:16.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629070+0000", 2024-09-12T22:04:16.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1209999999999999e-06 2024-09-12T22:04:16.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629132+0000", 2024-09-12T22:04:16.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2557000000000004e-05 2024-09-12T22:04:16.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629147+0000", 2024-09-12T22:04:16.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4491999999999999e-05 2024-09-12T22:04:16.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629156+0000", 2024-09-12T22:04:16.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7089999999999997e-06 2024-09-12T22:04:16.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631865+0000", 2024-09-12T22:04:16.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00270835 2024-09-12T22:04:16.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631932+0000", 2024-09-12T22:04:16.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7322000000000004e-05 2024-09-12T22:04:16.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632095+0000", 2024-09-12T22:04:16.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016314699999999999 2024-09-12T22:04:16.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676360+0000", 2024-09-12T22:04:16.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044264756000000002 2024-09-12T22:04:16.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711854+0000", 2024-09-12T22:04:16.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.03549389 2024-09-12T22:04:16.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711919+0000", 2024-09-12T22:04:16.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5024000000000006e-05 2024-09-12T22:04:16.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711956+0000", 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6990999999999999e-05 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44117 5.8 5:1ecb02e0:::benchmark_data_smithi043_32659_object44116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.389190717, 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082354986000000005, 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.047 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44117 2024-09-12T22:04:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629214+0000", 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629315+0000", 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010045800000000001 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629328+0000", 2024-09-12T22:04:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3016e-05 2024-09-12T22:04:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629336+0000", 2024-09-12T22:04:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7229999999999993e-06 2024-09-12T22:04:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631856+0000", 2024-09-12T22:04:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025199300000000001 2024-09-12T22:04:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631954+0000", 2024-09-12T22:04:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7565999999999994e-05 2024-09-12T22:04:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632073+0000", 2024-09-12T22:04:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119677 2024-09-12T22:04:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676523+0000", 2024-09-12T22:04:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044449163 2024-09-12T22:04:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676612+0000", 2024-09-12T22:04:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9579000000000004e-05 2024-09-12T22:04:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711509+0000", 2024-09-12T22:04:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.034897125000000001 2024-09-12T22:04:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711568+0000", 2024-09-12T22:04:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8996999999999998e-05 2024-09-12T22:04:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44120 5.b 5:df1f2c5f:::benchmark_data_smithi043_32659_object44119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.387015055999999, 2024-09-12T22:04:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043861974999999997, 2024-09-12T22:04:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44120 2024-09-12T22:04:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631390+0000", 2024-09-12T22:04:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:04:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631444+0000", 2024-09-12T22:04:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-12T22:04:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631452+0000", 2024-09-12T22:04:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4610000000000008e-06 2024-09-12T22:04:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631458+0000", 2024-09-12T22:04:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:04:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631509+0000", 2024-09-12T22:04:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1442e-05 2024-09-12T22:04:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631627+0000", 2024-09-12T22:04:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011796800000000001 2024-09-12T22:04:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631814+0000", 2024-09-12T22:04:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018735400000000001 2024-09-12T22:04:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674612+0000", 2024-09-12T22:04:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042797287000000003 2024-09-12T22:04:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675160+0000", 2024-09-12T22:04:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000548187 2024-09-12T22:04:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675207+0000", 2024-09-12T22:04:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6833999999999999e-05 2024-09-12T22:04:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675251+0000", 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4348000000000003e-05 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.386707274000001, 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44122 5.d 5:bfd04815:::benchmark_data_smithi043_32659_object44121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.386609222000001, 2024-09-12T22:04:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.080166395000000001, 2024-09-12T22:04:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44122 2024-09-12T22:04:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:04:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631853+0000", 2024-09-12T22:04:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7209000000000001e-05 2024-09-12T22:04:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631858+0000", 2024-09-12T22:04:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:04:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631862+0000", 2024-09-12T22:04:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.692e-06 2024-09-12T22:04:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631905+0000", 2024-09-12T22:04:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3135e-05 2024-09-12T22:04:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632032+0000", 2024-09-12T22:04:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012740900000000001 2024-09-12T22:04:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632166+0000", 2024-09-12T22:04:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013318800000000001 2024-09-12T22:04:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674894+0000", 2024-09-12T22:04:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042728690999999999 2024-09-12T22:04:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711875+0000", 2024-09-12T22:04:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036980631 2024-09-12T22:04:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711923+0000", 2024-09-12T22:04:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8180000000000003e-05 2024-09-12T22:04:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711961+0000", 2024-09-12T22:04:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8142000000000002e-05 2024-09-12T22:04:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44123 5.e 5:7d83ca89:::benchmark_data_smithi043_32659_object44122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.386477454, 2024-09-12T22:04:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043329329, 2024-09-12T22:04:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44123 2024-09-12T22:04:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631928+0000", 2024-09-12T22:04:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2699999999999998e-07 2024-09-12T22:04:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631996+0000", 2024-09-12T22:04:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8141999999999999e-05 2024-09-12T22:04:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632004+0000", 2024-09-12T22:04:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7600000000000008e-06 2024-09-12T22:04:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632010+0000", 2024-09-12T22:04:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:04:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632069+0000", 2024-09-12T22:04:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8260000000000001e-05 2024-09-12T22:04:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632226+0000", 2024-09-12T22:04:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015702199999999999 2024-09-12T22:04:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632337+0000", 2024-09-12T22:04:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111069 2024-09-12T22:04:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674909+0000", 2024-09-12T22:04:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042571854999999999 2024-09-12T22:04:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675184+0000", 2024-09-12T22:04:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027561399999999998 2024-09-12T22:04:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675222+0000", 2024-09-12T22:04:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7710999999999999e-05 2024-09-12T22:04:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675256+0000", 2024-09-12T22:04:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4014000000000003e-05 2024-09-12T22:04:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.385766007000001, 2024-09-12T22:04:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44098 5.0 e28/22 ondisk, result = 0)", 2024-09-12T22:04:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.385375192, 2024-09-12T22:04:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043332180999999997, 2024-09-12T22:04:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633030+0000", 2024-09-12T22:04:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633035+0000", 2024-09-12T22:04:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:04:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633043+0000", 2024-09-12T22:04:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633048+0000", 2024-09-12T22:04:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5439999999999998e-06 2024-09-12T22:04:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633362+0000", 2024-09-12T22:04:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031397400000000001 2024-09-12T22:04:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633369+0000", 2024-09-12T22:04:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:04:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676361+0000", 2024-09-12T22:04:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042991954999999998 2024-09-12T22:04:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.384768086999999, 2024-09-12T22:04:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:44125 5.9 e28/22 5:9022696f:::benchmark_data_smithi043_32659_object44124:head v 28'2753, mlcod=28'2751)", 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.384729222000001, 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042744011999999998, 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633676+0000", 2024-09-12T22:04:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.44e-07 2024-09-12T22:04:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633755+0000", 2024-09-12T22:04:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9629000000000006e-05 2024-09-12T22:04:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674386+0000", 2024-09-12T22:04:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631364000000003 2024-09-12T22:04:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674399+0000", 2024-09-12T22:04:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2047e-05 2024-09-12T22:04:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674453+0000", 2024-09-12T22:04:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4453999999999997e-05 2024-09-12T22:04:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674479+0000", 2024-09-12T22:04:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6064999999999999e-05 2024-09-12T22:04:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676381+0000", 2024-09-12T22:04:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001901874 2024-09-12T22:04:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676419+0000", 2024-09-12T22:04:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7935000000000002e-05 2024-09-12T22:04:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44103 5.8 e28/22 ondisk, result = 0)", 2024-09-12T22:04:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.384223254, 2024-09-12T22:04:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042322950999999998, 2024-09-12T22:04:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:04:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634184+0000", 2024-09-12T22:04:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7690000000000001e-06 2024-09-12T22:04:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674407+0000", 2024-09-12T22:04:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040222750000000002 2024-09-12T22:04:16.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674417+0000", 2024-09-12T22:04:16.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0125e-05 2024-09-12T22:04:16.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676387+0000", 2024-09-12T22:04:16.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001970112 2024-09-12T22:04:16.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.102 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676394+0000", 2024-09-12T22:04:16.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:04:16.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.102 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676504+0000", 2024-09-12T22:04:16.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109621 2024-09-12T22:04:16.102 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.102 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.102 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.102 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44128 5.d 5:b9a92891:::benchmark_data_smithi043_32659_object44127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.102 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.343970465, 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040118138999999997, 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44128 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:16.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:16.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674435+0000", 2024-09-12T22:04:16.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5960000000000001e-06 2024-09-12T22:04:16.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674485+0000", 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0021000000000001e-05 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674495+0000", 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5189999999999998e-06 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674500+0000", 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674923+0000", 2024-09-12T22:04:16.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000423304 2024-09-12T22:04:16.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675027+0000", 2024-09-12T22:04:16.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103399 2024-09-12T22:04:16.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:16.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675141+0000", 2024-09-12T22:04:16.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114274 2024-09-12T22:04:16.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711649+0000", 2024-09-12T22:04:16.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036508011999999999 2024-09-12T22:04:16.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714466+0000", 2024-09-12T22:04:16.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028167370000000001 2024-09-12T22:04:16.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714508+0000", 2024-09-12T22:04:16.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2679000000000003e-05 2024-09-12T22:04:16.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714552+0000", 2024-09-12T22:04:16.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3528000000000001e-05 2024-09-12T22:04:16.108 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.108 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.108 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.108 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44129 5.0 5:0f626cda:::benchmark_data_smithi043_32659_object44128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.108 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:16.108 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.34389496, 2024-09-12T22:04:16.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042846404999999997, 2024-09-12T22:04:16.108 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.108 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.109 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.109 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.109 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.109 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.109 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44129 2024-09-12T22:04:16.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.109 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:16.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674510+0000", 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1600000000000002e-07 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674548+0000", 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8075999999999999e-05 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674689+0000", 2024-09-12T22:04:16.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014141499999999999 2024-09-12T22:04:16.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674696+0000", 2024-09-12T22:04:16.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4619999999999999e-06 2024-09-12T22:04:16.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713666+0000", 2024-09-12T22:04:16.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.038969072 2024-09-12T22:04:16.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713752+0000", 2024-09-12T22:04:16.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6768999999999995e-05 2024-09-12T22:04:16.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713835+0000", 2024-09-12T22:04:16.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2774000000000004e-05 2024-09-12T22:04:16.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717212+0000", 2024-09-12T22:04:16.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033769389999999998 2024-09-12T22:04:16.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717259+0000", 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7218000000000001e-05 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717310+0000", 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1156999999999998e-05 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717356+0000", 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5107e-05 2024-09-12T22:04:16.113 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.114 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.114 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.114 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44130 5.4 5:27857918:::benchmark_data_smithi043_32659_object44129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.114 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:16.114 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.343697106, 2024-09-12T22:04:16.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039844412000000003, 2024-09-12T22:04:16.114 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.114 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.114 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.114 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.114 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.114 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.115 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44130 2024-09-12T22:04:16.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.115 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:16.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:16.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674708+0000", 2024-09-12T22:04:16.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4300000000000003e-07 2024-09-12T22:04:16.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674749+0000", 2024-09-12T22:04:16.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1254999999999997e-05 2024-09-12T22:04:16.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674756+0000", 2024-09-12T22:04:16.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3289999999999996e-06 2024-09-12T22:04:16.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674762+0000", 2024-09-12T22:04:16.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.852e-06 2024-09-12T22:04:16.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.118 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:16.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9573999999999995e-05 2024-09-12T22:04:16.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.118 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674954+0000", 2024-09-12T22:04:16.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012254200000000001 2024-09-12T22:04:16.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.118 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675033+0000", 2024-09-12T22:04:16.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8707000000000004e-05 2024-09-12T22:04:16.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714381+0000", 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039348053000000001 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714477+0000", 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5650999999999996e-05 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714516+0000", 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9158e-05 2024-09-12T22:04:16.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714551+0000", 2024-09-12T22:04:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5648000000000002e-05 2024-09-12T22:04:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44131 5.0 5:013256f7:::benchmark_data_smithi043_32659_object44130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.343624639, 2024-09-12T22:04:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043388599, 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44131 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674780+0000", 2024-09-12T22:04:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674817+0000", 2024-09-12T22:04:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6859000000000001e-05 2024-09-12T22:04:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.501e-05 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674838+0000", 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-06 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715161+0000", 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.04032285 2024-09-12T22:04:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715317+0000", 2024-09-12T22:04:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015649199999999999 2024-09-12T22:04:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715463+0000", 2024-09-12T22:04:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145704 2024-09-12T22:04:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717480+0000", 2024-09-12T22:04:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020168220000000001 2024-09-12T22:04:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718079+0000", 2024-09-12T22:04:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000599115 2024-09-12T22:04:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718134+0000", 2024-09-12T22:04:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:04:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718168+0000", 2024-09-12T22:04:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4301000000000002e-05 2024-09-12T22:04:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44132 5.e 5:7634b859:::benchmark_data_smithi043_32659_object44131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.342957398999999, 2024-09-12T22:04:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039558587999999999, 2024-09-12T22:04:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44132 2024-09-12T22:04:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675448+0000", 2024-09-12T22:04:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3699999999999999e-07 2024-09-12T22:04:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675552+0000", 2024-09-12T22:04:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104294 2024-09-12T22:04:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675562+0000", 2024-09-12T22:04:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9629999999999993e-06 2024-09-12T22:04:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675569+0000", 2024-09-12T22:04:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8809999999999998e-06 2024-09-12T22:04:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675612+0000", 2024-09-12T22:04:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591000000000003e-05 2024-09-12T22:04:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675717+0000", 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010497099999999999 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675835+0000", 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011793799999999999 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713616+0000", 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037781032999999999 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714911+0000", 2024-09-12T22:04:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001294604 2024-09-12T22:04:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714964+0000", 2024-09-12T22:04:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3408000000000001e-05 2024-09-12T22:04:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715005+0000", 2024-09-12T22:04:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0967999999999998e-05 2024-09-12T22:04:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44133 5.b 5:d0a59edd:::benchmark_data_smithi043_32659_object44132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.342819619, 2024-09-12T22:04:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039513020000000003, 2024-09-12T22:04:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44133 2024-09-12T22:04:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675585+0000", 2024-09-12T22:04:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5499999999999998e-07 2024-09-12T22:04:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675634+0000", 2024-09-12T22:04:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8520999999999998e-05 2024-09-12T22:04:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675641+0000", 2024-09-12T22:04:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4440000000000002e-06 2024-09-12T22:04:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675646+0000", 2024-09-12T22:04:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2660000000000001e-06 2024-09-12T22:04:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675692+0000", 2024-09-12T22:04:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5915999999999999e-05 2024-09-12T22:04:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675812+0000", 2024-09-12T22:04:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119419 2024-09-12T22:04:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675950+0000", 2024-09-12T22:04:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013831499999999999 2024-09-12T22:04:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713574+0000", 2024-09-12T22:04:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037623801999999998 2024-09-12T22:04:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715015+0000", 2024-09-12T22:04:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014410720000000001 2024-09-12T22:04:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715059+0000", 2024-09-12T22:04:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:04:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715097+0000", 2024-09-12T22:04:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8519000000000002e-05 2024-09-12T22:04:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.138 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:16.139 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:16.138+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:16.140 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:16.191 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 22 16 75309 75293 213.883 165.188 0.00571243 0.0046726 2024-09-12T22:04:16.240 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:16.239+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:16.289 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:16.289 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:16.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.290 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:75550 5.2 5:45ea8f3e:::benchmark_data_smithi043_32659_object75549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:16.290 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:16.284151+0000", 2024-09-12T22:04:16.290 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0044450990000000001, 2024-09-12T22:04:16.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044635289999999999, 2024-09-12T22:04:16.290 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.290 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.290 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:16.290 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:16.290 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:16.290 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.290 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 75550 2024-09-12T22:04:16.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.290 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284151+0000", 2024-09-12T22:04:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284151+0000", 2024-09-12T22:04:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284152+0000", 2024-09-12T22:04:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-12T22:04:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284231+0000", 2024-09-12T22:04:16.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8953000000000001e-05 2024-09-12T22:04:16.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284242+0000", 2024-09-12T22:04:16.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1406000000000001e-05 2024-09-12T22:04:16.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284249+0000", 2024-09-12T22:04:16.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6370000000000002e-06 2024-09-12T22:04:16.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284305+0000", 2024-09-12T22:04:16.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6045000000000003e-05 2024-09-12T22:04:16.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284426+0000", 2024-09-12T22:04:16.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0001217 2024-09-12T22:04:16.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284562+0000", 2024-09-12T22:04:16.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013563099999999999 2024-09-12T22:04:16.294 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.294 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.294 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.294 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:75552 5.2 5:4058aadb:::benchmark_data_smithi043_32659_object75551:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:16.294 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:16.284267+0000", 2024-09-12T22:04:16.294 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0043287930000000001, 2024-09-12T22:04:16.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043933080000000003, 2024-09-12T22:04:16.294 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.294 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.294 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 75552 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284267+0000", 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284267+0000", 2024-09-12T22:04:16.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284267+0000", 2024-09-12T22:04:16.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:16.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284301+0000", 2024-09-12T22:04:16.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3429000000000001e-05 2024-09-12T22:04:16.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284307+0000", 2024-09-12T22:04:16.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5999999999999997e-06 2024-09-12T22:04:16.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284310+0000", 2024-09-12T22:04:16.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8319999999999999e-06 2024-09-12T22:04:16.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.286444+0000", 2024-09-12T22:04:16.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021333540000000001 2024-09-12T22:04:16.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.286567+0000", 2024-09-12T22:04:16.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012341699999999999 2024-09-12T22:04:16.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.286729+0000", 2024-09-12T22:04:16.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161786 2024-09-12T22:04:16.298 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.298 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.298 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.298 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:75554 5.2 5:453330b3:::benchmark_data_smithi043_32659_object75553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:16.298 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:16.284884+0000", 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0037116860000000001, 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038161990000000002, 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 75554 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284884+0000", 2024-09-12T22:04:16.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284884+0000", 2024-09-12T22:04:16.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284885+0000", 2024-09-12T22:04:16.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3699999999999999e-07 2024-09-12T22:04:16.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284952+0000", 2024-09-12T22:04:16.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6849999999999999e-05 2024-09-12T22:04:16.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284962+0000", 2024-09-12T22:04:16.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0329000000000001e-05 2024-09-12T22:04:16.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.284969+0000", 2024-09-12T22:04:16.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6810000000000001e-06 2024-09-12T22:04:16.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.288264+0000", 2024-09-12T22:04:16.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032954770000000002 2024-09-12T22:04:16.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.288356+0000", 2024-09-12T22:04:16.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1966999999999995e-05 2024-09-12T22:04:16.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.288493+0000", 2024-09-12T22:04:16.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013693700000000001 2024-09-12T22:04:16.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.302 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.303 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:75559 5.7 5:eac0cc44:::benchmark_data_smithi043_32659_object75558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:16.303 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:16.287134+0000", 2024-09-12T22:04:16.303 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0014612259999999999, 2024-09-12T22:04:16.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001605289, 2024-09-12T22:04:16.303 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.303 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.303 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:16.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:16.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:16.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.304 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 75559 2024-09-12T22:04:16.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.304 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287134+0000", 2024-09-12T22:04:16.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287134+0000", 2024-09-12T22:04:16.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287135+0000", 2024-09-12T22:04:16.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5300000000000002e-07 2024-09-12T22:04:16.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287197+0000", 2024-09-12T22:04:16.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1210000000000005e-05 2024-09-12T22:04:16.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287207+0000", 2024-09-12T22:04:16.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0779e-05 2024-09-12T22:04:16.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287212+0000", 2024-09-12T22:04:16.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0200000000000002e-06 2024-09-12T22:04:16.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287256+0000", 2024-09-12T22:04:16.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3677000000000002e-05 2024-09-12T22:04:16.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287393+0000", 2024-09-12T22:04:16.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013723000000000001 2024-09-12T22:04:16.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287497+0000", 2024-09-12T22:04:16.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000103523 2024-09-12T22:04:16.307 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.307 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.307 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.307 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:75561 5.2 5.20dbfc92 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T22:04:16.308 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:16.287885+0000", 2024-09-12T22:04:16.308 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00071046800000000002, 2024-09-12T22:04:16.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00089028100000000004, 2024-09-12T22:04:16.308 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.308 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.308 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:16.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:16.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:16.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.308 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 75561 2024-09-12T22:04:16.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.308 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287885+0000", 2024-09-12T22:04:16.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287885+0000", 2024-09-12T22:04:16.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287886+0000", 2024-09-12T22:04:16.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7800000000000001e-07 2024-09-12T22:04:16.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287942+0000", 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6572e-05 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287959+0000", 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6059999999999999e-05 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.287965+0000", 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5320000000000003e-06 2024-09-12T22:04:16.310 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.311 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.311 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.311 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.311 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:16.311 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 5 2024-09-12T22:04:16.311 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:16.312 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:16.341 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:16.340+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:16.355 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-09-12T22:04:16.443 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:16.442+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:16.504 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:16.505 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:16.505 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:16.505 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:16.505 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:16.517 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:16.561 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:16.560+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:16.645 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:16.643+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:16.667 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:16.667 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:16.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:16.667 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:16.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.667 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.667 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:16.668 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.214852938999996, 2024-09-12T22:04:16.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018534981999999998, 2024-09-12T22:04:16.668 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.668 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.668 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.668 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:16.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:16.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449725+0000", 2024-09-12T22:04:16.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799999999999999e-06 2024-09-12T22:04:16.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449731+0000", 2024-09-12T22:04:16.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.801e-06 2024-09-12T22:04:16.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449745+0000", 2024-09-12T22:04:16.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4198e-05 2024-09-12T22:04:16.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449758+0000", 2024-09-12T22:04:16.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2858e-05 2024-09-12T22:04:16.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449815+0000", 2024-09-12T22:04:16.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6978999999999998e-05 2024-09-12T22:04:16.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:16.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:16.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2369999999999997e-06 2024-09-12T22:04:16.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457683+0000", 2024-09-12T22:04:16.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078622640000000008 2024-09-12T22:04:16.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457840+0000", 2024-09-12T22:04:16.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015715299999999999 2024-09-12T22:04:16.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:16.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457972+0000", 2024-09-12T22:04:16.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013179500000000001 2024-09-12T22:04:16.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462325+0000", 2024-09-12T22:04:16.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043526859999999997 2024-09-12T22:04:16.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468180+0000", 2024-09-12T22:04:16.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058557169999999999 2024-09-12T22:04:16.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468221+0000", 2024-09-12T22:04:16.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0673000000000002e-05 2024-09-12T22:04:16.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468258+0000", 2024-09-12T22:04:16.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7240999999999998e-05 2024-09-12T22:04:16.674 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.674 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.675 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.675 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.675 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:16.675 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.214800328000003, 2024-09-12T22:04:16.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018748032000000001, 2024-09-12T22:04:16.675 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.675 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.675 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.675 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:16.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:16.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449779+0000", 2024-09-12T22:04:16.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4869999999999998e-06 2024-09-12T22:04:16.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449783+0000", 2024-09-12T22:04:16.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:04:16.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449791+0000", 2024-09-12T22:04:16.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2640000000000002e-06 2024-09-12T22:04:16.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449796+0000", 2024-09-12T22:04:16.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9370000000000001e-06 2024-09-12T22:04:16.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449915+0000", 2024-09-12T22:04:16.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118559 2024-09-12T22:04:16.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:16.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449920+0000", 2024-09-12T22:04:16.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.101e-06 2024-09-12T22:04:16.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458578+0000", 2024-09-12T22:04:16.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008657662 2024-09-12T22:04:16.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458978+0000", 2024-09-12T22:04:16.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00039977399999999998 2024-09-12T22:04:16.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:16.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459130+0000", 2024-09-12T22:04:16.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000152394 2024-09-12T22:04:16.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462793+0000", 2024-09-12T22:04:16.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036628770000000001 2024-09-12T22:04:16.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468451+0000", 2024-09-12T22:04:16.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056577820000000001 2024-09-12T22:04:16.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468501+0000", 2024-09-12T22:04:16.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0609999999999998e-05 2024-09-12T22:04:16.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468524+0000", 2024-09-12T22:04:16.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2804000000000001e-05 2024-09-12T22:04:16.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.682 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.682 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.682 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:16.682 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.214765626999998, 2024-09-12T22:04:16.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018816113999999998, 2024-09-12T22:04:16.682 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.683 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.683 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.683 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:16.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:16.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3360000000000001e-06 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449832+0000", 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1528e-05 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459429+0000", 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095926970000000007 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459597+0000", 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000168309 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459829+0000", 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231158 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462796+0000", 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029673849999999999 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468558+0000", 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057621449999999998 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468592+0000", 2024-09-12T22:04:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4241e-05 2024-09-12T22:04:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468627+0000", 2024-09-12T22:04:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4511999999999998e-05 2024-09-12T22:04:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.688 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:16.688 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.214698599000002, 2024-09-12T22:04:16.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018845905, 2024-09-12T22:04:16.688 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.688 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.688 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.688 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:16.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:16.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:16.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:04:16.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449881+0000", 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.005e-06 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449887+0000", 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9050000000000002e-06 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449892+0000", 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2009999999999998e-06 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460279+0000", 2024-09-12T22:04:16.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010386808000000001 2024-09-12T22:04:16.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460427+0000", 2024-09-12T22:04:16.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014789 2024-09-12T22:04:16.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:16.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460572+0000", 2024-09-12T22:04:16.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014453099999999999 2024-09-12T22:04:16.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462799+0000", 2024-09-12T22:04:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002227049 2024-09-12T22:04:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468672+0000", 2024-09-12T22:04:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058730060000000001 2024-09-12T22:04:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468704+0000", 2024-09-12T22:04:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2421e-05 2024-09-12T22:04:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468724+0000", 2024-09-12T22:04:16.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9582e-05 2024-09-12T22:04:16.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.693 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.693 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.693 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:04:16.693 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.214668129000003, 2024-09-12T22:04:16.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015455175, 2024-09-12T22:04:16.694 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.694 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.694 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.694 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:04:16.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449908+0000", 2024-09-12T22:04:16.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449909+0000", 2024-09-12T22:04:16.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2099999999999997e-07 2024-09-12T22:04:16.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449912+0000", 2024-09-12T22:04:16.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1439999999999999e-06 2024-09-12T22:04:16.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449925+0000", 2024-09-12T22:04:16.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2944e-05 2024-09-12T22:04:16.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449931+0000", 2024-09-12T22:04:16.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3289999999999999e-06 2024-09-12T22:04:16.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:04:16.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:04:16.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:16.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449990+0000", 2024-09-12T22:04:16.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8090000000000004e-06 2024-09-12T22:04:16.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.455881+0000", 2024-09-12T22:04:16.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058904400000000003 2024-09-12T22:04:16.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456556+0000", 2024-09-12T22:04:16.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00067549500000000002 2024-09-12T22:04:16.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.456742+0000", 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018546799999999999 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461053+0000", 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043118310000000003 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465220+0000", 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041667750000000002 2024-09-12T22:04:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465316+0000", 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5996999999999996e-05 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465363+0000", 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7111999999999999e-05 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.214625738000002, 2024-09-12T22:04:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017913407999999999, 2024-09-12T22:04:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3499999999999996e-07 2024-09-12T22:04:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449955+0000", 2024-09-12T22:04:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4379999999999999e-06 2024-09-12T22:04:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449963+0000", 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2719999999999997e-06 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449970+0000", 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5930000000000002e-06 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450563+0000", 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00059351900000000003 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450570+0000", 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3900000000000004e-06 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461148+0000", 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010577354000000001 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461312+0000", 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016392300000000001 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461525+0000", 2024-09-12T22:04:16.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021282199999999999 2024-09-12T22:04:16.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464272+0000", 2024-09-12T22:04:16.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027469740000000001 2024-09-12T22:04:16.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467749+0000", 2024-09-12T22:04:16.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003477235 2024-09-12T22:04:16.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467815+0000", 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5974000000000002e-05 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467864+0000", 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9279e-05 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.705 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:16.706 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.214594271999999, 2024-09-12T22:04:16.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018827507, 2024-09-12T22:04:16.706 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.706 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.706 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.706 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:16.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2739999999999999e-06 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449999+0000", 2024-09-12T22:04:16.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3349e-05 2024-09-12T22:04:16.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450005+0000", 2024-09-12T22:04:16.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.609e-06 2024-09-12T22:04:16.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461006+0000", 2024-09-12T22:04:16.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011000876 2024-09-12T22:04:16.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461236+0000", 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000230301 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461362+0000", 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012541900000000001 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464797+0000", 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034350840000000001 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468754+0000", 2024-09-12T22:04:16.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039576689999999996 2024-09-12T22:04:16.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468784+0000", 2024-09-12T22:04:16.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9558000000000001e-05 2024-09-12T22:04:16.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468810+0000", 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5752e-05 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.214562399999998, 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018888559999999999, 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:16.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:16.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450015+0000", 2024-09-12T22:04:16.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:04:16.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450018+0000", 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3840000000000001e-06 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8859999999999998e-06 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450030+0000", 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4829999999999999e-06 2024-09-12T22:04:16.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465718+0000", 2024-09-12T22:04:16.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015688163000000001 2024-09-12T22:04:16.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465793+0000", 2024-09-12T22:04:16.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4788000000000003e-05 2024-09-12T22:04:16.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:16.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466015+0000", 2024-09-12T22:04:16.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000221394 2024-09-12T22:04:16.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467628+0000", 2024-09-12T22:04:16.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016131190000000001 2024-09-12T22:04:16.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468849+0000", 2024-09-12T22:04:16.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012211699999999999 2024-09-12T22:04:16.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468878+0000", 2024-09-12T22:04:16.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8708e-05 2024-09-12T22:04:16.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468902+0000", 2024-09-12T22:04:16.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868e-05 2024-09-12T22:04:16.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.716 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.716 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:23 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.717 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:16.717 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.214538953000002, 2024-09-12T22:04:16.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021189669000000001, 2024-09-12T22:04:16.717 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.717 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.717 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.717 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:16.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:16.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450038+0000", 2024-09-12T22:04:16.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:16.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450042+0000", 2024-09-12T22:04:16.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7720000000000001e-06 2024-09-12T22:04:16.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450058+0000", 2024-09-12T22:04:16.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6379999999999999e-05 2024-09-12T22:04:16.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450067+0000", 2024-09-12T22:04:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3870000000000001e-06 2024-09-12T22:04:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466409+0000", 2024-09-12T22:04:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016341418999999999 2024-09-12T22:04:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466467+0000", 2024-09-12T22:04:16.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8613999999999998e-05 2024-09-12T22:04:16.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:16.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466612+0000", 2024-09-12T22:04:16.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014415000000000001 2024-09-12T22:04:16.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467856+0000", 2024-09-12T22:04:16.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012440039999999999 2024-09-12T22:04:16.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471178+0000", 2024-09-12T22:04:16.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033227450000000002 2024-09-12T22:04:16.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471207+0000", 2024-09-12T22:04:16.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8571000000000001e-05 2024-09-12T22:04:16.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471227+0000", 2024-09-12T22:04:16.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0109999999999999e-05 2024-09-12T22:04:16.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.723 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.723 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.723 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:16.723 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.214498413000001, 2024-09-12T22:04:16.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021231197, 2024-09-12T22:04:16.723 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.723 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.724 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.724 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:16.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:16.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450079+0000", 2024-09-12T22:04:16.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:04:16.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450083+0000", 2024-09-12T22:04:16.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1989999999999999e-06 2024-09-12T22:04:16.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450092+0000", 2024-09-12T22:04:16.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9400000000000008e-06 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450097+0000", 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466898+0000", 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016801226999999998 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466975+0000", 2024-09-12T22:04:16.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6197000000000002e-05 2024-09-12T22:04:16.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:16.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467158+0000", 2024-09-12T22:04:16.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183876 2024-09-12T22:04:16.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468270+0000", 2024-09-12T22:04:16.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001111229 2024-09-12T22:04:16.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471260+0000", 2024-09-12T22:04:16.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002989907 2024-09-12T22:04:16.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471289+0000", 2024-09-12T22:04:16.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9271000000000001e-05 2024-09-12T22:04:16.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471309+0000", 2024-09-12T22:04:16.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0302999999999999e-05 2024-09-12T22:04:16.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.728 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.729 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.729 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:16.729 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.214471811999999, 2024-09-12T22:04:16.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018145809999999998, 2024-09-12T22:04:16.729 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.729 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.729 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.729 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:16.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:16.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:16.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450114+0000", 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1849999999999993e-06 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1350000000000003e-06 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450128+0000", 2024-09-12T22:04:16.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2040000000000002e-06 2024-09-12T22:04:16.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454085+0000", 2024-09-12T22:04:16.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00395736 2024-09-12T22:04:16.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:16.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454090+0000", 2024-09-12T22:04:16.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.378e-06 2024-09-12T22:04:16.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457076+0000", 2024-09-12T22:04:16.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002985747 2024-09-12T22:04:16.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457178+0000", 2024-09-12T22:04:16.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010242 2024-09-12T22:04:16.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:16.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457452+0000", 2024-09-12T22:04:16.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027313000000000001 2024-09-12T22:04:16.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462024+0000", 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045727040000000004 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468161+0000", 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061372019999999996 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468212+0000", 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0707000000000001e-05 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468250+0000", 2024-09-12T22:04:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8148000000000001e-05 2024-09-12T22:04:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:04:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.213880435999997, 2024-09-12T22:04:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017301410999999999, 2024-09-12T22:04:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.736 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.736 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:04:16.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450696+0000", 2024-09-12T22:04:16.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450699+0000", 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0019999999999998e-06 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450705+0000", 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3199999999999996e-06 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450717+0000", 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2069000000000001e-05 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450726+0000", 2024-09-12T22:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2840000000000006e-06 2024-09-12T22:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454318+0000", 2024-09-12T22:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035919580000000001 2024-09-12T22:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454323+0000", 2024-09-12T22:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2490000000000001e-06 2024-09-12T22:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462054+0000", 2024-09-12T22:04:16.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0077311319999999999 2024-09-12T22:04:16.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462135+0000", 2024-09-12T22:04:16.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1558999999999996e-05 2024-09-12T22:04:16.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462273+0000", 2024-09-12T22:04:16.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013781000000000001 2024-09-12T22:04:16.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464587+0000", 2024-09-12T22:04:16.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023134319999999998 2024-09-12T22:04:16.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467908+0000", 2024-09-12T22:04:16.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033211310000000002 2024-09-12T22:04:16.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467960+0000", 2024-09-12T22:04:16.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2537000000000002e-05 2024-09-12T22:04:16.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467997+0000", 2024-09-12T22:04:16.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6928000000000003e-05 2024-09-12T22:04:16.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.741 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.741 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.741 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:16.742 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.213784257, 2024-09-12T22:04:16.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020127506999999999, 2024-09-12T22:04:16.742 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.742 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.742 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.742 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:16.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450793+0000", 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2800000000000005e-07 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450813+0000", 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0063000000000001e-05 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450847+0000", 2024-09-12T22:04:16.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3973000000000002e-05 2024-09-12T22:04:16.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450862+0000", 2024-09-12T22:04:16.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5358000000000001e-05 2024-09-12T22:04:16.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454355+0000", 2024-09-12T22:04:16.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003492841 2024-09-12T22:04:16.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:16.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454359+0000", 2024-09-12T22:04:16.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-09-12T22:04:16.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458704+0000", 2024-09-12T22:04:16.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043452459999999997 2024-09-12T22:04:16.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459009+0000", 2024-09-12T22:04:16.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030526199999999999 2024-09-12T22:04:16.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459143+0000", 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013375 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462690+0000", 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035466579999999998 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470863+0000", 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0081734089999999995 2024-09-12T22:04:16.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470898+0000", 2024-09-12T22:04:16.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4445e-05 2024-09-12T22:04:16.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470920+0000", 2024-09-12T22:04:16.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1844e-05 2024-09-12T22:04:16.747 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.747 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.747 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.748 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.748 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:16.748 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.212254137999999, 2024-09-12T22:04:16.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018704596, 2024-09-12T22:04:16.748 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.748 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.748 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.748 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:16.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452323+0000", 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452337+0000", 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452489+0000", 2024-09-12T22:04:16.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015167699999999999 2024-09-12T22:04:16.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452498+0000", 2024-09-12T22:04:16.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9709999999999993e-06 2024-09-12T22:04:16.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454393+0000", 2024-09-12T22:04:16.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001895171 2024-09-12T22:04:16.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454397+0000", 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4470000000000002e-06 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459570+0000", 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051728160000000002 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459718+0000", 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014857800000000001 2024-09-12T22:04:16.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:16.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459920+0000", 2024-09-12T22:04:16.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000202043 2024-09-12T22:04:16.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462696+0000", 2024-09-12T22:04:16.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027756299999999999 2024-09-12T22:04:16.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470963+0000", 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082671359999999996 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471000+0000", 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6748999999999997e-05 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471027+0000", 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7118e-05 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.754 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.754 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:04:16.754 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.211328459999997, 2024-09-12T22:04:16.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017680218000000001, 2024-09-12T22:04:16.754 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.754 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.754 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.754 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:04:16.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453248+0000", 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453249+0000", 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453253+0000", 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3630000000000004e-06 2024-09-12T22:04:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453261+0000", 2024-09-12T22:04:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9319999999999996e-06 2024-09-12T22:04:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453267+0000", 2024-09-12T22:04:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7989999999999999e-06 2024-09-12T22:04:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454995+0000", 2024-09-12T22:04:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001727793 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.455000+0000", 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0289999999999996e-06 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461445+0000", 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064456870000000003 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461546+0000", 2024-09-12T22:04:16.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101036 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461680+0000", 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013407299999999999 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464622+0000", 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029413379999999999 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470850+0000", 2024-09-12T22:04:16.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.006227977 2024-09-12T22:04:16.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470902+0000", 2024-09-12T22:04:16.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1916000000000002e-05 2024-09-12T22:04:16.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470928+0000", 2024-09-12T22:04:16.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.65e-05 2024-09-12T22:04:16.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.759 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.760 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:16.760 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:16.760 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.211296863999998, 2024-09-12T22:04:16.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017838390999999999, 2024-09-12T22:04:16.760 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.760 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.760 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:16.760 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:16.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453280+0000", 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453284+0000", 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.194e-06 2024-09-12T22:04:16.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453337+0000", 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2330999999999998e-05 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453353+0000", 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6001000000000001e-05 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454421+0000", 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010681009999999999 2024-09-12T22:04:16.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454424+0000", 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2550000000000002e-06 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460376+0000", 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059517770000000001 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460536+0000", 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015984699999999999 2024-09-12T22:04:16.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471118+0000", 2024-09-12T22:04:16.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010582322999999999 2024-09-12T22:04:16.764 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.764 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.764 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.764 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:16.764 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:16.764 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.031278552, 2024-09-12T22:04:16.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:16.764 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:16.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:16.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:16.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:16.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:16.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:16.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:16.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.769 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:65637 5.2 5:496bd980:::benchmark_data_smithi043_32659_object65636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:12.501459+0000", 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.1631168760000001, 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015326876, 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 65637 2024-09-12T22:04:16.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.501459+0000", 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.501459+0000", 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.501460+0000", 2024-09-12T22:04:16.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0699999999999996e-07 2024-09-12T22:04:16.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.501528+0000", 2024-09-12T22:04:16.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7331999999999998e-05 2024-09-12T22:04:16.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.501537+0000", 2024-09-12T22:04:16.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9719999999999998e-06 2024-09-12T22:04:16.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.501543+0000", 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4060000000000002e-06 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.502723+0000", 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001179841 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.502853+0000", 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013057100000000001 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.503010+0000", 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015690600000000001 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.504422+0000", 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001412188 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.516711+0000", 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012288953 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.516750+0000", 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8396000000000003e-05 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:12.516786+0000", 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6504000000000002e-05 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:75834 5.7 5:edaa6401:::benchmark_data_smithi043_32659_object75833:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:16.395400+0000", 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.26917598500000001, 2024-09-12T22:04:16.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016002796999999999, 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 75834 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.395400+0000", 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.395400+0000", 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.395401+0000", 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8899999999999998e-07 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.395475+0000", 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3287999999999994e-05 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.395488+0000", 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3334e-05 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.395497+0000", 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9970000000000004e-06 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.403525+0000", 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080280330000000004 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.403648+0000", 2024-09-12T22:04:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012311399999999999 2024-09-12T22:04:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.403788+0000", 2024-09-12T22:04:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000140221 2024-09-12T22:04:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.411256+0000", 2024-09-12T22:04:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0074680950000000001 2024-09-12T22:04:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.411321+0000", 2024-09-12T22:04:16.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4559000000000003e-05 2024-09-12T22:04:16.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.411353+0000", 2024-09-12T22:04:16.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1883e-05 2024-09-12T22:04:16.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.411403+0000", 2024-09-12T22:04:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0383999999999997e-05 2024-09-12T22:04:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:75856 5.7 5:e4c16863:::benchmark_data_smithi043_32659_object75855:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:16.403897+0000", 2024-09-12T22:04:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.26067951, 2024-09-12T22:04:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016625193999999999, 2024-09-12T22:04:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:16.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:16.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:16.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.782 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 75856 2024-09-12T22:04:16.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.782 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:16.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:16.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.403897+0000", 2024-09-12T22:04:16.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:16.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.403897+0000", 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.403898+0000", 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7300000000000005e-07 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.403954+0000", 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5915999999999998e-05 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.403963+0000", 2024-09-12T22:04:16.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4220000000000006e-06 2024-09-12T22:04:16.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.403970+0000", 2024-09-12T22:04:16.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5699999999999998e-06 2024-09-12T22:04:16.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:16.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.413644+0000", 2024-09-12T22:04:16.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0096739619999999995 2024-09-12T22:04:16.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.413808+0000", 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016405400000000001 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.413949+0000", 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014155999999999999 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.418750+0000", 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048006780000000001 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.420370+0000", 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001620518 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.420442+0000", 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1600999999999994e-05 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:16.420522+0000", 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0039999999999999e-05 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:16.787 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:16.787 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:16.788 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:16.787+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:16.789 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:16.889 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:16.888+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:16.938 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:16.939 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:16.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.939 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:77258 5.4 5:2c6580cf:::benchmark_data_smithi043_32659_object77257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:16.939 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.936145+0000", 2024-09-12T22:04:16.939 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00069855099999999995, 2024-09-12T22:04:16.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00072445799999999998, 2024-09-12T22:04:16.939 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.939 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.939 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:16.939 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.939 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.939 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.939 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 77258 2024-09-12T22:04:16.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.940 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936145+0000", 2024-09-12T22:04:16.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936145+0000", 2024-09-12T22:04:16.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.941 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936146+0000", 2024-09-12T22:04:16.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4869999999999999e-06 2024-09-12T22:04:16.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.941 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936254+0000", 2024-09-12T22:04:16.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000107672 2024-09-12T22:04:16.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.941 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936265+0000", 2024-09-12T22:04:16.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1795e-05 2024-09-12T22:04:16.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936273+0000", 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8660000000000006e-06 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936335+0000", 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1340000000000006e-05 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936455+0000", 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012001400000000001 2024-09-12T22:04:16.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936597+0000", 2024-09-12T22:04:16.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014265799999999999 2024-09-12T22:04:16.943 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.943 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.943 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.943 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:77251 5.b e32/22)", 2024-09-12T22:04:16.943 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.936318+0000", 2024-09-12T22:04:16.943 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00052461800000000002, 2024-09-12T22:04:16.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00061944300000000001, 2024-09-12T22:04:16.943 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.944 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.944 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:16.944 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936318+0000", 2024-09-12T22:04:16.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936318+0000", 2024-09-12T22:04:16.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936319+0000", 2024-09-12T22:04:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:04:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936322+0000", 2024-09-12T22:04:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1990000000000002e-06 2024-09-12T22:04:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936330+0000", 2024-09-12T22:04:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9279999999999993e-06 2024-09-12T22:04:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936336+0000", 2024-09-12T22:04:16.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2269999999999998e-06 2024-09-12T22:04:16.946 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.946 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.946 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.946 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:77236 5.0 5:086adda7:::benchmark_data_smithi043_32659_object77235:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:16.946 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.926323+0000", 2024-09-12T22:04:16.946 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.010519743999999999, 2024-09-12T22:04:16.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010664177, 2024-09-12T22:04:16.946 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.947 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.947 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:16.947 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.947 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.947 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.947 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 77236 2024-09-12T22:04:16.947 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.947 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.947 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.947 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.926323+0000", 2024-09-12T22:04:16.947 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.947 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.926323+0000", 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.926324+0000", 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2600000000000001e-07 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.926426+0000", 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010153399999999999 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.926438+0000", 2024-09-12T22:04:16.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2289e-05 2024-09-12T22:04:16.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.926446+0000", 2024-09-12T22:04:16.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4499999999999998e-06 2024-09-12T22:04:16.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928516+0000", 2024-09-12T22:04:16.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020699770000000002 2024-09-12T22:04:16.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928628+0000", 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112371 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928760+0000", 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000132399 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.934710+0000", 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0059494989999999996 2024-09-12T22:04:16.950 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.951 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.951 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.951 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:77239 5.8 5:147d0735:::benchmark_data_smithi043_32659_object77238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:16.951 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.927255+0000", 2024-09-12T22:04:16.951 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0095876480000000007, 2024-09-12T22:04:16.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0098051309999999999, 2024-09-12T22:04:16.951 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.951 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.951 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:16.951 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.951 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.951 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.952 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 77239 2024-09-12T22:04:16.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.952 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.927255+0000", 2024-09-12T22:04:16.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.927255+0000", 2024-09-12T22:04:16.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.927256+0000", 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.927333+0000", 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7074000000000001e-05 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.927347+0000", 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3356999999999999e-05 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.927354+0000", 2024-09-12T22:04:16.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3189999999999997e-06 2024-09-12T22:04:16.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928418+0000", 2024-09-12T22:04:16.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001063619 2024-09-12T22:04:16.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928537+0000", 2024-09-12T22:04:16.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119154 2024-09-12T22:04:16.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928673+0000", 2024-09-12T22:04:16.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000136348 2024-09-12T22:04:16.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.935934+0000", 2024-09-12T22:04:16.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0072609909999999996 2024-09-12T22:04:16.955 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.955 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.955 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.956 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:77242 5.0 5:0b98eaef:::benchmark_data_smithi043_32659_object77241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:16.956 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.927762+0000", 2024-09-12T22:04:16.956 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0090807470000000001, 2024-09-12T22:04:16.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093727350000000001, 2024-09-12T22:04:16.956 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.956 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.956 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:16.956 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.956 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.956 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.956 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 77242 2024-09-12T22:04:16.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.956 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.927762+0000", 2024-09-12T22:04:16.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.927762+0000", 2024-09-12T22:04:16.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.927763+0000", 2024-09-12T22:04:16.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.61e-07 2024-09-12T22:04:16.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.927793+0000", 2024-09-12T22:04:16.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0102000000000001e-05 2024-09-12T22:04:16.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.927805+0000", 2024-09-12T22:04:16.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1496e-05 2024-09-12T22:04:16.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.927812+0000", 2024-09-12T22:04:16.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1550000000000001e-06 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930794+0000", 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0029816489999999998 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930915+0000", 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012148500000000001 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931044+0000", 2024-09-12T22:04:16.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012942499999999999 2024-09-12T22:04:16.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936041+0000", 2024-09-12T22:04:16.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049961809999999997 2024-09-12T22:04:16.960 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.960 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.960 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.960 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:77244 5.b 5:d65469c0:::benchmark_data_smithi043_32659_object77243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:16.960 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.928641+0000", 2024-09-12T22:04:16.960 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0082019139999999994, 2024-09-12T22:04:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0085664839999999992, 2024-09-12T22:04:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 77244 2024-09-12T22:04:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928641+0000", 2024-09-12T22:04:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928641+0000", 2024-09-12T22:04:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928642+0000", 2024-09-12T22:04:16.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9500000000000001e-07 2024-09-12T22:04:16.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928674+0000", 2024-09-12T22:04:16.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2190999999999997e-05 2024-09-12T22:04:16.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928684+0000", 2024-09-12T22:04:16.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8290000000000003e-06 2024-09-12T22:04:16.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928690+0000", 2024-09-12T22:04:16.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4520000000000002e-06 2024-09-12T22:04:16.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928735+0000", 2024-09-12T22:04:16.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4440999999999997e-05 2024-09-12T22:04:16.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928848+0000", 2024-09-12T22:04:16.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011311600000000001 2024-09-12T22:04:16.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.928976+0000", 2024-09-12T22:04:16.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012846900000000001 2024-09-12T22:04:16.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.935817+0000", 2024-09-12T22:04:16.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0068404329999999999 2024-09-12T22:04:16.966 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.966 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.966 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.966 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:77248 5.8 5:19ab8b8f:::benchmark_data_smithi043_32659_object77247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:16.966 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.930410+0000", 2024-09-12T22:04:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0064334140000000001, 2024-09-12T22:04:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0068721570000000003, 2024-09-12T22:04:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 77248 2024-09-12T22:04:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930410+0000", 2024-09-12T22:04:16.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930410+0000", 2024-09-12T22:04:16.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930411+0000", 2024-09-12T22:04:16.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.362e-06 2024-09-12T22:04:16.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930450+0000", 2024-09-12T22:04:16.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8646999999999998e-05 2024-09-12T22:04:16.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930462+0000", 2024-09-12T22:04:16.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2162e-05 2024-09-12T22:04:16.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930470+0000", 2024-09-12T22:04:16.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0909999999999993e-06 2024-09-12T22:04:16.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933497+0000", 2024-09-12T22:04:16.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003027039 2024-09-12T22:04:16.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933612+0000", 2024-09-12T22:04:16.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115364 2024-09-12T22:04:16.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933753+0000", 2024-09-12T22:04:16.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014021699999999999 2024-09-12T22:04:16.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936134+0000", 2024-09-12T22:04:16.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023809669999999999 2024-09-12T22:04:16.975 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.975 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.975 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.976 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:77247 5.f e32/22 5:fc829029:::benchmark_data_smithi043_32659_object77246:head v 32'4869, mlcod=32'4867)", 2024-09-12T22:04:16.976 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.930606+0000", 2024-09-12T22:04:16.976 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0062368670000000001, 2024-09-12T22:04:16.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0067446880000000004, 2024-09-12T22:04:16.976 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.976 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.977 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:16.977 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930606+0000", 2024-09-12T22:04:16.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930606+0000", 2024-09-12T22:04:16.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930607+0000", 2024-09-12T22:04:16.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1900000000000003e-07 2024-09-12T22:04:16.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930656+0000", 2024-09-12T22:04:16.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9314999999999998e-05 2024-09-12T22:04:16.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930666+0000", 2024-09-12T22:04:16.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6490000000000003e-06 2024-09-12T22:04:16.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930671+0000", 2024-09-12T22:04:16.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:04:16.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930712+0000", 2024-09-12T22:04:16.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0586000000000001e-05 2024-09-12T22:04:16.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.930750+0000", 2024-09-12T22:04:16.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7731999999999997e-05 2024-09-12T22:04:16.981 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.981 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.981 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.981 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:77251 5.b 5:d77d3b75:::benchmark_data_smithi043_32659_object77250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:16.981 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.931061+0000", 2024-09-12T22:04:16.981 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0057820850000000002, 2024-09-12T22:04:16.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0063468159999999999, 2024-09-12T22:04:16.981 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.981 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.982 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:16.982 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.982 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.982 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.982 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 77251 2024-09-12T22:04:16.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.982 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931061+0000", 2024-09-12T22:04:16.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931061+0000", 2024-09-12T22:04:16.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931062+0000", 2024-09-12T22:04:16.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3500000000000005e-07 2024-09-12T22:04:16.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931126+0000", 2024-09-12T22:04:16.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4508e-05 2024-09-12T22:04:16.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931134+0000", 2024-09-12T22:04:16.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9410000000000007e-06 2024-09-12T22:04:16.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931139+0000", 2024-09-12T22:04:16.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6670000000000004e-06 2024-09-12T22:04:16.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933547+0000", 2024-09-12T22:04:16.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024075960000000001 2024-09-12T22:04:16.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933665+0000", 2024-09-12T22:04:16.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011830200000000001 2024-09-12T22:04:16.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:16.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933755+0000", 2024-09-12T22:04:16.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9981000000000005e-05 2024-09-12T22:04:16.986 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.986 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.986 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.987 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:77249 5.a e32/22 5:5cbb297f:::benchmark_data_smithi043_32659_object77248:head v 32'4829, mlcod=32'4827)", 2024-09-12T22:04:16.987 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.931149+0000", 2024-09-12T22:04:16.987 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0056936859999999999, 2024-09-12T22:04:16.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0063238369999999997, 2024-09-12T22:04:16.987 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.987 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.987 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:16.987 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931149+0000", 2024-09-12T22:04:16.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931149+0000", 2024-09-12T22:04:16.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931150+0000", 2024-09-12T22:04:16.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7299999999999996e-07 2024-09-12T22:04:16.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931217+0000", 2024-09-12T22:04:16.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7089999999999996e-05 2024-09-12T22:04:16.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931225+0000", 2024-09-12T22:04:16.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4510000000000003e-06 2024-09-12T22:04:16.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931230+0000", 2024-09-12T22:04:16.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3759999999999999e-06 2024-09-12T22:04:16.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931267+0000", 2024-09-12T22:04:16.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7029000000000001e-05 2024-09-12T22:04:16.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.931280+0000", 2024-09-12T22:04:16.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3311e-05 2024-09-12T22:04:16.991 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.991 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.991 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.992 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:77253 5.d 5:bacfd6ef:::benchmark_data_smithi043_32659_object77252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:16.992 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.932296+0000", 2024-09-12T22:04:16.992 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.004547349, 2024-09-12T22:04:16.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0052402910000000002, 2024-09-12T22:04:16.992 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.992 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.992 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:16.992 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:16.992 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:16.993 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:16.993 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 77253 2024-09-12T22:04:16.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.993 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932296+0000", 2024-09-12T22:04:16.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932296+0000", 2024-09-12T22:04:16.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932297+0000", 2024-09-12T22:04:16.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4e-07 2024-09-12T22:04:16.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932363+0000", 2024-09-12T22:04:16.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6676999999999999e-05 2024-09-12T22:04:16.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:16.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932374+0000", 2024-09-12T22:04:16.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1093e-05 2024-09-12T22:04:16.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:16.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932381+0000", 2024-09-12T22:04:16.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4180000000000002e-06 2024-09-12T22:04:16.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:16.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932437+0000", 2024-09-12T22:04:16.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6592999999999998e-05 2024-09-12T22:04:16.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:16.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932576+0000", 2024-09-12T22:04:16.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013901300000000001 2024-09-12T22:04:16.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:16.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932716+0000", 2024-09-12T22:04:16.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000139844 2024-09-12T22:04:16.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:16.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.935644+0000", 2024-09-12T22:04:16.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0029273340000000002 2024-09-12T22:04:16.997 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.997 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:16.997 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:16.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.998 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:77252 5.f e32/22 5:fa706c1d:::benchmark_data_smithi043_32659_object77251:head v 32'4870, mlcod=32'4867)", 2024-09-12T22:04:16.998 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.932550+0000", 2024-09-12T22:04:16.998 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.004292695, 2024-09-12T22:04:16.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0050630129999999999, 2024-09-12T22:04:16.998 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:16.998 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:16.998 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:16.998 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:16.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:16.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932550+0000", 2024-09-12T22:04:16.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:16.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932550+0000", 2024-09-12T22:04:16.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:16.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:16.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932551+0000", 2024-09-12T22:04:16.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7299999999999995e-07 2024-09-12T22:04:16.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:16.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:16.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:16.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932606+0000", 2024-09-12T22:04:17.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5281000000000001e-05 2024-09-12T22:04:17.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932614+0000", 2024-09-12T22:04:17.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8310000000000001e-06 2024-09-12T22:04:17.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.932619+0000", 2024-09-12T22:04:17.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7899999999999999e-06 2024-09-12T22:04:17.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933615+0000", 2024-09-12T22:04:17.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00099569599999999991 2024-09-12T22:04:17.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933631+0000", 2024-09-12T22:04:17.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6526999999999999e-05 2024-09-12T22:04:17.001 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.001 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.001 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:77250 5.a e32/22 5:520b73cc:::benchmark_data_smithi043_32659_object77249:head v 32'4830, mlcod=32'4827)", 2024-09-12T22:04:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.933367+0000", 2024-09-12T22:04:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0034757630000000002, 2024-09-12T22:04:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043025590000000001, 2024-09-12T22:04:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933367+0000", 2024-09-12T22:04:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933367+0000", 2024-09-12T22:04:17.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933368+0000", 2024-09-12T22:04:17.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0100000000000004e-07 2024-09-12T22:04:17.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933430+0000", 2024-09-12T22:04:17.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1538999999999995e-05 2024-09-12T22:04:17.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933441+0000", 2024-09-12T22:04:17.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1728e-05 2024-09-12T22:04:17.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933449+0000", 2024-09-12T22:04:17.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:04:17.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933530+0000", 2024-09-12T22:04:17.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1551000000000006e-05 2024-09-12T22:04:17.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933548+0000", 2024-09-12T22:04:17.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7524999999999999e-05 2024-09-12T22:04:17.005 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.005 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.006 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.006 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:77255 5.b 5:d674225f:::benchmark_data_smithi043_32659_object77254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:17.006 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.933544+0000", 2024-09-12T22:04:17.006 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0032990559999999999, 2024-09-12T22:04:17.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0041730609999999996, 2024-09-12T22:04:17.006 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.006 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.006 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:17.006 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.006 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.006 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.007 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 77255 2024-09-12T22:04:17.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.007 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933544+0000", 2024-09-12T22:04:17.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933544+0000", 2024-09-12T22:04:17.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933545+0000", 2024-09-12T22:04:17.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8800000000000001e-07 2024-09-12T22:04:17.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933651+0000", 2024-09-12T22:04:17.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010614 2024-09-12T22:04:17.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933660+0000", 2024-09-12T22:04:17.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8019999999999998e-06 2024-09-12T22:04:17.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933666+0000", 2024-09-12T22:04:17.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:04:17.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.935866+0000", 2024-09-12T22:04:17.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021995869999999998 2024-09-12T22:04:17.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.935963+0000", 2024-09-12T22:04:17.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7009000000000006e-05 2024-09-12T22:04:17.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.936063+0000", 2024-09-12T22:04:17.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9722999999999994e-05 2024-09-12T22:04:17.010 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.010 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.010 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.010 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:77256 5.f e32/22 5:fd4b06cc:::benchmark_data_smithi043_32659_object77255:head v 32'4871, mlcod=32'4867)", 2024-09-12T22:04:17.010 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:16.933973+0000", 2024-09-12T22:04:17.011 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0028704619999999998, 2024-09-12T22:04:17.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003782007, 2024-09-12T22:04:17.011 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.011 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.011 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:17.011 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933973+0000", 2024-09-12T22:04:17.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933973+0000", 2024-09-12T22:04:17.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.933973+0000", 2024-09-12T22:04:17.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.61e-07 2024-09-12T22:04:17.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.934042+0000", 2024-09-12T22:04:17.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8666999999999998e-05 2024-09-12T22:04:17.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.934054+0000", 2024-09-12T22:04:17.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1609e-05 2024-09-12T22:04:17.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.934062+0000", 2024-09-12T22:04:17.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4589999999999998e-06 2024-09-12T22:04:17.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.935647+0000", 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015849919999999999 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:16.935660+0000", 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2641e-05 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 15 2024-09-12T22:04:17.014 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:17.017 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:17.017 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:17.015+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:17.117 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:17.116+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:17.191 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 23 16 77960 77944 211.787 165.688 0.00609456 0.00471892 2024-09-12T22:04:17.202 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:17.203 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:17.203 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:17.203 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:17.203 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:17.214 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:17.256 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:17.255+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:17.319 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:17.318+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:17.402 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:17.403 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:17.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:17.403 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:17.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.403 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44102 5.0 5:0d5aa1ff:::benchmark_data_smithi043_32659_object44101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.403 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:17.403 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.775494651000001, 2024-09-12T22:04:17.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051636015, 2024-09-12T22:04:17.403 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.403 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.403 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.403 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.403 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.404 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.404 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44102 2024-09-12T22:04:17.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.404 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:17.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:17.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624875+0000", 2024-09-12T22:04:17.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:04:17.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624930+0000", 2024-09-12T22:04:17.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5256000000000001e-05 2024-09-12T22:04:17.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624951+0000", 2024-09-12T22:04:17.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0551999999999999e-05 2024-09-12T22:04:17.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624958+0000", 2024-09-12T22:04:17.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1849999999999998e-06 2024-09-12T22:04:17.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629885+0000", 2024-09-12T22:04:17.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049266120000000004 2024-09-12T22:04:17.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629999+0000", 2024-09-12T22:04:17.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011385 2024-09-12T22:04:17.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630125+0000", 2024-09-12T22:04:17.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012640500000000001 2024-09-12T22:04:17.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633338+0000", 2024-09-12T22:04:17.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032135559999999998 2024-09-12T22:04:17.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676425+0000", 2024-09-12T22:04:17.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043086753999999998 2024-09-12T22:04:17.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676472+0000", 2024-09-12T22:04:17.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6971999999999997e-05 2024-09-12T22:04:17.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676510+0000", 2024-09-12T22:04:17.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8096999999999998e-05 2024-09-12T22:04:17.409 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.409 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.409 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.409 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44103 5.8 5:170742c6:::benchmark_data_smithi043_32659_object44102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.409 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:17.409 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.7753715, 2024-09-12T22:04:17.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051500936999999997, 2024-09-12T22:04:17.410 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.410 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.410 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.410 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.410 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.410 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.410 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44103 2024-09-12T22:04:17.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.410 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:17.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:17.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624998+0000", 2024-09-12T22:04:17.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:17.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625061+0000", 2024-09-12T22:04:17.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2667000000000002e-05 2024-09-12T22:04:17.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625069+0000", 2024-09-12T22:04:17.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999993e-06 2024-09-12T22:04:17.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625077+0000", 2024-09-12T22:04:17.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0090000000000007e-06 2024-09-12T22:04:17.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629869+0000", 2024-09-12T22:04:17.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047921769999999999 2024-09-12T22:04:17.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629938+0000", 2024-09-12T22:04:17.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9542000000000006e-05 2024-09-12T22:04:17.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630010+0000", 2024-09-12T22:04:17.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1795e-05 2024-09-12T22:04:17.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676348+0000", 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.046337830000000003 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676399+0000", 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1150000000000003e-05 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676460+0000", 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1142999999999994e-05 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676498+0000", 2024-09-12T22:04:17.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8111000000000002e-05 2024-09-12T22:04:17.415 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.415 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.415 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.415 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.415 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:17.415 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.774073075, 2024-09-12T22:04:17.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:17.415 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.415 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.415 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.416 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.416 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.416 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.416 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:17.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.416 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:17.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:17.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:17.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:17.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:17.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:17.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:17.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:17.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:17.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:17.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:17.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:17.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:17.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:17.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:17.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:17.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:17.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:17.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:17.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:17.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:17.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:17.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:17.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:17.421 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.421 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.421 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.421 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44115 5.0 5:0ee09c30:::benchmark_data_smithi043_32659_object44114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.421 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:17.421 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.771300397999999, 2024-09-12T22:04:17.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082887358999999994, 2024-09-12T22:04:17.421 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.421 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.421 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.422 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.422 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.422 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.422 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44115 2024-09-12T22:04:17.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.422 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:17.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629070+0000", 2024-09-12T22:04:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1209999999999999e-06 2024-09-12T22:04:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629132+0000", 2024-09-12T22:04:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2557000000000004e-05 2024-09-12T22:04:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629147+0000", 2024-09-12T22:04:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4491999999999999e-05 2024-09-12T22:04:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629156+0000", 2024-09-12T22:04:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7089999999999997e-06 2024-09-12T22:04:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631865+0000", 2024-09-12T22:04:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00270835 2024-09-12T22:04:17.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631932+0000", 2024-09-12T22:04:17.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7322000000000004e-05 2024-09-12T22:04:17.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632095+0000", 2024-09-12T22:04:17.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016314699999999999 2024-09-12T22:04:17.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676360+0000", 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044264756000000002 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711854+0000", 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.03549389 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711919+0000", 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5024000000000006e-05 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711956+0000", 2024-09-12T22:04:17.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6990999999999999e-05 2024-09-12T22:04:17.427 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.427 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.427 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.427 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44117 5.8 5:1ecb02e0:::benchmark_data_smithi043_32659_object44116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.427 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:17.427 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.771155578, 2024-09-12T22:04:17.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082354986000000005, 2024-09-12T22:04:17.427 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.427 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.427 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.427 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.428 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.428 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.428 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44117 2024-09-12T22:04:17.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.428 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:17.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:17.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629214+0000", 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629315+0000", 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010045800000000001 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629328+0000", 2024-09-12T22:04:17.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3016e-05 2024-09-12T22:04:17.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629336+0000", 2024-09-12T22:04:17.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7229999999999993e-06 2024-09-12T22:04:17.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631856+0000", 2024-09-12T22:04:17.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025199300000000001 2024-09-12T22:04:17.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631954+0000", 2024-09-12T22:04:17.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7565999999999994e-05 2024-09-12T22:04:17.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632073+0000", 2024-09-12T22:04:17.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119677 2024-09-12T22:04:17.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676523+0000", 2024-09-12T22:04:17.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044449163 2024-09-12T22:04:17.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676612+0000", 2024-09-12T22:04:17.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9579000000000004e-05 2024-09-12T22:04:17.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.432 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711509+0000", 2024-09-12T22:04:17.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.034897125000000001 2024-09-12T22:04:17.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.432 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711568+0000", 2024-09-12T22:04:17.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8996999999999998e-05 2024-09-12T22:04:17.432 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.432 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.433 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.433 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44120 5.b 5:df1f2c5f:::benchmark_data_smithi043_32659_object44119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.433 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:17.433 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.768979916999999, 2024-09-12T22:04:17.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043861974999999997, 2024-09-12T22:04:17.433 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.433 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.433 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.433 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.433 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.433 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.433 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44120 2024-09-12T22:04:17.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.434 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:17.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:17.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631390+0000", 2024-09-12T22:04:17.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:04:17.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631444+0000", 2024-09-12T22:04:17.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-12T22:04:17.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631452+0000", 2024-09-12T22:04:17.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4610000000000008e-06 2024-09-12T22:04:17.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631458+0000", 2024-09-12T22:04:17.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:04:17.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631509+0000", 2024-09-12T22:04:17.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1442e-05 2024-09-12T22:04:17.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631627+0000", 2024-09-12T22:04:17.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011796800000000001 2024-09-12T22:04:17.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631814+0000", 2024-09-12T22:04:17.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018735400000000001 2024-09-12T22:04:17.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674612+0000", 2024-09-12T22:04:17.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042797287000000003 2024-09-12T22:04:17.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675160+0000", 2024-09-12T22:04:17.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000548187 2024-09-12T22:04:17.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675207+0000", 2024-09-12T22:04:17.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6833999999999999e-05 2024-09-12T22:04:17.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675251+0000", 2024-09-12T22:04:17.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4348000000000003e-05 2024-09-12T22:04:17.438 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.438 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.438 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.439 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.439 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:17.439 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.768672134999999, 2024-09-12T22:04:17.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:17.439 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.439 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.439 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.439 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.439 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.439 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.439 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:17.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.440 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.440 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:17.440 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.440 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:17.440 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:17.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:17.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:17.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:17.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:17.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:17.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.442 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:17.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:17.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.442 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:17.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:17.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.442 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:17.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:17.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.443 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.443 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:17.443 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:17.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.443 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.443 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:17.443 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:17.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.443 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.443 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:17.443 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:17.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.444 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.444 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:17.444 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:17.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.444 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.444 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:17.444 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:17.444 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.444 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.444 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.445 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44122 5.d 5:bfd04815:::benchmark_data_smithi043_32659_object44121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.445 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:17.445 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.768574083000001, 2024-09-12T22:04:17.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.080166395000000001, 2024-09-12T22:04:17.445 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.445 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.445 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.445 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.445 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.445 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.445 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44122 2024-09-12T22:04:17.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.446 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.446 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:17.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.446 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:17.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.446 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:17.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:04:17.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631853+0000", 2024-09-12T22:04:17.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7209000000000001e-05 2024-09-12T22:04:17.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631858+0000", 2024-09-12T22:04:17.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:04:17.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631862+0000", 2024-09-12T22:04:17.448 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.692e-06 2024-09-12T22:04:17.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631905+0000", 2024-09-12T22:04:17.448 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3135e-05 2024-09-12T22:04:17.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632032+0000", 2024-09-12T22:04:17.448 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012740900000000001 2024-09-12T22:04:17.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632166+0000", 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013318800000000001 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674894+0000", 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042728690999999999 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711875+0000", 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036980631 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.450 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711923+0000", 2024-09-12T22:04:17.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8180000000000003e-05 2024-09-12T22:04:17.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.450 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711961+0000", 2024-09-12T22:04:17.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8142000000000002e-05 2024-09-12T22:04:17.450 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.450 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.450 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.450 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44123 5.e 5:7d83ca89:::benchmark_data_smithi043_32659_object44122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.451 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:17.451 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.768442315, 2024-09-12T22:04:17.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043329329, 2024-09-12T22:04:17.451 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.451 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.451 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.451 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.451 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.451 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.451 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44123 2024-09-12T22:04:17.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.451 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:17.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:17.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631928+0000", 2024-09-12T22:04:17.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2699999999999998e-07 2024-09-12T22:04:17.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631996+0000", 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8141999999999999e-05 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632004+0000", 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7600000000000008e-06 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632010+0000", 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:04:17.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632069+0000", 2024-09-12T22:04:17.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8260000000000001e-05 2024-09-12T22:04:17.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632226+0000", 2024-09-12T22:04:17.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015702199999999999 2024-09-12T22:04:17.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632337+0000", 2024-09-12T22:04:17.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111069 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674909+0000", 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042571854999999999 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675184+0000", 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027561399999999998 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675222+0000", 2024-09-12T22:04:17.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7710999999999999e-05 2024-09-12T22:04:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675256+0000", 2024-09-12T22:04:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4014000000000003e-05 2024-09-12T22:04:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.767730867999999, 2024-09-12T22:04:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:17.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:17.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:17.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:17.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:17.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:17.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:17.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:17.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:17.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44098 5.0 e28/22 ondisk, result = 0)", 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.767340053, 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043332180999999997, 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.462 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:17.463 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:17.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:17.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633030+0000", 2024-09-12T22:04:17.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:17.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633035+0000", 2024-09-12T22:04:17.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:04:17.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633043+0000", 2024-09-12T22:04:17.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:17.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633048+0000", 2024-09-12T22:04:17.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5439999999999998e-06 2024-09-12T22:04:17.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633362+0000", 2024-09-12T22:04:17.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031397400000000001 2024-09-12T22:04:17.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633369+0000", 2024-09-12T22:04:17.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:04:17.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676361+0000", 2024-09-12T22:04:17.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042991954999999998 2024-09-12T22:04:17.466 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.466 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.466 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.466 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.466 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:17.466 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.766732948, 2024-09-12T22:04:17.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:17.466 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.466 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.467 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.467 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.467 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.467 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.467 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:17.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.467 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:17.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:17.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:17.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:17.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:17.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:17.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:17.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:17.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:17.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:17.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:17.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:17.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.471 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:17.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:17.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.471 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:17.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:17.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.471 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:17.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:44125 5.9 e28/22 5:9022696f:::benchmark_data_smithi043_32659_object44124:head v 28'2753, mlcod=28'2751)", 2024-09-12T22:04:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.766694083000001, 2024-09-12T22:04:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042744011999999998, 2024-09-12T22:04:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633676+0000", 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.44e-07 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633755+0000", 2024-09-12T22:04:17.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9629000000000006e-05 2024-09-12T22:04:17.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674386+0000", 2024-09-12T22:04:17.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631364000000003 2024-09-12T22:04:17.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674399+0000", 2024-09-12T22:04:17.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2047e-05 2024-09-12T22:04:17.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674453+0000", 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4453999999999997e-05 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674479+0000", 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6064999999999999e-05 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676381+0000", 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001901874 2024-09-12T22:04:17.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676419+0000", 2024-09-12T22:04:17.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7935000000000002e-05 2024-09-12T22:04:17.476 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.476 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.476 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.476 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44103 5.8 e28/22 ondisk, result = 0)", 2024-09-12T22:04:17.476 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:17.476 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.766188115, 2024-09-12T22:04:17.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042322950999999998, 2024-09-12T22:04:17.476 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.477 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.477 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:17.477 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:17.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:17.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:17.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:04:17.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634184+0000", 2024-09-12T22:04:17.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7690000000000001e-06 2024-09-12T22:04:17.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674407+0000", 2024-09-12T22:04:17.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040222750000000002 2024-09-12T22:04:17.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674417+0000", 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0125e-05 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676387+0000", 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001970112 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676394+0000", 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:04:17.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.480 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.480 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676504+0000", 2024-09-12T22:04:17.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109621 2024-09-12T22:04:17.480 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.480 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.480 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.480 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44128 5.d 5:b9a92891:::benchmark_data_smithi043_32659_object44127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.480 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:17.480 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.725935326, 2024-09-12T22:04:17.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040118138999999997, 2024-09-12T22:04:17.480 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.481 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.481 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.481 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44128 2024-09-12T22:04:17.481 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.481 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.481 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.481 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.481 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:17.481 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.481 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.481 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674435+0000", 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5960000000000001e-06 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674485+0000", 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0021000000000001e-05 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674495+0000", 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5189999999999998e-06 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674500+0000", 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674923+0000", 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000423304 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675027+0000", 2024-09-12T22:04:17.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103399 2024-09-12T22:04:17.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:17.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675141+0000", 2024-09-12T22:04:17.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114274 2024-09-12T22:04:17.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711649+0000", 2024-09-12T22:04:17.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036508011999999999 2024-09-12T22:04:17.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714466+0000", 2024-09-12T22:04:17.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028167370000000001 2024-09-12T22:04:17.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714508+0000", 2024-09-12T22:04:17.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2679000000000003e-05 2024-09-12T22:04:17.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714552+0000", 2024-09-12T22:04:17.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3528000000000001e-05 2024-09-12T22:04:17.486 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.486 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.486 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.486 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44129 5.0 5:0f626cda:::benchmark_data_smithi043_32659_object44128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.486 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:17.486 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.725859821, 2024-09-12T22:04:17.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042846404999999997, 2024-09-12T22:04:17.486 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.486 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.486 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.486 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.487 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.487 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.487 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44129 2024-09-12T22:04:17.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.487 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.487 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.487 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:17.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.487 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.487 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:17.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674510+0000", 2024-09-12T22:04:17.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1600000000000002e-07 2024-09-12T22:04:17.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674548+0000", 2024-09-12T22:04:17.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8075999999999999e-05 2024-09-12T22:04:17.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674689+0000", 2024-09-12T22:04:17.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014141499999999999 2024-09-12T22:04:17.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674696+0000", 2024-09-12T22:04:17.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4619999999999999e-06 2024-09-12T22:04:17.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713666+0000", 2024-09-12T22:04:17.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.038969072 2024-09-12T22:04:17.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713752+0000", 2024-09-12T22:04:17.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6768999999999995e-05 2024-09-12T22:04:17.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713835+0000", 2024-09-12T22:04:17.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2774000000000004e-05 2024-09-12T22:04:17.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717212+0000", 2024-09-12T22:04:17.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033769389999999998 2024-09-12T22:04:17.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717259+0000", 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7218000000000001e-05 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717310+0000", 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1156999999999998e-05 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717356+0000", 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5107e-05 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.491 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.492 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.492 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44130 5.4 5:27857918:::benchmark_data_smithi043_32659_object44129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.492 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:17.492 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.725661967000001, 2024-09-12T22:04:17.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039844412000000003, 2024-09-12T22:04:17.492 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.492 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.492 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.492 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.492 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.492 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.492 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44130 2024-09-12T22:04:17.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.493 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:17.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:17.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674708+0000", 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4300000000000003e-07 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674749+0000", 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1254999999999997e-05 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674756+0000", 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3289999999999996e-06 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674762+0000", 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.852e-06 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9573999999999995e-05 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674954+0000", 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012254200000000001 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675033+0000", 2024-09-12T22:04:17.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8707000000000004e-05 2024-09-12T22:04:17.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714381+0000", 2024-09-12T22:04:17.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039348053000000001 2024-09-12T22:04:17.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714477+0000", 2024-09-12T22:04:17.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5650999999999996e-05 2024-09-12T22:04:17.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714516+0000", 2024-09-12T22:04:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9158e-05 2024-09-12T22:04:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714551+0000", 2024-09-12T22:04:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5648000000000002e-05 2024-09-12T22:04:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.498 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44131 5.0 5:013256f7:::benchmark_data_smithi043_32659_object44130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.498 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:17.498 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.7255895, 2024-09-12T22:04:17.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043388599, 2024-09-12T22:04:17.498 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.498 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.498 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.498 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.498 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.498 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.498 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44131 2024-09-12T22:04:17.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.498 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674780+0000", 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674817+0000", 2024-09-12T22:04:17.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6859000000000001e-05 2024-09-12T22:04:17.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:17.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.501e-05 2024-09-12T22:04:17.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674838+0000", 2024-09-12T22:04:17.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-06 2024-09-12T22:04:17.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715161+0000", 2024-09-12T22:04:17.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.04032285 2024-09-12T22:04:17.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715317+0000", 2024-09-12T22:04:17.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015649199999999999 2024-09-12T22:04:17.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715463+0000", 2024-09-12T22:04:17.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145704 2024-09-12T22:04:17.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717480+0000", 2024-09-12T22:04:17.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020168220000000001 2024-09-12T22:04:17.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718079+0000", 2024-09-12T22:04:17.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000599115 2024-09-12T22:04:17.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718134+0000", 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718168+0000", 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4301000000000002e-05 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44132 5.e 5:7634b859:::benchmark_data_smithi043_32659_object44131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:17.503 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.72492226, 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039558587999999999, 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44132 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:17.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675448+0000", 2024-09-12T22:04:17.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3699999999999999e-07 2024-09-12T22:04:17.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675552+0000", 2024-09-12T22:04:17.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104294 2024-09-12T22:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675562+0000", 2024-09-12T22:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9629999999999993e-06 2024-09-12T22:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675569+0000", 2024-09-12T22:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8809999999999998e-06 2024-09-12T22:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675612+0000", 2024-09-12T22:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591000000000003e-05 2024-09-12T22:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675717+0000", 2024-09-12T22:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010497099999999999 2024-09-12T22:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675835+0000", 2024-09-12T22:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011793799999999999 2024-09-12T22:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713616+0000", 2024-09-12T22:04:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037781032999999999 2024-09-12T22:04:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714911+0000", 2024-09-12T22:04:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001294604 2024-09-12T22:04:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714964+0000", 2024-09-12T22:04:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3408000000000001e-05 2024-09-12T22:04:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715005+0000", 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0967999999999998e-05 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44133 5.b 5:d0a59edd:::benchmark_data_smithi043_32659_object44132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.72478448, 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039513020000000003, 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44133 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:17.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:17.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:17.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675585+0000", 2024-09-12T22:04:17.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5499999999999998e-07 2024-09-12T22:04:17.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:17.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675634+0000", 2024-09-12T22:04:17.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8520999999999998e-05 2024-09-12T22:04:17.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675641+0000", 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4440000000000002e-06 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675646+0000", 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2660000000000001e-06 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675692+0000", 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5915999999999999e-05 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675812+0000", 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119419 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675950+0000", 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013831499999999999 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713574+0000", 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037623801999999998 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715015+0000", 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014410720000000001 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715059+0000", 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715097+0000", 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8519000000000002e-05 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.514 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.515 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.515 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:17.515 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:17.515 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:17.516 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:17.515+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:17.517 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:17.617 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:17.616+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:17.669 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:17.669 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:17.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.669 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79239 5.1 5:81d3bf0a:::benchmark_data_smithi043_32659_object79238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:17.669 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.663059+0000", 2024-09-12T22:04:17.669 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0046831620000000003, 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047081809999999997, 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79239 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663059+0000", 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:17.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663059+0000", 2024-09-12T22:04:17.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:17.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663060+0000", 2024-09-12T22:04:17.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7899999999999997e-07 2024-09-12T22:04:17.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:17.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663124+0000", 2024-09-12T22:04:17.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3868999999999994e-05 2024-09-12T22:04:17.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:17.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663143+0000", 2024-09-12T22:04:17.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9400999999999999e-05 2024-09-12T22:04:17.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663150+0000", 2024-09-12T22:04:17.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9310000000000002e-06 2024-09-12T22:04:17.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:17.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663234+0000", 2024-09-12T22:04:17.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4257000000000003e-05 2024-09-12T22:04:17.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:17.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663348+0000", 2024-09-12T22:04:17.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011404300000000001 2024-09-12T22:04:17.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663535+0000", 2024-09-12T22:04:17.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018675699999999999 2024-09-12T22:04:17.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667155+0000", 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036199869999999999 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79240 5.1 5:8be95289:::benchmark_data_smithi043_32659_object79239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.663175+0000", 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0045670140000000003, 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046709610000000004, 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:17.674 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:17.675 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:17.675 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:17.675 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.675 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79240 2024-09-12T22:04:17.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.675 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:17.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:17.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663175+0000", 2024-09-12T22:04:17.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:17.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663175+0000", 2024-09-12T22:04:17.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:17.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663176+0000", 2024-09-12T22:04:17.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0299999999999999e-07 2024-09-12T22:04:17.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:17.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663206+0000", 2024-09-12T22:04:17.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9762000000000001e-05 2024-09-12T22:04:17.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:17.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663214+0000", 2024-09-12T22:04:17.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:04:17.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.663220+0000", 2024-09-12T22:04:17.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9719999999999997e-06 2024-09-12T22:04:17.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:17.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.665348+0000", 2024-09-12T22:04:17.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021281799999999999 2024-09-12T22:04:17.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:17.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.665467+0000", 2024-09-12T22:04:17.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118844 2024-09-12T22:04:17.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.665598+0000", 2024-09-12T22:04:17.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013101700000000001 2024-09-12T22:04:17.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:17.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667573+0000", 2024-09-12T22:04:17.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019751199999999999 2024-09-12T22:04:17.678 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.679 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:17.679 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.679 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79248 5.f 5:f40431ba:::benchmark_data_smithi043_32659_object79247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:17.679 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.667298+0000", 2024-09-12T22:04:17.679 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000443824, 2024-09-12T22:04:17.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00062711699999999995, 2024-09-12T22:04:17.679 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:17.680 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:17.680 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:17.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:17.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:17.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.680 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79248 2024-09-12T22:04:17.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.680 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:17.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:17.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667298+0000", 2024-09-12T22:04:17.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667298+0000", 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667299+0000", 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0759999999999999e-06 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667355+0000", 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5714000000000002e-05 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:17.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667367+0000", 2024-09-12T22:04:17.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2197e-05 2024-09-12T22:04:17.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667374+0000", 2024-09-12T22:04:17.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8179999999999998e-06 2024-09-12T22:04:17.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:17.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667419+0000", 2024-09-12T22:04:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4407999999999999e-05 2024-09-12T22:04:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667503+0000", 2024-09-12T22:04:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4901000000000006e-05 2024-09-12T22:04:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667591+0000", 2024-09-12T22:04:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7460999999999995e-05 2024-09-12T22:04:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.684 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:79246 5.3 e32/22 5:c2679232:::benchmark_data_smithi043_32659_object79245:head v 32'4918, mlcod=32'4915)", 2024-09-12T22:04:17.684 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.667603+0000", 2024-09-12T22:04:17.684 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00013897000000000001, 2024-09-12T22:04:17.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00038728500000000002, 2024-09-12T22:04:17.684 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:17.684 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:17.684 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:17.684 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:17.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:17.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667603+0000", 2024-09-12T22:04:17.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:17.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667603+0000", 2024-09-12T22:04:17.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:17.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667604+0000", 2024-09-12T22:04:17.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5699999999999998e-07 2024-09-12T22:04:17.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:17.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667662+0000", 2024-09-12T22:04:17.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8709999999999999e-05 2024-09-12T22:04:17.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:17.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667669+0000", 2024-09-12T22:04:17.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1539999999999999e-06 2024-09-12T22:04:17.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667673+0000", 2024-09-12T22:04:17.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.228e-06 2024-09-12T22:04:17.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:17.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667722+0000", 2024-09-12T22:04:17.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9595999999999997e-05 2024-09-12T22:04:17.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:17.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667733+0000", 2024-09-12T22:04:17.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:04:17.687 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.687 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:17.687 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.687 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79249 5.1 5:8f22ef54:::benchmark_data_smithi043_32659_object79248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:17.688 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.667736+0000", 2024-09-12T22:04:17.688 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.5470000000000002e-06, 2024-09-12T22:04:17.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031692500000000002, 2024-09-12T22:04:17.688 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:17.688 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:17.688 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:17.688 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:17.688 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:17.688 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.688 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79249 2024-09-12T22:04:17.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.688 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:17.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667736+0000", 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667736+0000", 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667736+0000", 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4199999999999995e-07 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:17.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667802+0000", 2024-09-12T22:04:17.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5308999999999994e-05 2024-09-12T22:04:17.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:17.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667809+0000", 2024-09-12T22:04:17.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2189999999999998e-06 2024-09-12T22:04:17.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667813+0000", 2024-09-12T22:04:17.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8990000000000003e-06 2024-09-12T22:04:17.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:17.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667866+0000", 2024-09-12T22:04:17.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3272000000000001e-05 2024-09-12T22:04:17.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:17.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667996+0000", 2024-09-12T22:04:17.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130328 2024-09-12T22:04:17.691 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.691 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:17.691 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.691 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79250 5.7 5:e2e28e89:::benchmark_data_smithi043_32659_object79249:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:17.692 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.667822+0000", 2024-09-12T22:04:17.692 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999199, 2024-09-12T22:04:17.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000304822, 2024-09-12T22:04:17.692 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:17.692 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:17.692 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:17.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:17.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:17.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.692 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79250 2024-09-12T22:04:17.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.692 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:17.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667822+0000", 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667822+0000", 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667823+0000", 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1800000000000001e-07 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:17.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667850+0000", 2024-09-12T22:04:17.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6735000000000001e-05 2024-09-12T22:04:17.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:17.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667855+0000", 2024-09-12T22:04:17.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9660000000000004e-06 2024-09-12T22:04:17.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667858+0000", 2024-09-12T22:04:17.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1760000000000002e-06 2024-09-12T22:04:17.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667898+0000", 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0720999999999999e-05 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.668013+0000", 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114287 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.668120+0000", 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107489 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.695 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:17.696 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.696 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:79239 5.1 e32/22)", 2024-09-12T22:04:17.696 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.667868+0000", 2024-09-12T22:04:17.696 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9998736, 2024-09-12T22:04:17.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032211099999999998, 2024-09-12T22:04:17.696 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:17.696 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:17.696 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:17.696 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:17.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:17.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667868+0000", 2024-09-12T22:04:17.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:17.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667868+0000", 2024-09-12T22:04:17.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:17.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667869+0000", 2024-09-12T22:04:17.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:04:17.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667873+0000", 2024-09-12T22:04:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8929999999999998e-06 2024-09-12T22:04:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667881+0000", 2024-09-12T22:04:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9500000000000001e-06 2024-09-12T22:04:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667887+0000", 2024-09-12T22:04:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0440000000000001e-06 2024-09-12T22:04:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.698 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79252 5.2 5:4776a7a7:::benchmark_data_smithi043_32659_object79251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.667866+0000", 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.999876, 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374139, 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79252 2024-09-12T22:04:17.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667866+0000", 2024-09-12T22:04:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667866+0000", 2024-09-12T22:04:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667867+0000", 2024-09-12T22:04:17.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1600000000000001e-07 2024-09-12T22:04:17.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:17.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667906+0000", 2024-09-12T22:04:17.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9631000000000001e-05 2024-09-12T22:04:17.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:17.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667913+0000", 2024-09-12T22:04:17.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:04:17.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667919+0000", 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.896e-06 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667962+0000", 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3195000000000002e-05 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.668075+0000", 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000112447 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.668201+0000", 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012647799999999999 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79253 5.f 5.8391cc2f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.667959+0000", 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.999783, 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034324699999999997, 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:17.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:17.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:17.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:17.704 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79253 2024-09-12T22:04:17.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.704 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:17.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:17.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667959+0000", 2024-09-12T22:04:17.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:17.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667959+0000", 2024-09-12T22:04:17.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:17.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:17.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.667960+0000", 2024-09-12T22:04:17.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:17.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:17.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.668032+0000", 2024-09-12T22:04:17.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1932000000000002e-05 2024-09-12T22:04:17.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:17.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.668040+0000", 2024-09-12T22:04:17.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0749999999999998e-06 2024-09-12T22:04:17.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:17.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:17.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:17.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.668051+0000", 2024-09-12T22:04:17.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0784999999999999e-05 2024-09-12T22:04:17.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.706 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:17.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:17.706 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:17.706 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 9 2024-09-12T22:04:17.706 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:17.707 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:17.741 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:04:17.751 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:17.750+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:17.818 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:17.817+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:17.845 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:17.846 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:17.856 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:17.883 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-09-12T22:04:17.883 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:04:17.901 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:17.901 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:17.918 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:17.918 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:17.919 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:17.918+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:17.939 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:04:18.010 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:18.011 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:18.021 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:18.022 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:18.019+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:18.050 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-09-12T22:04:18.121 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:18.120+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:18.153 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:18.153 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:18.162 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:18.191 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 24 16 80172 80156 208.722 138.25 0.0108876 0.00477879 2024-09-12T22:04:18.222 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:18.221+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:18.264 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:18.264 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:18.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:18.323 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:18.322+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:18.371 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:04:18.464 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:18.463+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:18.465 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:18.465 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:18.465 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:18.565 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:18.564+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:18.567 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:18.567 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:18.576 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:18.666 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:18.665+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:18.678 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:18.678 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:18.687 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:18.768 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:18.767+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:18.838 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:18.882 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:18.881+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:18.943 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:18.943 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:18.952 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:18.993 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:18.992+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:19.071 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:19.070+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:19.095 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:19.095 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:19.104 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:19.171 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:19.171+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:19.191 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 25 16 80425 80409 201.006 15.8125 0.00870824 0.00480784 2024-09-12T22:04:19.246 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:19.246 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:19.255 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:19.299 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:19.298+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:19.359 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:19.359 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:19.364 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-09-12T22:04:19.370 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:19.411 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:19.410+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:19.473 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:19.472+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:19.564 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:19.564 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:19.574 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:19.573+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:19.575 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:19.675 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:19.673+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:19.727 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:19.727 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:19.740 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:19.781 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:19.780+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:19.876 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:19.875+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:19.885 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:19.885 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:19.899 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:19.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:04:19.977 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:19.976+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:20.038 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:20.046 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:20.046 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:20.058 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:20.058 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:20.059 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:20.077 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:20.077 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:20.080 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:20.080 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:20.101 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:20.100+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:20.179 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:20.178+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:20.191 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 26 16 82801 82785 198.986 148.5 0.00265096 0.00502281 2024-09-12T22:04:20.251 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:20.251 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:20.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:20.251 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:20.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.251 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44102 5.0 5:0d5aa1ff:::benchmark_data_smithi043_32659_object44101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.251 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:20.252 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.622823994000001, 2024-09-12T22:04:20.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051636015, 2024-09-12T22:04:20.252 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.252 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.252 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.252 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.252 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.252 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.252 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44102 2024-09-12T22:04:20.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.252 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:20.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:20.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624875+0000", 2024-09-12T22:04:20.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:04:20.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624930+0000", 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5256000000000001e-05 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624951+0000", 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0551999999999999e-05 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624958+0000", 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1849999999999998e-06 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629885+0000", 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049266120000000004 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629999+0000", 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011385 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630125+0000", 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012640500000000001 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633338+0000", 2024-09-12T22:04:20.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032135559999999998 2024-09-12T22:04:20.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676425+0000", 2024-09-12T22:04:20.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043086753999999998 2024-09-12T22:04:20.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676472+0000", 2024-09-12T22:04:20.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6971999999999997e-05 2024-09-12T22:04:20.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.257 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676510+0000", 2024-09-12T22:04:20.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8096999999999998e-05 2024-09-12T22:04:20.257 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.257 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.257 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.257 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44103 5.8 5:170742c6:::benchmark_data_smithi043_32659_object44102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.257 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:20.257 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.622700843000001, 2024-09-12T22:04:20.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051500936999999997, 2024-09-12T22:04:20.258 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.258 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.258 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.258 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.258 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.258 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.258 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44103 2024-09-12T22:04:20.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.258 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:20.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:20.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624998+0000", 2024-09-12T22:04:20.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:20.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625061+0000", 2024-09-12T22:04:20.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2667000000000002e-05 2024-09-12T22:04:20.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625069+0000", 2024-09-12T22:04:20.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999993e-06 2024-09-12T22:04:20.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625077+0000", 2024-09-12T22:04:20.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0090000000000007e-06 2024-09-12T22:04:20.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629869+0000", 2024-09-12T22:04:20.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047921769999999999 2024-09-12T22:04:20.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629938+0000", 2024-09-12T22:04:20.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9542000000000006e-05 2024-09-12T22:04:20.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630010+0000", 2024-09-12T22:04:20.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1795e-05 2024-09-12T22:04:20.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676348+0000", 2024-09-12T22:04:20.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.046337830000000003 2024-09-12T22:04:20.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676399+0000", 2024-09-12T22:04:20.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1150000000000003e-05 2024-09-12T22:04:20.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676460+0000", 2024-09-12T22:04:20.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1142999999999994e-05 2024-09-12T22:04:20.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676498+0000", 2024-09-12T22:04:20.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8111000000000002e-05 2024-09-12T22:04:20.263 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.263 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.263 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.263 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.621402418000001, 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:20.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:20.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:20.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:20.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:20.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:20.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:20.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:20.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:20.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:20.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:20.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:20.269 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.269 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.269 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.269 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44115 5.0 5:0ee09c30:::benchmark_data_smithi043_32659_object44114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.269 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:20.269 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.618629740999999, 2024-09-12T22:04:20.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082887358999999994, 2024-09-12T22:04:20.270 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.270 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.270 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.270 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.270 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.270 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.270 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44115 2024-09-12T22:04:20.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.270 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:20.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629070+0000", 2024-09-12T22:04:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1209999999999999e-06 2024-09-12T22:04:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629132+0000", 2024-09-12T22:04:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2557000000000004e-05 2024-09-12T22:04:20.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629147+0000", 2024-09-12T22:04:20.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4491999999999999e-05 2024-09-12T22:04:20.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629156+0000", 2024-09-12T22:04:20.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7089999999999997e-06 2024-09-12T22:04:20.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631865+0000", 2024-09-12T22:04:20.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00270835 2024-09-12T22:04:20.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631932+0000", 2024-09-12T22:04:20.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7322000000000004e-05 2024-09-12T22:04:20.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632095+0000", 2024-09-12T22:04:20.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016314699999999999 2024-09-12T22:04:20.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676360+0000", 2024-09-12T22:04:20.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044264756000000002 2024-09-12T22:04:20.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711854+0000", 2024-09-12T22:04:20.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.03549389 2024-09-12T22:04:20.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711919+0000", 2024-09-12T22:04:20.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5024000000000006e-05 2024-09-12T22:04:20.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711956+0000", 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6990999999999999e-05 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44117 5.8 5:1ecb02e0:::benchmark_data_smithi043_32659_object44116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.618484921, 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082354986000000005, 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.275 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.276 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.276 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.276 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.276 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44117 2024-09-12T22:04:20.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.276 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:20.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629214+0000", 2024-09-12T22:04:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629315+0000", 2024-09-12T22:04:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010045800000000001 2024-09-12T22:04:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629328+0000", 2024-09-12T22:04:20.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3016e-05 2024-09-12T22:04:20.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629336+0000", 2024-09-12T22:04:20.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7229999999999993e-06 2024-09-12T22:04:20.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631856+0000", 2024-09-12T22:04:20.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025199300000000001 2024-09-12T22:04:20.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631954+0000", 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7565999999999994e-05 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632073+0000", 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119677 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676523+0000", 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044449163 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676612+0000", 2024-09-12T22:04:20.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9579000000000004e-05 2024-09-12T22:04:20.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711509+0000", 2024-09-12T22:04:20.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.034897125000000001 2024-09-12T22:04:20.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711568+0000", 2024-09-12T22:04:20.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8996999999999998e-05 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44120 5.b 5:df1f2c5f:::benchmark_data_smithi043_32659_object44119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.61630926, 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043861974999999997, 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.281 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.282 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44120 2024-09-12T22:04:20.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.282 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:20.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:20.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631390+0000", 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631444+0000", 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631452+0000", 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4610000000000008e-06 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631458+0000", 2024-09-12T22:04:20.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:04:20.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631509+0000", 2024-09-12T22:04:20.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1442e-05 2024-09-12T22:04:20.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631627+0000", 2024-09-12T22:04:20.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011796800000000001 2024-09-12T22:04:20.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631814+0000", 2024-09-12T22:04:20.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018735400000000001 2024-09-12T22:04:20.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674612+0000", 2024-09-12T22:04:20.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042797287000000003 2024-09-12T22:04:20.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675160+0000", 2024-09-12T22:04:20.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000548187 2024-09-12T22:04:20.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675207+0000", 2024-09-12T22:04:20.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6833999999999999e-05 2024-09-12T22:04:20.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675251+0000", 2024-09-12T22:04:20.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4348000000000003e-05 2024-09-12T22:04:20.286 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.286 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.286 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.616001477999999, 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.287 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:20.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:20.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:20.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:20.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:20.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:20.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:20.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:20.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:20.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:20.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:20.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:20.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:20.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:20.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:20.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:20.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:20.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:20.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.292 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.293 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44122 5.d 5:bfd04815:::benchmark_data_smithi043_32659_object44121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.293 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:20.293 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.615903425999999, 2024-09-12T22:04:20.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.080166395000000001, 2024-09-12T22:04:20.293 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.293 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.293 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.293 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44122 2024-09-12T22:04:20.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.293 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:20.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:20.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:20.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:04:20.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631853+0000", 2024-09-12T22:04:20.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7209000000000001e-05 2024-09-12T22:04:20.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631858+0000", 2024-09-12T22:04:20.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:04:20.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631862+0000", 2024-09-12T22:04:20.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.692e-06 2024-09-12T22:04:20.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631905+0000", 2024-09-12T22:04:20.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3135e-05 2024-09-12T22:04:20.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632032+0000", 2024-09-12T22:04:20.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012740900000000001 2024-09-12T22:04:20.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:20.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632166+0000", 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013318800000000001 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674894+0000", 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042728690999999999 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711875+0000", 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036980631 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711923+0000", 2024-09-12T22:04:20.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8180000000000003e-05 2024-09-12T22:04:20.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711961+0000", 2024-09-12T22:04:20.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8142000000000002e-05 2024-09-12T22:04:20.298 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.298 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.298 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.298 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44123 5.e 5:7d83ca89:::benchmark_data_smithi043_32659_object44122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.298 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:20.298 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.615771658, 2024-09-12T22:04:20.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043329329, 2024-09-12T22:04:20.299 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.299 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.299 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.299 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.299 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.299 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.299 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44123 2024-09-12T22:04:20.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.299 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:20.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:20.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631928+0000", 2024-09-12T22:04:20.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2699999999999998e-07 2024-09-12T22:04:20.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631996+0000", 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8141999999999999e-05 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632004+0000", 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7600000000000008e-06 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632010+0000", 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632069+0000", 2024-09-12T22:04:20.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8260000000000001e-05 2024-09-12T22:04:20.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632226+0000", 2024-09-12T22:04:20.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015702199999999999 2024-09-12T22:04:20.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632337+0000", 2024-09-12T22:04:20.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111069 2024-09-12T22:04:20.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674909+0000", 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042571854999999999 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675184+0000", 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027561399999999998 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675222+0000", 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7710999999999999e-05 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675256+0000", 2024-09-12T22:04:20.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4014000000000003e-05 2024-09-12T22:04:20.304 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.304 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.304 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.304 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.304 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:20.304 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.615060210999999, 2024-09-12T22:04:20.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:20.304 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.304 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.304 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:20.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:20.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:20.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:20.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:20.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:20.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:20.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:20.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:20.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:20.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:20.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:20.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:20.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:20.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:20.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:20.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:20.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:20.309 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.310 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.310 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.310 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44098 5.0 e28/22 ondisk, result = 0)", 2024-09-12T22:04:20.310 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:20.310 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.614669396, 2024-09-12T22:04:20.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043332180999999997, 2024-09-12T22:04:20.310 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.310 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.310 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:20.310 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:20.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:20.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633030+0000", 2024-09-12T22:04:20.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:20.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633035+0000", 2024-09-12T22:04:20.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:04:20.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633043+0000", 2024-09-12T22:04:20.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:20.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633048+0000", 2024-09-12T22:04:20.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5439999999999998e-06 2024-09-12T22:04:20.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633362+0000", 2024-09-12T22:04:20.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031397400000000001 2024-09-12T22:04:20.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633369+0000", 2024-09-12T22:04:20.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:04:20.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676361+0000", 2024-09-12T22:04:20.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042991954999999998 2024-09-12T22:04:20.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.314 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.314 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.314 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:20.314 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.614062291, 2024-09-12T22:04:20.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:20.314 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.314 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.314 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:20.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:20.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:20.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:20.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:20.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:20.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:20.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:20.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:20.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:20.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:20.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:20.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:20.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:20.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:20.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:20.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:20.319 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.320 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.320 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.320 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:44125 5.9 e28/22 5:9022696f:::benchmark_data_smithi043_32659_object44124:head v 28'2753, mlcod=28'2751)", 2024-09-12T22:04:20.320 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:20.320 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.614023425999999, 2024-09-12T22:04:20.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042744011999999998, 2024-09-12T22:04:20.320 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.320 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.320 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.320 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:20.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:20.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633676+0000", 2024-09-12T22:04:20.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.44e-07 2024-09-12T22:04:20.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633755+0000", 2024-09-12T22:04:20.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9629000000000006e-05 2024-09-12T22:04:20.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674386+0000", 2024-09-12T22:04:20.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631364000000003 2024-09-12T22:04:20.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674399+0000", 2024-09-12T22:04:20.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2047e-05 2024-09-12T22:04:20.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674453+0000", 2024-09-12T22:04:20.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4453999999999997e-05 2024-09-12T22:04:20.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674479+0000", 2024-09-12T22:04:20.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6064999999999999e-05 2024-09-12T22:04:20.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676381+0000", 2024-09-12T22:04:20.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001901874 2024-09-12T22:04:20.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676419+0000", 2024-09-12T22:04:20.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7935000000000002e-05 2024-09-12T22:04:20.324 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.324 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.324 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.324 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44103 5.8 e28/22 ondisk, result = 0)", 2024-09-12T22:04:20.324 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:20.324 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.613517458, 2024-09-12T22:04:20.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042322950999999998, 2024-09-12T22:04:20.325 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.325 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.325 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:20.325 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:20.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:20.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:20.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:04:20.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634184+0000", 2024-09-12T22:04:20.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7690000000000001e-06 2024-09-12T22:04:20.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674407+0000", 2024-09-12T22:04:20.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040222750000000002 2024-09-12T22:04:20.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674417+0000", 2024-09-12T22:04:20.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0125e-05 2024-09-12T22:04:20.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676387+0000", 2024-09-12T22:04:20.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001970112 2024-09-12T22:04:20.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676394+0000", 2024-09-12T22:04:20.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:04:20.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676504+0000", 2024-09-12T22:04:20.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109621 2024-09-12T22:04:20.328 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.328 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.328 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.328 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44128 5.d 5:b9a92891:::benchmark_data_smithi043_32659_object44127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.328 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.573264669, 2024-09-12T22:04:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040118138999999997, 2024-09-12T22:04:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44128 2024-09-12T22:04:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674435+0000", 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5960000000000001e-06 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674485+0000", 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0021000000000001e-05 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674495+0000", 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5189999999999998e-06 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674500+0000", 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674923+0000", 2024-09-12T22:04:20.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000423304 2024-09-12T22:04:20.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675027+0000", 2024-09-12T22:04:20.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103399 2024-09-12T22:04:20.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:20.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675141+0000", 2024-09-12T22:04:20.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114274 2024-09-12T22:04:20.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711649+0000", 2024-09-12T22:04:20.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036508011999999999 2024-09-12T22:04:20.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714466+0000", 2024-09-12T22:04:20.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028167370000000001 2024-09-12T22:04:20.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714508+0000", 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2679000000000003e-05 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714552+0000", 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3528000000000001e-05 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44129 5.0 5:0f626cda:::benchmark_data_smithi043_32659_object44128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:20.335 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.573189164, 2024-09-12T22:04:20.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042846404999999997, 2024-09-12T22:04:20.335 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.335 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.335 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.335 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.335 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.335 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.335 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44129 2024-09-12T22:04:20.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.335 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:20.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:20.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674510+0000", 2024-09-12T22:04:20.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1600000000000002e-07 2024-09-12T22:04:20.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674548+0000", 2024-09-12T22:04:20.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8075999999999999e-05 2024-09-12T22:04:20.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674689+0000", 2024-09-12T22:04:20.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014141499999999999 2024-09-12T22:04:20.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674696+0000", 2024-09-12T22:04:20.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4619999999999999e-06 2024-09-12T22:04:20.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713666+0000", 2024-09-12T22:04:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.038969072 2024-09-12T22:04:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713752+0000", 2024-09-12T22:04:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6768999999999995e-05 2024-09-12T22:04:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713835+0000", 2024-09-12T22:04:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2774000000000004e-05 2024-09-12T22:04:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717212+0000", 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033769389999999998 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717259+0000", 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7218000000000001e-05 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717310+0000", 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1156999999999998e-05 2024-09-12T22:04:20.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717356+0000", 2024-09-12T22:04:20.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5107e-05 2024-09-12T22:04:20.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.340 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.340 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44130 5.4 5:27857918:::benchmark_data_smithi043_32659_object44129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.340 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:20.340 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.572991310000001, 2024-09-12T22:04:20.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039844412000000003, 2024-09-12T22:04:20.340 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.341 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.341 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.341 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.341 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.341 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.341 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44130 2024-09-12T22:04:20.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.341 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:20.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:20.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674708+0000", 2024-09-12T22:04:20.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4300000000000003e-07 2024-09-12T22:04:20.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674749+0000", 2024-09-12T22:04:20.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1254999999999997e-05 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674756+0000", 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3289999999999996e-06 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674762+0000", 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.852e-06 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:20.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9573999999999995e-05 2024-09-12T22:04:20.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674954+0000", 2024-09-12T22:04:20.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012254200000000001 2024-09-12T22:04:20.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675033+0000", 2024-09-12T22:04:20.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8707000000000004e-05 2024-09-12T22:04:20.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714381+0000", 2024-09-12T22:04:20.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039348053000000001 2024-09-12T22:04:20.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714477+0000", 2024-09-12T22:04:20.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5650999999999996e-05 2024-09-12T22:04:20.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714516+0000", 2024-09-12T22:04:20.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9158e-05 2024-09-12T22:04:20.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714551+0000", 2024-09-12T22:04:20.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5648000000000002e-05 2024-09-12T22:04:20.346 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.346 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.346 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.346 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44131 5.0 5:013256f7:::benchmark_data_smithi043_32659_object44130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.346 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:20.346 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.572918843, 2024-09-12T22:04:20.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043388599, 2024-09-12T22:04:20.346 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.346 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.346 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.347 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44131 2024-09-12T22:04:20.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.347 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:20.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674780+0000", 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674817+0000", 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6859000000000001e-05 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:20.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.501e-05 2024-09-12T22:04:20.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674838+0000", 2024-09-12T22:04:20.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-06 2024-09-12T22:04:20.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715161+0000", 2024-09-12T22:04:20.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.04032285 2024-09-12T22:04:20.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715317+0000", 2024-09-12T22:04:20.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015649199999999999 2024-09-12T22:04:20.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715463+0000", 2024-09-12T22:04:20.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145704 2024-09-12T22:04:20.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717480+0000", 2024-09-12T22:04:20.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020168220000000001 2024-09-12T22:04:20.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718079+0000", 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000599115 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718134+0000", 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718168+0000", 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4301000000000002e-05 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.351 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.352 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44132 5.e 5:7634b859:::benchmark_data_smithi043_32659_object44131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.352 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:20.352 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.572251603, 2024-09-12T22:04:20.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039558587999999999, 2024-09-12T22:04:20.352 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.352 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.352 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.352 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.352 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.352 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.352 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44132 2024-09-12T22:04:20.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.353 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:20.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:20.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675448+0000", 2024-09-12T22:04:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3699999999999999e-07 2024-09-12T22:04:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675552+0000", 2024-09-12T22:04:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104294 2024-09-12T22:04:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675562+0000", 2024-09-12T22:04:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9629999999999993e-06 2024-09-12T22:04:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675569+0000", 2024-09-12T22:04:20.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8809999999999998e-06 2024-09-12T22:04:20.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675612+0000", 2024-09-12T22:04:20.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591000000000003e-05 2024-09-12T22:04:20.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675717+0000", 2024-09-12T22:04:20.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010497099999999999 2024-09-12T22:04:20.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675835+0000", 2024-09-12T22:04:20.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011793799999999999 2024-09-12T22:04:20.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713616+0000", 2024-09-12T22:04:20.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037781032999999999 2024-09-12T22:04:20.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714911+0000", 2024-09-12T22:04:20.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001294604 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714964+0000", 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3408000000000001e-05 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715005+0000", 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0967999999999998e-05 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44133 5.b 5:d0a59edd:::benchmark_data_smithi043_32659_object44132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 15.572113823, 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039513020000000003, 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44133 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:20.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:20.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:20.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:20.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:20.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:20.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675585+0000", 2024-09-12T22:04:20.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5499999999999998e-07 2024-09-12T22:04:20.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:20.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675634+0000", 2024-09-12T22:04:20.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8520999999999998e-05 2024-09-12T22:04:20.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:20.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675641+0000", 2024-09-12T22:04:20.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4440000000000002e-06 2024-09-12T22:04:20.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675646+0000", 2024-09-12T22:04:20.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2660000000000001e-06 2024-09-12T22:04:20.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:20.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675692+0000", 2024-09-12T22:04:20.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5915999999999999e-05 2024-09-12T22:04:20.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:20.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675812+0000", 2024-09-12T22:04:20.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119419 2024-09-12T22:04:20.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675950+0000", 2024-09-12T22:04:20.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013831499999999999 2024-09-12T22:04:20.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713574+0000", 2024-09-12T22:04:20.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037623801999999998 2024-09-12T22:04:20.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715015+0000", 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014410720000000001 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715059+0000", 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715097+0000", 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8519000000000002e-05 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.365 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:20.366 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:20.366 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:20.367 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:20.368 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:20.365+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:20.468 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:20.467+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:20.515 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:20.515 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:20.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.515 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:83681 5.2 5:4dfb42d6:::benchmark_data_smithi043_32659_object83680:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:20.515 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:20.508482+0000", 2024-09-12T22:04:20.515 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0054691829999999999, 2024-09-12T22:04:20.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054896329999999998, 2024-09-12T22:04:20.516 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.516 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.516 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:20.516 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:20.516 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:20.516 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.516 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 83681 2024-09-12T22:04:20.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.516 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508482+0000", 2024-09-12T22:04:20.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508482+0000", 2024-09-12T22:04:20.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508483+0000", 2024-09-12T22:04:20.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3099999999999997e-07 2024-09-12T22:04:20.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508516+0000", 2024-09-12T22:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2966000000000003e-05 2024-09-12T22:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508524+0000", 2024-09-12T22:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508532+0000", 2024-09-12T22:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5220000000000001e-06 2024-09-12T22:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508573+0000", 2024-09-12T22:04:20.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1047999999999997e-05 2024-09-12T22:04:20.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508688+0000", 2024-09-12T22:04:20.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011544600000000001 2024-09-12T22:04:20.519 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.519 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.519 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.519 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:83682 5.5 5:a67dac31:::benchmark_data_smithi043_32659_object83681:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:20.519 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:20.508551+0000", 2024-09-12T22:04:20.520 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.005400078, 2024-09-12T22:04:20.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054642639999999999, 2024-09-12T22:04:20.520 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.520 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.520 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:20.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:20.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:20.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.520 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 83682 2024-09-12T22:04:20.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.520 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508551+0000", 2024-09-12T22:04:20.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508551+0000", 2024-09-12T22:04:20.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508552+0000", 2024-09-12T22:04:20.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3300000000000002e-07 2024-09-12T22:04:20.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508581+0000", 2024-09-12T22:04:20.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9220000000000001e-05 2024-09-12T22:04:20.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508589+0000", 2024-09-12T22:04:20.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9580000000000007e-06 2024-09-12T22:04:20.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508595+0000", 2024-09-12T22:04:20.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4999999999999999e-06 2024-09-12T22:04:20.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508650+0000", 2024-09-12T22:04:20.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5572000000000003e-05 2024-09-12T22:04:20.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508782+0000", 2024-09-12T22:04:20.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131216 2024-09-12T22:04:20.523 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.523 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.523 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:83684 5.5 5:a5c02b29:::benchmark_data_smithi043_32659_object83683:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:20.508619+0000", 2024-09-12T22:04:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0053321469999999998, 2024-09-12T22:04:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054413509999999997, 2024-09-12T22:04:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 83684 2024-09-12T22:04:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508619+0000", 2024-09-12T22:04:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508619+0000", 2024-09-12T22:04:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508620+0000", 2024-09-12T22:04:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-09-12T22:04:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508682+0000", 2024-09-12T22:04:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1947999999999997e-05 2024-09-12T22:04:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508692+0000", 2024-09-12T22:04:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0045e-05 2024-09-12T22:04:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508699+0000", 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6420000000000001e-06 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.510795+0000", 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020967749999999999 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.510912+0000", 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011613 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:83685 5.2 5:415a0e04:::benchmark_data_smithi043_32659_object83684:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:20.508709+0000", 2024-09-12T22:04:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0052424810000000002, 2024-09-12T22:04:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00538808, 2024-09-12T22:04:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 83685 2024-09-12T22:04:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.528 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508709+0000", 2024-09-12T22:04:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508709+0000", 2024-09-12T22:04:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508710+0000", 2024-09-12T22:04:20.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2600000000000002e-07 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508743+0000", 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3457000000000002e-05 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508751+0000", 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8059999999999995e-06 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508757+0000", 2024-09-12T22:04:20.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8259999999999998e-06 2024-09-12T22:04:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.510633+0000", 2024-09-12T22:04:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018760669999999999 2024-09-12T22:04:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.510748+0000", 2024-09-12T22:04:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114947 2024-09-12T22:04:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:83686 5.2 5:43cf38fe:::benchmark_data_smithi043_32659_object83685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:20.508793+0000", 2024-09-12T22:04:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0051588329999999998, 2024-09-12T22:04:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0053415379999999998, 2024-09-12T22:04:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 83686 2024-09-12T22:04:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.532 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508793+0000", 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508793+0000", 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508793+0000", 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.37e-07 2024-09-12T22:04:20.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508826+0000", 2024-09-12T22:04:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2257e-05 2024-09-12T22:04:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508834+0000", 2024-09-12T22:04:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7309999999999999e-06 2024-09-12T22:04:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.508841+0000", 2024-09-12T22:04:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:04:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.512632+0000", 2024-09-12T22:04:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037911310000000001 2024-09-12T22:04:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.512766+0000", 2024-09-12T22:04:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013441399999999999 2024-09-12T22:04:20.535 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:83689 5.d e34/22 5:bc877aeb:::benchmark_data_smithi043_32659_object83688:head v 34'5192, mlcod=34'5189)", 2024-09-12T22:04:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:20.511095+0000", 2024-09-12T22:04:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0028566870000000001, 2024-09-12T22:04:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0030805429999999998, 2024-09-12T22:04:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.511095+0000", 2024-09-12T22:04:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.511095+0000", 2024-09-12T22:04:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.511096+0000", 2024-09-12T22:04:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7900000000000007e-07 2024-09-12T22:04:20.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.511170+0000", 2024-09-12T22:04:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3841e-05 2024-09-12T22:04:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.511179+0000", 2024-09-12T22:04:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3710000000000006e-06 2024-09-12T22:04:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.511186+0000", 2024-09-12T22:04:20.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.861e-06 2024-09-12T22:04:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.511247+0000", 2024-09-12T22:04:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0989000000000002e-05 2024-09-12T22:04:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.511268+0000", 2024-09-12T22:04:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1126000000000001e-05 2024-09-12T22:04:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.539 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:83693 5.5 5:a0c11044:::benchmark_data_smithi043_32659_object83692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:20.511845+0000", 2024-09-12T22:04:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0021070590000000001, 2024-09-12T22:04:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023638119999999999, 2024-09-12T22:04:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 83693 2024-09-12T22:04:20.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.511845+0000", 2024-09-12T22:04:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.511845+0000", 2024-09-12T22:04:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.511846+0000", 2024-09-12T22:04:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.232e-06 2024-09-12T22:04:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.511946+0000", 2024-09-12T22:04:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9995999999999996e-05 2024-09-12T22:04:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.511957+0000", 2024-09-12T22:04:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1382999999999999e-05 2024-09-12T22:04:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.511964+0000", 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2960000000000001e-06 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.512481+0000", 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000516815 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.512597+0000", 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011572400000000001 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.543 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:83692 5.d e34/22 5:bdc47631:::benchmark_data_smithi043_32659_object83691:head v 34'5193, mlcod=34'5189)", 2024-09-12T22:04:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:20.513453+0000", 2024-09-12T22:04:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00049896000000000001, 2024-09-12T22:04:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00079306199999999998, 2024-09-12T22:04:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.513453+0000", 2024-09-12T22:04:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.513453+0000", 2024-09-12T22:04:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.513453+0000", 2024-09-12T22:04:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3900000000000005e-07 2024-09-12T22:04:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.513523+0000", 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9559000000000003e-05 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.513531+0000", 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1410000000000005e-06 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.513537+0000", 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.514128+0000", 2024-09-12T22:04:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000590928 2024-09-12T22:04:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:20.514146+0000", 2024-09-12T22:04:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8241e-05 2024-09-12T22:04:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:20.547 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 8 2024-09-12T22:04:20.547 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:20.548 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:20.592 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:20.591+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:20.670 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:20.669+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:20.694 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:20.695 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:20.695 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:20.706 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:20.771 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:20.770+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:20.871 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:20.870+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:20.899 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:20.899 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:20.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:20.899 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:20.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.899 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.446246467000002, 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018534981999999998, 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:20.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449725+0000", 2024-09-12T22:04:20.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799999999999999e-06 2024-09-12T22:04:20.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449731+0000", 2024-09-12T22:04:20.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.801e-06 2024-09-12T22:04:20.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449745+0000", 2024-09-12T22:04:20.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4198e-05 2024-09-12T22:04:20.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449758+0000", 2024-09-12T22:04:20.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2858e-05 2024-09-12T22:04:20.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449815+0000", 2024-09-12T22:04:20.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6978999999999998e-05 2024-09-12T22:04:20.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:20.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:20.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2369999999999997e-06 2024-09-12T22:04:20.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457683+0000", 2024-09-12T22:04:20.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078622640000000008 2024-09-12T22:04:20.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457840+0000", 2024-09-12T22:04:20.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015715299999999999 2024-09-12T22:04:20.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:20.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457972+0000", 2024-09-12T22:04:20.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013179500000000001 2024-09-12T22:04:20.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462325+0000", 2024-09-12T22:04:20.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043526859999999997 2024-09-12T22:04:20.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468180+0000", 2024-09-12T22:04:20.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058557169999999999 2024-09-12T22:04:20.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468221+0000", 2024-09-12T22:04:20.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0673000000000002e-05 2024-09-12T22:04:20.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468258+0000", 2024-09-12T22:04:20.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7240999999999998e-05 2024-09-12T22:04:20.906 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.906 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.906 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.906 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:20.906 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:20.906 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.446193856000001, 2024-09-12T22:04:20.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018748032000000001, 2024-09-12T22:04:20.906 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.907 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.907 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.907 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:20.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:20.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449779+0000", 2024-09-12T22:04:20.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4869999999999998e-06 2024-09-12T22:04:20.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449783+0000", 2024-09-12T22:04:20.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:04:20.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449791+0000", 2024-09-12T22:04:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2640000000000002e-06 2024-09-12T22:04:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449796+0000", 2024-09-12T22:04:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9370000000000001e-06 2024-09-12T22:04:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449915+0000", 2024-09-12T22:04:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118559 2024-09-12T22:04:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449920+0000", 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.101e-06 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458578+0000", 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008657662 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458978+0000", 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00039977399999999998 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459130+0000", 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000152394 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462793+0000", 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036628770000000001 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468451+0000", 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056577820000000001 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468501+0000", 2024-09-12T22:04:20.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0609999999999998e-05 2024-09-12T22:04:20.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468524+0000", 2024-09-12T22:04:20.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2804000000000001e-05 2024-09-12T22:04:20.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.912 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.912 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:20.912 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:20.913 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.446159154999997, 2024-09-12T22:04:20.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018816113999999998, 2024-09-12T22:04:20.913 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.913 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.913 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.913 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:20.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:20.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:20.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-09-12T22:04:20.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:20.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3360000000000001e-06 2024-09-12T22:04:20.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449832+0000", 2024-09-12T22:04:20.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1528e-05 2024-09-12T22:04:20.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:04:20.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-12T22:04:20.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459429+0000", 2024-09-12T22:04:20.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095926970000000007 2024-09-12T22:04:20.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459597+0000", 2024-09-12T22:04:20.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000168309 2024-09-12T22:04:20.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:20.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459829+0000", 2024-09-12T22:04:20.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231158 2024-09-12T22:04:20.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462796+0000", 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029673849999999999 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468558+0000", 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057621449999999998 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468592+0000", 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4241e-05 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468627+0000", 2024-09-12T22:04:20.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4511999999999998e-05 2024-09-12T22:04:20.918 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.918 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.918 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.918 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:20.918 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:20.918 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.446092127, 2024-09-12T22:04:20.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018845905, 2024-09-12T22:04:20.918 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.918 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.918 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.918 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:20.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:20.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:20.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:04:20.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449881+0000", 2024-09-12T22:04:20.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.005e-06 2024-09-12T22:04:20.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449887+0000", 2024-09-12T22:04:20.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9050000000000002e-06 2024-09-12T22:04:20.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449892+0000", 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2009999999999998e-06 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460279+0000", 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010386808000000001 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460427+0000", 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014789 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:20.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460572+0000", 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014453099999999999 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462799+0000", 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002227049 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468672+0000", 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058730060000000001 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468704+0000", 2024-09-12T22:04:20.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2421e-05 2024-09-12T22:04:20.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468724+0000", 2024-09-12T22:04:20.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9582e-05 2024-09-12T22:04:20.923 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.923 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.923 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.923 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:20.923 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:20.923 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.446019266, 2024-09-12T22:04:20.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017913407999999999, 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:20.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3499999999999996e-07 2024-09-12T22:04:20.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449955+0000", 2024-09-12T22:04:20.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4379999999999999e-06 2024-09-12T22:04:20.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449963+0000", 2024-09-12T22:04:20.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2719999999999997e-06 2024-09-12T22:04:20.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449970+0000", 2024-09-12T22:04:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5930000000000002e-06 2024-09-12T22:04:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450563+0000", 2024-09-12T22:04:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00059351900000000003 2024-09-12T22:04:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450570+0000", 2024-09-12T22:04:20.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3900000000000004e-06 2024-09-12T22:04:20.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461148+0000", 2024-09-12T22:04:20.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010577354000000001 2024-09-12T22:04:20.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461312+0000", 2024-09-12T22:04:20.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016392300000000001 2024-09-12T22:04:20.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461525+0000", 2024-09-12T22:04:20.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021282199999999999 2024-09-12T22:04:20.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464272+0000", 2024-09-12T22:04:20.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027469740000000001 2024-09-12T22:04:20.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467749+0000", 2024-09-12T22:04:20.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003477235 2024-09-12T22:04:20.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467815+0000", 2024-09-12T22:04:20.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5974000000000002e-05 2024-09-12T22:04:20.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467864+0000", 2024-09-12T22:04:20.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9279e-05 2024-09-12T22:04:20.929 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.929 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.929 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.930 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:20.930 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:20.930 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.445987799999997, 2024-09-12T22:04:20.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018827507, 2024-09-12T22:04:20.930 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.930 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.930 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.930 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:20.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:20.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:04:20.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:20.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:04:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2739999999999999e-06 2024-09-12T22:04:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449999+0000", 2024-09-12T22:04:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3349e-05 2024-09-12T22:04:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450005+0000", 2024-09-12T22:04:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.609e-06 2024-09-12T22:04:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461006+0000", 2024-09-12T22:04:20.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011000876 2024-09-12T22:04:20.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461236+0000", 2024-09-12T22:04:20.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000230301 2024-09-12T22:04:20.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:20.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461362+0000", 2024-09-12T22:04:20.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012541900000000001 2024-09-12T22:04:20.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464797+0000", 2024-09-12T22:04:20.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034350840000000001 2024-09-12T22:04:20.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468754+0000", 2024-09-12T22:04:20.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039576689999999996 2024-09-12T22:04:20.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468784+0000", 2024-09-12T22:04:20.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9558000000000001e-05 2024-09-12T22:04:20.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468810+0000", 2024-09-12T22:04:20.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5752e-05 2024-09-12T22:04:20.935 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.935 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.935 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.936 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:20.936 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:20.936 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.445955927999997, 2024-09-12T22:04:20.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018888559999999999, 2024-09-12T22:04:20.936 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.936 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.936 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450015+0000", 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:04:20.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450018+0000", 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3840000000000001e-06 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8859999999999998e-06 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450030+0000", 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4829999999999999e-06 2024-09-12T22:04:20.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465718+0000", 2024-09-12T22:04:20.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015688163000000001 2024-09-12T22:04:20.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465793+0000", 2024-09-12T22:04:20.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4788000000000003e-05 2024-09-12T22:04:20.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:20.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466015+0000", 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000221394 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467628+0000", 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016131190000000001 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468849+0000", 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012211699999999999 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468878+0000", 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8708e-05 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468902+0000", 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868e-05 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:23 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.445932481, 2024-09-12T22:04:20.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021189669000000001, 2024-09-12T22:04:20.942 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.942 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.942 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.942 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:20.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:20.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450038+0000", 2024-09-12T22:04:20.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:20.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450042+0000", 2024-09-12T22:04:20.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7720000000000001e-06 2024-09-12T22:04:20.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450058+0000", 2024-09-12T22:04:20.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6379999999999999e-05 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450067+0000", 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3870000000000001e-06 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466409+0000", 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016341418999999999 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466467+0000", 2024-09-12T22:04:20.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8613999999999998e-05 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466612+0000", 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014415000000000001 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467856+0000", 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012440039999999999 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471178+0000", 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033227450000000002 2024-09-12T22:04:20.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471207+0000", 2024-09-12T22:04:20.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8571000000000001e-05 2024-09-12T22:04:20.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471227+0000", 2024-09-12T22:04:20.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0109999999999999e-05 2024-09-12T22:04:20.946 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.946 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.946 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.947 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:20.947 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:20.947 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.445891940999999, 2024-09-12T22:04:20.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021231197, 2024-09-12T22:04:20.947 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.947 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.947 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.947 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:20.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450079+0000", 2024-09-12T22:04:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:04:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450083+0000", 2024-09-12T22:04:20.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1989999999999999e-06 2024-09-12T22:04:20.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450092+0000", 2024-09-12T22:04:20.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9400000000000008e-06 2024-09-12T22:04:20.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450097+0000", 2024-09-12T22:04:20.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:04:20.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466898+0000", 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016801226999999998 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466975+0000", 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6197000000000002e-05 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467158+0000", 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183876 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468270+0000", 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001111229 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471260+0000", 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002989907 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471289+0000", 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9271000000000001e-05 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471309+0000", 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0302999999999999e-05 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.445865339999997, 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018145809999999998, 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.952 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:20.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450114+0000", 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1849999999999993e-06 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1350000000000003e-06 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450128+0000", 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2040000000000002e-06 2024-09-12T22:04:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454085+0000", 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00395736 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454090+0000", 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.378e-06 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457076+0000", 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002985747 2024-09-12T22:04:20.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457178+0000", 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010242 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457452+0000", 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027313000000000001 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462024+0000", 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045727040000000004 2024-09-12T22:04:20.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468161+0000", 2024-09-12T22:04:20.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061372019999999996 2024-09-12T22:04:20.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468212+0000", 2024-09-12T22:04:20.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0707000000000001e-05 2024-09-12T22:04:20.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468250+0000", 2024-09-12T22:04:20.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8148000000000001e-05 2024-09-12T22:04:20.958 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.958 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.958 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.958 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:20.958 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:20.958 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.445177784999998, 2024-09-12T22:04:20.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020127506999999999, 2024-09-12T22:04:20.958 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.958 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.958 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.958 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450793+0000", 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2800000000000005e-07 2024-09-12T22:04:20.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450813+0000", 2024-09-12T22:04:20.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0063000000000001e-05 2024-09-12T22:04:20.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450847+0000", 2024-09-12T22:04:20.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3973000000000002e-05 2024-09-12T22:04:20.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450862+0000", 2024-09-12T22:04:20.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5358000000000001e-05 2024-09-12T22:04:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454355+0000", 2024-09-12T22:04:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003492841 2024-09-12T22:04:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454359+0000", 2024-09-12T22:04:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-09-12T22:04:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458704+0000", 2024-09-12T22:04:20.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043452459999999997 2024-09-12T22:04:20.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459009+0000", 2024-09-12T22:04:20.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030526199999999999 2024-09-12T22:04:20.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:20.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459143+0000", 2024-09-12T22:04:20.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013375 2024-09-12T22:04:20.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462690+0000", 2024-09-12T22:04:20.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035466579999999998 2024-09-12T22:04:20.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470863+0000", 2024-09-12T22:04:20.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0081734089999999995 2024-09-12T22:04:20.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470898+0000", 2024-09-12T22:04:20.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4445e-05 2024-09-12T22:04:20.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470920+0000", 2024-09-12T22:04:20.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1844e-05 2024-09-12T22:04:20.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.964 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.964 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:20.964 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:20.964 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.443647665999997, 2024-09-12T22:04:20.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018704596, 2024-09-12T22:04:20.964 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.965 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.965 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.965 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:20.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:20.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452323+0000", 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452337+0000", 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452489+0000", 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015167699999999999 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452498+0000", 2024-09-12T22:04:20.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9709999999999993e-06 2024-09-12T22:04:20.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454393+0000", 2024-09-12T22:04:20.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001895171 2024-09-12T22:04:20.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:20.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454397+0000", 2024-09-12T22:04:20.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4470000000000002e-06 2024-09-12T22:04:20.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459570+0000", 2024-09-12T22:04:20.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051728160000000002 2024-09-12T22:04:20.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459718+0000", 2024-09-12T22:04:20.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014857800000000001 2024-09-12T22:04:20.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:20.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459920+0000", 2024-09-12T22:04:20.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000202043 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462696+0000", 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027756299999999999 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470963+0000", 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082671359999999996 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471000+0000", 2024-09-12T22:04:20.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6748999999999997e-05 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471027+0000", 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7118e-05 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.442690392000003, 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017838390999999999, 2024-09-12T22:04:20.970 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.971 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.971 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:20.971 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:20.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:20.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453280+0000", 2024-09-12T22:04:20.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:04:20.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453284+0000", 2024-09-12T22:04:20.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.194e-06 2024-09-12T22:04:20.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453337+0000", 2024-09-12T22:04:20.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2330999999999998e-05 2024-09-12T22:04:20.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453353+0000", 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6001000000000001e-05 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454421+0000", 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010681009999999999 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454424+0000", 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2550000000000002e-06 2024-09-12T22:04:20.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460376+0000", 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059517770000000001 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460536+0000", 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015984699999999999 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471118+0000", 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010582322999999999 2024-09-12T22:04:20.974 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.262672080000002, 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.975 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:20.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:20.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:20.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:20.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:20.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:20.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:20.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:20.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:20.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:20.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:20.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:20.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:20.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:20.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:20.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:20.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:20.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:20.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:20.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:20.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:20.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:20.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:20.980 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.980 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.980 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.981 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79646 5.2 5:49f0ec46:::benchmark_data_smithi043_32659_object79645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:20.981 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.830362+0000", 2024-09-12T22:04:20.981 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.0656081390000001, 2024-09-12T22:04:20.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017793442, 2024-09-12T22:04:20.981 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.981 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.981 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.981 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:20.981 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:20.981 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.981 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79646 2024-09-12T22:04:20.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.981 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830362+0000", 2024-09-12T22:04:20.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830362+0000", 2024-09-12T22:04:20.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830362+0000", 2024-09-12T22:04:20.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.72e-07 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830413+0000", 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1159999999999998e-05 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830421+0000", 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6890000000000004e-06 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830424+0000", 2024-09-12T22:04:20.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.444e-06 2024-09-12T22:04:20.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830452+0000", 2024-09-12T22:04:20.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7849000000000001e-05 2024-09-12T22:04:20.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830525+0000", 2024-09-12T22:04:20.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3108000000000005e-05 2024-09-12T22:04:20.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830601+0000", 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5440999999999998e-05 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.832355+0000", 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001754205 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848089+0000", 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015733566000000001 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848126+0000", 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7839999999999997e-05 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848155+0000", 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8768e-05 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79650 5.1 5:87bbf2de:::benchmark_data_smithi043_32659_object79649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.0644867730000001, 2024-09-12T22:04:20.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021887977999999999, 2024-09-12T22:04:20.987 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.987 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.987 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:20.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:20.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.987 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79650 2024-09-12T22:04:20.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.987 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:20.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:20.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831484+0000", 2024-09-12T22:04:20.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:04:20.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831558+0000", 2024-09-12T22:04:20.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4556999999999998e-05 2024-09-12T22:04:20.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831567+0000", 2024-09-12T22:04:20.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3410000000000003e-06 2024-09-12T22:04:20.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831574+0000", 2024-09-12T22:04:20.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2559999999999996e-06 2024-09-12T22:04:20.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.832773+0000", 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001199475 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.832890+0000", 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116768 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.833027+0000", 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000136527 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.837448+0000", 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044212130000000002 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853313+0000", 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015865016999999999 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853344+0000", 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1010000000000003e-05 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853371+0000", 2024-09-12T22:04:20.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7092000000000001e-05 2024-09-12T22:04:20.992 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.992 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.992 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.992 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79651 5.1 5:82b16cba:::benchmark_data_smithi043_32659_object79650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:20.992 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:20.992 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.0641623660000001, 2024-09-12T22:04:20.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021652616999999999, 2024-09-12T22:04:20.992 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.992 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.992 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.993 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:20.993 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:20.993 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.993 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79651 2024-09-12T22:04:20.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.993 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:20.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:20.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:20.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831808+0000", 2024-09-12T22:04:20.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4099999999999998e-07 2024-09-12T22:04:20.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:20.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831886+0000", 2024-09-12T22:04:20.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8184999999999998e-05 2024-09-12T22:04:20.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:20.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831896+0000", 2024-09-12T22:04:20.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0001e-05 2024-09-12T22:04:20.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:20.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831902+0000", 2024-09-12T22:04:20.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7960000000000001e-06 2024-09-12T22:04:20.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:20.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835123+0000", 2024-09-12T22:04:20.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032211660000000001 2024-09-12T22:04:20.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835281+0000", 2024-09-12T22:04:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015780699999999999 2024-09-12T22:04:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835443+0000", 2024-09-12T22:04:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016203499999999999 2024-09-12T22:04:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.837588+0000", 2024-09-12T22:04:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021443159999999998 2024-09-12T22:04:20.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:20.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853402+0000", 2024-09-12T22:04:20.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015814528000000001 2024-09-12T22:04:20.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:20.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853434+0000", 2024-09-12T22:04:20.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1955999999999997e-05 2024-09-12T22:04:20.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:20.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853460+0000", 2024-09-12T22:04:20.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6086000000000001e-05 2024-09-12T22:04:20.998 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.998 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:20.998 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:20.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.998 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79659 5.1 5:881dc852:::benchmark_data_smithi043_32659_object79658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:20.998 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:20.998 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.056288822, 2024-09-12T22:04:20.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019797940999999999, 2024-09-12T22:04:20.998 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:20.998 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:20.998 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:20.998 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79659 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:20.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839682+0000", 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839723+0000", 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0611999999999997e-05 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839736+0000", 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3285000000000001e-05 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839755+0000", 2024-09-12T22:04:21.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8870000000000001e-05 2024-09-12T22:04:21.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:21.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839792+0000", 2024-09-12T22:04:21.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7162000000000001e-05 2024-09-12T22:04:21.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:21.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839876+0000", 2024-09-12T22:04:21.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4376999999999995e-05 2024-09-12T22:04:21.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839980+0000", 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000103149 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.841622+0000", 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001642117 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859420+0000", 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017798538999999999 2024-09-12T22:04:21.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859454+0000", 2024-09-12T22:04:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3315000000000002e-05 2024-09-12T22:04:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859479+0000", 2024-09-12T22:04:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5384999999999998e-05 2024-09-12T22:04:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.004 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79661 5.2 5:4081316a:::benchmark_data_smithi043_32659_object79660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:21.004 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:21.004 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.0476158959999999, 2024-09-12T22:04:21.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.025955590000000001, 2024-09-12T22:04:21.004 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:21.004 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:21.004 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.004 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:21.004 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:21.004 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.004 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79661 2024-09-12T22:04:21.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.004 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:21.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:21.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:21.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:21.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:21.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:21.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848355+0000", 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3009999999999999e-06 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848410+0000", 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639000000000003e-05 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848426+0000", 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5979000000000001e-05 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848436+0000", 2024-09-12T22:04:21.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0227000000000001e-05 2024-09-12T22:04:21.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:21.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848479+0000", 2024-09-12T22:04:21.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2450000000000002e-05 2024-09-12T22:04:21.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:21.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848574+0000", 2024-09-12T22:04:21.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5508999999999996e-05 2024-09-12T22:04:21.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848667+0000", 2024-09-12T22:04:21.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999997e-05 2024-09-12T22:04:21.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:21.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.850764+0000", 2024-09-12T22:04:21.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020964920000000001 2024-09-12T22:04:21.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874250+0000", 2024-09-12T22:04:21.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.023486440000000001 2024-09-12T22:04:21.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874283+0000", 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2552000000000003e-05 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874310+0000", 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7001000000000001e-05 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79671 5.2 5:46f8404a:::benchmark_data_smithi043_32659_object79670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:21.009 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.042411559, 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021880646, 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79671 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853559+0000", 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.012e-06 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853609+0000", 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9372000000000001e-05 2024-09-12T22:04:21.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:21.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853617+0000", 2024-09-12T22:04:21.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.055e-06 2024-09-12T22:04:21.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853621+0000", 2024-09-12T22:04:21.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:04:21.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:21.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853659+0000", 2024-09-12T22:04:21.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7981000000000001e-05 2024-09-12T22:04:21.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:21.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853750+0000", 2024-09-12T22:04:21.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0797000000000005e-05 2024-09-12T22:04:21.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853835+0000", 2024-09-12T22:04:21.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4958999999999998e-05 2024-09-12T22:04:21.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:21.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.855573+0000", 2024-09-12T22:04:21.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001737854 2024-09-12T22:04:21.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875378+0000", 2024-09-12T22:04:21.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019805146999999999 2024-09-12T22:04:21.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:21.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875412+0000", 2024-09-12T22:04:21.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3649999999999998e-05 2024-09-12T22:04:21.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:21.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875439+0000", 2024-09-12T22:04:21.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7160000000000001e-05 2024-09-12T22:04:21.015 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.015 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.015 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.015 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.015 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.015 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:21.016 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:21.015+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:21.017 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:21.118 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:21.117+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:21.164 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:21.164 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:21.164 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.164 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:85518 5.e 5:7e27b461:::benchmark_data_smithi043_32659_object85517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.164 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:21.149546+0000", 2024-09-12T22:04:21.164 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.012860227, 2024-09-12T22:04:21.164 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012885661, 2024-09-12T22:04:21.164 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.164 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.164 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:21.164 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.164 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 85518 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.149546+0000", 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.149546+0000", 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.165 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.149547+0000", 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.149578+0000", 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1198999999999997e-05 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.149590+0000", 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1371e-05 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.166 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.167 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.167 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.149595+0000", 2024-09-12T22:04:21.167 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3900000000000001e-06 2024-09-12T22:04:21.167 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.167 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.167 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.167 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.156480+0000", 2024-09-12T22:04:21.167 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0068850609999999996 2024-09-12T22:04:21.167 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.167 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.167 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.167 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.156612+0000", 2024-09-12T22:04:21.167 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000131409 2024-09-12T22:04:21.167 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.168 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.168 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.168 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.168 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.168 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:85522 5.e 5:7814754e:::benchmark_data_smithi043_32659_object85521:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.168 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:21.152186+0000", 2024-09-12T22:04:21.168 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.010220552000000001, 2024-09-12T22:04:21.168 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010318147999999999, 2024-09-12T22:04:21.168 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.168 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.168 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:21.168 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.168 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.169 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.169 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 85522 2024-09-12T22:04:21.169 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.169 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.169 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.169 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.169 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.152186+0000", 2024-09-12T22:04:21.169 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.169 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.169 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.169 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.169 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.152186+0000", 2024-09-12T22:04:21.169 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.169 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.152187+0000", 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9100000000000003e-07 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.152216+0000", 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9261999999999999e-05 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.152227+0000", 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0848e-05 2024-09-12T22:04:21.170 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.171 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.171 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.171 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.152232+0000", 2024-09-12T22:04:21.171 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.062e-06 2024-09-12T22:04:21.171 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.171 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.171 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.171 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158709+0000", 2024-09-12T22:04:21.171 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0064767449999999999 2024-09-12T22:04:21.171 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.171 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.171 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.171 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158844+0000", 2024-09-12T22:04:21.171 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013547799999999999 2024-09-12T22:04:21.172 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.172 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.172 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.172 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.172 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.172 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:85527 5.e 5:74a7446a:::benchmark_data_smithi043_32659_object85526:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.172 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:21.156636+0000", 2024-09-12T22:04:21.172 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0057711330000000003, 2024-09-12T22:04:21.172 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0059366050000000002, 2024-09-12T22:04:21.172 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.172 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.172 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:21.172 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.172 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.173 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.173 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 85527 2024-09-12T22:04:21.173 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.173 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.173 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.176 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.176 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.156636+0000", 2024-09-12T22:04:21.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.177 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.177 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.156636+0000", 2024-09-12T22:04:21.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.177 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.177 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.156637+0000", 2024-09-12T22:04:21.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2279999999999999e-06 2024-09-12T22:04:21.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.156730+0000", 2024-09-12T22:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3561999999999996e-05 2024-09-12T22:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.156741+0000", 2024-09-12T22:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0702e-05 2024-09-12T22:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.156749+0000", 2024-09-12T22:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.157e-06 2024-09-12T22:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.179 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.161562+0000", 2024-09-12T22:04:21.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0048125149999999998 2024-09-12T22:04:21.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.179 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.161647+0000", 2024-09-12T22:04:21.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5156999999999998e-05 2024-09-12T22:04:21.179 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.179 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.179 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.180 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:85528 5.8 5:114e7769:::benchmark_data_smithi043_32659_object85527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.180 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:21.158057+0000", 2024-09-12T22:04:21.180 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0043501340000000003, 2024-09-12T22:04:21.180 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045833159999999996, 2024-09-12T22:04:21.180 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.180 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.180 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:21.180 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.180 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.180 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.180 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 85528 2024-09-12T22:04:21.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.180 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.181 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.181 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.181 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158057+0000", 2024-09-12T22:04:21.181 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158057+0000", 2024-09-12T22:04:21.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.183 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.183 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158057+0000", 2024-09-12T22:04:21.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:04:21.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.183 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158117+0000", 2024-09-12T22:04:21.184 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9413000000000002e-05 2024-09-12T22:04:21.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158126+0000", 2024-09-12T22:04:21.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0510000000000002e-06 2024-09-12T22:04:21.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158131+0000", 2024-09-12T22:04:21.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7469999999999996e-06 2024-09-12T22:04:21.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158660+0000", 2024-09-12T22:04:21.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00052906100000000005 2024-09-12T22:04:21.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158801+0000", 2024-09-12T22:04:21.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000141884 2024-09-12T22:04:21.186 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.186 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.186 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.187 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:85532 5.9 e34/22 5:9adec2ee:::benchmark_data_smithi043_32659_object85531:head v 34'5337, mlcod=34'5335)", 2024-09-12T22:04:21.187 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:21.158713+0000", 2024-09-12T22:04:21.187 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0036935290000000001, 2024-09-12T22:04:21.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0039951420000000001, 2024-09-12T22:04:21.187 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.187 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.187 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:21.187 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158713+0000", 2024-09-12T22:04:21.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.188 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.188 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158713+0000", 2024-09-12T22:04:21.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.188 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.188 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158714+0000", 2024-09-12T22:04:21.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7400000000000002e-07 2024-09-12T22:04:21.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158751+0000", 2024-09-12T22:04:21.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6625999999999998e-05 2024-09-12T22:04:21.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158760+0000", 2024-09-12T22:04:21.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9630000000000004e-06 2024-09-12T22:04:21.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158768+0000", 2024-09-12T22:04:21.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0020000000000006e-06 2024-09-12T22:04:21.190 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.190 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158812+0000", 2024-09-12T22:04:21.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4872e-05 2024-09-12T22:04:21.190 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.190 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.158837+0000", 2024-09-12T22:04:21.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4831e-05 2024-09-12T22:04:21.190 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.190 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.190 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.191 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:85535 5.f e34/22 5:f9c32e22:::benchmark_data_smithi043_32659_object85534:head v 34'5380, mlcod=34'5378)", 2024-09-12T22:04:21.191 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:21.159176+0000", 2024-09-12T22:04:21.191 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0032307809999999998, 2024-09-12T22:04:21.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035831750000000001, 2024-09-12T22:04:21.191 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.191 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.191 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:21.191 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.191 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.159176+0000", 2024-09-12T22:04:21.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.159176+0000", 2024-09-12T22:04:21.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.159177+0000", 2024-09-12T22:04:21.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.61e-07 2024-09-12T22:04:21.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.159228+0000", 2024-09-12T22:04:21.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1044000000000001e-05 2024-09-12T22:04:21.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.159238+0000", 2024-09-12T22:04:21.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.022e-05 2024-09-12T22:04:21.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.159244+0000", 2024-09-12T22:04:21.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6069999999999996e-06 2024-09-12T22:04:21.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.194 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.159296+0000", 2024-09-12T22:04:21.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1156999999999998e-05 2024-09-12T22:04:21.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.194 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.159313+0000", 2024-09-12T22:04:21.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7053000000000001e-05 2024-09-12T22:04:21.194 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.194 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.194 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.195 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.195 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:85536 5.9 e34/22 5:9d7b8db0:::benchmark_data_smithi043_32659_object85535:head v 34'5338, mlcod=34'5335)", 2024-09-12T22:04:21.195 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:21.161210+0000", 2024-09-12T22:04:21.195 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0011965459999999999, 2024-09-12T22:04:21.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015921360000000001, 2024-09-12T22:04:21.195 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.195 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.195 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:21.195 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.161210+0000", 2024-09-12T22:04:21.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.161210+0000", 2024-09-12T22:04:21.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.161211+0000", 2024-09-12T22:04:21.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5099999999999999e-07 2024-09-12T22:04:21.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.161237+0000", 2024-09-12T22:04:21.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5890000000000001e-05 2024-09-12T22:04:21.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.161247+0000", 2024-09-12T22:04:21.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0248000000000001e-05 2024-09-12T22:04:21.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.161252+0000", 2024-09-12T22:04:21.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6299999999999997e-06 2024-09-12T22:04:21.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.161414+0000", 2024-09-12T22:04:21.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016195099999999999 2024-09-12T22:04:21.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.161432+0000", 2024-09-12T22:04:21.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8868e-05 2024-09-12T22:04:21.198 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.198 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.198 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:85539 5.8 5:1a15cd27:::benchmark_data_smithi043_32659_object85538:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:21.162584+0000", 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9998226, 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00026534900000000001, 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 85539 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.199 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.200 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.200 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162584+0000", 2024-09-12T22:04:21.200 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.200 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.200 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162584+0000", 2024-09-12T22:04:21.200 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.200 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162585+0000", 2024-09-12T22:04:21.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.217e-06 2024-09-12T22:04:21.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162612+0000", 2024-09-12T22:04:21.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6570000000000001e-05 2024-09-12T22:04:21.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162626+0000", 2024-09-12T22:04:21.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3618000000000001e-05 2024-09-12T22:04:21.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162632+0000", 2024-09-12T22:04:21.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0410000000000003e-06 2024-09-12T22:04:21.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162692+0000", 2024-09-12T22:04:21.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0690000000000003e-05 2024-09-12T22:04:21.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162834+0000", 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014214800000000001 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:85540 5.a 5:5fa43c98:::benchmark_data_smithi043_32659_object85539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:21.162755+0000", 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9996519, 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000162888, 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.203 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.204 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:04:21.204 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.204 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.204 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.204 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 85540 2024-09-12T22:04:21.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.204 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162755+0000", 2024-09-12T22:04:21.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162755+0000", 2024-09-12T22:04:21.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162755+0000", 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.06e-07 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162829+0000", 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3645000000000004e-05 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162835+0000", 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9109999999999998e-06 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162839+0000", 2024-09-12T22:04:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0489999999999997e-06 2024-09-12T22:04:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.162889+0000", 2024-09-12T22:04:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9759000000000003e-05 2024-09-12T22:04:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:85493 5.e 5:7342a8aa:::benchmark_data_smithi043_32659_object85492:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.208 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:21.141806+0000", 2024-09-12T22:04:21.208 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.020600718000000001, 2024-09-12T22:04:21.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021173147, 2024-09-12T22:04:21.208 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.208 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.208 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:21.208 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.208 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.208 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.208 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 85493 2024-09-12T22:04:21.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.208 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.141806+0000", 2024-09-12T22:04:21.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.141806+0000", 2024-09-12T22:04:21.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.141807+0000", 2024-09-12T22:04:21.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.265e-06 2024-09-12T22:04:21.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.141853+0000", 2024-09-12T22:04:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5915999999999999e-05 2024-09-12T22:04:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.141867+0000", 2024-09-12T22:04:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3720000000000001e-05 2024-09-12T22:04:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.141875+0000", 2024-09-12T22:04:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3010000000000007e-06 2024-09-12T22:04:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.142189+0000", 2024-09-12T22:04:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031353700000000002 2024-09-12T22:04:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.142311+0000", 2024-09-12T22:04:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000122049 2024-09-12T22:04:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:85503 5.e 5:77d022ac:::benchmark_data_smithi043_32659_object85502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:21.144159+0000", 2024-09-12T22:04:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.018248205999999999, 2024-09-12T22:04:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018892263999999999, 2024-09-12T22:04:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 85503 2024-09-12T22:04:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.144159+0000", 2024-09-12T22:04:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.144159+0000", 2024-09-12T22:04:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.144159+0000", 2024-09-12T22:04:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7900000000000007e-07 2024-09-12T22:04:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.144405+0000", 2024-09-12T22:04:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00024562400000000001 2024-09-12T22:04:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.144419+0000", 2024-09-12T22:04:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3648999999999999e-05 2024-09-12T22:04:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.144427+0000", 2024-09-12T22:04:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6610000000000006e-06 2024-09-12T22:04:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.144476+0000", 2024-09-12T22:04:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8356999999999998e-05 2024-09-12T22:04:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.144566+0000", 2024-09-12T22:04:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0709000000000002e-05 2024-09-12T22:04:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:85512 5.e 5:7f5ebbee:::benchmark_data_smithi043_32659_object85511:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:21.146569+0000", 2024-09-12T22:04:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.015837871, 2024-09-12T22:04:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016551878999999999, 2024-09-12T22:04:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 85512 2024-09-12T22:04:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.146569+0000", 2024-09-12T22:04:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.146569+0000", 2024-09-12T22:04:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.146570+0000", 2024-09-12T22:04:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4499999999999996e-07 2024-09-12T22:04:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.146646+0000", 2024-09-12T22:04:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6773000000000005e-05 2024-09-12T22:04:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.146656+0000", 2024-09-12T22:04:21.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9960000000000005e-06 2024-09-12T22:04:21.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.146663+0000", 2024-09-12T22:04:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.905e-06 2024-09-12T22:04:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.154036+0000", 2024-09-12T22:04:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.007372829 2024-09-12T22:04:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:21.154189+0000", 2024-09-12T22:04:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015243599999999999 2024-09-12T22:04:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 12 2024-09-12T22:04:21.222 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:21.223 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 27 16 85627 85611 198.157 176.625 0.00264448 0.00504379 2024-09-12T22:04:21.224 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:21.224 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:21.222+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:21.324 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:21.323+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:21.382 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:04:21.417 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:21.417 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:21.417 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:21.417 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:21.418 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:21.425 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:21.424+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:21.430 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:21.525 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:21.525+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:21.619 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:21.619 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:21.619 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:21.620 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:21.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.620 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44102 5.0 5:0d5aa1ff:::benchmark_data_smithi043_32659_object44101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.620 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:21.620 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.991086394, 2024-09-12T22:04:21.620 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051636015, 2024-09-12T22:04:21.620 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.620 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.620 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.620 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.620 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.620 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.621 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44102 2024-09-12T22:04:21.621 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.621 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.621 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.621 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.621 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:21.621 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.622 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.622 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.622 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.622 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:21.622 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.622 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.622 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.622 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.622 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624875+0000", 2024-09-12T22:04:21.622 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:04:21.622 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.623 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.623 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.623 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624930+0000", 2024-09-12T22:04:21.623 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5256000000000001e-05 2024-09-12T22:04:21.623 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.623 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.623 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.623 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624951+0000", 2024-09-12T22:04:21.623 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0551999999999999e-05 2024-09-12T22:04:21.623 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.623 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.623 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.623 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624958+0000", 2024-09-12T22:04:21.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1849999999999998e-06 2024-09-12T22:04:21.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629885+0000", 2024-09-12T22:04:21.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049266120000000004 2024-09-12T22:04:21.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629999+0000", 2024-09-12T22:04:21.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011385 2024-09-12T22:04:21.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.625 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630125+0000", 2024-09-12T22:04:21.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012640500000000001 2024-09-12T22:04:21.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.625 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.625 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633338+0000", 2024-09-12T22:04:21.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032135559999999998 2024-09-12T22:04:21.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.625 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.625 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676425+0000", 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043086753999999998 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676472+0000", 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6971999999999997e-05 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676510+0000", 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8096999999999998e-05 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.627 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44103 5.8 5:170742c6:::benchmark_data_smithi043_32659_object44102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.627 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:21.627 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.990963242999999, 2024-09-12T22:04:21.627 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051500936999999997, 2024-09-12T22:04:21.627 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.627 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.627 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.627 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.627 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.627 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.627 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44103 2024-09-12T22:04:21.627 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.628 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:21.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:21.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.629 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624998+0000", 2024-09-12T22:04:21.629 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:21.629 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.629 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.629 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.629 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625061+0000", 2024-09-12T22:04:21.629 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2667000000000002e-05 2024-09-12T22:04:21.629 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.629 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.629 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.629 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625069+0000", 2024-09-12T22:04:21.629 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999993e-06 2024-09-12T22:04:21.629 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625077+0000", 2024-09-12T22:04:21.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0090000000000007e-06 2024-09-12T22:04:21.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629869+0000", 2024-09-12T22:04:21.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047921769999999999 2024-09-12T22:04:21.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629938+0000", 2024-09-12T22:04:21.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9542000000000006e-05 2024-09-12T22:04:21.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630010+0000", 2024-09-12T22:04:21.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1795e-05 2024-09-12T22:04:21.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676348+0000", 2024-09-12T22:04:21.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.046337830000000003 2024-09-12T22:04:21.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676399+0000", 2024-09-12T22:04:21.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1150000000000003e-05 2024-09-12T22:04:21.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676460+0000", 2024-09-12T22:04:21.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1142999999999994e-05 2024-09-12T22:04:21.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676498+0000", 2024-09-12T22:04:21.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8111000000000002e-05 2024-09-12T22:04:21.633 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.633 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.633 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.633 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.633 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.633 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.633 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:21.633 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.989664818000001, 2024-09-12T22:04:21.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:21.633 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.633 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.634 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.634 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.634 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.634 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.634 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:21.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.634 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:21.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.637 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:21.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:21.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.637 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:21.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:21.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.637 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:21.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:21.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:21.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:21.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:21.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:21.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:21.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:21.639 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.639 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.640 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.640 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44115 5.0 5:0ee09c30:::benchmark_data_smithi043_32659_object44114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.640 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:21.640 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.986892140999998, 2024-09-12T22:04:21.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082887358999999994, 2024-09-12T22:04:21.640 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.640 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.640 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.640 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.640 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.641 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.641 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44115 2024-09-12T22:04:21.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.641 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.641 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:21.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:21.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629070+0000", 2024-09-12T22:04:21.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1209999999999999e-06 2024-09-12T22:04:21.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629132+0000", 2024-09-12T22:04:21.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2557000000000004e-05 2024-09-12T22:04:21.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629147+0000", 2024-09-12T22:04:21.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4491999999999999e-05 2024-09-12T22:04:21.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629156+0000", 2024-09-12T22:04:21.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7089999999999997e-06 2024-09-12T22:04:21.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631865+0000", 2024-09-12T22:04:21.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00270835 2024-09-12T22:04:21.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631932+0000", 2024-09-12T22:04:21.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7322000000000004e-05 2024-09-12T22:04:21.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632095+0000", 2024-09-12T22:04:21.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016314699999999999 2024-09-12T22:04:21.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.645 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.645 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676360+0000", 2024-09-12T22:04:21.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044264756000000002 2024-09-12T22:04:21.645 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.645 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.645 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711854+0000", 2024-09-12T22:04:21.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.03549389 2024-09-12T22:04:21.645 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.645 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711919+0000", 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5024000000000006e-05 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711956+0000", 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6990999999999999e-05 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44117 5.8 5:1ecb02e0:::benchmark_data_smithi043_32659_object44116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:21.646 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.986747320999999, 2024-09-12T22:04:21.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082354986000000005, 2024-09-12T22:04:21.647 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.647 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.647 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.647 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.647 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.647 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.647 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44117 2024-09-12T22:04:21.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.647 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:21.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:21.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629214+0000", 2024-09-12T22:04:21.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:21.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629315+0000", 2024-09-12T22:04:21.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010045800000000001 2024-09-12T22:04:21.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.649 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.649 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629328+0000", 2024-09-12T22:04:21.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3016e-05 2024-09-12T22:04:21.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.649 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.649 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629336+0000", 2024-09-12T22:04:21.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7229999999999993e-06 2024-09-12T22:04:21.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.650 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.650 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631856+0000", 2024-09-12T22:04:21.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025199300000000001 2024-09-12T22:04:21.650 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.650 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.650 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631954+0000", 2024-09-12T22:04:21.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7565999999999994e-05 2024-09-12T22:04:21.650 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.650 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.650 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632073+0000", 2024-09-12T22:04:21.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119677 2024-09-12T22:04:21.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.651 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676523+0000", 2024-09-12T22:04:21.651 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044449163 2024-09-12T22:04:21.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.651 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676612+0000", 2024-09-12T22:04:21.651 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9579000000000004e-05 2024-09-12T22:04:21.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.651 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711509+0000", 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.034897125000000001 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711568+0000", 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8996999999999998e-05 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44120 5.b 5:df1f2c5f:::benchmark_data_smithi043_32659_object44119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.98457166, 2024-09-12T22:04:21.652 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043861974999999997, 2024-09-12T22:04:21.653 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.653 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.653 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.653 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.653 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.653 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.653 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44120 2024-09-12T22:04:21.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.653 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.653 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.653 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:21.653 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631390+0000", 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631444+0000", 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-12T22:04:21.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631452+0000", 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4610000000000008e-06 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631458+0000", 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631509+0000", 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1442e-05 2024-09-12T22:04:21.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.656 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631627+0000", 2024-09-12T22:04:21.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011796800000000001 2024-09-12T22:04:21.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.656 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631814+0000", 2024-09-12T22:04:21.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018735400000000001 2024-09-12T22:04:21.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.656 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674612+0000", 2024-09-12T22:04:21.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042797287000000003 2024-09-12T22:04:21.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675160+0000", 2024-09-12T22:04:21.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000548187 2024-09-12T22:04:21.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675207+0000", 2024-09-12T22:04:21.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6833999999999999e-05 2024-09-12T22:04:21.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675251+0000", 2024-09-12T22:04:21.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4348000000000003e-05 2024-09-12T22:04:21.658 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.658 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.658 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.658 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.658 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:21.658 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.984263878, 2024-09-12T22:04:21.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:21.658 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.658 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.659 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.659 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.659 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.659 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.659 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:21.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.659 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:21.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:21.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:21.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:21.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:21.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:21.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:21.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:21.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.663 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.663 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:21.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:21.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.663 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.663 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:21.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:21.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:21.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:21.664 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.664 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.664 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.664 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44122 5.d 5:bfd04815:::benchmark_data_smithi043_32659_object44121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.664 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:21.664 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.984165826000002, 2024-09-12T22:04:21.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.080166395000000001, 2024-09-12T22:04:21.664 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.664 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.665 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.665 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.665 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.665 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.665 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44122 2024-09-12T22:04:21.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.665 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:21.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:21.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:21.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:04:21.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631853+0000", 2024-09-12T22:04:21.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7209000000000001e-05 2024-09-12T22:04:21.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.667 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631858+0000", 2024-09-12T22:04:21.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:04:21.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.667 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631862+0000", 2024-09-12T22:04:21.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.692e-06 2024-09-12T22:04:21.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.667 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631905+0000", 2024-09-12T22:04:21.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3135e-05 2024-09-12T22:04:21.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632032+0000", 2024-09-12T22:04:21.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012740900000000001 2024-09-12T22:04:21.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:21.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632166+0000", 2024-09-12T22:04:21.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013318800000000001 2024-09-12T22:04:21.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674894+0000", 2024-09-12T22:04:21.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042728690999999999 2024-09-12T22:04:21.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711875+0000", 2024-09-12T22:04:21.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036980631 2024-09-12T22:04:21.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711923+0000", 2024-09-12T22:04:21.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8180000000000003e-05 2024-09-12T22:04:21.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711961+0000", 2024-09-12T22:04:21.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8142000000000002e-05 2024-09-12T22:04:21.670 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.670 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.670 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.670 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44123 5.e 5:7d83ca89:::benchmark_data_smithi043_32659_object44122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.670 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:21.670 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.984034057999999, 2024-09-12T22:04:21.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043329329, 2024-09-12T22:04:21.670 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.670 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.671 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.671 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.671 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.671 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.671 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44123 2024-09-12T22:04:21.671 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.671 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.671 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.671 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.671 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:21.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.671 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.672 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:21.672 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.672 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631928+0000", 2024-09-12T22:04:21.672 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2699999999999998e-07 2024-09-12T22:04:21.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631996+0000", 2024-09-12T22:04:21.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8141999999999999e-05 2024-09-12T22:04:21.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632004+0000", 2024-09-12T22:04:21.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7600000000000008e-06 2024-09-12T22:04:21.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632010+0000", 2024-09-12T22:04:21.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:04:21.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632069+0000", 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8260000000000001e-05 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632226+0000", 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015702199999999999 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632337+0000", 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111069 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674909+0000", 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042571854999999999 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675184+0000", 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027561399999999998 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675222+0000", 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7710999999999999e-05 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.676 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.676 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675256+0000", 2024-09-12T22:04:21.676 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4014000000000003e-05 2024-09-12T22:04:21.676 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.676 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.676 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.676 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.676 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.676 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.676 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:21.676 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.983322610999998, 2024-09-12T22:04:21.676 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:21.676 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.676 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.677 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.677 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.677 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.677 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.677 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:21.677 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.677 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.677 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.677 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.677 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:21.677 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.677 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.677 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:21.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:21.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:21.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:21.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:21.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:21.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.682 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.682 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.682 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44098 5.0 e28/22 ondisk, result = 0)", 2024-09-12T22:04:21.682 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:21.682 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.982931795999999, 2024-09-12T22:04:21.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043332180999999997, 2024-09-12T22:04:21.682 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.682 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.682 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:21.682 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.683 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:21.683 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.683 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.683 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.683 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:21.683 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.683 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.683 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.683 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633030+0000", 2024-09-12T22:04:21.683 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:21.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.683 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633035+0000", 2024-09-12T22:04:21.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:04:21.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633043+0000", 2024-09-12T22:04:21.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:21.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633048+0000", 2024-09-12T22:04:21.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5439999999999998e-06 2024-09-12T22:04:21.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633362+0000", 2024-09-12T22:04:21.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031397400000000001 2024-09-12T22:04:21.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633369+0000", 2024-09-12T22:04:21.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:04:21.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676361+0000", 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042991954999999998 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.982324690999999, 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.686 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:21.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:21.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:21.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:21.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:21.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:21.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:21.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:21.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:21.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:21.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:21.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.691 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.692 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:44125 5.9 e28/22 5:9022696f:::benchmark_data_smithi043_32659_object44124:head v 28'2753, mlcod=28'2751)", 2024-09-12T22:04:21.692 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:21.692 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.982285826000002, 2024-09-12T22:04:21.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042744011999999998, 2024-09-12T22:04:21.692 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.692 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.692 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.692 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:21.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:21.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633676+0000", 2024-09-12T22:04:21.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.44e-07 2024-09-12T22:04:21.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633755+0000", 2024-09-12T22:04:21.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9629000000000006e-05 2024-09-12T22:04:21.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674386+0000", 2024-09-12T22:04:21.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631364000000003 2024-09-12T22:04:21.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674399+0000", 2024-09-12T22:04:21.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2047e-05 2024-09-12T22:04:21.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674453+0000", 2024-09-12T22:04:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4453999999999997e-05 2024-09-12T22:04:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674479+0000", 2024-09-12T22:04:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6064999999999999e-05 2024-09-12T22:04:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676381+0000", 2024-09-12T22:04:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001901874 2024-09-12T22:04:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676419+0000", 2024-09-12T22:04:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7935000000000002e-05 2024-09-12T22:04:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44103 5.8 e28/22 ondisk, result = 0)", 2024-09-12T22:04:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.981779857999999, 2024-09-12T22:04:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042322950999999998, 2024-09-12T22:04:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:21.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:04:21.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634184+0000", 2024-09-12T22:04:21.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7690000000000001e-06 2024-09-12T22:04:21.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674407+0000", 2024-09-12T22:04:21.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040222750000000002 2024-09-12T22:04:21.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674417+0000", 2024-09-12T22:04:21.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0125e-05 2024-09-12T22:04:21.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676387+0000", 2024-09-12T22:04:21.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001970112 2024-09-12T22:04:21.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676394+0000", 2024-09-12T22:04:21.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:04:21.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676504+0000", 2024-09-12T22:04:21.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109621 2024-09-12T22:04:21.700 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.700 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.700 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.700 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44128 5.d 5:b9a92891:::benchmark_data_smithi043_32659_object44127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.700 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:21.700 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.941527068999999, 2024-09-12T22:04:21.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040118138999999997, 2024-09-12T22:04:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44128 2024-09-12T22:04:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674435+0000", 2024-09-12T22:04:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5960000000000001e-06 2024-09-12T22:04:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674485+0000", 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0021000000000001e-05 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674495+0000", 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5189999999999998e-06 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674500+0000", 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674923+0000", 2024-09-12T22:04:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000423304 2024-09-12T22:04:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675027+0000", 2024-09-12T22:04:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103399 2024-09-12T22:04:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675141+0000", 2024-09-12T22:04:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114274 2024-09-12T22:04:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711649+0000", 2024-09-12T22:04:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036508011999999999 2024-09-12T22:04:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714466+0000", 2024-09-12T22:04:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028167370000000001 2024-09-12T22:04:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714508+0000", 2024-09-12T22:04:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2679000000000003e-05 2024-09-12T22:04:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714552+0000", 2024-09-12T22:04:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3528000000000001e-05 2024-09-12T22:04:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44129 5.0 5:0f626cda:::benchmark_data_smithi043_32659_object44128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.941451564000001, 2024-09-12T22:04:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042846404999999997, 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44129 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674510+0000", 2024-09-12T22:04:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1600000000000002e-07 2024-09-12T22:04:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674548+0000", 2024-09-12T22:04:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8075999999999999e-05 2024-09-12T22:04:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674689+0000", 2024-09-12T22:04:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014141499999999999 2024-09-12T22:04:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674696+0000", 2024-09-12T22:04:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4619999999999999e-06 2024-09-12T22:04:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713666+0000", 2024-09-12T22:04:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.038969072 2024-09-12T22:04:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713752+0000", 2024-09-12T22:04:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6768999999999995e-05 2024-09-12T22:04:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713835+0000", 2024-09-12T22:04:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2774000000000004e-05 2024-09-12T22:04:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717212+0000", 2024-09-12T22:04:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033769389999999998 2024-09-12T22:04:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717259+0000", 2024-09-12T22:04:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7218000000000001e-05 2024-09-12T22:04:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717310+0000", 2024-09-12T22:04:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1156999999999998e-05 2024-09-12T22:04:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717356+0000", 2024-09-12T22:04:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5107e-05 2024-09-12T22:04:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44130 5.4 5:27857918:::benchmark_data_smithi043_32659_object44129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.941253710000002, 2024-09-12T22:04:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039844412000000003, 2024-09-12T22:04:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44130 2024-09-12T22:04:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674708+0000", 2024-09-12T22:04:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4300000000000003e-07 2024-09-12T22:04:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674749+0000", 2024-09-12T22:04:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1254999999999997e-05 2024-09-12T22:04:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674756+0000", 2024-09-12T22:04:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3289999999999996e-06 2024-09-12T22:04:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674762+0000", 2024-09-12T22:04:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.852e-06 2024-09-12T22:04:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9573999999999995e-05 2024-09-12T22:04:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674954+0000", 2024-09-12T22:04:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012254200000000001 2024-09-12T22:04:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675033+0000", 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8707000000000004e-05 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714381+0000", 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039348053000000001 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714477+0000", 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5650999999999996e-05 2024-09-12T22:04:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714516+0000", 2024-09-12T22:04:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9158e-05 2024-09-12T22:04:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714551+0000", 2024-09-12T22:04:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5648000000000002e-05 2024-09-12T22:04:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44131 5.0 5:013256f7:::benchmark_data_smithi043_32659_object44130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.941181242999999, 2024-09-12T22:04:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043388599, 2024-09-12T22:04:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44131 2024-09-12T22:04:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674780+0000", 2024-09-12T22:04:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674817+0000", 2024-09-12T22:04:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6859000000000001e-05 2024-09-12T22:04:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.501e-05 2024-09-12T22:04:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674838+0000", 2024-09-12T22:04:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-06 2024-09-12T22:04:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715161+0000", 2024-09-12T22:04:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.04032285 2024-09-12T22:04:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715317+0000", 2024-09-12T22:04:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015649199999999999 2024-09-12T22:04:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715463+0000", 2024-09-12T22:04:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145704 2024-09-12T22:04:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717480+0000", 2024-09-12T22:04:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020168220000000001 2024-09-12T22:04:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718079+0000", 2024-09-12T22:04:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000599115 2024-09-12T22:04:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718134+0000", 2024-09-12T22:04:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:04:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718168+0000", 2024-09-12T22:04:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4301000000000002e-05 2024-09-12T22:04:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44132 5.e 5:7634b859:::benchmark_data_smithi043_32659_object44131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.940514003000001, 2024-09-12T22:04:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039558587999999999, 2024-09-12T22:04:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44132 2024-09-12T22:04:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675448+0000", 2024-09-12T22:04:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3699999999999999e-07 2024-09-12T22:04:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675552+0000", 2024-09-12T22:04:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104294 2024-09-12T22:04:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675562+0000", 2024-09-12T22:04:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9629999999999993e-06 2024-09-12T22:04:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675569+0000", 2024-09-12T22:04:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8809999999999998e-06 2024-09-12T22:04:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675612+0000", 2024-09-12T22:04:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591000000000003e-05 2024-09-12T22:04:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675717+0000", 2024-09-12T22:04:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010497099999999999 2024-09-12T22:04:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675835+0000", 2024-09-12T22:04:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011793799999999999 2024-09-12T22:04:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713616+0000", 2024-09-12T22:04:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037781032999999999 2024-09-12T22:04:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714911+0000", 2024-09-12T22:04:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001294604 2024-09-12T22:04:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714964+0000", 2024-09-12T22:04:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3408000000000001e-05 2024-09-12T22:04:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715005+0000", 2024-09-12T22:04:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0967999999999998e-05 2024-09-12T22:04:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44133 5.b 5:d0a59edd:::benchmark_data_smithi043_32659_object44132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.940376223000001, 2024-09-12T22:04:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039513020000000003, 2024-09-12T22:04:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44133 2024-09-12T22:04:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675585+0000", 2024-09-12T22:04:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5499999999999998e-07 2024-09-12T22:04:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675634+0000", 2024-09-12T22:04:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8520999999999998e-05 2024-09-12T22:04:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675641+0000", 2024-09-12T22:04:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4440000000000002e-06 2024-09-12T22:04:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675646+0000", 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2660000000000001e-06 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675692+0000", 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5915999999999999e-05 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675812+0000", 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119419 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675950+0000", 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013831499999999999 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713574+0000", 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037623801999999998 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715015+0000", 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014410720000000001 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715059+0000", 2024-09-12T22:04:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:04:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715097+0000", 2024-09-12T22:04:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8519000000000002e-05 2024-09-12T22:04:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:21.736 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:21.738 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:21.736+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:21.738 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:21.839 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:21.838+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:21.889 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:21.889 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:21.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.890 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:87610 5.7 5:e005438d:::benchmark_data_smithi043_32659_object87609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.890 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:21.883971+0000", 2024-09-12T22:04:21.890 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0038022469999999999, 2024-09-12T22:04:21.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038224119999999999, 2024-09-12T22:04:21.890 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:21.890 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:21.890 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:21.890 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:21.890 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:21.890 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.890 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87610 2024-09-12T22:04:21.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883971+0000", 2024-09-12T22:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883971+0000", 2024-09-12T22:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883972+0000", 2024-09-12T22:04:21.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8700000000000004e-07 2024-09-12T22:04:21.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:21.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.884054+0000", 2024-09-12T22:04:21.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1892999999999997e-05 2024-09-12T22:04:21.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:21.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.884062+0000", 2024-09-12T22:04:21.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3489999999999992e-06 2024-09-12T22:04:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.884069+0000", 2024-09-12T22:04:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4200000000000004e-06 2024-09-12T22:04:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.884120+0000", 2024-09-12T22:04:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1569e-05 2024-09-12T22:04:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.884251+0000", 2024-09-12T22:04:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013043500000000001 2024-09-12T22:04:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.887673+0000", 2024-09-12T22:04:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034222010000000001 2024-09-12T22:04:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.887723+0000", 2024-09-12T22:04:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9753999999999998e-05 2024-09-12T22:04:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:21.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.887794+0000", 2024-09-12T22:04:21.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0903999999999997e-05 2024-09-12T22:04:21.895 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.895 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.895 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.895 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:87612 5.5 5:a1bf7041:::benchmark_data_smithi043_32659_object87611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.895 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:21.884247+0000", 2024-09-12T22:04:21.895 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0035262890000000002, 2024-09-12T22:04:21.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036287350000000001, 2024-09-12T22:04:21.895 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:21.896 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:21.896 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:21.896 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:21.896 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:21.896 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.896 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87612 2024-09-12T22:04:21.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.896 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:21.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:21.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.884247+0000", 2024-09-12T22:04:21.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.884247+0000", 2024-09-12T22:04:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.884248+0000", 2024-09-12T22:04:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4499999999999996e-07 2024-09-12T22:04:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.884290+0000", 2024-09-12T22:04:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2386999999999999e-05 2024-09-12T22:04:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.884299+0000", 2024-09-12T22:04:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0550000000000005e-06 2024-09-12T22:04:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.884306+0000", 2024-09-12T22:04:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5919999999999997e-06 2024-09-12T22:04:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.884357+0000", 2024-09-12T22:04:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1261000000000003e-05 2024-09-12T22:04:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.884493+0000", 2024-09-12T22:04:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135637 2024-09-12T22:04:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:87618 5.f 5:fb10af69:::benchmark_data_smithi043_32659_object87617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:21.886393+0000", 2024-09-12T22:04:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0013806910000000001, 2024-09-12T22:04:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015386950000000001, 2024-09-12T22:04:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87618 2024-09-12T22:04:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886393+0000", 2024-09-12T22:04:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886393+0000", 2024-09-12T22:04:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886394+0000", 2024-09-12T22:04:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0100000000000003e-07 2024-09-12T22:04:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886472+0000", 2024-09-12T22:04:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7937999999999998e-05 2024-09-12T22:04:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886482+0000", 2024-09-12T22:04:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9769999999999995e-06 2024-09-12T22:04:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886489+0000", 2024-09-12T22:04:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1489999999999997e-06 2024-09-12T22:04:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886536+0000", 2024-09-12T22:04:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6853e-05 2024-09-12T22:04:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886703+0000", 2024-09-12T22:04:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167629 2024-09-12T22:04:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886783+0000", 2024-09-12T22:04:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9678000000000005e-05 2024-09-12T22:04:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:87616 5.d e34/22 5:ba9c3fc2:::benchmark_data_smithi043_32659_object87615:head v 34'5434, mlcod=34'5432)", 2024-09-12T22:04:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:21.886588+0000", 2024-09-12T22:04:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0011853619999999999, 2024-09-12T22:04:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0014014349999999999, 2024-09-12T22:04:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886588+0000", 2024-09-12T22:04:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886588+0000", 2024-09-12T22:04:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886589+0000", 2024-09-12T22:04:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:04:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886654+0000", 2024-09-12T22:04:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5414999999999996e-05 2024-09-12T22:04:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886662+0000", 2024-09-12T22:04:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0639999999999994e-06 2024-09-12T22:04:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886669+0000", 2024-09-12T22:04:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:04:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886713+0000", 2024-09-12T22:04:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3962999999999999e-05 2024-09-12T22:04:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886731+0000", 2024-09-12T22:04:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8372e-05 2024-09-12T22:04:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:87593 5.1 5:804796db:::benchmark_data_smithi043_32659_object87592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:21.876537+0000", 2024-09-12T22:04:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.011236464999999999, 2024-09-12T22:04:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011517851000000001, 2024-09-12T22:04:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87593 2024-09-12T22:04:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.876537+0000", 2024-09-12T22:04:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.876537+0000", 2024-09-12T22:04:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.876538+0000", 2024-09-12T22:04:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:04:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.876594+0000", 2024-09-12T22:04:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6616000000000001e-05 2024-09-12T22:04:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.876602+0000", 2024-09-12T22:04:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8609999999999998e-06 2024-09-12T22:04:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.876609+0000", 2024-09-12T22:04:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5069999999999997e-06 2024-09-12T22:04:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879013+0000", 2024-09-12T22:04:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024046929999999998 2024-09-12T22:04:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879259+0000", 2024-09-12T22:04:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000245827 2024-09-12T22:04:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:87597 5.9 5:99a5f7ab:::benchmark_data_smithi043_32659_object87596:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:21.879123+0000", 2024-09-12T22:04:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0086503350000000003, 2024-09-12T22:04:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089990499999999998, 2024-09-12T22:04:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87597 2024-09-12T22:04:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879123+0000", 2024-09-12T22:04:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879123+0000", 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879124+0000", 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4499999999999997e-07 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879158+0000", 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4564000000000003e-05 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879168+0000", 2024-09-12T22:04:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4809999999999995e-06 2024-09-12T22:04:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879174+0000", 2024-09-12T22:04:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:04:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879304+0000", 2024-09-12T22:04:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129629 2024-09-12T22:04:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879433+0000", 2024-09-12T22:04:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129744 2024-09-12T22:04:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879576+0000", 2024-09-12T22:04:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000142896 2024-09-12T22:04:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883750+0000", 2024-09-12T22:04:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041742369999999999 2024-09-12T22:04:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:87598 5.9 5:9eaf3d19:::benchmark_data_smithi043_32659_object87597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:21.879182+0000", 2024-09-12T22:04:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0085912509999999994, 2024-09-12T22:04:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.009015828, 2024-09-12T22:04:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87598 2024-09-12T22:04:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879182+0000", 2024-09-12T22:04:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879182+0000", 2024-09-12T22:04:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879183+0000", 2024-09-12T22:04:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:04:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879208+0000", 2024-09-12T22:04:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4794e-05 2024-09-12T22:04:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879216+0000", 2024-09-12T22:04:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9480000000000008e-06 2024-09-12T22:04:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879220+0000", 2024-09-12T22:04:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.848e-06 2024-09-12T22:04:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.881476+0000", 2024-09-12T22:04:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022552710000000001 2024-09-12T22:04:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.881632+0000", 2024-09-12T22:04:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015584 2024-09-12T22:04:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.881765+0000", 2024-09-12T22:04:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013365299999999999 2024-09-12T22:04:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883804+0000", 2024-09-12T22:04:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020388229999999999 2024-09-12T22:04:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:87600 5.9 5:971d0e40:::benchmark_data_smithi043_32659_object87599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:21.879432+0000", 2024-09-12T22:04:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0083413719999999997, 2024-09-12T22:04:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0088450779999999993, 2024-09-12T22:04:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87600 2024-09-12T22:04:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879432+0000", 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879432+0000", 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879433+0000", 2024-09-12T22:04:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3e-07 2024-09-12T22:04:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879495+0000", 2024-09-12T22:04:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1910999999999997e-05 2024-09-12T22:04:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879503+0000", 2024-09-12T22:04:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:04:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.879508+0000", 2024-09-12T22:04:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6509999999999998e-06 2024-09-12T22:04:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883827+0000", 2024-09-12T22:04:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004318349 2024-09-12T22:04:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883920+0000", 2024-09-12T22:04:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3098999999999998e-05 2024-09-12T22:04:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.884081+0000", 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016105000000000001 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886137+0000", 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020557829999999998 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:87602 5.1 5:8f8bed7b:::benchmark_data_smithi043_32659_object87601:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:21.880221+0000", 2024-09-12T22:04:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0075525560000000002, 2024-09-12T22:04:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0081381730000000003, 2024-09-12T22:04:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87602 2024-09-12T22:04:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.880221+0000", 2024-09-12T22:04:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.880221+0000", 2024-09-12T22:04:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.880222+0000", 2024-09-12T22:04:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000005e-07 2024-09-12T22:04:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.880283+0000", 2024-09-12T22:04:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1236999999999997e-05 2024-09-12T22:04:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.880288+0000", 2024-09-12T22:04:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3619999999999997e-06 2024-09-12T22:04:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.880292+0000", 2024-09-12T22:04:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9790000000000004e-06 2024-09-12T22:04:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886115+0000", 2024-09-12T22:04:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058227219999999998 2024-09-12T22:04:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886220+0000", 2024-09-12T22:04:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105004 2024-09-12T22:04:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:87607 5.9 5:9bf4a9d9:::benchmark_data_smithi043_32659_object87606:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:21.883024+0000", 2024-09-12T22:04:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0047491790000000001, 2024-09-12T22:04:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054038549999999999, 2024-09-12T22:04:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87607 2024-09-12T22:04:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883024+0000", 2024-09-12T22:04:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883024+0000", 2024-09-12T22:04:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883025+0000", 2024-09-12T22:04:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.093e-06 2024-09-12T22:04:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883068+0000", 2024-09-12T22:04:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2548e-05 2024-09-12T22:04:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883081+0000", 2024-09-12T22:04:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2566e-05 2024-09-12T22:04:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883088+0000", 2024-09-12T22:04:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1930000000000004e-06 2024-09-12T22:04:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886169+0000", 2024-09-12T22:04:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0030815740000000001 2024-09-12T22:04:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886281+0000", 2024-09-12T22:04:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011140499999999999 2024-09-12T22:04:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.886368+0000", 2024-09-12T22:04:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6971999999999993e-05 2024-09-12T22:04:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:87608 5.1 5:8f1153f3:::benchmark_data_smithi043_32659_object87607:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T22:04:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:21.883129+0000", 2024-09-12T22:04:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0046444399999999997, 2024-09-12T22:04:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0053741029999999999, 2024-09-12T22:04:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87608 2024-09-12T22:04:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883129+0000", 2024-09-12T22:04:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883129+0000", 2024-09-12T22:04:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883130+0000", 2024-09-12T22:04:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:04:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883207+0000", 2024-09-12T22:04:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6413000000000002e-05 2024-09-12T22:04:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883219+0000", 2024-09-12T22:04:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2166e-05 2024-09-12T22:04:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.883227+0000", 2024-09-12T22:04:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1880000000000002e-06 2024-09-12T22:04:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.888271+0000", 2024-09-12T22:04:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0050444050000000001 2024-09-12T22:04:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:21.888398+0000", 2024-09-12T22:04:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012643999999999999 2024-09-12T22:04:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 11 2024-09-12T22:04:21.939 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:21.940 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:21.941 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:21.939+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:22.041 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:22.041+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:22.052 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:04:22.081 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:04:22.094 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:22.094 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:22.094 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:22.094 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:22.094 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:22.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:22.146 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:22.146+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:22.164 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-09-12T22:04:22.191 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 28 16 88470 88454 197.426 177.688 0.0061165 0.0050623 2024-09-12T22:04:22.192 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:22.211 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:22.212 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:22.231 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:22.231 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:22.234 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:22.235 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:22.243 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:22.243+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:22.295 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:22.295 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:22.309 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:22.350 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:22.350+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-09-12T22:04:22.445 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:22.444+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:22.457 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:22.458 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:22.470 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:22.554 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:22.553+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:22.647 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:22.647+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:22.659 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:22.659 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:22.670 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:22.754 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:22.753+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:22.851 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:22.848+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:22.853 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:22.854 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:22.868 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:22.951 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:22.949+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:23.022 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:23.022 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:23.036 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:23.050 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:23.049+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:23.151 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:23.151+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:23.189 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:23.190 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:23.191 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 29 16 91338 91322 196.799 179.25 0.00807333 0.00507837 2024-09-12T22:04:23.201 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:23.285 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:23.285+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:23.353 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:23.353+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:23.399 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:23.399 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:23.412 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:23.456 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:23.455+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:23.555 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:23.554+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:23.564 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:23.565 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:23.579 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:23.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-12T22:04:23.663 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:23.662+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:23.756 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:23.755+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:23.764 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:23.765 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:23.778 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:23.857 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:23.856+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:23.958 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:23.956+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:23.970 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:23.970 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:23.983 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:24.059 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:24.058+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:24.135 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:24.136 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:24.149 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:24.190 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:24.189+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:24.191 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 30 15 94193 94178 196.188 178.5 0.00399644 0.00509458 2024-09-12T22:04:24.235 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:04:24.261 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:24.260+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:24.336 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:24.336 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:24.346 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:24.352 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:24.362 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:24.361+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:24.365 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:24.365 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:24.385 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:24.385 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:24.387 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:04:24.389 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:24.390 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:24.463 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:24.462+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:24.548 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:24.548 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:24.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:24.548 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:24.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.549 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:24.549 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:24.549 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.095594196, 2024-09-12T22:04:24.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018534981999999998, 2024-09-12T22:04:24.549 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.549 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.549 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.549 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449725+0000", 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799999999999999e-06 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449731+0000", 2024-09-12T22:04:24.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.801e-06 2024-09-12T22:04:24.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449745+0000", 2024-09-12T22:04:24.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4198e-05 2024-09-12T22:04:24.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449758+0000", 2024-09-12T22:04:24.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2858e-05 2024-09-12T22:04:24.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449815+0000", 2024-09-12T22:04:24.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6978999999999998e-05 2024-09-12T22:04:24.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:24.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:24.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2369999999999997e-06 2024-09-12T22:04:24.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457683+0000", 2024-09-12T22:04:24.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078622640000000008 2024-09-12T22:04:24.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457840+0000", 2024-09-12T22:04:24.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015715299999999999 2024-09-12T22:04:24.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:24.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457972+0000", 2024-09-12T22:04:24.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013179500000000001 2024-09-12T22:04:24.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462325+0000", 2024-09-12T22:04:24.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043526859999999997 2024-09-12T22:04:24.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468180+0000", 2024-09-12T22:04:24.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058557169999999999 2024-09-12T22:04:24.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468221+0000", 2024-09-12T22:04:24.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0673000000000002e-05 2024-09-12T22:04:24.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468258+0000", 2024-09-12T22:04:24.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7240999999999998e-05 2024-09-12T22:04:24.555 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.555 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.555 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.555 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:24.555 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:24.555 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.095541584999999, 2024-09-12T22:04:24.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018748032000000001, 2024-09-12T22:04:24.555 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.555 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.556 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.556 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:24.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:24.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449779+0000", 2024-09-12T22:04:24.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4869999999999998e-06 2024-09-12T22:04:24.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449783+0000", 2024-09-12T22:04:24.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:04:24.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449791+0000", 2024-09-12T22:04:24.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2640000000000002e-06 2024-09-12T22:04:24.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449796+0000", 2024-09-12T22:04:24.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9370000000000001e-06 2024-09-12T22:04:24.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449915+0000", 2024-09-12T22:04:24.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118559 2024-09-12T22:04:24.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:24.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449920+0000", 2024-09-12T22:04:24.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.101e-06 2024-09-12T22:04:24.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458578+0000", 2024-09-12T22:04:24.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008657662 2024-09-12T22:04:24.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458978+0000", 2024-09-12T22:04:24.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00039977399999999998 2024-09-12T22:04:24.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:24.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459130+0000", 2024-09-12T22:04:24.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000152394 2024-09-12T22:04:24.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462793+0000", 2024-09-12T22:04:24.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036628770000000001 2024-09-12T22:04:24.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468451+0000", 2024-09-12T22:04:24.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056577820000000001 2024-09-12T22:04:24.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468501+0000", 2024-09-12T22:04:24.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0609999999999998e-05 2024-09-12T22:04:24.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468524+0000", 2024-09-12T22:04:24.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2804000000000001e-05 2024-09-12T22:04:24.561 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.561 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.561 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.561 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:24.562 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:24.562 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.095506884000002, 2024-09-12T22:04:24.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018816113999999998, 2024-09-12T22:04:24.562 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.562 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.562 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.562 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:24.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:24.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:24.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-09-12T22:04:24.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:24.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3360000000000001e-06 2024-09-12T22:04:24.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449832+0000", 2024-09-12T22:04:24.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1528e-05 2024-09-12T22:04:24.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:04:24.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-12T22:04:24.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459429+0000", 2024-09-12T22:04:24.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095926970000000007 2024-09-12T22:04:24.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459597+0000", 2024-09-12T22:04:24.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000168309 2024-09-12T22:04:24.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:24.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459829+0000", 2024-09-12T22:04:24.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231158 2024-09-12T22:04:24.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462796+0000", 2024-09-12T22:04:24.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029673849999999999 2024-09-12T22:04:24.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468558+0000", 2024-09-12T22:04:24.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057621449999999998 2024-09-12T22:04:24.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468592+0000", 2024-09-12T22:04:24.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4241e-05 2024-09-12T22:04:24.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468627+0000", 2024-09-12T22:04:24.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4511999999999998e-05 2024-09-12T22:04:24.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.567 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.567 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:24.567 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:24.567 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.095439855999999, 2024-09-12T22:04:24.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018845905, 2024-09-12T22:04:24.567 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.567 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.567 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.567 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:24.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:24.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:24.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:04:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449881+0000", 2024-09-12T22:04:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.005e-06 2024-09-12T22:04:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449887+0000", 2024-09-12T22:04:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9050000000000002e-06 2024-09-12T22:04:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449892+0000", 2024-09-12T22:04:24.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2009999999999998e-06 2024-09-12T22:04:24.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460279+0000", 2024-09-12T22:04:24.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010386808000000001 2024-09-12T22:04:24.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460427+0000", 2024-09-12T22:04:24.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014789 2024-09-12T22:04:24.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:24.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460572+0000", 2024-09-12T22:04:24.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014453099999999999 2024-09-12T22:04:24.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462799+0000", 2024-09-12T22:04:24.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002227049 2024-09-12T22:04:24.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468672+0000", 2024-09-12T22:04:24.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058730060000000001 2024-09-12T22:04:24.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468704+0000", 2024-09-12T22:04:24.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2421e-05 2024-09-12T22:04:24.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468724+0000", 2024-09-12T22:04:24.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9582e-05 2024-09-12T22:04:24.572 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.572 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.572 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.572 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.095366994999999, 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017913407999999999, 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3499999999999996e-07 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449955+0000", 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4379999999999999e-06 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449963+0000", 2024-09-12T22:04:24.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2719999999999997e-06 2024-09-12T22:04:24.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449970+0000", 2024-09-12T22:04:24.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5930000000000002e-06 2024-09-12T22:04:24.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450563+0000", 2024-09-12T22:04:24.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00059351900000000003 2024-09-12T22:04:24.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:24.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450570+0000", 2024-09-12T22:04:24.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3900000000000004e-06 2024-09-12T22:04:24.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461148+0000", 2024-09-12T22:04:24.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010577354000000001 2024-09-12T22:04:24.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461312+0000", 2024-09-12T22:04:24.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016392300000000001 2024-09-12T22:04:24.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461525+0000", 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021282199999999999 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464272+0000", 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027469740000000001 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467749+0000", 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003477235 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467815+0000", 2024-09-12T22:04:24.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5974000000000002e-05 2024-09-12T22:04:24.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467864+0000", 2024-09-12T22:04:24.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9279e-05 2024-09-12T22:04:24.578 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.578 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.578 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.578 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.095335529000003, 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018827507, 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:24.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:04:24.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:24.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:04:24.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2739999999999999e-06 2024-09-12T22:04:24.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449999+0000", 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3349e-05 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450005+0000", 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.609e-06 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461006+0000", 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011000876 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461236+0000", 2024-09-12T22:04:24.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000230301 2024-09-12T22:04:24.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:24.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461362+0000", 2024-09-12T22:04:24.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012541900000000001 2024-09-12T22:04:24.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464797+0000", 2024-09-12T22:04:24.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034350840000000001 2024-09-12T22:04:24.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468754+0000", 2024-09-12T22:04:24.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039576689999999996 2024-09-12T22:04:24.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468784+0000", 2024-09-12T22:04:24.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9558000000000001e-05 2024-09-12T22:04:24.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468810+0000", 2024-09-12T22:04:24.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5752e-05 2024-09-12T22:04:24.583 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.095303657000002, 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018888559999999999, 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:24.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:24.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450015+0000", 2024-09-12T22:04:24.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:04:24.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450018+0000", 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3840000000000001e-06 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8859999999999998e-06 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450030+0000", 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4829999999999999e-06 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465718+0000", 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015688163000000001 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465793+0000", 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4788000000000003e-05 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466015+0000", 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000221394 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467628+0000", 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016131190000000001 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468849+0000", 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012211699999999999 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468878+0000", 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8708e-05 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468902+0000", 2024-09-12T22:04:24.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868e-05 2024-09-12T22:04:24.589 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.589 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.589 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.589 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:23 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:24.589 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:24.589 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.095280209999999, 2024-09-12T22:04:24.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021189669000000001, 2024-09-12T22:04:24.589 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450038+0000", 2024-09-12T22:04:24.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:24.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450042+0000", 2024-09-12T22:04:24.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7720000000000001e-06 2024-09-12T22:04:24.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450058+0000", 2024-09-12T22:04:24.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6379999999999999e-05 2024-09-12T22:04:24.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450067+0000", 2024-09-12T22:04:24.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3870000000000001e-06 2024-09-12T22:04:24.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466409+0000", 2024-09-12T22:04:24.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016341418999999999 2024-09-12T22:04:24.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466467+0000", 2024-09-12T22:04:24.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8613999999999998e-05 2024-09-12T22:04:24.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:24.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466612+0000", 2024-09-12T22:04:24.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014415000000000001 2024-09-12T22:04:24.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467856+0000", 2024-09-12T22:04:24.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012440039999999999 2024-09-12T22:04:24.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471178+0000", 2024-09-12T22:04:24.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033227450000000002 2024-09-12T22:04:24.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471207+0000", 2024-09-12T22:04:24.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8571000000000001e-05 2024-09-12T22:04:24.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471227+0000", 2024-09-12T22:04:24.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0109999999999999e-05 2024-09-12T22:04:24.595 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.595 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.595 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.595 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:24.595 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:24.595 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.095239669999998, 2024-09-12T22:04:24.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021231197, 2024-09-12T22:04:24.595 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.595 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.595 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.596 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:24.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:24.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450079+0000", 2024-09-12T22:04:24.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:04:24.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450083+0000", 2024-09-12T22:04:24.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1989999999999999e-06 2024-09-12T22:04:24.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450092+0000", 2024-09-12T22:04:24.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9400000000000008e-06 2024-09-12T22:04:24.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450097+0000", 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466898+0000", 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016801226999999998 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466975+0000", 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6197000000000002e-05 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:24.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467158+0000", 2024-09-12T22:04:24.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183876 2024-09-12T22:04:24.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468270+0000", 2024-09-12T22:04:24.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001111229 2024-09-12T22:04:24.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471260+0000", 2024-09-12T22:04:24.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002989907 2024-09-12T22:04:24.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471289+0000", 2024-09-12T22:04:24.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9271000000000001e-05 2024-09-12T22:04:24.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471309+0000", 2024-09-12T22:04:24.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0302999999999999e-05 2024-09-12T22:04:24.600 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.600 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.600 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.601 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:24.601 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:24.601 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.095213069000003, 2024-09-12T22:04:24.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018145809999999998, 2024-09-12T22:04:24.601 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.601 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.601 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.601 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:24.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:24.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:24.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:24.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450114+0000", 2024-09-12T22:04:24.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1849999999999993e-06 2024-09-12T22:04:24.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:04:24.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1350000000000003e-06 2024-09-12T22:04:24.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450128+0000", 2024-09-12T22:04:24.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2040000000000002e-06 2024-09-12T22:04:24.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454085+0000", 2024-09-12T22:04:24.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00395736 2024-09-12T22:04:24.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:24.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454090+0000", 2024-09-12T22:04:24.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.378e-06 2024-09-12T22:04:24.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457076+0000", 2024-09-12T22:04:24.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002985747 2024-09-12T22:04:24.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457178+0000", 2024-09-12T22:04:24.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010242 2024-09-12T22:04:24.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:24.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457452+0000", 2024-09-12T22:04:24.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027313000000000001 2024-09-12T22:04:24.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462024+0000", 2024-09-12T22:04:24.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045727040000000004 2024-09-12T22:04:24.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468161+0000", 2024-09-12T22:04:24.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061372019999999996 2024-09-12T22:04:24.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468212+0000", 2024-09-12T22:04:24.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0707000000000001e-05 2024-09-12T22:04:24.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468250+0000", 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8148000000000001e-05 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.094525513999997, 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020127506999999999, 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.607 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:24.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:24.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450793+0000", 2024-09-12T22:04:24.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2800000000000005e-07 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450813+0000", 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0063000000000001e-05 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450847+0000", 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3973000000000002e-05 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450862+0000", 2024-09-12T22:04:24.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5358000000000001e-05 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454355+0000", 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003492841 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454359+0000", 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458704+0000", 2024-09-12T22:04:24.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043452459999999997 2024-09-12T22:04:24.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459009+0000", 2024-09-12T22:04:24.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030526199999999999 2024-09-12T22:04:24.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:24.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459143+0000", 2024-09-12T22:04:24.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013375 2024-09-12T22:04:24.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462690+0000", 2024-09-12T22:04:24.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035466579999999998 2024-09-12T22:04:24.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470863+0000", 2024-09-12T22:04:24.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0081734089999999995 2024-09-12T22:04:24.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470898+0000", 2024-09-12T22:04:24.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4445e-05 2024-09-12T22:04:24.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470920+0000", 2024-09-12T22:04:24.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1844e-05 2024-09-12T22:04:24.613 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.613 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.613 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.613 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:24.613 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:24.613 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.092995395000003, 2024-09-12T22:04:24.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018704596, 2024-09-12T22:04:24.613 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.613 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.613 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.614 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:24.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:24.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452323+0000", 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452337+0000", 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452489+0000", 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015167699999999999 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452498+0000", 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9709999999999993e-06 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454393+0000", 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001895171 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454397+0000", 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4470000000000002e-06 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459570+0000", 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051728160000000002 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459718+0000", 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014857800000000001 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459920+0000", 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000202043 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462696+0000", 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027756299999999999 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470963+0000", 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082671359999999996 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471000+0000", 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6748999999999997e-05 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471027+0000", 2024-09-12T22:04:24.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7118e-05 2024-09-12T22:04:24.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.619 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.619 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:24.619 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:24.619 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.092038121000002, 2024-09-12T22:04:24.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017838390999999999, 2024-09-12T22:04:24.619 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.619 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.619 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:24.619 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453279+0000", 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453280+0000", 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:04:24.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453284+0000", 2024-09-12T22:04:24.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.194e-06 2024-09-12T22:04:24.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453337+0000", 2024-09-12T22:04:24.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2330999999999998e-05 2024-09-12T22:04:24.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.453353+0000", 2024-09-12T22:04:24.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6001000000000001e-05 2024-09-12T22:04:24.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454421+0000", 2024-09-12T22:04:24.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010681009999999999 2024-09-12T22:04:24.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:24.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454424+0000", 2024-09-12T22:04:24.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2550000000000002e-06 2024-09-12T22:04:24.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460376+0000", 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059517770000000001 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460536+0000", 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015984699999999999 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471118+0000", 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010582322999999999 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.624 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:24.624 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:24.624 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.912019809, 2024-09-12T22:04:24.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:24.624 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.624 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.624 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.624 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:24.624 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:24.624 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:24.624 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:24.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.625 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:24.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:24.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:24.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:24.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:24.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:24.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:24.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:24.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:24.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79646 5.2 5:49f0ec46:::benchmark_data_smithi043_32659_object79645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.830362+0000", 2024-09-12T22:04:24.629 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.7149558679999997, 2024-09-12T22:04:24.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017793442, 2024-09-12T22:04:24.630 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.630 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.630 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:24.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:24.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:24.630 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79646 2024-09-12T22:04:24.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.630 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830362+0000", 2024-09-12T22:04:24.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830362+0000", 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830362+0000", 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.72e-07 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830413+0000", 2024-09-12T22:04:24.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1159999999999998e-05 2024-09-12T22:04:24.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830421+0000", 2024-09-12T22:04:24.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6890000000000004e-06 2024-09-12T22:04:24.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830424+0000", 2024-09-12T22:04:24.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.444e-06 2024-09-12T22:04:24.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830452+0000", 2024-09-12T22:04:24.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7849000000000001e-05 2024-09-12T22:04:24.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830525+0000", 2024-09-12T22:04:24.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3108000000000005e-05 2024-09-12T22:04:24.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:24.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.830601+0000", 2024-09-12T22:04:24.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5440999999999998e-05 2024-09-12T22:04:24.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.832355+0000", 2024-09-12T22:04:24.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001754205 2024-09-12T22:04:24.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848089+0000", 2024-09-12T22:04:24.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015733566000000001 2024-09-12T22:04:24.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848126+0000", 2024-09-12T22:04:24.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7839999999999997e-05 2024-09-12T22:04:24.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848155+0000", 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8768e-05 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79650 5.1 5:87bbf2de:::benchmark_data_smithi043_32659_object79649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.7138345020000001, 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021887977999999999, 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:24.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:24.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:24.636 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79650 2024-09-12T22:04:24.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.636 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:24.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:24.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831484+0000", 2024-09-12T22:04:24.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:04:24.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831558+0000", 2024-09-12T22:04:24.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4556999999999998e-05 2024-09-12T22:04:24.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831567+0000", 2024-09-12T22:04:24.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3410000000000003e-06 2024-09-12T22:04:24.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831574+0000", 2024-09-12T22:04:24.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2559999999999996e-06 2024-09-12T22:04:24.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.832773+0000", 2024-09-12T22:04:24.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001199475 2024-09-12T22:04:24.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.832890+0000", 2024-09-12T22:04:24.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116768 2024-09-12T22:04:24.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:24.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.833027+0000", 2024-09-12T22:04:24.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000136527 2024-09-12T22:04:24.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.837448+0000", 2024-09-12T22:04:24.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044212130000000002 2024-09-12T22:04:24.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853313+0000", 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015865016999999999 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853344+0000", 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1010000000000003e-05 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853371+0000", 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7092000000000001e-05 2024-09-12T22:04:24.640 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.641 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.641 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.641 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79651 5.1 5:82b16cba:::benchmark_data_smithi043_32659_object79650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:24.641 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:24.641 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.7135100950000002, 2024-09-12T22:04:24.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021652616999999999, 2024-09-12T22:04:24.641 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.641 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.641 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:24.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:24.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:24.642 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79651 2024-09-12T22:04:24.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.642 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:24.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:24.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831808+0000", 2024-09-12T22:04:24.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4099999999999998e-07 2024-09-12T22:04:24.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831886+0000", 2024-09-12T22:04:24.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8184999999999998e-05 2024-09-12T22:04:24.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831896+0000", 2024-09-12T22:04:24.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0001e-05 2024-09-12T22:04:24.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831902+0000", 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7960000000000001e-06 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835123+0000", 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032211660000000001 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835281+0000", 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015780699999999999 2024-09-12T22:04:24.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:24.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835443+0000", 2024-09-12T22:04:24.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016203499999999999 2024-09-12T22:04:24.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.837588+0000", 2024-09-12T22:04:24.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021443159999999998 2024-09-12T22:04:24.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853402+0000", 2024-09-12T22:04:24.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015814528000000001 2024-09-12T22:04:24.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853434+0000", 2024-09-12T22:04:24.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1955999999999997e-05 2024-09-12T22:04:24.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853460+0000", 2024-09-12T22:04:24.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6086000000000001e-05 2024-09-12T22:04:24.646 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.646 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.646 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.647 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79659 5.1 5:881dc852:::benchmark_data_smithi043_32659_object79658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:24.647 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:24.647 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.7056365509999996, 2024-09-12T22:04:24.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019797940999999999, 2024-09-12T22:04:24.647 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.647 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.647 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.647 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:24.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:24.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:24.648 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79659 2024-09-12T22:04:24.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.648 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:24.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:24.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839682+0000", 2024-09-12T22:04:24.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-12T22:04:24.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839723+0000", 2024-09-12T22:04:24.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0611999999999997e-05 2024-09-12T22:04:24.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839736+0000", 2024-09-12T22:04:24.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3285000000000001e-05 2024-09-12T22:04:24.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839755+0000", 2024-09-12T22:04:24.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8870000000000001e-05 2024-09-12T22:04:24.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839792+0000", 2024-09-12T22:04:24.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7162000000000001e-05 2024-09-12T22:04:24.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839876+0000", 2024-09-12T22:04:24.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4376999999999995e-05 2024-09-12T22:04:24.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:24.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839980+0000", 2024-09-12T22:04:24.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000103149 2024-09-12T22:04:24.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.841622+0000", 2024-09-12T22:04:24.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001642117 2024-09-12T22:04:24.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859420+0000", 2024-09-12T22:04:24.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017798538999999999 2024-09-12T22:04:24.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859454+0000", 2024-09-12T22:04:24.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3315000000000002e-05 2024-09-12T22:04:24.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859479+0000", 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5384999999999998e-05 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79661 5.2 5:4081316a:::benchmark_data_smithi043_32659_object79660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.6969636250000004, 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.025955590000000001, 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:24.654 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:24.654 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:24.654 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79661 2024-09-12T22:04:24.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.654 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:24.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:24.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848355+0000", 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3009999999999999e-06 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848410+0000", 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639000000000003e-05 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848426+0000", 2024-09-12T22:04:24.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5979000000000001e-05 2024-09-12T22:04:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848436+0000", 2024-09-12T22:04:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0227000000000001e-05 2024-09-12T22:04:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848479+0000", 2024-09-12T22:04:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2450000000000002e-05 2024-09-12T22:04:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848574+0000", 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5508999999999996e-05 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848667+0000", 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999997e-05 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.850764+0000", 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020964920000000001 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874250+0000", 2024-09-12T22:04:24.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.023486440000000001 2024-09-12T22:04:24.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874283+0000", 2024-09-12T22:04:24.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2552000000000003e-05 2024-09-12T22:04:24.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874310+0000", 2024-09-12T22:04:24.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7001000000000001e-05 2024-09-12T22:04:24.658 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.658 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.658 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.659 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79671 5.2 5:46f8404a:::benchmark_data_smithi043_32659_object79670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:24.659 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:24.659 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.6917592880000001, 2024-09-12T22:04:24.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021880646, 2024-09-12T22:04:24.659 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:24.659 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:24.659 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:24.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:24.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:24.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:24.659 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79671 2024-09-12T22:04:24.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.660 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:24.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:24.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:24.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:24.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:24.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:24.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:24.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853559+0000", 2024-09-12T22:04:24.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.012e-06 2024-09-12T22:04:24.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:24.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853609+0000", 2024-09-12T22:04:24.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9372000000000001e-05 2024-09-12T22:04:24.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:24.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853617+0000", 2024-09-12T22:04:24.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.055e-06 2024-09-12T22:04:24.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853621+0000", 2024-09-12T22:04:24.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:04:24.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:24.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853659+0000", 2024-09-12T22:04:24.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7981000000000001e-05 2024-09-12T22:04:24.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:24.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853750+0000", 2024-09-12T22:04:24.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0797000000000005e-05 2024-09-12T22:04:24.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:24.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853835+0000", 2024-09-12T22:04:24.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4958999999999998e-05 2024-09-12T22:04:24.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:24.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.855573+0000", 2024-09-12T22:04:24.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001737854 2024-09-12T22:04:24.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:24.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875378+0000", 2024-09-12T22:04:24.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019805146999999999 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875412+0000", 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3649999999999998e-05 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875439+0000", 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7160000000000001e-05 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:24.665 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:24.666 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:24.666 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:24.665+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:24.767 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:24.766+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:24.811 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:24.811 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:24.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.812 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:95911 5.b 5:d383484a:::benchmark_data_smithi043_32659_object95910:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T22:04:24.812 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:24.804419+0000", 2024-09-12T22:04:24.812 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0056390010000000003, 2024-09-12T22:04:24.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056633309999999997, 2024-09-12T22:04:24.812 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:24.812 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:24.812 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:24.812 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:24.812 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:24.812 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:24.812 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 95911 2024-09-12T22:04:24.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.813 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:24.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:24.813 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.804419+0000", 2024-09-12T22:04:24.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:24.813 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.804419+0000", 2024-09-12T22:04:24.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.804420+0000", 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5499999999999997e-07 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.804466+0000", 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6329000000000003e-05 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.804474+0000", 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7479999999999993e-06 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.804480+0000", 2024-09-12T22:04:24.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:04:24.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:24.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.806719+0000", 2024-09-12T22:04:24.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022385669999999999 2024-09-12T22:04:24.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:24.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.806859+0000", 2024-09-12T22:04:24.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013978100000000001 2024-09-12T22:04:24.815 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.815 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:24.816 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.816 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:95908 5.f e35/22 5:f0bdbe04:::benchmark_data_smithi043_32659_object95907:head v 35'6022, mlcod=35'6018)", 2024-09-12T22:04:24.816 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:24.806187+0000", 2024-09-12T22:04:24.816 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0038708660000000002, 2024-09-12T22:04:24.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0039554350000000002, 2024-09-12T22:04:24.816 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:24.816 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:24.816 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:24.816 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:24.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:24.816 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.806187+0000", 2024-09-12T22:04:24.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:24.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.806187+0000", 2024-09-12T22:04:24.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:24.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.806188+0000", 2024-09-12T22:04:24.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:04:24.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:24.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.806243+0000", 2024-09-12T22:04:24.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5016000000000003e-05 2024-09-12T22:04:24.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:24.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.806252+0000", 2024-09-12T22:04:24.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1880000000000008e-06 2024-09-12T22:04:24.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.806259+0000", 2024-09-12T22:04:24.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5390000000000004e-06 2024-09-12T22:04:24.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.806314+0000", 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5735000000000001e-05 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.806327+0000", 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2312e-05 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:95916 5.d 5:bc1b880e:::benchmark_data_smithi043_32659_object95915:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T22:04:24.819 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:24.807634+0000", 2024-09-12T22:04:24.820 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0024237320000000001, 2024-09-12T22:04:24.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002545472, 2024-09-12T22:04:24.820 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:24.820 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:24.820 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:24.820 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:24.820 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:24.820 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:24.820 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 95916 2024-09-12T22:04:24.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.820 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:24.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:24.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.807634+0000", 2024-09-12T22:04:24.821 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:24.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.807634+0000", 2024-09-12T22:04:24.821 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:24.822 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.807635+0000", 2024-09-12T22:04:24.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5600000000000004e-07 2024-09-12T22:04:24.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:24.822 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.807746+0000", 2024-09-12T22:04:24.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011123700000000001 2024-09-12T22:04:24.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:24.822 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.807757+0000", 2024-09-12T22:04:24.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1082e-05 2024-09-12T22:04:24.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.823 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.807764+0000", 2024-09-12T22:04:24.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1189999999999999e-06 2024-09-12T22:04:24.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.823 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:24.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.807812+0000", 2024-09-12T22:04:24.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7558000000000001e-05 2024-09-12T22:04:24.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:24.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.807961+0000", 2024-09-12T22:04:24.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000148589 2024-09-12T22:04:24.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:24.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808067+0000", 2024-09-12T22:04:24.825 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010628099999999999 2024-09-12T22:04:24.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.825 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:24.825 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810124+0000", 2024-09-12T22:04:24.825 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002057503 2024-09-12T22:04:24.825 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.825 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:24.825 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.825 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:95920 5.b 5:d27dad7e:::benchmark_data_smithi043_32659_object95919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T22:04:24.826 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:24.808133+0000", 2024-09-12T22:04:24.826 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00192505, 2024-09-12T22:04:24.826 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021271609999999998, 2024-09-12T22:04:24.826 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:24.826 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:24.826 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:24.826 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:24.826 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:24.826 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:24.826 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 95920 2024-09-12T22:04:24.826 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.827 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:24.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:24.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808133+0000", 2024-09-12T22:04:24.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:24.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808133+0000", 2024-09-12T22:04:24.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:24.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808134+0000", 2024-09-12T22:04:24.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:04:24.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:24.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808186+0000", 2024-09-12T22:04:24.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2403e-05 2024-09-12T22:04:24.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:24.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808194+0000", 2024-09-12T22:04:24.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3669999999999997e-06 2024-09-12T22:04:24.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808201+0000", 2024-09-12T22:04:24.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5250000000000002e-06 2024-09-12T22:04:24.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:24.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.809003+0000", 2024-09-12T22:04:24.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00080157299999999998 2024-09-12T22:04:24.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.830 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:24.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.809125+0000", 2024-09-12T22:04:24.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012207400000000001 2024-09-12T22:04:24.830 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.830 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:24.830 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.830 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:95919 5.f e35/22 5:f18a3d43:::benchmark_data_smithi043_32659_object95918:head v 35'6023, mlcod=35'6019)", 2024-09-12T22:04:24.830 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:24.808363+0000", 2024-09-12T22:04:24.831 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0016949059999999999, 2024-09-12T22:04:24.831 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019613249999999999, 2024-09-12T22:04:24.831 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:24.831 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:24.831 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:24.831 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:24.831 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.831 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:24.831 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808363+0000", 2024-09-12T22:04:24.831 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.831 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.832 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:24.832 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808363+0000", 2024-09-12T22:04:24.832 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.832 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:24.832 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808364+0000", 2024-09-12T22:04:24.832 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4900000000000004e-07 2024-09-12T22:04:24.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:24.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808441+0000", 2024-09-12T22:04:24.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6564999999999996e-05 2024-09-12T22:04:24.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:24.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808452+0000", 2024-09-12T22:04:24.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1017e-05 2024-09-12T22:04:24.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808457+0000", 2024-09-12T22:04:24.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9399999999999999e-06 2024-09-12T22:04:24.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:24.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808503+0000", 2024-09-12T22:04:24.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5704999999999997e-05 2024-09-12T22:04:24.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:24.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808529+0000", 2024-09-12T22:04:24.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5514e-05 2024-09-12T22:04:24.835 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.835 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:24.835 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.835 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.835 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:95922 5.8 5:158c8a15:::benchmark_data_smithi043_32659_object95921:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T22:04:24.835 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:24.808954+0000", 2024-09-12T22:04:24.835 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0011039699999999999, 2024-09-12T22:04:24.835 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014342650000000001, 2024-09-12T22:04:24.835 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:24.835 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:24.835 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:24.836 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:24.836 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:24.836 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:24.836 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 95922 2024-09-12T22:04:24.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.836 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:24.836 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.836 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:24.836 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808954+0000", 2024-09-12T22:04:24.836 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.836 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.837 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:24.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808954+0000", 2024-09-12T22:04:24.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.837 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:24.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.808955+0000", 2024-09-12T22:04:24.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8400000000000002e-07 2024-09-12T22:04:24.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.837 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:24.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.809071+0000", 2024-09-12T22:04:24.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:24.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:24.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.809083+0000", 2024-09-12T22:04:24.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1344e-05 2024-09-12T22:04:24.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.839 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.809093+0000", 2024-09-12T22:04:24.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0458e-05 2024-09-12T22:04:24.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.839 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:24.839 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.809144+0000", 2024-09-12T22:04:24.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0439000000000003e-05 2024-09-12T22:04:24.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.839 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:24.839 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.809271+0000", 2024-09-12T22:04:24.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000127501 2024-09-12T22:04:24.840 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.840 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:24.840 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.840 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:95925 5.a 5:53dd728f:::benchmark_data_smithi043_32659_object95924:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T22:04:24.840 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:24.810209+0000", 2024-09-12T22:04:24.840 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9998493, 2024-09-12T22:04:24.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00024991, 2024-09-12T22:04:24.840 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:24.840 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:24.841 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:24.841 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:24.841 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:24.841 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:24.841 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 95925 2024-09-12T22:04:24.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.841 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:24.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:24.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810209+0000", 2024-09-12T22:04:24.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.842 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:24.842 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810209+0000", 2024-09-12T22:04:24.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.842 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:24.842 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810210+0000", 2024-09-12T22:04:24.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9000000000000005e-07 2024-09-12T22:04:24.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:24.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810253+0000", 2024-09-12T22:04:24.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3349000000000001e-05 2024-09-12T22:04:24.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:24.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810262+0000", 2024-09-12T22:04:24.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0909999999999999e-06 2024-09-12T22:04:24.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810269+0000", 2024-09-12T22:04:24.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.657e-06 2024-09-12T22:04:24.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:24.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810318+0000", 2024-09-12T22:04:24.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8674999999999997e-05 2024-09-12T22:04:24.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:24.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810427+0000", 2024-09-12T22:04:24.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010920399999999999 2024-09-12T22:04:24.845 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.845 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:24.845 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.845 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:95926 5.0 5:06ccd6f0:::benchmark_data_smithi043_32659_object95925:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T22:04:24.845 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:24.810298+0000", 2024-09-12T22:04:24.845 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9997597, 2024-09-12T22:04:24.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000233119, 2024-09-12T22:04:24.845 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:24.846 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:24.846 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:04:24.846 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:24.846 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:24.846 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:24.846 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 95926 2024-09-12T22:04:24.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.846 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:24.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:24.846 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810298+0000", 2024-09-12T22:04:24.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.847 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:24.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810298+0000", 2024-09-12T22:04:24.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.847 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:24.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810299+0000", 2024-09-12T22:04:24.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8100000000000003e-07 2024-09-12T22:04:24.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:24.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810369+0000", 2024-09-12T22:04:24.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9861000000000001e-05 2024-09-12T22:04:24.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:24.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810377+0000", 2024-09-12T22:04:24.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2770000000000005e-06 2024-09-12T22:04:24.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810383+0000", 2024-09-12T22:04:24.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9139999999999996e-06 2024-09-12T22:04:24.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:24.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810429+0000", 2024-09-12T22:04:24.850 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5760999999999998e-05 2024-09-12T22:04:24.850 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.850 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:24.850 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.851 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:95927 5.4 5:2ef13775:::benchmark_data_smithi043_32659_object95926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T22:04:24.851 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:24.810431+0000", 2024-09-12T22:04:24.851 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9996266, 2024-09-12T22:04:24.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016474099999999999, 2024-09-12T22:04:24.851 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:24.851 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:24.851 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:04:24.851 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:24.851 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:24.851 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:24.851 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 95927 2024-09-12T22:04:24.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.852 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:24.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:24.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810431+0000", 2024-09-12T22:04:24.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:24.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810431+0000", 2024-09-12T22:04:24.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:24.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:24.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810432+0000", 2024-09-12T22:04:24.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7899999999999998e-07 2024-09-12T22:04:24.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:24.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810496+0000", 2024-09-12T22:04:24.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4540000000000002e-05 2024-09-12T22:04:24.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:24.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810505+0000", 2024-09-12T22:04:24.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2220000000000002e-06 2024-09-12T22:04:24.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.854 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:24.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810512+0000", 2024-09-12T22:04:24.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.878e-06 2024-09-12T22:04:24.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:24.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:24.854 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:24.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:24.810563+0000", 2024-09-12T22:04:24.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1363999999999998e-05 2024-09-12T22:04:24.855 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.855 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:24.855 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.855 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:24.855 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:24.855 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 9 2024-09-12T22:04:24.855 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:24.856 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:24.898 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:24.897+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:24.968 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:24.968+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:25.048 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:25.048 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:25.049 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:25.049 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:25.049 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:25.059 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:25.070 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:25.068+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:25.171 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:25.170+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:25.191 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 31 16 97016 97000 195.548 176.375 0.00507557 0.00511118 2024-09-12T22:04:25.255 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:25.256 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:25.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:25.256 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:25.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.256 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44102 5.0 5:0d5aa1ff:::benchmark_data_smithi043_32659_object44101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.256 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:25.256 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.627764392, 2024-09-12T22:04:25.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051636015, 2024-09-12T22:04:25.256 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.256 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.256 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.256 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.257 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.257 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.257 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44102 2024-09-12T22:04:25.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.257 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.257 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:25.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:25.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624875+0000", 2024-09-12T22:04:25.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:04:25.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624930+0000", 2024-09-12T22:04:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5256000000000001e-05 2024-09-12T22:04:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624951+0000", 2024-09-12T22:04:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0551999999999999e-05 2024-09-12T22:04:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624958+0000", 2024-09-12T22:04:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1849999999999998e-06 2024-09-12T22:04:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629885+0000", 2024-09-12T22:04:25.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049266120000000004 2024-09-12T22:04:25.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629999+0000", 2024-09-12T22:04:25.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011385 2024-09-12T22:04:25.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630125+0000", 2024-09-12T22:04:25.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012640500000000001 2024-09-12T22:04:25.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633338+0000", 2024-09-12T22:04:25.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032135559999999998 2024-09-12T22:04:25.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676425+0000", 2024-09-12T22:04:25.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043086753999999998 2024-09-12T22:04:25.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676472+0000", 2024-09-12T22:04:25.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6971999999999997e-05 2024-09-12T22:04:25.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676510+0000", 2024-09-12T22:04:25.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8096999999999998e-05 2024-09-12T22:04:25.262 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.262 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.262 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.262 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44103 5.8 5:170742c6:::benchmark_data_smithi043_32659_object44102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.262 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:25.262 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.627641240999999, 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051500936999999997, 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44103 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:25.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624998+0000", 2024-09-12T22:04:25.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:25.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625061+0000", 2024-09-12T22:04:25.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2667000000000002e-05 2024-09-12T22:04:25.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625069+0000", 2024-09-12T22:04:25.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999993e-06 2024-09-12T22:04:25.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625077+0000", 2024-09-12T22:04:25.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0090000000000007e-06 2024-09-12T22:04:25.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629869+0000", 2024-09-12T22:04:25.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047921769999999999 2024-09-12T22:04:25.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629938+0000", 2024-09-12T22:04:25.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9542000000000006e-05 2024-09-12T22:04:25.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630010+0000", 2024-09-12T22:04:25.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1795e-05 2024-09-12T22:04:25.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676348+0000", 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.046337830000000003 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676399+0000", 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1150000000000003e-05 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676460+0000", 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1142999999999994e-05 2024-09-12T22:04:25.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676498+0000", 2024-09-12T22:04:25.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8111000000000002e-05 2024-09-12T22:04:25.268 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.268 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.268 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.268 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.268 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:25.268 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.626342816000001, 2024-09-12T22:04:25.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:25.269 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.269 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.269 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.269 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.269 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.269 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.269 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:25.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.269 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:25.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:25.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:25.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:25.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:25.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:25.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:25.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:25.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:25.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:25.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:25.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:25.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:25.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:25.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:25.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:25.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:25.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:25.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:25.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:25.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:25.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:25.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:25.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:25.274 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.274 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.274 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.274 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44115 5.0 5:0ee09c30:::benchmark_data_smithi043_32659_object44114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.274 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:25.274 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.623570139000002, 2024-09-12T22:04:25.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082887358999999994, 2024-09-12T22:04:25.275 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.275 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.275 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.275 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.275 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.275 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.275 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44115 2024-09-12T22:04:25.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.275 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:25.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:25.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629070+0000", 2024-09-12T22:04:25.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1209999999999999e-06 2024-09-12T22:04:25.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629132+0000", 2024-09-12T22:04:25.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2557000000000004e-05 2024-09-12T22:04:25.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629147+0000", 2024-09-12T22:04:25.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4491999999999999e-05 2024-09-12T22:04:25.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629156+0000", 2024-09-12T22:04:25.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7089999999999997e-06 2024-09-12T22:04:25.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631865+0000", 2024-09-12T22:04:25.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00270835 2024-09-12T22:04:25.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631932+0000", 2024-09-12T22:04:25.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7322000000000004e-05 2024-09-12T22:04:25.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632095+0000", 2024-09-12T22:04:25.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016314699999999999 2024-09-12T22:04:25.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676360+0000", 2024-09-12T22:04:25.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044264756000000002 2024-09-12T22:04:25.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711854+0000", 2024-09-12T22:04:25.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.03549389 2024-09-12T22:04:25.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711919+0000", 2024-09-12T22:04:25.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5024000000000006e-05 2024-09-12T22:04:25.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711956+0000", 2024-09-12T22:04:25.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6990999999999999e-05 2024-09-12T22:04:25.280 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.280 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.280 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.280 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44117 5.8 5:1ecb02e0:::benchmark_data_smithi043_32659_object44116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.280 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:25.280 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.623425318999999, 2024-09-12T22:04:25.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082354986000000005, 2024-09-12T22:04:25.281 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.281 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.281 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.281 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.281 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.281 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.281 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44117 2024-09-12T22:04:25.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.281 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:25.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:25.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629214+0000", 2024-09-12T22:04:25.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:25.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629315+0000", 2024-09-12T22:04:25.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010045800000000001 2024-09-12T22:04:25.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629328+0000", 2024-09-12T22:04:25.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3016e-05 2024-09-12T22:04:25.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629336+0000", 2024-09-12T22:04:25.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7229999999999993e-06 2024-09-12T22:04:25.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631856+0000", 2024-09-12T22:04:25.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025199300000000001 2024-09-12T22:04:25.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631954+0000", 2024-09-12T22:04:25.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7565999999999994e-05 2024-09-12T22:04:25.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632073+0000", 2024-09-12T22:04:25.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119677 2024-09-12T22:04:25.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676523+0000", 2024-09-12T22:04:25.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044449163 2024-09-12T22:04:25.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676612+0000", 2024-09-12T22:04:25.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9579000000000004e-05 2024-09-12T22:04:25.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711509+0000", 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.034897125000000001 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711568+0000", 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8996999999999998e-05 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44120 5.b 5:df1f2c5f:::benchmark_data_smithi043_32659_object44119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.286 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:25.287 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.621249658, 2024-09-12T22:04:25.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043861974999999997, 2024-09-12T22:04:25.287 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.287 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.287 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.287 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.287 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.287 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.287 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44120 2024-09-12T22:04:25.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.287 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:25.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:25.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631390+0000", 2024-09-12T22:04:25.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:04:25.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631444+0000", 2024-09-12T22:04:25.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-12T22:04:25.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631452+0000", 2024-09-12T22:04:25.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4610000000000008e-06 2024-09-12T22:04:25.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631458+0000", 2024-09-12T22:04:25.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:04:25.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631509+0000", 2024-09-12T22:04:25.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1442e-05 2024-09-12T22:04:25.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631627+0000", 2024-09-12T22:04:25.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011796800000000001 2024-09-12T22:04:25.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631814+0000", 2024-09-12T22:04:25.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018735400000000001 2024-09-12T22:04:25.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674612+0000", 2024-09-12T22:04:25.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042797287000000003 2024-09-12T22:04:25.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675160+0000", 2024-09-12T22:04:25.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000548187 2024-09-12T22:04:25.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675207+0000", 2024-09-12T22:04:25.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6833999999999999e-05 2024-09-12T22:04:25.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675251+0000", 2024-09-12T22:04:25.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4348000000000003e-05 2024-09-12T22:04:25.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.292 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.292 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.292 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:25.293 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.620941876, 2024-09-12T22:04:25.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:25.293 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.293 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.293 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.293 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:25.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.293 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:25.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:25.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:25.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:25.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:25.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44122 5.d 5:bfd04815:::benchmark_data_smithi043_32659_object44121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.620843824000001, 2024-09-12T22:04:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.080166395000000001, 2024-09-12T22:04:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44122 2024-09-12T22:04:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:04:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631853+0000", 2024-09-12T22:04:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7209000000000001e-05 2024-09-12T22:04:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631858+0000", 2024-09-12T22:04:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:04:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631862+0000", 2024-09-12T22:04:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.692e-06 2024-09-12T22:04:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631905+0000", 2024-09-12T22:04:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3135e-05 2024-09-12T22:04:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632032+0000", 2024-09-12T22:04:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012740900000000001 2024-09-12T22:04:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632166+0000", 2024-09-12T22:04:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013318800000000001 2024-09-12T22:04:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674894+0000", 2024-09-12T22:04:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042728690999999999 2024-09-12T22:04:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711875+0000", 2024-09-12T22:04:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036980631 2024-09-12T22:04:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711923+0000", 2024-09-12T22:04:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8180000000000003e-05 2024-09-12T22:04:25.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711961+0000", 2024-09-12T22:04:25.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8142000000000002e-05 2024-09-12T22:04:25.304 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.304 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.304 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.304 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44123 5.e 5:7d83ca89:::benchmark_data_smithi043_32659_object44122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.304 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:25.304 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.620712055999999, 2024-09-12T22:04:25.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043329329, 2024-09-12T22:04:25.305 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.305 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.305 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.305 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.305 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.305 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.305 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44123 2024-09-12T22:04:25.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.305 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:25.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:25.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631928+0000", 2024-09-12T22:04:25.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2699999999999998e-07 2024-09-12T22:04:25.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631996+0000", 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8141999999999999e-05 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632004+0000", 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7600000000000008e-06 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632010+0000", 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632069+0000", 2024-09-12T22:04:25.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8260000000000001e-05 2024-09-12T22:04:25.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632226+0000", 2024-09-12T22:04:25.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015702199999999999 2024-09-12T22:04:25.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632337+0000", 2024-09-12T22:04:25.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111069 2024-09-12T22:04:25.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674909+0000", 2024-09-12T22:04:25.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042571854999999999 2024-09-12T22:04:25.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675184+0000", 2024-09-12T22:04:25.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027561399999999998 2024-09-12T22:04:25.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675222+0000", 2024-09-12T22:04:25.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7710999999999999e-05 2024-09-12T22:04:25.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675256+0000", 2024-09-12T22:04:25.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4014000000000003e-05 2024-09-12T22:04:25.310 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.310 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.310 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.310 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.310 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:25.310 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.620000609000002, 2024-09-12T22:04:25.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:25.311 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.311 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.311 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.311 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.311 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.311 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.311 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:25.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.311 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:25.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:25.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:25.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:25.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:25.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:25.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:25.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:25.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:25.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:25.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:25.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:25.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:25.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:25.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:25.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:25.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:25.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:25.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:25.316 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.316 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.316 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.317 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44098 5.0 e28/22 ondisk, result = 0)", 2024-09-12T22:04:25.317 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:25.317 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.619609793999999, 2024-09-12T22:04:25.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043332180999999997, 2024-09-12T22:04:25.317 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.317 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.317 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:25.317 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:25.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:25.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633030+0000", 2024-09-12T22:04:25.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:25.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633035+0000", 2024-09-12T22:04:25.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:04:25.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633043+0000", 2024-09-12T22:04:25.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:25.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633048+0000", 2024-09-12T22:04:25.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5439999999999998e-06 2024-09-12T22:04:25.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633362+0000", 2024-09-12T22:04:25.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031397400000000001 2024-09-12T22:04:25.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633369+0000", 2024-09-12T22:04:25.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:04:25.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676361+0000", 2024-09-12T22:04:25.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042991954999999998 2024-09-12T22:04:25.321 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.321 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.321 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.321 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.321 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:25.321 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.619002688999998, 2024-09-12T22:04:25.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:25.321 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.321 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.322 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.322 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.322 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.322 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.322 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:25.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.322 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:25.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:25.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:25.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:25.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:25.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:25.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:25.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:25.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:25.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:25.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:25.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:25.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:25.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:25.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:25.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:25.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:25.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:25.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:25.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:25.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:25.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:25.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:25.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:25.327 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.327 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.327 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.327 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:44125 5.9 e28/22 5:9022696f:::benchmark_data_smithi043_32659_object44124:head v 28'2753, mlcod=28'2751)", 2024-09-12T22:04:25.327 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:25.327 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.618963824000001, 2024-09-12T22:04:25.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042744011999999998, 2024-09-12T22:04:25.327 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.327 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.327 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.327 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:25.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:25.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633676+0000", 2024-09-12T22:04:25.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.44e-07 2024-09-12T22:04:25.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633755+0000", 2024-09-12T22:04:25.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9629000000000006e-05 2024-09-12T22:04:25.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674386+0000", 2024-09-12T22:04:25.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631364000000003 2024-09-12T22:04:25.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674399+0000", 2024-09-12T22:04:25.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2047e-05 2024-09-12T22:04:25.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674453+0000", 2024-09-12T22:04:25.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4453999999999997e-05 2024-09-12T22:04:25.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674479+0000", 2024-09-12T22:04:25.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6064999999999999e-05 2024-09-12T22:04:25.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676381+0000", 2024-09-12T22:04:25.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001901874 2024-09-12T22:04:25.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676419+0000", 2024-09-12T22:04:25.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7935000000000002e-05 2024-09-12T22:04:25.331 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.331 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.331 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.331 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44103 5.8 e28/22 ondisk, result = 0)", 2024-09-12T22:04:25.331 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:25.332 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.618457855999999, 2024-09-12T22:04:25.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042322950999999998, 2024-09-12T22:04:25.332 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.332 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.332 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:25.332 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:25.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:25.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:25.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:04:25.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634184+0000", 2024-09-12T22:04:25.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7690000000000001e-06 2024-09-12T22:04:25.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674407+0000", 2024-09-12T22:04:25.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040222750000000002 2024-09-12T22:04:25.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674417+0000", 2024-09-12T22:04:25.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0125e-05 2024-09-12T22:04:25.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676387+0000", 2024-09-12T22:04:25.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001970112 2024-09-12T22:04:25.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676394+0000", 2024-09-12T22:04:25.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:04:25.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676504+0000", 2024-09-12T22:04:25.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109621 2024-09-12T22:04:25.335 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.335 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.335 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44128 5.d 5:b9a92891:::benchmark_data_smithi043_32659_object44127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.578205066999999, 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040118138999999997, 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44128 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:25.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:25.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674435+0000", 2024-09-12T22:04:25.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5960000000000001e-06 2024-09-12T22:04:25.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674485+0000", 2024-09-12T22:04:25.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0021000000000001e-05 2024-09-12T22:04:25.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674495+0000", 2024-09-12T22:04:25.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5189999999999998e-06 2024-09-12T22:04:25.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674500+0000", 2024-09-12T22:04:25.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:04:25.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674923+0000", 2024-09-12T22:04:25.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000423304 2024-09-12T22:04:25.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675027+0000", 2024-09-12T22:04:25.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103399 2024-09-12T22:04:25.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:25.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675141+0000", 2024-09-12T22:04:25.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114274 2024-09-12T22:04:25.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711649+0000", 2024-09-12T22:04:25.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036508011999999999 2024-09-12T22:04:25.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714466+0000", 2024-09-12T22:04:25.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028167370000000001 2024-09-12T22:04:25.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714508+0000", 2024-09-12T22:04:25.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2679000000000003e-05 2024-09-12T22:04:25.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714552+0000", 2024-09-12T22:04:25.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3528000000000001e-05 2024-09-12T22:04:25.341 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.341 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44129 5.0 5:0f626cda:::benchmark_data_smithi043_32659_object44128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.578129562000001, 2024-09-12T22:04:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042846404999999997, 2024-09-12T22:04:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44129 2024-09-12T22:04:25.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.343 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:25.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:25.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674510+0000", 2024-09-12T22:04:25.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1600000000000002e-07 2024-09-12T22:04:25.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674548+0000", 2024-09-12T22:04:25.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8075999999999999e-05 2024-09-12T22:04:25.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674689+0000", 2024-09-12T22:04:25.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014141499999999999 2024-09-12T22:04:25.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674696+0000", 2024-09-12T22:04:25.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4619999999999999e-06 2024-09-12T22:04:25.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713666+0000", 2024-09-12T22:04:25.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.038969072 2024-09-12T22:04:25.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713752+0000", 2024-09-12T22:04:25.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6768999999999995e-05 2024-09-12T22:04:25.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713835+0000", 2024-09-12T22:04:25.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2774000000000004e-05 2024-09-12T22:04:25.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717212+0000", 2024-09-12T22:04:25.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033769389999999998 2024-09-12T22:04:25.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717259+0000", 2024-09-12T22:04:25.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7218000000000001e-05 2024-09-12T22:04:25.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717310+0000", 2024-09-12T22:04:25.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1156999999999998e-05 2024-09-12T22:04:25.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717356+0000", 2024-09-12T22:04:25.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5107e-05 2024-09-12T22:04:25.347 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.347 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.348 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.348 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44130 5.4 5:27857918:::benchmark_data_smithi043_32659_object44129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.348 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:25.348 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.577931708000001, 2024-09-12T22:04:25.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039844412000000003, 2024-09-12T22:04:25.348 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.348 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.348 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.348 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.348 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.348 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.348 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44130 2024-09-12T22:04:25.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.349 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:25.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:25.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674708+0000", 2024-09-12T22:04:25.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4300000000000003e-07 2024-09-12T22:04:25.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674749+0000", 2024-09-12T22:04:25.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1254999999999997e-05 2024-09-12T22:04:25.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674756+0000", 2024-09-12T22:04:25.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3289999999999996e-06 2024-09-12T22:04:25.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674762+0000", 2024-09-12T22:04:25.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.852e-06 2024-09-12T22:04:25.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:25.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9573999999999995e-05 2024-09-12T22:04:25.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674954+0000", 2024-09-12T22:04:25.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012254200000000001 2024-09-12T22:04:25.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675033+0000", 2024-09-12T22:04:25.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8707000000000004e-05 2024-09-12T22:04:25.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714381+0000", 2024-09-12T22:04:25.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039348053000000001 2024-09-12T22:04:25.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714477+0000", 2024-09-12T22:04:25.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5650999999999996e-05 2024-09-12T22:04:25.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714516+0000", 2024-09-12T22:04:25.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9158e-05 2024-09-12T22:04:25.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714551+0000", 2024-09-12T22:04:25.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5648000000000002e-05 2024-09-12T22:04:25.354 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.354 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.354 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.354 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44131 5.0 5:013256f7:::benchmark_data_smithi043_32659_object44130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.354 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:25.354 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.577859240999999, 2024-09-12T22:04:25.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043388599, 2024-09-12T22:04:25.354 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.354 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.354 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.354 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44131 2024-09-12T22:04:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674780+0000", 2024-09-12T22:04:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674817+0000", 2024-09-12T22:04:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6859000000000001e-05 2024-09-12T22:04:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:25.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.501e-05 2024-09-12T22:04:25.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674838+0000", 2024-09-12T22:04:25.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-06 2024-09-12T22:04:25.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715161+0000", 2024-09-12T22:04:25.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.04032285 2024-09-12T22:04:25.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715317+0000", 2024-09-12T22:04:25.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015649199999999999 2024-09-12T22:04:25.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715463+0000", 2024-09-12T22:04:25.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145704 2024-09-12T22:04:25.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717480+0000", 2024-09-12T22:04:25.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020168220000000001 2024-09-12T22:04:25.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718079+0000", 2024-09-12T22:04:25.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000599115 2024-09-12T22:04:25.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718134+0000", 2024-09-12T22:04:25.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:04:25.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718168+0000", 2024-09-12T22:04:25.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4301000000000002e-05 2024-09-12T22:04:25.360 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.360 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.360 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.360 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44132 5.e 5:7634b859:::benchmark_data_smithi043_32659_object44131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.360 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:25.360 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.577192001, 2024-09-12T22:04:25.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039558587999999999, 2024-09-12T22:04:25.360 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.360 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.360 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.360 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.361 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.361 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.361 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44132 2024-09-12T22:04:25.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.361 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:25.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:25.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675448+0000", 2024-09-12T22:04:25.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3699999999999999e-07 2024-09-12T22:04:25.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675552+0000", 2024-09-12T22:04:25.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104294 2024-09-12T22:04:25.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675562+0000", 2024-09-12T22:04:25.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9629999999999993e-06 2024-09-12T22:04:25.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675569+0000", 2024-09-12T22:04:25.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8809999999999998e-06 2024-09-12T22:04:25.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675612+0000", 2024-09-12T22:04:25.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591000000000003e-05 2024-09-12T22:04:25.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675717+0000", 2024-09-12T22:04:25.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010497099999999999 2024-09-12T22:04:25.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675835+0000", 2024-09-12T22:04:25.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011793799999999999 2024-09-12T22:04:25.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713616+0000", 2024-09-12T22:04:25.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037781032999999999 2024-09-12T22:04:25.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714911+0000", 2024-09-12T22:04:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001294604 2024-09-12T22:04:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714964+0000", 2024-09-12T22:04:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3408000000000001e-05 2024-09-12T22:04:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715005+0000", 2024-09-12T22:04:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0967999999999998e-05 2024-09-12T22:04:25.366 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.366 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.366 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.366 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44133 5.b 5:d0a59edd:::benchmark_data_smithi043_32659_object44132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:25.366 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:25.366 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.577054221000001, 2024-09-12T22:04:25.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039513020000000003, 2024-09-12T22:04:25.366 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:25.366 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:25.366 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.366 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:25.366 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:25.367 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.367 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44133 2024-09-12T22:04:25.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.367 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:25.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:25.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:25.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:25.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:25.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:25.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:25.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675585+0000", 2024-09-12T22:04:25.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5499999999999998e-07 2024-09-12T22:04:25.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:25.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675634+0000", 2024-09-12T22:04:25.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8520999999999998e-05 2024-09-12T22:04:25.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:25.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675641+0000", 2024-09-12T22:04:25.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4440000000000002e-06 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675646+0000", 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2660000000000001e-06 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675692+0000", 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5915999999999999e-05 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675812+0000", 2024-09-12T22:04:25.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119419 2024-09-12T22:04:25.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:25.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675950+0000", 2024-09-12T22:04:25.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013831499999999999 2024-09-12T22:04:25.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713574+0000", 2024-09-12T22:04:25.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037623801999999998 2024-09-12T22:04:25.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:25.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715015+0000", 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014410720000000001 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715059+0000", 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715097+0000", 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8519000000000002e-05 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.371 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:25.372 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:25.372 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:25.373 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:25.374 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:25.371+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:25.379 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-09-12T22:04:25.473 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:25.472+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:25.527 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:25.527 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:25.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.527 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:97944 5.7 5:ea6a4b83:::benchmark_data_smithi043_32659_object97943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:25.527 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.521013+0000", 2024-09-12T22:04:25.527 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0042491719999999998, 2024-09-12T22:04:25.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042785319999999998, 2024-09-12T22:04:25.528 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.528 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.528 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:25.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:25.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:25.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.528 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97944 2024-09-12T22:04:25.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.528 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521013+0000", 2024-09-12T22:04:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521013+0000", 2024-09-12T22:04:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521014+0000", 2024-09-12T22:04:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4900000000000005e-07 2024-09-12T22:04:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521118+0000", 2024-09-12T22:04:25.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000104051 2024-09-12T22:04:25.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521131+0000", 2024-09-12T22:04:25.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3086e-05 2024-09-12T22:04:25.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521139+0000", 2024-09-12T22:04:25.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:04:25.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521189+0000", 2024-09-12T22:04:25.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0439000000000003e-05 2024-09-12T22:04:25.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:25.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521397+0000", 2024-09-12T22:04:25.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020811700000000001 2024-09-12T22:04:25.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.532 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:25.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.532 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:97945 5.2 5:4262569a:::benchmark_data_smithi043_32659_object97944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:25.532 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.521156+0000", 2024-09-12T22:04:25.532 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0041067100000000004, 2024-09-12T22:04:25.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042156499999999996, 2024-09-12T22:04:25.532 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:25.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:25.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:25.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.533 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97945 2024-09-12T22:04:25.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.533 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521156+0000", 2024-09-12T22:04:25.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521156+0000", 2024-09-12T22:04:25.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521156+0000", 2024-09-12T22:04:25.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8500000000000001e-07 2024-09-12T22:04:25.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521194+0000", 2024-09-12T22:04:25.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7348000000000002e-05 2024-09-12T22:04:25.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521201+0000", 2024-09-12T22:04:25.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7640000000000005e-06 2024-09-12T22:04:25.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521211+0000", 2024-09-12T22:04:25.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7869999999999996e-06 2024-09-12T22:04:25.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521285+0000", 2024-09-12T22:04:25.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4229999999999999e-05 2024-09-12T22:04:25.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:25.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521420+0000", 2024-09-12T22:04:25.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000134719 2024-09-12T22:04:25.536 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.536 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:25.536 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.536 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:97947 5.f 5:fdb7c0b9:::benchmark_data_smithi043_32659_object97946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:25.536 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.521228+0000", 2024-09-12T22:04:25.536 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0040348140000000003, 2024-09-12T22:04:25.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042155439999999999, 2024-09-12T22:04:25.536 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.537 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.537 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:25.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:25.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:25.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.537 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97947 2024-09-12T22:04:25.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.537 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521228+0000", 2024-09-12T22:04:25.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521228+0000", 2024-09-12T22:04:25.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521228+0000", 2024-09-12T22:04:25.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.13e-07 2024-09-12T22:04:25.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521264+0000", 2024-09-12T22:04:25.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5992999999999999e-05 2024-09-12T22:04:25.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521272+0000", 2024-09-12T22:04:25.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:04:25.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521278+0000", 2024-09-12T22:04:25.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-12T22:04:25.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521329+0000", 2024-09-12T22:04:25.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1134999999999997e-05 2024-09-12T22:04:25.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:25.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521460+0000", 2024-09-12T22:04:25.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013098 2024-09-12T22:04:25.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:25.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521607+0000", 2024-09-12T22:04:25.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000146329 2024-09-12T22:04:25.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.541 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:25.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.541 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:97948 5.6 5:67749b93:::benchmark_data_smithi043_32659_object97947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:25.541 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.521289+0000", 2024-09-12T22:04:25.541 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0039739279999999998, 2024-09-12T22:04:25.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042326589999999997, 2024-09-12T22:04:25.541 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.541 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.541 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:25.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97948 2024-09-12T22:04:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521289+0000", 2024-09-12T22:04:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521289+0000", 2024-09-12T22:04:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521289+0000", 2024-09-12T22:04:25.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7100000000000002e-07 2024-09-12T22:04:25.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521323+0000", 2024-09-12T22:04:25.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4122999999999998e-05 2024-09-12T22:04:25.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521331+0000", 2024-09-12T22:04:25.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8120000000000008e-06 2024-09-12T22:04:25.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521337+0000", 2024-09-12T22:04:25.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8340000000000004e-06 2024-09-12T22:04:25.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521390+0000", 2024-09-12T22:04:25.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3495000000000002e-05 2024-09-12T22:04:25.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:25.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521513+0000", 2024-09-12T22:04:25.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012281400000000001 2024-09-12T22:04:25.545 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.545 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:25.545 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.545 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:97950 5.f 5:f31d78a3:::benchmark_data_smithi043_32659_object97949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:25.545 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.521809+0000", 2024-09-12T22:04:25.545 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.003453312, 2024-09-12T22:04:25.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037848780000000002, 2024-09-12T22:04:25.545 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.545 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97950 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521809+0000", 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521809+0000", 2024-09-12T22:04:25.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521810+0000", 2024-09-12T22:04:25.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0800000000000004e-07 2024-09-12T22:04:25.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521838+0000", 2024-09-12T22:04:25.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7659000000000001e-05 2024-09-12T22:04:25.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521849+0000", 2024-09-12T22:04:25.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1562e-05 2024-09-12T22:04:25.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.521856+0000", 2024-09-12T22:04:25.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.579e-06 2024-09-12T22:04:25.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.524062+0000", 2024-09-12T22:04:25.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022064839999999999 2024-09-12T22:04:25.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:25.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.524209+0000", 2024-09-12T22:04:25.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014654199999999999 2024-09-12T22:04:25.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:25.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.524862+0000", 2024-09-12T22:04:25.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00065321900000000002 2024-09-12T22:04:25.549 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.549 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:25.549 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.550 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:97951 5.5 5:a885b875:::benchmark_data_smithi043_32659_object97950:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:25.550 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.522405+0000", 2024-09-12T22:04:25.550 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0028570449999999999, 2024-09-12T22:04:25.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032641580000000001, 2024-09-12T22:04:25.550 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.550 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.550 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:25.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:25.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:25.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.550 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97951 2024-09-12T22:04:25.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.550 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522405+0000", 2024-09-12T22:04:25.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522405+0000", 2024-09-12T22:04:25.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522406+0000", 2024-09-12T22:04:25.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3300000000000001e-07 2024-09-12T22:04:25.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522474+0000", 2024-09-12T22:04:25.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7831999999999997e-05 2024-09-12T22:04:25.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522483+0000", 2024-09-12T22:04:25.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2439999999999999e-06 2024-09-12T22:04:25.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522490+0000", 2024-09-12T22:04:25.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3130000000000004e-06 2024-09-12T22:04:25.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522742+0000", 2024-09-12T22:04:25.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000252816 2024-09-12T22:04:25.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:25.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522862+0000", 2024-09-12T22:04:25.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011989600000000001 2024-09-12T22:04:25.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:25.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.525634+0000", 2024-09-12T22:04:25.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027716450000000001 2024-09-12T22:04:25.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.554 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:25.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:97952 5.1 5:80278b1e:::benchmark_data_smithi043_32659_object97951:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.522504+0000", 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0027585219999999998, 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032411660000000002, 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97952 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522504+0000", 2024-09-12T22:04:25.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522504+0000", 2024-09-12T22:04:25.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522504+0000", 2024-09-12T22:04:25.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2499999999999995e-07 2024-09-12T22:04:25.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522564+0000", 2024-09-12T22:04:25.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9942999999999999e-05 2024-09-12T22:04:25.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522572+0000", 2024-09-12T22:04:25.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4150000000000002e-06 2024-09-12T22:04:25.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522577+0000", 2024-09-12T22:04:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3820000000000003e-06 2024-09-12T22:04:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522704+0000", 2024-09-12T22:04:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012693099999999999 2024-09-12T22:04:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.523147+0000", 2024-09-12T22:04:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044281499999999999 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:97940 5.d e36/22 5:b6acae65:::benchmark_data_smithi043_32659_object97939:head v 36'6066, mlcod=36'6063)", 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.522798+0000", 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0024645320000000002, 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0030167079999999999, 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522798+0000", 2024-09-12T22:04:25.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522798+0000", 2024-09-12T22:04:25.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522799+0000", 2024-09-12T22:04:25.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5000000000000002e-07 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522903+0000", 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000104864 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522912+0000", 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0100000000000001e-06 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522920+0000", 2024-09-12T22:04:25.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1659999999999997e-06 2024-09-12T22:04:25.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.523119+0000", 2024-09-12T22:04:25.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019896599999999999 2024-09-12T22:04:25.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:25.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.523136+0000", 2024-09-12T22:04:25.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7574000000000001e-05 2024-09-12T22:04:25.562 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.562 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:25.562 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.563 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:97953 5.6 5:6d830e7b:::benchmark_data_smithi043_32659_object97952:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:25.563 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.522790+0000", 2024-09-12T22:04:25.563 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0024724360000000002, 2024-09-12T22:04:25.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031057620000000002, 2024-09-12T22:04:25.563 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.563 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.563 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:25.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:25.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:25.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.563 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97953 2024-09-12T22:04:25.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.564 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522790+0000", 2024-09-12T22:04:25.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522790+0000", 2024-09-12T22:04:25.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522791+0000", 2024-09-12T22:04:25.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3500000000000005e-07 2024-09-12T22:04:25.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522947+0000", 2024-09-12T22:04:25.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000155852 2024-09-12T22:04:25.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522955+0000", 2024-09-12T22:04:25.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:04:25.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522961+0000", 2024-09-12T22:04:25.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8080000000000001e-06 2024-09-12T22:04:25.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.523536+0000", 2024-09-12T22:04:25.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00057484500000000004 2024-09-12T22:04:25.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:25.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.523666+0000", 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013027199999999999 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:97954 5.1 5:8873806b:::benchmark_data_smithi043_32659_object97953:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.522993+0000", 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0022697809999999998, 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029941189999999999, 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:25.567 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.568 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97954 2024-09-12T22:04:25.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.568 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522993+0000", 2024-09-12T22:04:25.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522993+0000", 2024-09-12T22:04:25.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.522993+0000", 2024-09-12T22:04:25.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0200000000000002e-07 2024-09-12T22:04:25.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.523112+0000", 2024-09-12T22:04:25.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011854300000000001 2024-09-12T22:04:25.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.523120+0000", 2024-09-12T22:04:25.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0239999999999997e-06 2024-09-12T22:04:25.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.523126+0000", 2024-09-12T22:04:25.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3470000000000004e-06 2024-09-12T22:04:25.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.525122+0000", 2024-09-12T22:04:25.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019958609999999998 2024-09-12T22:04:25.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:25.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.525320+0000", 2024-09-12T22:04:25.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000198409 2024-09-12T22:04:25.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.571 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:25.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.572 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:97955 5.c 5:3d0dfa56:::benchmark_data_smithi043_32659_object97954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:25.572 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.524259+0000", 2024-09-12T22:04:25.572 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001003451, 2024-09-12T22:04:25.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018134080000000001, 2024-09-12T22:04:25.572 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.572 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.572 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:25.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:25.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:25.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.573 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97955 2024-09-12T22:04:25.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.573 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.524259+0000", 2024-09-12T22:04:25.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.524259+0000", 2024-09-12T22:04:25.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.524260+0000", 2024-09-12T22:04:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6799999999999999e-07 2024-09-12T22:04:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.524713+0000", 2024-09-12T22:04:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00045290700000000001 2024-09-12T22:04:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.524724+0000", 2024-09-12T22:04:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1603999999999999e-05 2024-09-12T22:04:25.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.524736+0000", 2024-09-12T22:04:25.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2029e-05 2024-09-12T22:04:25.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.524797+0000", 2024-09-12T22:04:25.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0630000000000001e-05 2024-09-12T22:04:25.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.524926+0000", 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012872299999999999 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:97957 5.3 5.9c780de3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.525963+0000", 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9993, 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000186975, 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.576 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97957 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.525963+0000", 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.525963+0000", 2024-09-12T22:04:25.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.525964+0000", 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.167e-06 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.526066+0000", 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010257200000000001 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.526078+0000", 2024-09-12T22:04:25.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1401e-05 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.526085+0000", 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3200000000000002e-06 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.526144+0000", 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8678000000000003e-05 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:25.580 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 12 2024-09-12T22:04:25.580 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:25.581 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:25.582 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:25.579+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:25.682 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:25.681+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:25.776 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:25.776 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:25.784 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:25.782+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:25.789 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:25.884 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:25.883+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:25.984 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:25.985 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:25.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:25.985 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:25.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.985 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:25.985 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:25.985 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.531912278, 2024-09-12T22:04:25.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018534981999999998, 2024-09-12T22:04:25.985 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.985 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.985 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.985 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:25.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:25.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449725+0000", 2024-09-12T22:04:25.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799999999999999e-06 2024-09-12T22:04:25.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449731+0000", 2024-09-12T22:04:25.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.801e-06 2024-09-12T22:04:25.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449745+0000", 2024-09-12T22:04:25.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4198e-05 2024-09-12T22:04:25.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449758+0000", 2024-09-12T22:04:25.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2858e-05 2024-09-12T22:04:25.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449815+0000", 2024-09-12T22:04:25.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6978999999999998e-05 2024-09-12T22:04:25.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:25.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:25.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2369999999999997e-06 2024-09-12T22:04:25.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457683+0000", 2024-09-12T22:04:25.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078622640000000008 2024-09-12T22:04:25.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:25.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457840+0000", 2024-09-12T22:04:25.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015715299999999999 2024-09-12T22:04:25.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:25.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457972+0000", 2024-09-12T22:04:25.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013179500000000001 2024-09-12T22:04:25.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:25.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462325+0000", 2024-09-12T22:04:25.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043526859999999997 2024-09-12T22:04:25.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468180+0000", 2024-09-12T22:04:25.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058557169999999999 2024-09-12T22:04:25.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:25.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468221+0000", 2024-09-12T22:04:25.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0673000000000002e-05 2024-09-12T22:04:25.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:25.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468258+0000", 2024-09-12T22:04:25.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7240999999999998e-05 2024-09-12T22:04:25.991 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.991 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:25.991 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.991 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:25.991 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:25.991 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.531859666999999, 2024-09-12T22:04:25.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018748032000000001, 2024-09-12T22:04:25.991 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.992 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.992 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.992 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:25.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:25.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449779+0000", 2024-09-12T22:04:25.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4869999999999998e-06 2024-09-12T22:04:25.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449783+0000", 2024-09-12T22:04:25.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:04:25.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449791+0000", 2024-09-12T22:04:25.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2640000000000002e-06 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449796+0000", 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9370000000000001e-06 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449915+0000", 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118559 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449920+0000", 2024-09-12T22:04:25.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.101e-06 2024-09-12T22:04:25.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:25.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458578+0000", 2024-09-12T22:04:25.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008657662 2024-09-12T22:04:25.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:25.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458978+0000", 2024-09-12T22:04:25.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00039977399999999998 2024-09-12T22:04:25.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:25.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459130+0000", 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000152394 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462793+0000", 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036628770000000001 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468451+0000", 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056577820000000001 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:25.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468501+0000", 2024-09-12T22:04:25.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0609999999999998e-05 2024-09-12T22:04:25.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:25.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468524+0000", 2024-09-12T22:04:25.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2804000000000001e-05 2024-09-12T22:04:25.997 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.997 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:25.997 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:25.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.997 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:25.997 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:25.997 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.531824966000002, 2024-09-12T22:04:25.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018816113999999998, 2024-09-12T22:04:25.998 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:25.998 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:25.998 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:25.998 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:25.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:25.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:25.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:25.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3360000000000001e-06 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:25.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449832+0000", 2024-09-12T22:04:26.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1528e-05 2024-09-12T22:04:26.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:04:26.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-12T22:04:26.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459429+0000", 2024-09-12T22:04:26.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095926970000000007 2024-09-12T22:04:26.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459597+0000", 2024-09-12T22:04:26.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000168309 2024-09-12T22:04:26.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:26.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459829+0000", 2024-09-12T22:04:26.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231158 2024-09-12T22:04:26.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462796+0000", 2024-09-12T22:04:26.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029673849999999999 2024-09-12T22:04:26.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468558+0000", 2024-09-12T22:04:26.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057621449999999998 2024-09-12T22:04:26.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468592+0000", 2024-09-12T22:04:26.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4241e-05 2024-09-12T22:04:26.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468627+0000", 2024-09-12T22:04:26.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4511999999999998e-05 2024-09-12T22:04:26.002 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.003 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.003 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.003 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:26.003 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:26.003 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.531757937999998, 2024-09-12T22:04:26.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018845905, 2024-09-12T22:04:26.003 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.003 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.003 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.003 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:26.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:26.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:26.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:04:26.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449881+0000", 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.005e-06 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449887+0000", 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9050000000000002e-06 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449892+0000", 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2009999999999998e-06 2024-09-12T22:04:26.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460279+0000", 2024-09-12T22:04:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010386808000000001 2024-09-12T22:04:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460427+0000", 2024-09-12T22:04:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014789 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460572+0000", 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014453099999999999 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462799+0000", 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002227049 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468672+0000", 2024-09-12T22:04:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058730060000000001 2024-09-12T22:04:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468704+0000", 2024-09-12T22:04:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2421e-05 2024-09-12T22:04:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468724+0000", 2024-09-12T22:04:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9582e-05 2024-09-12T22:04:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.531685076999999, 2024-09-12T22:04:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017913407999999999, 2024-09-12T22:04:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449951+0000", 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3499999999999996e-07 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449955+0000", 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4379999999999999e-06 2024-09-12T22:04:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449963+0000", 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2719999999999997e-06 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449970+0000", 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5930000000000002e-06 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450563+0000", 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00059351900000000003 2024-09-12T22:04:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450570+0000", 2024-09-12T22:04:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3900000000000004e-06 2024-09-12T22:04:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461148+0000", 2024-09-12T22:04:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010577354000000001 2024-09-12T22:04:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461312+0000", 2024-09-12T22:04:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016392300000000001 2024-09-12T22:04:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461525+0000", 2024-09-12T22:04:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021282199999999999 2024-09-12T22:04:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464272+0000", 2024-09-12T22:04:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027469740000000001 2024-09-12T22:04:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467749+0000", 2024-09-12T22:04:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003477235 2024-09-12T22:04:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467815+0000", 2024-09-12T22:04:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5974000000000002e-05 2024-09-12T22:04:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467864+0000", 2024-09-12T22:04:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9279e-05 2024-09-12T22:04:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.531653611000003, 2024-09-12T22:04:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018827507, 2024-09-12T22:04:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:04:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:04:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2739999999999999e-06 2024-09-12T22:04:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449999+0000", 2024-09-12T22:04:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3349e-05 2024-09-12T22:04:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450005+0000", 2024-09-12T22:04:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.609e-06 2024-09-12T22:04:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461006+0000", 2024-09-12T22:04:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011000876 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461236+0000", 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000230301 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461362+0000", 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012541900000000001 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464797+0000", 2024-09-12T22:04:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034350840000000001 2024-09-12T22:04:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468754+0000", 2024-09-12T22:04:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039576689999999996 2024-09-12T22:04:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468784+0000", 2024-09-12T22:04:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9558000000000001e-05 2024-09-12T22:04:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468810+0000", 2024-09-12T22:04:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5752e-05 2024-09-12T22:04:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.531621739000002, 2024-09-12T22:04:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018888559999999999, 2024-09-12T22:04:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450015+0000", 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:04:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450018+0000", 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3840000000000001e-06 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8859999999999998e-06 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450030+0000", 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4829999999999999e-06 2024-09-12T22:04:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465718+0000", 2024-09-12T22:04:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015688163000000001 2024-09-12T22:04:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465793+0000", 2024-09-12T22:04:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4788000000000003e-05 2024-09-12T22:04:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466015+0000", 2024-09-12T22:04:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000221394 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467628+0000", 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016131190000000001 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468849+0000", 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012211699999999999 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468878+0000", 2024-09-12T22:04:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8708e-05 2024-09-12T22:04:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468902+0000", 2024-09-12T22:04:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868e-05 2024-09-12T22:04:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:23 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.531598291999998, 2024-09-12T22:04:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021189669000000001, 2024-09-12T22:04:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450038+0000", 2024-09-12T22:04:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450042+0000", 2024-09-12T22:04:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7720000000000001e-06 2024-09-12T22:04:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450058+0000", 2024-09-12T22:04:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6379999999999999e-05 2024-09-12T22:04:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450067+0000", 2024-09-12T22:04:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3870000000000001e-06 2024-09-12T22:04:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466409+0000", 2024-09-12T22:04:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016341418999999999 2024-09-12T22:04:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466467+0000", 2024-09-12T22:04:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8613999999999998e-05 2024-09-12T22:04:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466612+0000", 2024-09-12T22:04:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014415000000000001 2024-09-12T22:04:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467856+0000", 2024-09-12T22:04:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012440039999999999 2024-09-12T22:04:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471178+0000", 2024-09-12T22:04:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033227450000000002 2024-09-12T22:04:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471207+0000", 2024-09-12T22:04:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8571000000000001e-05 2024-09-12T22:04:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471227+0000", 2024-09-12T22:04:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0109999999999999e-05 2024-09-12T22:04:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.531557751999998, 2024-09-12T22:04:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021231197, 2024-09-12T22:04:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450079+0000", 2024-09-12T22:04:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:04:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450083+0000", 2024-09-12T22:04:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1989999999999999e-06 2024-09-12T22:04:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450092+0000", 2024-09-12T22:04:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9400000000000008e-06 2024-09-12T22:04:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450097+0000", 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466898+0000", 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016801226999999998 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466975+0000", 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6197000000000002e-05 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467158+0000", 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183876 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468270+0000", 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001111229 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471260+0000", 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002989907 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471289+0000", 2024-09-12T22:04:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9271000000000001e-05 2024-09-12T22:04:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471309+0000", 2024-09-12T22:04:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0302999999999999e-05 2024-09-12T22:04:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.531531151000003, 2024-09-12T22:04:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018145809999999998, 2024-09-12T22:04:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450114+0000", 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1849999999999993e-06 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:04:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1350000000000003e-06 2024-09-12T22:04:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450128+0000", 2024-09-12T22:04:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2040000000000002e-06 2024-09-12T22:04:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454085+0000", 2024-09-12T22:04:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00395736 2024-09-12T22:04:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454090+0000", 2024-09-12T22:04:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.378e-06 2024-09-12T22:04:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457076+0000", 2024-09-12T22:04:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002985747 2024-09-12T22:04:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457178+0000", 2024-09-12T22:04:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010242 2024-09-12T22:04:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457452+0000", 2024-09-12T22:04:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027313000000000001 2024-09-12T22:04:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462024+0000", 2024-09-12T22:04:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045727040000000004 2024-09-12T22:04:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468161+0000", 2024-09-12T22:04:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061372019999999996 2024-09-12T22:04:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468212+0000", 2024-09-12T22:04:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0707000000000001e-05 2024-09-12T22:04:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468250+0000", 2024-09-12T22:04:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8148000000000001e-05 2024-09-12T22:04:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.530843595999997, 2024-09-12T22:04:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020127506999999999, 2024-09-12T22:04:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450793+0000", 2024-09-12T22:04:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2800000000000005e-07 2024-09-12T22:04:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450813+0000", 2024-09-12T22:04:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0063000000000001e-05 2024-09-12T22:04:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450847+0000", 2024-09-12T22:04:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3973000000000002e-05 2024-09-12T22:04:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450862+0000", 2024-09-12T22:04:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5358000000000001e-05 2024-09-12T22:04:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454355+0000", 2024-09-12T22:04:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003492841 2024-09-12T22:04:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454359+0000", 2024-09-12T22:04:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-09-12T22:04:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458704+0000", 2024-09-12T22:04:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043452459999999997 2024-09-12T22:04:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459009+0000", 2024-09-12T22:04:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030526199999999999 2024-09-12T22:04:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459143+0000", 2024-09-12T22:04:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013375 2024-09-12T22:04:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462690+0000", 2024-09-12T22:04:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035466579999999998 2024-09-12T22:04:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470863+0000", 2024-09-12T22:04:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0081734089999999995 2024-09-12T22:04:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470898+0000", 2024-09-12T22:04:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4445e-05 2024-09-12T22:04:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470920+0000", 2024-09-12T22:04:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1844e-05 2024-09-12T22:04:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.529313477000002, 2024-09-12T22:04:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018704596, 2024-09-12T22:04:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452323+0000", 2024-09-12T22:04:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:04:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452337+0000", 2024-09-12T22:04:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:04:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452489+0000", 2024-09-12T22:04:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015167699999999999 2024-09-12T22:04:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452498+0000", 2024-09-12T22:04:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9709999999999993e-06 2024-09-12T22:04:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454393+0000", 2024-09-12T22:04:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001895171 2024-09-12T22:04:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454397+0000", 2024-09-12T22:04:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4470000000000002e-06 2024-09-12T22:04:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459570+0000", 2024-09-12T22:04:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051728160000000002 2024-09-12T22:04:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459718+0000", 2024-09-12T22:04:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014857800000000001 2024-09-12T22:04:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459920+0000", 2024-09-12T22:04:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000202043 2024-09-12T22:04:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462696+0000", 2024-09-12T22:04:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027756299999999999 2024-09-12T22:04:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470963+0000", 2024-09-12T22:04:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082671359999999996 2024-09-12T22:04:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471000+0000", 2024-09-12T22:04:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6748999999999997e-05 2024-09-12T22:04:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471027+0000", 2024-09-12T22:04:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7118e-05 2024-09-12T22:04:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.348337891, 2024-09-12T22:04:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79650 5.1 5:87bbf2de:::benchmark_data_smithi043_32659_object79649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.1501525840000006, 2024-09-12T22:04:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021887977999999999, 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79650 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831484+0000", 2024-09-12T22:04:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:04:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831558+0000", 2024-09-12T22:04:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4556999999999998e-05 2024-09-12T22:04:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831567+0000", 2024-09-12T22:04:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3410000000000003e-06 2024-09-12T22:04:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831574+0000", 2024-09-12T22:04:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2559999999999996e-06 2024-09-12T22:04:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.832773+0000", 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001199475 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.832890+0000", 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116768 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.833027+0000", 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000136527 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.837448+0000", 2024-09-12T22:04:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044212130000000002 2024-09-12T22:04:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853313+0000", 2024-09-12T22:04:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015865016999999999 2024-09-12T22:04:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853344+0000", 2024-09-12T22:04:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1010000000000003e-05 2024-09-12T22:04:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853371+0000", 2024-09-12T22:04:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7092000000000001e-05 2024-09-12T22:04:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79651 5.1 5:82b16cba:::benchmark_data_smithi043_32659_object79650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.1498281769999998, 2024-09-12T22:04:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021652616999999999, 2024-09-12T22:04:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79651 2024-09-12T22:04:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831808+0000", 2024-09-12T22:04:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4099999999999998e-07 2024-09-12T22:04:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831886+0000", 2024-09-12T22:04:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8184999999999998e-05 2024-09-12T22:04:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831896+0000", 2024-09-12T22:04:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0001e-05 2024-09-12T22:04:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831902+0000", 2024-09-12T22:04:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7960000000000001e-06 2024-09-12T22:04:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835123+0000", 2024-09-12T22:04:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032211660000000001 2024-09-12T22:04:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835281+0000", 2024-09-12T22:04:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015780699999999999 2024-09-12T22:04:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835443+0000", 2024-09-12T22:04:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016203499999999999 2024-09-12T22:04:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.837588+0000", 2024-09-12T22:04:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021443159999999998 2024-09-12T22:04:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853402+0000", 2024-09-12T22:04:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015814528000000001 2024-09-12T22:04:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853434+0000", 2024-09-12T22:04:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1955999999999997e-05 2024-09-12T22:04:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853460+0000", 2024-09-12T22:04:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6086000000000001e-05 2024-09-12T22:04:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79659 5.1 5:881dc852:::benchmark_data_smithi043_32659_object79658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.1419546329999992, 2024-09-12T22:04:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019797940999999999, 2024-09-12T22:04:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79659 2024-09-12T22:04:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839682+0000", 2024-09-12T22:04:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-12T22:04:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839723+0000", 2024-09-12T22:04:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0611999999999997e-05 2024-09-12T22:04:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839736+0000", 2024-09-12T22:04:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3285000000000001e-05 2024-09-12T22:04:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839755+0000", 2024-09-12T22:04:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8870000000000001e-05 2024-09-12T22:04:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839792+0000", 2024-09-12T22:04:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7162000000000001e-05 2024-09-12T22:04:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839876+0000", 2024-09-12T22:04:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4376999999999995e-05 2024-09-12T22:04:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839980+0000", 2024-09-12T22:04:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000103149 2024-09-12T22:04:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.841622+0000", 2024-09-12T22:04:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001642117 2024-09-12T22:04:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859420+0000", 2024-09-12T22:04:26.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017798538999999999 2024-09-12T22:04:26.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859454+0000", 2024-09-12T22:04:26.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3315000000000002e-05 2024-09-12T22:04:26.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859479+0000", 2024-09-12T22:04:26.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5384999999999998e-05 2024-09-12T22:04:26.095 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.095 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.095 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.095 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79661 5.2 5:4081316a:::benchmark_data_smithi043_32659_object79660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:26.095 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:26.095 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.1332817070000001, 2024-09-12T22:04:26.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.025955590000000001, 2024-09-12T22:04:26.095 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.095 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.095 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.095 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:26.096 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:26.096 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.096 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79661 2024-09-12T22:04:26.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.096 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:26.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:26.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848355+0000", 2024-09-12T22:04:26.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3009999999999999e-06 2024-09-12T22:04:26.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848410+0000", 2024-09-12T22:04:26.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639000000000003e-05 2024-09-12T22:04:26.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848426+0000", 2024-09-12T22:04:26.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5979000000000001e-05 2024-09-12T22:04:26.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848436+0000", 2024-09-12T22:04:26.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0227000000000001e-05 2024-09-12T22:04:26.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848479+0000", 2024-09-12T22:04:26.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2450000000000002e-05 2024-09-12T22:04:26.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848574+0000", 2024-09-12T22:04:26.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5508999999999996e-05 2024-09-12T22:04:26.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:26.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848667+0000", 2024-09-12T22:04:26.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999997e-05 2024-09-12T22:04:26.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.850764+0000", 2024-09-12T22:04:26.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020964920000000001 2024-09-12T22:04:26.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874250+0000", 2024-09-12T22:04:26.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.023486440000000001 2024-09-12T22:04:26.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874283+0000", 2024-09-12T22:04:26.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2552000000000003e-05 2024-09-12T22:04:26.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874310+0000", 2024-09-12T22:04:26.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7001000000000001e-05 2024-09-12T22:04:26.101 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.101 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.101 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.101 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79671 5.2 5:46f8404a:::benchmark_data_smithi043_32659_object79670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:26.101 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:26.101 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.1280773699999997, 2024-09-12T22:04:26.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021880646, 2024-09-12T22:04:26.101 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.101 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.101 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.101 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:26.102 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:26.102 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.102 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79671 2024-09-12T22:04:26.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.102 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:26.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:26.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853559+0000", 2024-09-12T22:04:26.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.012e-06 2024-09-12T22:04:26.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853609+0000", 2024-09-12T22:04:26.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9372000000000001e-05 2024-09-12T22:04:26.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853617+0000", 2024-09-12T22:04:26.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.055e-06 2024-09-12T22:04:26.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853621+0000", 2024-09-12T22:04:26.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:04:26.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853659+0000", 2024-09-12T22:04:26.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7981000000000001e-05 2024-09-12T22:04:26.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853750+0000", 2024-09-12T22:04:26.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0797000000000005e-05 2024-09-12T22:04:26.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:26.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853835+0000", 2024-09-12T22:04:26.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4958999999999998e-05 2024-09-12T22:04:26.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.855573+0000", 2024-09-12T22:04:26.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001737854 2024-09-12T22:04:26.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:26.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875378+0000", 2024-09-12T22:04:26.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019805146999999999 2024-09-12T22:04:26.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875412+0000", 2024-09-12T22:04:26.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3649999999999998e-05 2024-09-12T22:04:26.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875439+0000", 2024-09-12T22:04:26.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7160000000000001e-05 2024-09-12T22:04:26.107 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.107 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.107 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.107 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:98916 5.5 5:a5cbea4a:::benchmark_data_smithi043_32659_object98915:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:26.107 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.855470+0000", 2024-09-12T22:04:26.107 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.12616602699999999, 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018007867, 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 98916 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855470+0000", 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855470+0000", 2024-09-12T22:04:26.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855470+0000", 2024-09-12T22:04:26.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4300000000000003e-07 2024-09-12T22:04:26.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855504+0000", 2024-09-12T22:04:26.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3834000000000002e-05 2024-09-12T22:04:26.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855511+0000", 2024-09-12T22:04:26.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4170000000000003e-06 2024-09-12T22:04:26.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855517+0000", 2024-09-12T22:04:26.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0039999999999996e-06 2024-09-12T22:04:26.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.857432+0000", 2024-09-12T22:04:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001914935 2024-09-12T22:04:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.857585+0000", 2024-09-12T22:04:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015281499999999999 2024-09-12T22:04:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.873343+0000", 2024-09-12T22:04:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015757693999999999 2024-09-12T22:04:26.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.873390+0000", 2024-09-12T22:04:26.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7438999999999998e-05 2024-09-12T22:04:26.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.873478+0000", 2024-09-12T22:04:26.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7186000000000002e-05 2024-09-12T22:04:26.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.112 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.113 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:98918 5.5 5:a750d745:::benchmark_data_smithi043_32659_object98917:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:26.113 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.855621+0000", 2024-09-12T22:04:26.113 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.126014391, 2024-09-12T22:04:26.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017972768, 2024-09-12T22:04:26.113 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:26.113 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:26.113 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:26.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:26.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:26.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.113 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 98918 2024-09-12T22:04:26.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.113 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855621+0000", 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855621+0000", 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855622+0000", 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-07 2024-09-12T22:04:26.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855668+0000", 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6116999999999999e-05 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855676+0000", 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7130000000000005e-06 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855682+0000", 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6800000000000004e-06 2024-09-12T22:04:26.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:26.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.859547+0000", 2024-09-12T22:04:26.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038645569999999998 2024-09-12T22:04:26.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:26.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.859691+0000", 2024-09-12T22:04:26.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014451700000000001 2024-09-12T22:04:26.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:26.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.873492+0000", 2024-09-12T22:04:26.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013800105999999999 2024-09-12T22:04:26.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:26.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.873535+0000", 2024-09-12T22:04:26.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3090999999999998e-05 2024-09-12T22:04:26.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:26.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:26.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:26.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.873594+0000", 2024-09-12T22:04:26.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9435000000000003e-05 2024-09-12T22:04:26.118 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.118 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.118 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.118 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:26.118 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:26.118 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:26.119 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:26.120 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:26.118+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:26.164 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:04:26.192 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 32 16 99857 99841 194.986 177.562 0.00377183 0.00512579 2024-09-12T22:04:26.220 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:26.219+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:26.269 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:26.269 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:26.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.269 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:100073 5.0 5.bf0b8670 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:26.269 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:26.264546+0000", 2024-09-12T22:04:26.269 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0025044009999999998, 2024-09-12T22:04:26.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025243869999999999, 2024-09-12T22:04:26.270 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:26.270 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:26.270 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:26.270 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:26.270 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:26.270 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.270 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 100073 2024-09-12T22:04:26.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.270 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:26.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:26.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264546+0000", 2024-09-12T22:04:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264546+0000", 2024-09-12T22:04:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264547+0000", 2024-09-12T22:04:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3200000000000004e-07 2024-09-12T22:04:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264603+0000", 2024-09-12T22:04:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6180000000000001e-05 2024-09-12T22:04:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264624+0000", 2024-09-12T22:04:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1013e-05 2024-09-12T22:04:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264632+0000", 2024-09-12T22:04:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3000000000000004e-06 2024-09-12T22:04:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.273 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:26.273 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.273 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:100074 5.0 5.321263f0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:26.273 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:26.264661+0000", 2024-09-12T22:04:26.273 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0023897969999999999, 2024-09-12T22:04:26.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002469995, 2024-09-12T22:04:26.273 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:26.273 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:26.273 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:26.273 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:26.273 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:26.274 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.274 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 100074 2024-09-12T22:04:26.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.274 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:26.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:26.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264661+0000", 2024-09-12T22:04:26.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:26.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264661+0000", 2024-09-12T22:04:26.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:26.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264662+0000", 2024-09-12T22:04:26.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4600000000000004e-07 2024-09-12T22:04:26.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:26.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264693+0000", 2024-09-12T22:04:26.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0988999999999998e-05 2024-09-12T22:04:26.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:26.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264702+0000", 2024-09-12T22:04:26.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1940000000000004e-06 2024-09-12T22:04:26.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264709+0000", 2024-09-12T22:04:26.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2400000000000001e-06 2024-09-12T22:04:26.276 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.276 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:26.276 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.276 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:100072 5.f e36/22 5:fb41aa03:::benchmark_data_smithi043_32659_object100071:head v 36'6296, mlcod=36'6293)", 2024-09-12T22:04:26.276 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:26.264861+0000", 2024-09-12T22:04:26.277 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0021898249999999998, 2024-09-12T22:04:26.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023239810000000001, 2024-09-12T22:04:26.277 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:26.277 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:26.277 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:26.277 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:26.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:26.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264861+0000", 2024-09-12T22:04:26.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:26.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264861+0000", 2024-09-12T22:04:26.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:26.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264862+0000", 2024-09-12T22:04:26.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:04:26.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:26.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264903+0000", 2024-09-12T22:04:26.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1362999999999997e-05 2024-09-12T22:04:26.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:26.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264912+0000", 2024-09-12T22:04:26.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4830000000000005e-06 2024-09-12T22:04:26.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264919+0000", 2024-09-12T22:04:26.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2299999999999996e-06 2024-09-12T22:04:26.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:26.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264992+0000", 2024-09-12T22:04:26.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3078999999999996e-05 2024-09-12T22:04:26.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:26.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.265039+0000", 2024-09-12T22:04:26.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6907000000000003e-05 2024-09-12T22:04:26.280 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.280 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:26.280 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.280 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:100076 5.8 5.798dea48 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:26.280 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:26.265247+0000", 2024-09-12T22:04:26.280 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0018036739999999999, 2024-09-12T22:04:26.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019944720000000002, 2024-09-12T22:04:26.281 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:26.281 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:26.281 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:26.281 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:26.281 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:26.281 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.281 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 100076 2024-09-12T22:04:26.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.281 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:26.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:26.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.265247+0000", 2024-09-12T22:04:26.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:26.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.265247+0000", 2024-09-12T22:04:26.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:26.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.265248+0000", 2024-09-12T22:04:26.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:04:26.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:26.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.265300+0000", 2024-09-12T22:04:26.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2299000000000002e-05 2024-09-12T22:04:26.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:26.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.265327+0000", 2024-09-12T22:04:26.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6525000000000001e-05 2024-09-12T22:04:26.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.265336+0000", 2024-09-12T22:04:26.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6809999999999993e-06 2024-09-12T22:04:26.284 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.284 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:26.285 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.285 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:100077 5.0 5.c28abdd0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:26.285 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:26.265417+0000", 2024-09-12T22:04:26.285 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0016338520000000001, 2024-09-12T22:04:26.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001878369, 2024-09-12T22:04:26.285 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:26.285 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:26.285 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:26.285 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:26.285 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:26.285 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.286 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 100077 2024-09-12T22:04:26.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.286 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:26.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:26.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.265417+0000", 2024-09-12T22:04:26.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:26.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.265417+0000", 2024-09-12T22:04:26.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.265418+0000", 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1900000000000001e-07 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.265525+0000", 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010749 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.265536+0000", 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0339999999999999e-05 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.265541+0000", 2024-09-12T22:04:26.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8000000000000004e-06 2024-09-12T22:04:26.288 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.288 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:26.288 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.288 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:100079 5.e 5:715cf26d:::benchmark_data_smithi043_32659_object100078:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:26.288 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:26.266886+0000", 2024-09-12T22:04:26.288 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00016483399999999999, 2024-09-12T22:04:26.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046609899999999998, 2024-09-12T22:04:26.288 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:26.289 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:26.289 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:26.289 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:26.289 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:26.289 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.289 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 100079 2024-09-12T22:04:26.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.289 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:26.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:26.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.266886+0000", 2024-09-12T22:04:26.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.266886+0000", 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.266887+0000", 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9100000000000002e-07 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.266983+0000", 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6399999999999999e-05 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:26.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.266996+0000", 2024-09-12T22:04:26.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2337999999999999e-05 2024-09-12T22:04:26.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267003+0000", 2024-09-12T22:04:26.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2620000000000001e-06 2024-09-12T22:04:26.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:26.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267051+0000", 2024-09-12T22:04:26.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7833000000000001e-05 2024-09-12T22:04:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267216+0000", 2024-09-12T22:04:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000165506 2024-09-12T22:04:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:100081 5.b 5:dcb5632d:::benchmark_data_smithi043_32659_object100080:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:26.267024+0000", 2024-09-12T22:04:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 2.6715000000000001e-05, 2024-09-12T22:04:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00039703699999999999, 2024-09-12T22:04:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 100081 2024-09-12T22:04:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267024+0000", 2024-09-12T22:04:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267024+0000", 2024-09-12T22:04:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267025+0000", 2024-09-12T22:04:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7399999999999998e-07 2024-09-12T22:04:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267117+0000", 2024-09-12T22:04:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2e-05 2024-09-12T22:04:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267125+0000", 2024-09-12T22:04:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4279999999999996e-06 2024-09-12T22:04:26.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267133+0000", 2024-09-12T22:04:26.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2879999999999993e-06 2024-09-12T22:04:26.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:26.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267180+0000", 2024-09-12T22:04:26.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6437999999999998e-05 2024-09-12T22:04:26.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:26.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267282+0000", 2024-09-12T22:04:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000101882 2024-09-12T22:04:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:100082 5.4 5:25944e95:::benchmark_data_smithi043_32659_object100081:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:26.267215+0000", 2024-09-12T22:04:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.999836, 2024-09-12T22:04:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027071099999999998, 2024-09-12T22:04:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:26.298 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:26.298 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.298 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 100082 2024-09-12T22:04:26.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.298 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:26.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:26.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267215+0000", 2024-09-12T22:04:26.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:26.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267215+0000", 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267216+0000", 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8999999999999995e-07 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267284+0000", 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8256000000000005e-05 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:26.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267293+0000", 2024-09-12T22:04:26.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:04:26.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267300+0000", 2024-09-12T22:04:26.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5729999999999996e-06 2024-09-12T22:04:26.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:26.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267349+0000", 2024-09-12T22:04:26.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8715999999999999e-05 2024-09-12T22:04:26.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:26.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.267458+0000", 2024-09-12T22:04:26.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109347 2024-09-12T22:04:26.301 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.301 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:26.301 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.301 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:100067 5.b 5:db03e367:::benchmark_data_smithi043_32659_object100066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:26.301 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:26.263288+0000", 2024-09-12T22:04:26.301 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0037631840000000001, 2024-09-12T22:04:26.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0042624029999999997, 2024-09-12T22:04:26.301 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:26.301 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:26.302 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:26.302 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:26.302 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:26.302 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.302 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 100067 2024-09-12T22:04:26.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.302 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:26.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:26.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263288+0000", 2024-09-12T22:04:26.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:26.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263288+0000", 2024-09-12T22:04:26.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:26.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263288+0000", 2024-09-12T22:04:26.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0200000000000002e-07 2024-09-12T22:04:26.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:26.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263356+0000", 2024-09-12T22:04:26.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7701999999999997e-05 2024-09-12T22:04:26.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:26.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263363+0000", 2024-09-12T22:04:26.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.148e-06 2024-09-12T22:04:26.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263368+0000", 2024-09-12T22:04:26.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.69e-06 2024-09-12T22:04:26.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:26.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263420+0000", 2024-09-12T22:04:26.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2135999999999997e-05 2024-09-12T22:04:26.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:26.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263541+0000", 2024-09-12T22:04:26.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000120664 2024-09-12T22:04:26.305 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.305 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:26.305 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.305 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:100068 5.8 5:1ee4f5a0:::benchmark_data_smithi043_32659_object100067:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:26.305 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:26.263385+0000", 2024-09-12T22:04:26.305 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0036660500000000001, 2024-09-12T22:04:26.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0042274519999999996, 2024-09-12T22:04:26.306 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:26.306 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:26.306 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:26.306 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:26.306 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:26.306 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.306 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 100068 2024-09-12T22:04:26.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.306 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:26.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:26.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263385+0000", 2024-09-12T22:04:26.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:26.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263385+0000", 2024-09-12T22:04:26.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:26.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263385+0000", 2024-09-12T22:04:26.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:04:26.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:26.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263438+0000", 2024-09-12T22:04:26.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2695999999999998e-05 2024-09-12T22:04:26.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:26.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263473+0000", 2024-09-12T22:04:26.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5293000000000002e-05 2024-09-12T22:04:26.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263479+0000", 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7400000000000001e-06 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263529+0000", 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0306999999999998e-05 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263650+0000", 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000120518 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:26.309 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.310 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:100070 5.4 5:2ba57166:::benchmark_data_smithi043_32659_object100069:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:26.310 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:26.263837+0000", 2024-09-12T22:04:26.310 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0032133690000000002, 2024-09-12T22:04:26.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038342900000000002, 2024-09-12T22:04:26.310 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:26.310 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:26.310 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:26.310 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:26.310 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:26.310 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.310 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 100070 2024-09-12T22:04:26.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.311 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:26.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:26.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263837+0000", 2024-09-12T22:04:26.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:26.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263837+0000", 2024-09-12T22:04:26.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:26.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263838+0000", 2024-09-12T22:04:26.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.029e-06 2024-09-12T22:04:26.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:26.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263910+0000", 2024-09-12T22:04:26.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1804000000000006e-05 2024-09-12T22:04:26.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:26.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263923+0000", 2024-09-12T22:04:26.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2514000000000001e-05 2024-09-12T22:04:26.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.263932+0000", 2024-09-12T22:04:26.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.816e-06 2024-09-12T22:04:26.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:26.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264818+0000", 2024-09-12T22:04:26.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00088593099999999996 2024-09-12T22:04:26.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:26.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264967+0000", 2024-09-12T22:04:26.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014954500000000001 2024-09-12T22:04:26.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.314 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:26.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.314 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:100071 5.0 5:0bd985c3:::benchmark_data_smithi043_32659_object100070:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:26.314 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:26.264326+0000", 2024-09-12T22:04:26.314 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0027247019999999999, 2024-09-12T22:04:26.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034056170000000001, 2024-09-12T22:04:26.314 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:26.314 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:26.314 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:26.314 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:26.314 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 100071 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264326+0000", 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264326+0000", 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:26.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264327+0000", 2024-09-12T22:04:26.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7700000000000003e-07 2024-09-12T22:04:26.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:26.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264364+0000", 2024-09-12T22:04:26.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6613000000000003e-05 2024-09-12T22:04:26.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:26.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264376+0000", 2024-09-12T22:04:26.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2887999999999999e-05 2024-09-12T22:04:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264386+0000", 2024-09-12T22:04:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0790000000000007e-06 2024-09-12T22:04:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.264611+0000", 2024-09-12T22:04:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000225338 2024-09-12T22:04:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:26.265472+0000", 2024-09-12T22:04:26.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00086060800000000001 2024-09-12T22:04:26.318 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.318 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:26.318 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.318 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:26.318 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:26.318 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 12 2024-09-12T22:04:26.318 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:26.320 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:26.320 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-09-12T22:04:26.321 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-09-12T22:04:26.361 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:26.360+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:26.391 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:04:26.422 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:26.421+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:26.502 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:26.510 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:26.510 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:26.521 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:26.522 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:26.523 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:26.521+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:26.523 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:26.539 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:26.539 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:26.543 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:26.543 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:26.624 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:26.623+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:26.714 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:26.714 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:26.724 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:26.723+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:26.727 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:26.825 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:26.824+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:26.879 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:26.879 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:26.892 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:26.926 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:26.925+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:27.027 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:27.026+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:27.085 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:27.085 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:27.099 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:27.128 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:27.127+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:27.192 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 33 16 102681 102665 194.425 176.5 0.00602029 0.0051408 2024-09-12T22:04:27.228 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:27.227+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:27.258 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:27.258 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:27.271 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:27.329 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:27.328+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:27.394 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:04:27.426 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:27.426 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:27.430 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:27.429+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:27.438 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:27.530 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:27.529+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:27.619 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:27.619 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:27.631 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:27.630+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:27.632 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:27.732 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:27.731+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:27.782 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:27.782 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:27.795 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:27.839 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:27.838+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:27.934 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:27.933+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:27.961 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:28.035 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:28.034+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:28.135 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:28.134+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:28.158 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:28.158 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:28.170 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:28.192 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 34 16 105514 105498 193.914 177.062 0.00956697 0.00515406 2024-09-12T22:04:28.236 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:28.235+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:28.315 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:28.316 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:28.328 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:28.369 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:28.368+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:28.388 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-09-12T22:04:28.438 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:28.437+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:28.474 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:28.474 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:28.486 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:28.539 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:28.538+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:28.544 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:04:28.629 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:28.629 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:28.639 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:28.638+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:28.641 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:28.657 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:28.677 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:28.677 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:28.695 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:28.695 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:28.699 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:28.699 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:28.741 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:28.739+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:28.835 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:28.836 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:28.836 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:28.836 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:28.836 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.836 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44102 5.0 5:0d5aa1ff:::benchmark_data_smithi043_32659_object44101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.836 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:28.836 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.207730893000001, 2024-09-12T22:04:28.836 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051636015, 2024-09-12T22:04:28.836 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.836 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.836 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.837 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.837 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.837 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.837 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44102 2024-09-12T22:04:28.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.837 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.837 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:28.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.837 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624875+0000", 2024-09-12T22:04:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:04:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624930+0000", 2024-09-12T22:04:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5256000000000001e-05 2024-09-12T22:04:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.839 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624951+0000", 2024-09-12T22:04:28.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0551999999999999e-05 2024-09-12T22:04:28.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.839 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.839 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624958+0000", 2024-09-12T22:04:28.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1849999999999998e-06 2024-09-12T22:04:28.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.839 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.839 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629885+0000", 2024-09-12T22:04:28.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049266120000000004 2024-09-12T22:04:28.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629999+0000", 2024-09-12T22:04:28.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011385 2024-09-12T22:04:28.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630125+0000", 2024-09-12T22:04:28.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012640500000000001 2024-09-12T22:04:28.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633338+0000", 2024-09-12T22:04:28.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032135559999999998 2024-09-12T22:04:28.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676425+0000", 2024-09-12T22:04:28.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043086753999999998 2024-09-12T22:04:28.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676472+0000", 2024-09-12T22:04:28.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6971999999999997e-05 2024-09-12T22:04:28.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676510+0000", 2024-09-12T22:04:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8096999999999998e-05 2024-09-12T22:04:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44103 5.8 5:170742c6:::benchmark_data_smithi043_32659_object44102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.207607742, 2024-09-12T22:04:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051500936999999997, 2024-09-12T22:04:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.843 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.843 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.843 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44103 2024-09-12T22:04:28.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.843 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:28.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:28.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624998+0000", 2024-09-12T22:04:28.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:28.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625061+0000", 2024-09-12T22:04:28.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2667000000000002e-05 2024-09-12T22:04:28.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625069+0000", 2024-09-12T22:04:28.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999993e-06 2024-09-12T22:04:28.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625077+0000", 2024-09-12T22:04:28.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0090000000000007e-06 2024-09-12T22:04:28.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629869+0000", 2024-09-12T22:04:28.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047921769999999999 2024-09-12T22:04:28.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629938+0000", 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9542000000000006e-05 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630010+0000", 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1795e-05 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676348+0000", 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.046337830000000003 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676399+0000", 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1150000000000003e-05 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676460+0000", 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1142999999999994e-05 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676498+0000", 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8111000000000002e-05 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.206309316999999, 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:28.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:28.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:28.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:28.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.850 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.850 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:28.850 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:28.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.850 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.850 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:28.850 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:28.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.850 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.850 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.851 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44115 5.0 5:0ee09c30:::benchmark_data_smithi043_32659_object44114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.203536639999999, 2024-09-12T22:04:28.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082887358999999994, 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44115 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629070+0000", 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1209999999999999e-06 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629132+0000", 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2557000000000004e-05 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629147+0000", 2024-09-12T22:04:28.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4491999999999999e-05 2024-09-12T22:04:28.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629156+0000", 2024-09-12T22:04:28.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7089999999999997e-06 2024-09-12T22:04:28.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631865+0000", 2024-09-12T22:04:28.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00270835 2024-09-12T22:04:28.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631932+0000", 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7322000000000004e-05 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632095+0000", 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016314699999999999 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676360+0000", 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044264756000000002 2024-09-12T22:04:28.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711854+0000", 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.03549389 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711919+0000", 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5024000000000006e-05 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711956+0000", 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6990999999999999e-05 2024-09-12T22:04:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44117 5.8 5:1ecb02e0:::benchmark_data_smithi043_32659_object44116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.20339182, 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082354986000000005, 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44117 2024-09-12T22:04:28.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.860 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:28.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:28.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629214+0000", 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629315+0000", 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010045800000000001 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629328+0000", 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3016e-05 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629336+0000", 2024-09-12T22:04:28.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7229999999999993e-06 2024-09-12T22:04:28.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.862 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631856+0000", 2024-09-12T22:04:28.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025199300000000001 2024-09-12T22:04:28.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.862 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631954+0000", 2024-09-12T22:04:28.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7565999999999994e-05 2024-09-12T22:04:28.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632073+0000", 2024-09-12T22:04:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119677 2024-09-12T22:04:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676523+0000", 2024-09-12T22:04:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044449163 2024-09-12T22:04:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676612+0000", 2024-09-12T22:04:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9579000000000004e-05 2024-09-12T22:04:28.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711509+0000", 2024-09-12T22:04:28.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.034897125000000001 2024-09-12T22:04:28.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711568+0000", 2024-09-12T22:04:28.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8996999999999998e-05 2024-09-12T22:04:28.864 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.864 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.864 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.865 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44120 5.b 5:df1f2c5f:::benchmark_data_smithi043_32659_object44119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.865 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:28.865 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.201216159000001, 2024-09-12T22:04:28.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043861974999999997, 2024-09-12T22:04:28.865 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.865 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.865 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.865 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.866 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.866 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.866 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44120 2024-09-12T22:04:28.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.866 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:28.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:28.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631390+0000", 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631444+0000", 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631452+0000", 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4610000000000008e-06 2024-09-12T22:04:28.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631458+0000", 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631509+0000", 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1442e-05 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631627+0000", 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011796800000000001 2024-09-12T22:04:28.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631814+0000", 2024-09-12T22:04:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018735400000000001 2024-09-12T22:04:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674612+0000", 2024-09-12T22:04:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042797287000000003 2024-09-12T22:04:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675160+0000", 2024-09-12T22:04:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000548187 2024-09-12T22:04:28.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675207+0000", 2024-09-12T22:04:28.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6833999999999999e-05 2024-09-12T22:04:28.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675251+0000", 2024-09-12T22:04:28.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4348000000000003e-05 2024-09-12T22:04:28.870 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.870 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.870 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.871 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.871 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:28.871 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.200908377000001, 2024-09-12T22:04:28.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:28.871 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.871 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.871 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.871 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.871 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.871 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.871 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:28.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.871 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.872 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:28.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.872 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.872 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:28.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.872 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.872 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:28.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:28.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:28.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:28.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:28.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:28.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44122 5.d 5:bfd04815:::benchmark_data_smithi043_32659_object44121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.200810324999999, 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.080166395000000001, 2024-09-12T22:04:28.876 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44122 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:28.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:28.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:04:28.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631853+0000", 2024-09-12T22:04:28.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7209000000000001e-05 2024-09-12T22:04:28.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631858+0000", 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631862+0000", 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.692e-06 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631905+0000", 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3135e-05 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632032+0000", 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012740900000000001 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632166+0000", 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013318800000000001 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674894+0000", 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042728690999999999 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711875+0000", 2024-09-12T22:04:28.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036980631 2024-09-12T22:04:28.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711923+0000", 2024-09-12T22:04:28.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8180000000000003e-05 2024-09-12T22:04:28.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711961+0000", 2024-09-12T22:04:28.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8142000000000002e-05 2024-09-12T22:04:28.881 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.881 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.881 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44123 5.e 5:7d83ca89:::benchmark_data_smithi043_32659_object44122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.200678557, 2024-09-12T22:04:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043329329, 2024-09-12T22:04:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44123 2024-09-12T22:04:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631928+0000", 2024-09-12T22:04:28.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2699999999999998e-07 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631996+0000", 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8141999999999999e-05 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632004+0000", 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7600000000000008e-06 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632010+0000", 2024-09-12T22:04:28.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:04:28.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632069+0000", 2024-09-12T22:04:28.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8260000000000001e-05 2024-09-12T22:04:28.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632226+0000", 2024-09-12T22:04:28.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015702199999999999 2024-09-12T22:04:28.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632337+0000", 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111069 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674909+0000", 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042571854999999999 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675184+0000", 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027561399999999998 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675222+0000", 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7710999999999999e-05 2024-09-12T22:04:28.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675256+0000", 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4014000000000003e-05 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.199967109999999, 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.887 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:28.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:28.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:28.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:28.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:28.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:28.892 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.892 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.893 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.893 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44098 5.0 e28/22 ondisk, result = 0)", 2024-09-12T22:04:28.893 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:28.893 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.199576295, 2024-09-12T22:04:28.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043332180999999997, 2024-09-12T22:04:28.893 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.893 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.893 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:28.893 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633030+0000", 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633035+0000", 2024-09-12T22:04:28.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633043+0000", 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633048+0000", 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5439999999999998e-06 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633362+0000", 2024-09-12T22:04:28.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031397400000000001 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633369+0000", 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676361+0000", 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042991954999999998 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.19896919, 2024-09-12T22:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:28.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:28.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:28.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:28.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:28.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:28.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:28.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:28.902 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.902 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.902 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.902 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:44125 5.9 e28/22 5:9022696f:::benchmark_data_smithi043_32659_object44124:head v 28'2753, mlcod=28'2751)", 2024-09-12T22:04:28.902 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:28.902 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.198930324999999, 2024-09-12T22:04:28.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042744011999999998, 2024-09-12T22:04:28.902 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.902 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.902 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633676+0000", 2024-09-12T22:04:28.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.44e-07 2024-09-12T22:04:28.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633755+0000", 2024-09-12T22:04:28.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9629000000000006e-05 2024-09-12T22:04:28.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674386+0000", 2024-09-12T22:04:28.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631364000000003 2024-09-12T22:04:28.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674399+0000", 2024-09-12T22:04:28.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2047e-05 2024-09-12T22:04:28.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674453+0000", 2024-09-12T22:04:28.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4453999999999997e-05 2024-09-12T22:04:28.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674479+0000", 2024-09-12T22:04:28.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6064999999999999e-05 2024-09-12T22:04:28.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676381+0000", 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001901874 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676419+0000", 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7935000000000002e-05 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44103 5.8 e28/22 ondisk, result = 0)", 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.198424357, 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042322950999999998, 2024-09-12T22:04:28.906 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:28.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:04:28.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634184+0000", 2024-09-12T22:04:28.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7690000000000001e-06 2024-09-12T22:04:28.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674407+0000", 2024-09-12T22:04:28.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040222750000000002 2024-09-12T22:04:28.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674417+0000", 2024-09-12T22:04:28.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0125e-05 2024-09-12T22:04:28.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676387+0000", 2024-09-12T22:04:28.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001970112 2024-09-12T22:04:28.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676394+0000", 2024-09-12T22:04:28.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:04:28.910 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.910 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.910 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.910 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676504+0000", 2024-09-12T22:04:28.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109621 2024-09-12T22:04:28.910 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.910 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.910 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.910 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.910 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.910 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44128 5.d 5:b9a92891:::benchmark_data_smithi043_32659_object44127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.910 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:28.910 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.158171568, 2024-09-12T22:04:28.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040118138999999997, 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44128 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:28.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674435+0000", 2024-09-12T22:04:28.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5960000000000001e-06 2024-09-12T22:04:28.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674485+0000", 2024-09-12T22:04:28.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0021000000000001e-05 2024-09-12T22:04:28.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674495+0000", 2024-09-12T22:04:28.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5189999999999998e-06 2024-09-12T22:04:28.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674500+0000", 2024-09-12T22:04:28.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:04:28.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674923+0000", 2024-09-12T22:04:28.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000423304 2024-09-12T22:04:28.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675027+0000", 2024-09-12T22:04:28.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103399 2024-09-12T22:04:28.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:28.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675141+0000", 2024-09-12T22:04:28.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114274 2024-09-12T22:04:28.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711649+0000", 2024-09-12T22:04:28.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036508011999999999 2024-09-12T22:04:28.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714466+0000", 2024-09-12T22:04:28.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028167370000000001 2024-09-12T22:04:28.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714508+0000", 2024-09-12T22:04:28.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2679000000000003e-05 2024-09-12T22:04:28.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.916 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.916 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714552+0000", 2024-09-12T22:04:28.916 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3528000000000001e-05 2024-09-12T22:04:28.916 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.916 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.916 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.916 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.916 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44129 5.0 5:0f626cda:::benchmark_data_smithi043_32659_object44128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.916 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:28.916 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.158096062999999, 2024-09-12T22:04:28.916 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042846404999999997, 2024-09-12T22:04:28.916 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.917 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.917 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.917 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.917 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.917 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.917 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44129 2024-09-12T22:04:28.917 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.917 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.917 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.917 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.917 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:28.917 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.917 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.917 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674510+0000", 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1600000000000002e-07 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674548+0000", 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8075999999999999e-05 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674689+0000", 2024-09-12T22:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014141499999999999 2024-09-12T22:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674696+0000", 2024-09-12T22:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4619999999999999e-06 2024-09-12T22:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713666+0000", 2024-09-12T22:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.038969072 2024-09-12T22:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.920 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.920 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713752+0000", 2024-09-12T22:04:28.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6768999999999995e-05 2024-09-12T22:04:28.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.920 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.920 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713835+0000", 2024-09-12T22:04:28.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2774000000000004e-05 2024-09-12T22:04:28.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.920 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.920 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717212+0000", 2024-09-12T22:04:28.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033769389999999998 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717259+0000", 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7218000000000001e-05 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717310+0000", 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1156999999999998e-05 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717356+0000", 2024-09-12T22:04:28.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5107e-05 2024-09-12T22:04:28.922 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.922 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.922 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.922 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.922 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.922 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44130 5.4 5:27857918:::benchmark_data_smithi043_32659_object44129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.922 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:28.922 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.157898208999999, 2024-09-12T22:04:28.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039844412000000003, 2024-09-12T22:04:28.922 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.922 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.922 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.922 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.922 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.923 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.923 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44130 2024-09-12T22:04:28.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.923 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.923 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.923 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.923 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:28.923 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.923 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.923 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.923 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:28.923 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.924 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674708+0000", 2024-09-12T22:04:28.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4300000000000003e-07 2024-09-12T22:04:28.924 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.924 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674749+0000", 2024-09-12T22:04:28.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1254999999999997e-05 2024-09-12T22:04:28.924 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.924 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674756+0000", 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3289999999999996e-06 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674762+0000", 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.852e-06 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9573999999999995e-05 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674954+0000", 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012254200000000001 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675033+0000", 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8707000000000004e-05 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714381+0000", 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039348053000000001 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714477+0000", 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5650999999999996e-05 2024-09-12T22:04:28.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714516+0000", 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9158e-05 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714551+0000", 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5648000000000002e-05 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.927 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44131 5.0 5:013256f7:::benchmark_data_smithi043_32659_object44130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.157825742, 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043388599, 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44131 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.928 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:28.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:28.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674780+0000", 2024-09-12T22:04:28.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:28.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674817+0000", 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6859000000000001e-05 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.501e-05 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674838+0000", 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-06 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715161+0000", 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.04032285 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715317+0000", 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015649199999999999 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715463+0000", 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145704 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.931 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717480+0000", 2024-09-12T22:04:28.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020168220000000001 2024-09-12T22:04:28.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.932 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718079+0000", 2024-09-12T22:04:28.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000599115 2024-09-12T22:04:28.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.932 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718134+0000", 2024-09-12T22:04:28.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:04:28.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.932 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718168+0000", 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4301000000000002e-05 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44132 5.e 5:7634b859:::benchmark_data_smithi043_32659_object44131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.157158502000001, 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039558587999999999, 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.933 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.934 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.934 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.934 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44132 2024-09-12T22:04:28.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.934 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.934 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:28.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.934 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675448+0000", 2024-09-12T22:04:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3699999999999999e-07 2024-09-12T22:04:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675552+0000", 2024-09-12T22:04:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104294 2024-09-12T22:04:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675562+0000", 2024-09-12T22:04:28.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9629999999999993e-06 2024-09-12T22:04:28.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675569+0000", 2024-09-12T22:04:28.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8809999999999998e-06 2024-09-12T22:04:28.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675612+0000", 2024-09-12T22:04:28.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591000000000003e-05 2024-09-12T22:04:28.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675717+0000", 2024-09-12T22:04:28.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010497099999999999 2024-09-12T22:04:28.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675835+0000", 2024-09-12T22:04:28.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011793799999999999 2024-09-12T22:04:28.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713616+0000", 2024-09-12T22:04:28.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037781032999999999 2024-09-12T22:04:28.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714911+0000", 2024-09-12T22:04:28.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001294604 2024-09-12T22:04:28.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714964+0000", 2024-09-12T22:04:28.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3408000000000001e-05 2024-09-12T22:04:28.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715005+0000", 2024-09-12T22:04:28.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0967999999999998e-05 2024-09-12T22:04:28.940 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.940 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.940 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.940 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44133 5.b 5:d0a59edd:::benchmark_data_smithi043_32659_object44132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:28.940 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:28.940 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.157020721999999, 2024-09-12T22:04:28.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039513020000000003, 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44133 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675585+0000", 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5499999999999998e-07 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675634+0000", 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8520999999999998e-05 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:28.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675641+0000", 2024-09-12T22:04:28.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4440000000000002e-06 2024-09-12T22:04:28.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:28.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675646+0000", 2024-09-12T22:04:28.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2660000000000001e-06 2024-09-12T22:04:28.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:28.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675692+0000", 2024-09-12T22:04:28.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5915999999999999e-05 2024-09-12T22:04:28.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:28.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675812+0000", 2024-09-12T22:04:28.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119419 2024-09-12T22:04:28.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:28.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675950+0000", 2024-09-12T22:04:28.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013831499999999999 2024-09-12T22:04:28.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:28.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713574+0000", 2024-09-12T22:04:28.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037623801999999998 2024-09-12T22:04:28.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715015+0000", 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014410720000000001 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715059+0000", 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715097+0000", 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8519000000000002e-05 2024-09-12T22:04:28.945 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.946 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.946 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.946 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:28.946 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:28.946 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:28.947 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:28.946+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:28.948 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:29.048 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:29.047+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:29.103 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:29.103 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:29.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.103 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:108099 5.9 5:9cabc904:::benchmark_data_smithi043_32659_object108098:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.104 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.097966+0000", 2024-09-12T22:04:29.104 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0033423070000000001, 2024-09-12T22:04:29.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033617489999999998, 2024-09-12T22:04:29.104 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.104 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.104 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:29.104 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.104 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.104 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.104 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 108099 2024-09-12T22:04:29.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.104 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097966+0000", 2024-09-12T22:04:29.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097966+0000", 2024-09-12T22:04:29.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097967+0000", 2024-09-12T22:04:29.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2299999999999999e-07 2024-09-12T22:04:29.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098057+0000", 2024-09-12T22:04:29.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0196000000000002e-05 2024-09-12T22:04:29.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098065+0000", 2024-09-12T22:04:29.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5590000000000006e-06 2024-09-12T22:04:29.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098072+0000", 2024-09-12T22:04:29.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2110000000000003e-06 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098113+0000", 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1502999999999999e-05 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098244+0000", 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131466 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098384+0000", 2024-09-12T22:04:29.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000139875 2024-09-12T22:04:29.108 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.108 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.108 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.108 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:108100 5.c 5:3a7a19a9:::benchmark_data_smithi043_32659_object108099:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.108 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.098429+0000", 2024-09-12T22:04:29.108 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.002878523, 2024-09-12T22:04:29.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002945582, 2024-09-12T22:04:29.108 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.108 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.108 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:29.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 108100 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098429+0000", 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098429+0000", 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098430+0000", 2024-09-12T22:04:29.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3799999999999996e-07 2024-09-12T22:04:29.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098459+0000", 2024-09-12T22:04:29.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9099e-05 2024-09-12T22:04:29.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098468+0000", 2024-09-12T22:04:29.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3299999999999999e-06 2024-09-12T22:04:29.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098474+0000", 2024-09-12T22:04:29.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0000000000000002e-06 2024-09-12T22:04:29.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098540+0000", 2024-09-12T22:04:29.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5944000000000004e-05 2024-09-12T22:04:29.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098693+0000", 2024-09-12T22:04:29.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153747 2024-09-12T22:04:29.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.112 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.112 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:108101 5.9 5:9b2c489a:::benchmark_data_smithi043_32659_object108100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.112 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.098497+0000", 2024-09-12T22:04:29.112 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0028108510000000001, 2024-09-12T22:04:29.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029150909999999999, 2024-09-12T22:04:29.112 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.112 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.112 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:29.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.113 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 108101 2024-09-12T22:04:29.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.113 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098497+0000", 2024-09-12T22:04:29.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098497+0000", 2024-09-12T22:04:29.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098498+0000", 2024-09-12T22:04:29.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6599999999999996e-07 2024-09-12T22:04:29.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098536+0000", 2024-09-12T22:04:29.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8463000000000001e-05 2024-09-12T22:04:29.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098543+0000", 2024-09-12T22:04:29.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7549999999999997e-06 2024-09-12T22:04:29.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098548+0000", 2024-09-12T22:04:29.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:04:29.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100547+0000", 2024-09-12T22:04:29.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019993680000000001 2024-09-12T22:04:29.115 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:108102 5.2 5:4952633f:::benchmark_data_smithi043_32659_object108101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.098803+0000", 2024-09-12T22:04:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0025052310000000001, 2024-09-12T22:04:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002642508, 2024-09-12T22:04:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.117 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 108102 2024-09-12T22:04:29.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.117 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098803+0000", 2024-09-12T22:04:29.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098803+0000", 2024-09-12T22:04:29.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098803+0000", 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098828+0000", 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4759000000000001e-05 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098837+0000", 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7399999999999993e-06 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.098843+0000", 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7989999999999999e-06 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099972+0000", 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011292819999999999 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100112+0000", 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014047500000000001 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.119 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.120 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:108103 5.5 5:a3b1bb75:::benchmark_data_smithi043_32659_object108102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.120 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.099177+0000", 2024-09-12T22:04:29.120 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.002130463, 2024-09-12T22:04:29.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023089650000000001, 2024-09-12T22:04:29.120 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.120 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.120 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:29.120 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.120 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.120 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.120 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 108103 2024-09-12T22:04:29.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.121 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099177+0000", 2024-09-12T22:04:29.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099177+0000", 2024-09-12T22:04:29.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099178+0000", 2024-09-12T22:04:29.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:04:29.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099206+0000", 2024-09-12T22:04:29.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7441999999999999e-05 2024-09-12T22:04:29.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099216+0000", 2024-09-12T22:04:29.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0027000000000001e-05 2024-09-12T22:04:29.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099222+0000", 2024-09-12T22:04:29.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.489e-06 2024-09-12T22:04:29.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099306+0000", 2024-09-12T22:04:29.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3666999999999997e-05 2024-09-12T22:04:29.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099453+0000", 2024-09-12T22:04:29.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014699099999999999 2024-09-12T22:04:29.124 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.124 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.124 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.124 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:108104 5.1 5:87615185:::benchmark_data_smithi043_32659_object108103:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.124 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.099867+0000", 2024-09-12T22:04:29.124 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0014406219999999999, 2024-09-12T22:04:29.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016867169999999999, 2024-09-12T22:04:29.124 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.124 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.125 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:29.125 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.125 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.125 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.125 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 108104 2024-09-12T22:04:29.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.125 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099867+0000", 2024-09-12T22:04:29.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099867+0000", 2024-09-12T22:04:29.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099868+0000", 2024-09-12T22:04:29.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-12T22:04:29.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099941+0000", 2024-09-12T22:04:29.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2731999999999994e-05 2024-09-12T22:04:29.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099951+0000", 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0234000000000001e-05 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.099958+0000", 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6560000000000003e-06 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100494+0000", 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00053596500000000001 2024-09-12T22:04:29.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100618+0000", 2024-09-12T22:04:29.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124599 2024-09-12T22:04:29.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.128 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.128 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:108107 5.9 5.8a31bda9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.128 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.100500+0000", 2024-09-12T22:04:29.128 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00080767899999999995, 2024-09-12T22:04:29.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001110495, 2024-09-12T22:04:29.129 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.129 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.129 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:29.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.129 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 108107 2024-09-12T22:04:29.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.129 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100500+0000", 2024-09-12T22:04:29.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100500+0000", 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100501+0000", 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100577+0000", 2024-09-12T22:04:29.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6175999999999997e-05 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100586+0000", 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100603+0000", 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6622000000000001e-05 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.132 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:108108 5.6 5:68952a31:::benchmark_data_smithi043_32659_object108107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.132 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.100616+0000", 2024-09-12T22:04:29.132 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00069225999999999999, 2024-09-12T22:04:29.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010532530000000001, 2024-09-12T22:04:29.132 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.132 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.132 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:29.132 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.132 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.132 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.132 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 108108 2024-09-12T22:04:29.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.132 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100616+0000", 2024-09-12T22:04:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100616+0000", 2024-09-12T22:04:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100616+0000", 2024-09-12T22:04:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.61e-07 2024-09-12T22:04:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100647+0000", 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0363999999999999e-05 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100659+0000", 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100665+0000", 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-12T22:04:29.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100727+0000", 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2545999999999994e-05 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100877+0000", 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015034799999999999 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.135 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:108087 5.9 e37/22)", 2024-09-12T22:04:29.136 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.100703+0000", 2024-09-12T22:04:29.136 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00060450499999999997, 2024-09-12T22:04:29.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001025228, 2024-09-12T22:04:29.136 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.136 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.136 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:29.136 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100703+0000", 2024-09-12T22:04:29.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100703+0000", 2024-09-12T22:04:29.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100704+0000", 2024-09-12T22:04:29.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2600000000000001e-07 2024-09-12T22:04:29.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100709+0000", 2024-09-12T22:04:29.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6269999999999999e-06 2024-09-12T22:04:29.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100720+0000", 2024-09-12T22:04:29.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0733e-05 2024-09-12T22:04:29.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100727+0000", 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3069999999999997e-06 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:108106 5.d e37/22 5:ba620932:::benchmark_data_smithi043_32659_object108105:head v 37'6706, mlcod=37'6703)", 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.100740+0000", 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00056782700000000002, 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001036094, 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100740+0000", 2024-09-12T22:04:29.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100740+0000", 2024-09-12T22:04:29.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100740+0000", 2024-09-12T22:04:29.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:04:29.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100769+0000", 2024-09-12T22:04:29.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8759999999999999e-05 2024-09-12T22:04:29.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100780+0000", 2024-09-12T22:04:29.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0597e-05 2024-09-12T22:04:29.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100785+0000", 2024-09-12T22:04:29.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.575e-06 2024-09-12T22:04:29.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100878+0000", 2024-09-12T22:04:29.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2967999999999995e-05 2024-09-12T22:04:29.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.100896+0000", 2024-09-12T22:04:29.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.804e-05 2024-09-12T22:04:29.145 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.145 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.145 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.145 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:108087 5.9 5:962a777a:::benchmark_data_smithi043_32659_object108086:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.145 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.092816+0000", 2024-09-12T22:04:29.145 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0084917940000000004, 2024-09-12T22:04:29.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0090209109999999995, 2024-09-12T22:04:29.145 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.145 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.145 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:29.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.146 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.146 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.146 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 108087 2024-09-12T22:04:29.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.146 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.092816+0000", 2024-09-12T22:04:29.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.092816+0000", 2024-09-12T22:04:29.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.092817+0000", 2024-09-12T22:04:29.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.92e-07 2024-09-12T22:04:29.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.092873+0000", 2024-09-12T22:04:29.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5726999999999997e-05 2024-09-12T22:04:29.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.092882+0000", 2024-09-12T22:04:29.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4229999999999994e-06 2024-09-12T22:04:29.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.092890+0000", 2024-09-12T22:04:29.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9289999999999998e-06 2024-09-12T22:04:29.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.093995+0000", 2024-09-12T22:04:29.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00110524 2024-09-12T22:04:29.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.094088+0000", 2024-09-12T22:04:29.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2485000000000006e-05 2024-09-12T22:04:29.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.094178+0000", 2024-09-12T22:04:29.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9864000000000006e-05 2024-09-12T22:04:29.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.095590+0000", 2024-09-12T22:04:29.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001412438 2024-09-12T22:04:29.150 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.150 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.150 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.150 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:108089 5.1 5:847fd6d9:::benchmark_data_smithi043_32659_object108088:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.150 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.094276+0000", 2024-09-12T22:04:29.150 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0070315350000000002, 2024-09-12T22:04:29.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0076432669999999996, 2024-09-12T22:04:29.150 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.150 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.150 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:29.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.151 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.151 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 108089 2024-09-12T22:04:29.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.151 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.094276+0000", 2024-09-12T22:04:29.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.094276+0000", 2024-09-12T22:04:29.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.094277+0000", 2024-09-12T22:04:29.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:04:29.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.094337+0000", 2024-09-12T22:04:29.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9568000000000003e-05 2024-09-12T22:04:29.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.094345+0000", 2024-09-12T22:04:29.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.79e-06 2024-09-12T22:04:29.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.094351+0000", 2024-09-12T22:04:29.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-12T22:04:29.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.095366+0000", 2024-09-12T22:04:29.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010156340000000001 2024-09-12T22:04:29.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.095482+0000", 2024-09-12T22:04:29.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116081 2024-09-12T22:04:29.154 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.154 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.154 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.154 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:108094 5.1 5:86fc854d:::benchmark_data_smithi043_32659_object108093:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.154 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.096508+0000", 2024-09-12T22:04:29.154 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.004800304, 2024-09-12T22:04:29.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054702240000000001, 2024-09-12T22:04:29.154 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.154 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.154 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 108094 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.096508+0000", 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.096508+0000", 2024-09-12T22:04:29.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.096508+0000", 2024-09-12T22:04:29.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5799999999999998e-07 2024-09-12T22:04:29.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.096593+0000", 2024-09-12T22:04:29.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4145000000000002e-05 2024-09-12T22:04:29.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.096603+0000", 2024-09-12T22:04:29.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0183999999999999e-05 2024-09-12T22:04:29.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.096611+0000", 2024-09-12T22:04:29.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0690000000000002e-06 2024-09-12T22:04:29.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097281+0000", 2024-09-12T22:04:29.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00066991299999999995 2024-09-12T22:04:29.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097407+0000", 2024-09-12T22:04:29.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012608199999999999 2024-09-12T22:04:29.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.158 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.158 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:108095 5.d e37/22 5:b9aed40b:::benchmark_data_smithi043_32659_object108094:head v 37'6705, mlcod=37'6702)", 2024-09-12T22:04:29.158 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.097285+0000", 2024-09-12T22:04:29.158 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0040234379999999998, 2024-09-12T22:04:29.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047576650000000003, 2024-09-12T22:04:29.158 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.158 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.158 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:29.159 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097285+0000", 2024-09-12T22:04:29.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097285+0000", 2024-09-12T22:04:29.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097285+0000", 2024-09-12T22:04:29.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.27e-07 2024-09-12T22:04:29.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097362+0000", 2024-09-12T22:04:29.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6803000000000003e-05 2024-09-12T22:04:29.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097372+0000", 2024-09-12T22:04:29.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9620000000000005e-06 2024-09-12T22:04:29.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097393+0000", 2024-09-12T22:04:29.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1336e-05 2024-09-12T22:04:29.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097454+0000", 2024-09-12T22:04:29.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0812e-05 2024-09-12T22:04:29.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097473+0000", 2024-09-12T22:04:29.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8706999999999999e-05 2024-09-12T22:04:29.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.162 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.162 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.162 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:108097 5.2 5:4e57550f:::benchmark_data_smithi043_32659_object108096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.162 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:29.097656+0000", 2024-09-12T22:04:29.162 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0036516919999999998, 2024-09-12T22:04:29.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044415390000000004, 2024-09-12T22:04:29.162 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.162 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.162 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 108097 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097656+0000", 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097656+0000", 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097657+0000", 2024-09-12T22:04:29.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7000000000000004e-07 2024-09-12T22:04:29.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097681+0000", 2024-09-12T22:04:29.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4391000000000001e-05 2024-09-12T22:04:29.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097688+0000", 2024-09-12T22:04:29.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8510000000000001e-06 2024-09-12T22:04:29.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097694+0000", 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7169999999999996e-06 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097740+0000", 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6409999999999998e-05 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.097881+0000", 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014095000000000001 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.101975+0000", 2024-09-12T22:04:29.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040935640000000001 2024-09-12T22:04:29.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.102026+0000", 2024-09-12T22:04:29.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0689000000000002e-05 2024-09-12T22:04:29.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:29.102098+0000", 2024-09-12T22:04:29.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2197e-05 2024-09-12T22:04:29.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.167 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.167 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:29.167 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 15 2024-09-12T22:04:29.167 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:29.169 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:29.169 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:29.167+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:29.192 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 35 16 108382 108366 193.495 179.25 0.00251313 0.00516562 2024-09-12T22:04:29.269 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:29.268+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:29.362 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:29.363 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:29.363 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:29.363 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:29.363 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:29.370 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:29.369+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:29.375 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:29.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-09-12T22:04:29.471 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:29.470+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:29.567 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.114144162000002, 2024-09-12T22:04:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018534981999999998, 2024-09-12T22:04:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449725+0000", 2024-09-12T22:04:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799999999999999e-06 2024-09-12T22:04:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449731+0000", 2024-09-12T22:04:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.801e-06 2024-09-12T22:04:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449745+0000", 2024-09-12T22:04:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4198e-05 2024-09-12T22:04:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449758+0000", 2024-09-12T22:04:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2858e-05 2024-09-12T22:04:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449815+0000", 2024-09-12T22:04:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6978999999999998e-05 2024-09-12T22:04:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2369999999999997e-06 2024-09-12T22:04:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457683+0000", 2024-09-12T22:04:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078622640000000008 2024-09-12T22:04:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457840+0000", 2024-09-12T22:04:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015715299999999999 2024-09-12T22:04:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457972+0000", 2024-09-12T22:04:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013179500000000001 2024-09-12T22:04:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462325+0000", 2024-09-12T22:04:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043526859999999997 2024-09-12T22:04:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468180+0000", 2024-09-12T22:04:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058557169999999999 2024-09-12T22:04:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468221+0000", 2024-09-12T22:04:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0673000000000002e-05 2024-09-12T22:04:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468258+0000", 2024-09-12T22:04:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7240999999999998e-05 2024-09-12T22:04:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.114091551000001, 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018748032000000001, 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449779+0000", 2024-09-12T22:04:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4869999999999998e-06 2024-09-12T22:04:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449783+0000", 2024-09-12T22:04:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:04:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449791+0000", 2024-09-12T22:04:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2640000000000002e-06 2024-09-12T22:04:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449796+0000", 2024-09-12T22:04:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9370000000000001e-06 2024-09-12T22:04:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449915+0000", 2024-09-12T22:04:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118559 2024-09-12T22:04:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449920+0000", 2024-09-12T22:04:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.101e-06 2024-09-12T22:04:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458578+0000", 2024-09-12T22:04:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008657662 2024-09-12T22:04:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458978+0000", 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00039977399999999998 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459130+0000", 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000152394 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462793+0000", 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036628770000000001 2024-09-12T22:04:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468451+0000", 2024-09-12T22:04:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056577820000000001 2024-09-12T22:04:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468501+0000", 2024-09-12T22:04:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0609999999999998e-05 2024-09-12T22:04:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468524+0000", 2024-09-12T22:04:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2804000000000001e-05 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.114056849999997, 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018816113999999998, 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-09-12T22:04:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3360000000000001e-06 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449832+0000", 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1528e-05 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-12T22:04:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459429+0000", 2024-09-12T22:04:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095926970000000007 2024-09-12T22:04:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459597+0000", 2024-09-12T22:04:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000168309 2024-09-12T22:04:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459829+0000", 2024-09-12T22:04:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231158 2024-09-12T22:04:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462796+0000", 2024-09-12T22:04:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029673849999999999 2024-09-12T22:04:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468558+0000", 2024-09-12T22:04:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057621449999999998 2024-09-12T22:04:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468592+0000", 2024-09-12T22:04:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4241e-05 2024-09-12T22:04:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468627+0000", 2024-09-12T22:04:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4511999999999998e-05 2024-09-12T22:04:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.113989822000001, 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018845905, 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:04:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449881+0000", 2024-09-12T22:04:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.005e-06 2024-09-12T22:04:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449887+0000", 2024-09-12T22:04:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9050000000000002e-06 2024-09-12T22:04:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449892+0000", 2024-09-12T22:04:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2009999999999998e-06 2024-09-12T22:04:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460279+0000", 2024-09-12T22:04:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010386808000000001 2024-09-12T22:04:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460427+0000", 2024-09-12T22:04:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014789 2024-09-12T22:04:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460572+0000", 2024-09-12T22:04:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014453099999999999 2024-09-12T22:04:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462799+0000", 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002227049 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468672+0000", 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058730060000000001 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468704+0000", 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2421e-05 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468724+0000", 2024-09-12T22:04:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9582e-05 2024-09-12T22:04:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.113885494999998, 2024-09-12T22:04:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018827507, 2024-09-12T22:04:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:04:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2739999999999999e-06 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449999+0000", 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3349e-05 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450005+0000", 2024-09-12T22:04:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.609e-06 2024-09-12T22:04:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461006+0000", 2024-09-12T22:04:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011000876 2024-09-12T22:04:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461236+0000", 2024-09-12T22:04:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000230301 2024-09-12T22:04:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461362+0000", 2024-09-12T22:04:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012541900000000001 2024-09-12T22:04:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464797+0000", 2024-09-12T22:04:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034350840000000001 2024-09-12T22:04:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468754+0000", 2024-09-12T22:04:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039576689999999996 2024-09-12T22:04:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468784+0000", 2024-09-12T22:04:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9558000000000001e-05 2024-09-12T22:04:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468810+0000", 2024-09-12T22:04:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5752e-05 2024-09-12T22:04:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.113853622999997, 2024-09-12T22:04:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018888559999999999, 2024-09-12T22:04:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450015+0000", 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450018+0000", 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3840000000000001e-06 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8859999999999998e-06 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450030+0000", 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4829999999999999e-06 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465718+0000", 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015688163000000001 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465793+0000", 2024-09-12T22:04:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4788000000000003e-05 2024-09-12T22:04:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466015+0000", 2024-09-12T22:04:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000221394 2024-09-12T22:04:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467628+0000", 2024-09-12T22:04:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016131190000000001 2024-09-12T22:04:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468849+0000", 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012211699999999999 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468878+0000", 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8708e-05 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468902+0000", 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868e-05 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:23 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.113830176, 2024-09-12T22:04:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021189669000000001, 2024-09-12T22:04:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450038+0000", 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450042+0000", 2024-09-12T22:04:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7720000000000001e-06 2024-09-12T22:04:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450058+0000", 2024-09-12T22:04:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6379999999999999e-05 2024-09-12T22:04:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450067+0000", 2024-09-12T22:04:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3870000000000001e-06 2024-09-12T22:04:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466409+0000", 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016341418999999999 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466467+0000", 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8613999999999998e-05 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466612+0000", 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014415000000000001 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467856+0000", 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012440039999999999 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471178+0000", 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033227450000000002 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471207+0000", 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8571000000000001e-05 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471227+0000", 2024-09-12T22:04:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0109999999999999e-05 2024-09-12T22:04:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.113789636, 2024-09-12T22:04:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021231197, 2024-09-12T22:04:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450079+0000", 2024-09-12T22:04:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450083+0000", 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1989999999999999e-06 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450092+0000", 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9400000000000008e-06 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450097+0000", 2024-09-12T22:04:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466898+0000", 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016801226999999998 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466975+0000", 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6197000000000002e-05 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467158+0000", 2024-09-12T22:04:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183876 2024-09-12T22:04:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468270+0000", 2024-09-12T22:04:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001111229 2024-09-12T22:04:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471260+0000", 2024-09-12T22:04:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002989907 2024-09-12T22:04:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471289+0000", 2024-09-12T22:04:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9271000000000001e-05 2024-09-12T22:04:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471309+0000", 2024-09-12T22:04:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0302999999999999e-05 2024-09-12T22:04:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.113763034999998, 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018145809999999998, 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450114+0000", 2024-09-12T22:04:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1849999999999993e-06 2024-09-12T22:04:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:04:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1350000000000003e-06 2024-09-12T22:04:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450128+0000", 2024-09-12T22:04:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2040000000000002e-06 2024-09-12T22:04:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454085+0000", 2024-09-12T22:04:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00395736 2024-09-12T22:04:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454090+0000", 2024-09-12T22:04:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.378e-06 2024-09-12T22:04:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457076+0000", 2024-09-12T22:04:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002985747 2024-09-12T22:04:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457178+0000", 2024-09-12T22:04:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010242 2024-09-12T22:04:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457452+0000", 2024-09-12T22:04:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027313000000000001 2024-09-12T22:04:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462024+0000", 2024-09-12T22:04:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045727040000000004 2024-09-12T22:04:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468161+0000", 2024-09-12T22:04:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061372019999999996 2024-09-12T22:04:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468212+0000", 2024-09-12T22:04:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0707000000000001e-05 2024-09-12T22:04:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468250+0000", 2024-09-12T22:04:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8148000000000001e-05 2024-09-12T22:04:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.113075479999999, 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020127506999999999, 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450793+0000", 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2800000000000005e-07 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450813+0000", 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0063000000000001e-05 2024-09-12T22:04:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450847+0000", 2024-09-12T22:04:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3973000000000002e-05 2024-09-12T22:04:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450862+0000", 2024-09-12T22:04:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5358000000000001e-05 2024-09-12T22:04:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454355+0000", 2024-09-12T22:04:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003492841 2024-09-12T22:04:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454359+0000", 2024-09-12T22:04:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-09-12T22:04:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458704+0000", 2024-09-12T22:04:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043452459999999997 2024-09-12T22:04:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459009+0000", 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030526199999999999 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459143+0000", 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013375 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462690+0000", 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035466579999999998 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470863+0000", 2024-09-12T22:04:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0081734089999999995 2024-09-12T22:04:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470898+0000", 2024-09-12T22:04:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4445e-05 2024-09-12T22:04:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470920+0000", 2024-09-12T22:04:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1844e-05 2024-09-12T22:04:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.111545360999997, 2024-09-12T22:04:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018704596, 2024-09-12T22:04:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452323+0000", 2024-09-12T22:04:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:04:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452337+0000", 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452489+0000", 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015167699999999999 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452498+0000", 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9709999999999993e-06 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454393+0000", 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001895171 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454397+0000", 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4470000000000002e-06 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459570+0000", 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051728160000000002 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459718+0000", 2024-09-12T22:04:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014857800000000001 2024-09-12T22:04:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459920+0000", 2024-09-12T22:04:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000202043 2024-09-12T22:04:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462696+0000", 2024-09-12T22:04:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027756299999999999 2024-09-12T22:04:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470963+0000", 2024-09-12T22:04:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082671359999999996 2024-09-12T22:04:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471000+0000", 2024-09-12T22:04:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6748999999999997e-05 2024-09-12T22:04:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471027+0000", 2024-09-12T22:04:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7118e-05 2024-09-12T22:04:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.930569774999999, 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79650 5.1 5:87bbf2de:::benchmark_data_smithi043_32659_object79649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.732384467999999, 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021887977999999999, 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79650 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831484+0000", 2024-09-12T22:04:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:04:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831558+0000", 2024-09-12T22:04:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4556999999999998e-05 2024-09-12T22:04:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831567+0000", 2024-09-12T22:04:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3410000000000003e-06 2024-09-12T22:04:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831574+0000", 2024-09-12T22:04:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2559999999999996e-06 2024-09-12T22:04:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.832773+0000", 2024-09-12T22:04:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001199475 2024-09-12T22:04:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.832890+0000", 2024-09-12T22:04:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116768 2024-09-12T22:04:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.833027+0000", 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000136527 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.837448+0000", 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044212130000000002 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853313+0000", 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015865016999999999 2024-09-12T22:04:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853344+0000", 2024-09-12T22:04:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1010000000000003e-05 2024-09-12T22:04:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853371+0000", 2024-09-12T22:04:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7092000000000001e-05 2024-09-12T22:04:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79651 5.1 5:82b16cba:::benchmark_data_smithi043_32659_object79650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.732060061, 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021652616999999999, 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79651 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831808+0000", 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4099999999999998e-07 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831886+0000", 2024-09-12T22:04:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8184999999999998e-05 2024-09-12T22:04:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831896+0000", 2024-09-12T22:04:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0001e-05 2024-09-12T22:04:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831902+0000", 2024-09-12T22:04:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7960000000000001e-06 2024-09-12T22:04:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835123+0000", 2024-09-12T22:04:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032211660000000001 2024-09-12T22:04:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835281+0000", 2024-09-12T22:04:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015780699999999999 2024-09-12T22:04:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835443+0000", 2024-09-12T22:04:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016203499999999999 2024-09-12T22:04:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.837588+0000", 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021443159999999998 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853402+0000", 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015814528000000001 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853434+0000", 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1955999999999997e-05 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853460+0000", 2024-09-12T22:04:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6086000000000001e-05 2024-09-12T22:04:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79659 5.1 5:881dc852:::benchmark_data_smithi043_32659_object79658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.724186517, 2024-09-12T22:04:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019797940999999999, 2024-09-12T22:04:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79659 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839682+0000", 2024-09-12T22:04:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-12T22:04:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839723+0000", 2024-09-12T22:04:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0611999999999997e-05 2024-09-12T22:04:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839736+0000", 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3285000000000001e-05 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839755+0000", 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8870000000000001e-05 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839792+0000", 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7162000000000001e-05 2024-09-12T22:04:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839876+0000", 2024-09-12T22:04:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4376999999999995e-05 2024-09-12T22:04:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839980+0000", 2024-09-12T22:04:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000103149 2024-09-12T22:04:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.841622+0000", 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001642117 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859420+0000", 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017798538999999999 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859454+0000", 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3315000000000002e-05 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859479+0000", 2024-09-12T22:04:29.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5384999999999998e-05 2024-09-12T22:04:29.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.654 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.654 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79661 5.2 5:4081316a:::benchmark_data_smithi043_32659_object79660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:29.654 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:29.654 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.715513591000001, 2024-09-12T22:04:29.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.025955590000000001, 2024-09-12T22:04:29.654 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.654 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.654 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.654 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.655 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79661 2024-09-12T22:04:29.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.655 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:29.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:29.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848355+0000", 2024-09-12T22:04:29.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3009999999999999e-06 2024-09-12T22:04:29.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848410+0000", 2024-09-12T22:04:29.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639000000000003e-05 2024-09-12T22:04:29.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848426+0000", 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5979000000000001e-05 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848436+0000", 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0227000000000001e-05 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848479+0000", 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2450000000000002e-05 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848574+0000", 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5508999999999996e-05 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848667+0000", 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999997e-05 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.850764+0000", 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020964920000000001 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874250+0000", 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.023486440000000001 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874283+0000", 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2552000000000003e-05 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874310+0000", 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7001000000000001e-05 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79671 5.2 5:46f8404a:::benchmark_data_smithi043_32659_object79670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.710309254, 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021880646, 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79671 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:29.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:29.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853559+0000", 2024-09-12T22:04:29.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.012e-06 2024-09-12T22:04:29.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853609+0000", 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9372000000000001e-05 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853617+0000", 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.055e-06 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853621+0000", 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:04:29.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853659+0000", 2024-09-12T22:04:29.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7981000000000001e-05 2024-09-12T22:04:29.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853750+0000", 2024-09-12T22:04:29.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0797000000000005e-05 2024-09-12T22:04:29.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:29.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853835+0000", 2024-09-12T22:04:29.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4958999999999998e-05 2024-09-12T22:04:29.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.855573+0000", 2024-09-12T22:04:29.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001737854 2024-09-12T22:04:29.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875378+0000", 2024-09-12T22:04:29.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019805146999999999 2024-09-12T22:04:29.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875412+0000", 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3649999999999998e-05 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875439+0000", 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7160000000000001e-05 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:98916 5.5 5:a5cbea4a:::benchmark_data_smithi043_32659_object98915:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.855470+0000", 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.708397911, 2024-09-12T22:04:29.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018007867, 2024-09-12T22:04:29.666 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.666 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.666 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.666 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 98916 2024-09-12T22:04:29.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.666 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855470+0000", 2024-09-12T22:04:29.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855470+0000", 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855470+0000", 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4300000000000003e-07 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855504+0000", 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3834000000000002e-05 2024-09-12T22:04:29.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855511+0000", 2024-09-12T22:04:29.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4170000000000003e-06 2024-09-12T22:04:29.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855517+0000", 2024-09-12T22:04:29.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0039999999999996e-06 2024-09-12T22:04:29.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.857432+0000", 2024-09-12T22:04:29.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001914935 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.857585+0000", 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015281499999999999 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.873343+0000", 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015757693999999999 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.873390+0000", 2024-09-12T22:04:29.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7438999999999998e-05 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.873478+0000", 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7186000000000002e-05 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:99251 5.f 5:fe217d2d:::benchmark_data_smithi043_32659_object99250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.980015+0000", 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.583852185, 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019280414999999999, 2024-09-12T22:04:29.670 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 99251 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.980015+0000", 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.980015+0000", 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.980016+0000", 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3200000000000004e-07 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.980107+0000", 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1305999999999996e-05 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.980126+0000", 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8141000000000001e-05 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.980133+0000", 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3000000000000004e-06 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.986715+0000", 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065826239999999996 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.986825+0000", 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110011 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.986950+0000", 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124344 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.989683+0000", 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027328470000000001 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.999211+0000", 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095286810000000007 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.999260+0000", 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8331999999999997e-05 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.999296+0000", 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6096999999999997e-05 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.675 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.676 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:99266 5.f 5:f6f96762:::benchmark_data_smithi043_32659_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:29.676 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.985521+0000", 2024-09-12T22:04:29.676 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.5783467309999999, 2024-09-12T22:04:29.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018059446999999999, 2024-09-12T22:04:29.676 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:29.676 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:29.676 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:29.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:29.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:29.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.676 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 99266 2024-09-12T22:04:29.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.677 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:29.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:29.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.985521+0000", 2024-09-12T22:04:29.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:29.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.985521+0000", 2024-09-12T22:04:29.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:29.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:29.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.985522+0000", 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4600000000000003e-07 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.985575+0000", 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3659000000000002e-05 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.985586+0000", 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0321e-05 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.985592+0000", 2024-09-12T22:04:29.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.584e-06 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.991911+0000", 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063190099999999999 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.992071+0000", 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015939900000000001 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.992217+0000", 2024-09-12T22:04:29.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000146384 2024-09-12T22:04:29.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:29.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.996882+0000", 2024-09-12T22:04:29.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046648439999999996 2024-09-12T22:04:29.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:29.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:26.003476+0000", 2024-09-12T22:04:29.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065942079999999998 2024-09-12T22:04:29.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:29.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:26.003521+0000", 2024-09-12T22:04:29.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5024000000000001e-05 2024-09-12T22:04:29.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:29.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:29.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:29.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:26.003580+0000", 2024-09-12T22:04:29.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9168e-05 2024-09-12T22:04:29.681 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.681 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.681 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.681 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:29.681 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:29.681 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:29.683 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:29.683 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:29.681+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:29.784 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:29.783+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:29.837 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:29.837 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:29.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.837 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:110197 5.0 5:069d4539:::benchmark_data_smithi043_32659_object110196:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.837 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:29.826980+0000", 2024-09-12T22:04:29.838 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0085720120000000004, 2024-09-12T22:04:29.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0085987600000000004, 2024-09-12T22:04:29.838 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:29.838 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:29.838 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:29.838 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:29.838 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:29.838 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.838 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 110197 2024-09-12T22:04:29.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.838 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:29.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:29.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.826980+0000", 2024-09-12T22:04:29.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.839 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:29.839 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.826980+0000", 2024-09-12T22:04:29.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.839 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:29.839 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.826981+0000", 2024-09-12T22:04:29.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.032e-06 2024-09-12T22:04:29.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.839 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:29.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.827049+0000", 2024-09-12T22:04:29.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7885999999999993e-05 2024-09-12T22:04:29.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:29.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.827065+0000", 2024-09-12T22:04:29.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6127999999999999e-05 2024-09-12T22:04:29.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.827074+0000", 2024-09-12T22:04:29.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7329999999999998e-06 2024-09-12T22:04:29.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:29.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828286+0000", 2024-09-12T22:04:29.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001211104 2024-09-12T22:04:29.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:29.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828401+0000", 2024-09-12T22:04:29.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115185 2024-09-12T22:04:29.841 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.841 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:29.841 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.841 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:110200 5.8 5:1aa5636a:::benchmark_data_smithi043_32659_object110199:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:29.827851+0000", 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0077004839999999996, 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0078000889999999996, 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 110200 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:29.842 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.827851+0000", 2024-09-12T22:04:29.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:29.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.827851+0000", 2024-09-12T22:04:29.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:29.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.827852+0000", 2024-09-12T22:04:29.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:04:29.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:29.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.827921+0000", 2024-09-12T22:04:29.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9245000000000005e-05 2024-09-12T22:04:29.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:29.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.827930+0000", 2024-09-12T22:04:29.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6500000000000002e-06 2024-09-12T22:04:29.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.827936+0000", 2024-09-12T22:04:29.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2400000000000004e-06 2024-09-12T22:04:29.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:29.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828259+0000", 2024-09-12T22:04:29.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00032338499999999998 2024-09-12T22:04:29.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:29.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828337+0000", 2024-09-12T22:04:29.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7176999999999996e-05 2024-09-12T22:04:29.845 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.845 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:29.845 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.846 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:110202 5.0 5:0c52ac1a:::benchmark_data_smithi043_32659_object110201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.846 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:29.828091+0000", 2024-09-12T22:04:29.846 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0074604060000000002, 2024-09-12T22:04:29.846 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0076275220000000003, 2024-09-12T22:04:29.846 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:29.846 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:29.846 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:29.846 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:29.846 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:29.846 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.846 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 110202 2024-09-12T22:04:29.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.846 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:29.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828091+0000", 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828091+0000", 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828092+0000", 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3900000000000004e-07 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828130+0000", 2024-09-12T22:04:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7775999999999999e-05 2024-09-12T22:04:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828137+0000", 2024-09-12T22:04:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.464e-06 2024-09-12T22:04:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828142+0000", 2024-09-12T22:04:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1970000000000004e-06 2024-09-12T22:04:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.830686+0000", 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002543675 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.830811+0000", 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012475799999999999 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.849 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:110203 5.0 5:04911f3e:::benchmark_data_smithi043_32659_object110202:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.850 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:29.828152+0000", 2024-09-12T22:04:29.850 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0073995859999999997, 2024-09-12T22:04:29.850 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.007631774, 2024-09-12T22:04:29.850 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:29.850 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:29.850 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:29.850 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:29.850 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:29.850 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.850 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 110203 2024-09-12T22:04:29.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.850 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:29.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828152+0000", 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828152+0000", 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828153+0000", 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-07 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:29.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828187+0000", 2024-09-12T22:04:29.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4567999999999998e-05 2024-09-12T22:04:29.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:29.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828195+0000", 2024-09-12T22:04:29.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3810000000000001e-06 2024-09-12T22:04:29.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.828206+0000", 2024-09-12T22:04:29.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1849e-05 2024-09-12T22:04:29.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.832916+0000", 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047097950000000001 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833065+0000", 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014855599999999999 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.853 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:110206 5.0 5:030507cf:::benchmark_data_smithi043_32659_object110205:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.854 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:29.829805+0000", 2024-09-12T22:04:29.854 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0057470419999999999, 2024-09-12T22:04:29.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.006049708, 2024-09-12T22:04:29.854 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:29.854 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:29.854 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:29.854 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:29.854 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:29.854 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.854 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 110206 2024-09-12T22:04:29.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.854 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:29.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.854 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.829805+0000", 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.829805+0000", 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.829806+0000", 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0999999999999997e-07 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:29.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.829837+0000", 2024-09-12T22:04:29.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0969000000000001e-05 2024-09-12T22:04:29.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:29.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.829847+0000", 2024-09-12T22:04:29.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0974e-05 2024-09-12T22:04:29.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.829855+0000", 2024-09-12T22:04:29.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:04:29.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:29.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.834768+0000", 2024-09-12T22:04:29.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049129610000000004 2024-09-12T22:04:29.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:29.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.834904+0000", 2024-09-12T22:04:29.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013587199999999999 2024-09-12T22:04:29.857 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.857 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:29.857 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:110213 5.8 5:11edc3a5:::benchmark_data_smithi043_32659_object110212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:29.831208+0000", 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0043439869999999997, 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047103220000000003, 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 110213 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.858 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831208+0000", 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831208+0000", 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831208+0000", 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:29.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831263+0000", 2024-09-12T22:04:29.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4814000000000001e-05 2024-09-12T22:04:29.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:29.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831271+0000", 2024-09-12T22:04:29.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1240000000000005e-06 2024-09-12T22:04:29.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831276+0000", 2024-09-12T22:04:29.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6009999999999997e-06 2024-09-12T22:04:29.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.834752+0000", 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034758699999999998 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.834892+0000", 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014024900000000001 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:110215 5.8 5.b4c60818 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.861 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:29.831762+0000", 2024-09-12T22:04:29.862 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0037893010000000001, 2024-09-12T22:04:29.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004213568, 2024-09-12T22:04:29.862 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:29.862 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:29.862 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:29.862 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:29.862 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:29.862 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.862 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 110215 2024-09-12T22:04:29.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.862 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:29.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.862 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:29.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831762+0000", 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831762+0000", 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831763+0000", 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2200000000000004e-07 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:29.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831794+0000", 2024-09-12T22:04:29.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0701999999999998e-05 2024-09-12T22:04:29.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:29.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831801+0000", 2024-09-12T22:04:29.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4680000000000003e-06 2024-09-12T22:04:29.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831807+0000", 2024-09-12T22:04:29.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9039999999999997e-06 2024-09-12T22:04:29.864 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.864 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:29.864 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.865 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:110208 5.f e37/22 5:ffb7bd36:::benchmark_data_smithi043_32659_object110207:head v 37'6912, mlcod=37'6909)", 2024-09-12T22:04:29.865 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:29.831986+0000", 2024-09-12T22:04:29.865 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0035655470000000001, 2024-09-12T22:04:29.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040416610000000002, 2024-09-12T22:04:29.865 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:29.865 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:29.865 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:29.865 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:29.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.865 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:29.865 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831986+0000", 2024-09-12T22:04:29.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:29.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831986+0000", 2024-09-12T22:04:29.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:29.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.831987+0000", 2024-09-12T22:04:29.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:04:29.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:29.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.832051+0000", 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4659999999999994e-05 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.832059+0000", 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7200000000000006e-06 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.832064+0000", 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:29.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.832109+0000", 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.405e-05 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.832125+0000", 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6847e-05 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:110219 5.0 5.f20d2ba0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:29.833318+0000", 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0022339370000000001, 2024-09-12T22:04:29.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027615679999999998, 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 110219 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833318+0000", 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:29.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833318+0000", 2024-09-12T22:04:29.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:29.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833319+0000", 2024-09-12T22:04:29.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0500000000000002e-07 2024-09-12T22:04:29.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:29.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833389+0000", 2024-09-12T22:04:29.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0605000000000006e-05 2024-09-12T22:04:29.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833400+0000", 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0766e-05 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833407+0000", 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3579999999999997e-06 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:110217 5.f e37/22 5:f98ff594:::benchmark_data_smithi043_32659_object110216:head v 37'6913, mlcod=37'6909)", 2024-09-12T22:04:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:29.833712+0000", 2024-09-12T22:04:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0018399709999999999, 2024-09-12T22:04:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024170989999999998, 2024-09-12T22:04:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833712+0000", 2024-09-12T22:04:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833712+0000", 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833712+0000", 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833771+0000", 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8489000000000002e-05 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:29.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833778+0000", 2024-09-12T22:04:29.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:04:29.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833783+0000", 2024-09-12T22:04:29.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1970000000000004e-06 2024-09-12T22:04:29.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:29.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833817+0000", 2024-09-12T22:04:29.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3714000000000003e-05 2024-09-12T22:04:29.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:29.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.833837+0000", 2024-09-12T22:04:29.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0205999999999999e-05 2024-09-12T22:04:29.875 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.875 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:29.875 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.875 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:110218 5.f e37/22 5:f152ecad:::benchmark_data_smithi043_32659_object110217:head v 37'6914, mlcod=37'6909)", 2024-09-12T22:04:29.875 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:29.835055+0000", 2024-09-12T22:04:29.875 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000496391, 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011252289999999999, 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835055+0000", 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835055+0000", 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:29.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835056+0000", 2024-09-12T22:04:29.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:29.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:29.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835118+0000", 2024-09-12T22:04:29.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1623000000000003e-05 2024-09-12T22:04:29.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:29.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835128+0000", 2024-09-12T22:04:29.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0414000000000001e-05 2024-09-12T22:04:29.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835134+0000", 2024-09-12T22:04:29.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8329999999999999e-06 2024-09-12T22:04:29.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:29.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835193+0000", 2024-09-12T22:04:29.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9231000000000003e-05 2024-09-12T22:04:29.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:29.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835214+0000", 2024-09-12T22:04:29.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0775e-05 2024-09-12T22:04:29.879 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.879 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:29.879 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.879 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:110222 5.e 5:799f143c:::benchmark_data_smithi043_32659_object110221:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.879 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:29.835456+0000", 2024-09-12T22:04:29.879 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.5202000000000001e-05, 2024-09-12T22:04:29.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077972899999999995, 2024-09-12T22:04:29.879 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:29.879 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:29.879 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:29.879 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:29.880 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:29.880 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.880 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 110222 2024-09-12T22:04:29.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.880 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:29.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:29.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835456+0000", 2024-09-12T22:04:29.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:29.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835456+0000", 2024-09-12T22:04:29.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835458+0000", 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2839999999999999e-06 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835495+0000", 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7081e-05 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835507+0000", 2024-09-12T22:04:29.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2374e-05 2024-09-12T22:04:29.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835514+0000", 2024-09-12T22:04:29.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0910000000000004e-06 2024-09-12T22:04:29.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:29.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835563+0000", 2024-09-12T22:04:29.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.888e-05 2024-09-12T22:04:29.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:29.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.835683+0000", 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119972 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:110224 5.a 5.ae959d3a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:29.836136+0000", 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9994154, 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000161113, 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:29.883 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:29.884 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:29.884 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 110224 2024-09-12T22:04:29.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.884 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:29.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:29.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.836136+0000", 2024-09-12T22:04:29.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:29.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.836136+0000", 2024-09-12T22:04:29.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.836137+0000", 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3200000000000004e-07 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.836201+0000", 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4200000000000002e-05 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.836211+0000", 2024-09-12T22:04:29.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0149999999999999e-05 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.836219+0000", 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2509999999999994e-06 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:29.836285+0000", 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5915999999999997e-05 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:29.886 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:29.887 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 13 2024-09-12T22:04:29.887 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:29.888 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:29.889 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:29.886+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:29.989 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:29.988+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:30.077 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:30.078 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:30.078 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:30.078 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:30.078 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:30.090 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:30.089+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:30.091 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:30.191 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:30.190+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:30.192 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 36 16 111255 111239 193.107 179.562 0.00406487 0.00517597 2024-09-12T22:04:30.272 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44102 5.0 5:0d5aa1ff:::benchmark_data_smithi043_32659_object44101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.644318986999998, 2024-09-12T22:04:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051636015, 2024-09-12T22:04:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44102 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624875+0000", 2024-09-12T22:04:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:04:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624930+0000", 2024-09-12T22:04:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5256000000000001e-05 2024-09-12T22:04:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624951+0000", 2024-09-12T22:04:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0551999999999999e-05 2024-09-12T22:04:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624958+0000", 2024-09-12T22:04:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1849999999999998e-06 2024-09-12T22:04:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629885+0000", 2024-09-12T22:04:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049266120000000004 2024-09-12T22:04:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629999+0000", 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011385 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630125+0000", 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012640500000000001 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633338+0000", 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032135559999999998 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676425+0000", 2024-09-12T22:04:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043086753999999998 2024-09-12T22:04:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676472+0000", 2024-09-12T22:04:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6971999999999997e-05 2024-09-12T22:04:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676510+0000", 2024-09-12T22:04:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8096999999999998e-05 2024-09-12T22:04:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44103 5.8 5:170742c6:::benchmark_data_smithi043_32659_object44102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.644195836000002, 2024-09-12T22:04:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051500936999999997, 2024-09-12T22:04:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44103 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624998+0000", 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625061+0000", 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2667000000000002e-05 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625069+0000", 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999993e-06 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625077+0000", 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0090000000000007e-06 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629869+0000", 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047921769999999999 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629938+0000", 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9542000000000006e-05 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630010+0000", 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1795e-05 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676348+0000", 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.046337830000000003 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676399+0000", 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1150000000000003e-05 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676460+0000", 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1142999999999994e-05 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676498+0000", 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8111000000000002e-05 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.642897411, 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44115 5.0 5:0ee09c30:::benchmark_data_smithi043_32659_object44114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.640124734, 2024-09-12T22:04:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082887358999999994, 2024-09-12T22:04:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44115 2024-09-12T22:04:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629070+0000", 2024-09-12T22:04:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1209999999999999e-06 2024-09-12T22:04:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629132+0000", 2024-09-12T22:04:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2557000000000004e-05 2024-09-12T22:04:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629147+0000", 2024-09-12T22:04:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4491999999999999e-05 2024-09-12T22:04:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629156+0000", 2024-09-12T22:04:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7089999999999997e-06 2024-09-12T22:04:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631865+0000", 2024-09-12T22:04:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00270835 2024-09-12T22:04:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631932+0000", 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7322000000000004e-05 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632095+0000", 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016314699999999999 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676360+0000", 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044264756000000002 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711854+0000", 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.03549389 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711919+0000", 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5024000000000006e-05 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711956+0000", 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6990999999999999e-05 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44117 5.8 5:1ecb02e0:::benchmark_data_smithi043_32659_object44116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.639979914000001, 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082354986000000005, 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44117 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629214+0000", 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629315+0000", 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010045800000000001 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629328+0000", 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3016e-05 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629336+0000", 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7229999999999993e-06 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631856+0000", 2024-09-12T22:04:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025199300000000001 2024-09-12T22:04:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631954+0000", 2024-09-12T22:04:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7565999999999994e-05 2024-09-12T22:04:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632073+0000", 2024-09-12T22:04:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119677 2024-09-12T22:04:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676523+0000", 2024-09-12T22:04:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044449163 2024-09-12T22:04:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676612+0000", 2024-09-12T22:04:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9579000000000004e-05 2024-09-12T22:04:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711509+0000", 2024-09-12T22:04:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.034897125000000001 2024-09-12T22:04:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711568+0000", 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8996999999999998e-05 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44120 5.b 5:df1f2c5f:::benchmark_data_smithi043_32659_object44119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.637804252999999, 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043861974999999997, 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44120 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631390+0000", 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631444+0000", 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631452+0000", 2024-09-12T22:04:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4610000000000008e-06 2024-09-12T22:04:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631458+0000", 2024-09-12T22:04:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:04:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631509+0000", 2024-09-12T22:04:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1442e-05 2024-09-12T22:04:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631627+0000", 2024-09-12T22:04:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011796800000000001 2024-09-12T22:04:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631814+0000", 2024-09-12T22:04:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018735400000000001 2024-09-12T22:04:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674612+0000", 2024-09-12T22:04:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042797287000000003 2024-09-12T22:04:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675160+0000", 2024-09-12T22:04:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000548187 2024-09-12T22:04:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675207+0000", 2024-09-12T22:04:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6833999999999999e-05 2024-09-12T22:04:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675251+0000", 2024-09-12T22:04:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4348000000000003e-05 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.637496470999999, 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44122 5.d 5:bfd04815:::benchmark_data_smithi043_32659_object44121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.637398419, 2024-09-12T22:04:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.080166395000000001, 2024-09-12T22:04:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44122 2024-09-12T22:04:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631853+0000", 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7209000000000001e-05 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631858+0000", 2024-09-12T22:04:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:04:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631862+0000", 2024-09-12T22:04:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.692e-06 2024-09-12T22:04:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631905+0000", 2024-09-12T22:04:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3135e-05 2024-09-12T22:04:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632032+0000", 2024-09-12T22:04:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012740900000000001 2024-09-12T22:04:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632166+0000", 2024-09-12T22:04:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013318800000000001 2024-09-12T22:04:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674894+0000", 2024-09-12T22:04:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042728690999999999 2024-09-12T22:04:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711875+0000", 2024-09-12T22:04:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036980631 2024-09-12T22:04:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711923+0000", 2024-09-12T22:04:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8180000000000003e-05 2024-09-12T22:04:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711961+0000", 2024-09-12T22:04:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8142000000000002e-05 2024-09-12T22:04:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44123 5.e 5:7d83ca89:::benchmark_data_smithi043_32659_object44122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.637266651000001, 2024-09-12T22:04:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043329329, 2024-09-12T22:04:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44123 2024-09-12T22:04:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631928+0000", 2024-09-12T22:04:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2699999999999998e-07 2024-09-12T22:04:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631996+0000", 2024-09-12T22:04:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8141999999999999e-05 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632004+0000", 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7600000000000008e-06 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632010+0000", 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632069+0000", 2024-09-12T22:04:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8260000000000001e-05 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632226+0000", 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015702199999999999 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632337+0000", 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111069 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674909+0000", 2024-09-12T22:04:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042571854999999999 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675184+0000", 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027561399999999998 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675222+0000", 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7710999999999999e-05 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675256+0000", 2024-09-12T22:04:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4014000000000003e-05 2024-09-12T22:04:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.636555204, 2024-09-12T22:04:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44098 5.0 e28/22 ondisk, result = 0)", 2024-09-12T22:04:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.636164389000001, 2024-09-12T22:04:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043332180999999997, 2024-09-12T22:04:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633030+0000", 2024-09-12T22:04:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633035+0000", 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633043+0000", 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633048+0000", 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5439999999999998e-06 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633362+0000", 2024-09-12T22:04:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031397400000000001 2024-09-12T22:04:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633369+0000", 2024-09-12T22:04:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:04:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676361+0000", 2024-09-12T22:04:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042991954999999998 2024-09-12T22:04:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.635557284000001, 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:44125 5.9 e28/22 5:9022696f:::benchmark_data_smithi043_32659_object44124:head v 28'2753, mlcod=28'2751)", 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.635518419, 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042744011999999998, 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633676+0000", 2024-09-12T22:04:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.44e-07 2024-09-12T22:04:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633755+0000", 2024-09-12T22:04:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9629000000000006e-05 2024-09-12T22:04:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674386+0000", 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631364000000003 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674399+0000", 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2047e-05 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674453+0000", 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4453999999999997e-05 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674479+0000", 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6064999999999999e-05 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676381+0000", 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001901874 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676419+0000", 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7935000000000002e-05 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44103 5.8 e28/22 ondisk, result = 0)", 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.635012451000001, 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042322950999999998, 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:04:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634184+0000", 2024-09-12T22:04:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7690000000000001e-06 2024-09-12T22:04:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674407+0000", 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040222750000000002 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674417+0000", 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0125e-05 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676387+0000", 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001970112 2024-09-12T22:04:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676394+0000", 2024-09-12T22:04:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:04:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676504+0000", 2024-09-12T22:04:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109621 2024-09-12T22:04:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44128 5.d 5:b9a92891:::benchmark_data_smithi043_32659_object44127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.594759662000001, 2024-09-12T22:04:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040118138999999997, 2024-09-12T22:04:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44128 2024-09-12T22:04:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674435+0000", 2024-09-12T22:04:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5960000000000001e-06 2024-09-12T22:04:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674485+0000", 2024-09-12T22:04:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0021000000000001e-05 2024-09-12T22:04:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674495+0000", 2024-09-12T22:04:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5189999999999998e-06 2024-09-12T22:04:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674500+0000", 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674923+0000", 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000423304 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675027+0000", 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103399 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675141+0000", 2024-09-12T22:04:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114274 2024-09-12T22:04:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711649+0000", 2024-09-12T22:04:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036508011999999999 2024-09-12T22:04:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714466+0000", 2024-09-12T22:04:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028167370000000001 2024-09-12T22:04:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714508+0000", 2024-09-12T22:04:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2679000000000003e-05 2024-09-12T22:04:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714552+0000", 2024-09-12T22:04:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3528000000000001e-05 2024-09-12T22:04:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44129 5.0 5:0f626cda:::benchmark_data_smithi043_32659_object44128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.594684157, 2024-09-12T22:04:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042846404999999997, 2024-09-12T22:04:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44129 2024-09-12T22:04:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674510+0000", 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1600000000000002e-07 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674548+0000", 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8075999999999999e-05 2024-09-12T22:04:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674689+0000", 2024-09-12T22:04:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014141499999999999 2024-09-12T22:04:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674696+0000", 2024-09-12T22:04:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4619999999999999e-06 2024-09-12T22:04:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713666+0000", 2024-09-12T22:04:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.038969072 2024-09-12T22:04:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713752+0000", 2024-09-12T22:04:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6768999999999995e-05 2024-09-12T22:04:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713835+0000", 2024-09-12T22:04:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2774000000000004e-05 2024-09-12T22:04:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717212+0000", 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033769389999999998 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717259+0000", 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7218000000000001e-05 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717310+0000", 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1156999999999998e-05 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717356+0000", 2024-09-12T22:04:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5107e-05 2024-09-12T22:04:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44130 5.4 5:27857918:::benchmark_data_smithi043_32659_object44129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.594486303, 2024-09-12T22:04:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039844412000000003, 2024-09-12T22:04:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44130 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674708+0000", 2024-09-12T22:04:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4300000000000003e-07 2024-09-12T22:04:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674749+0000", 2024-09-12T22:04:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1254999999999997e-05 2024-09-12T22:04:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674756+0000", 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3289999999999996e-06 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674762+0000", 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.852e-06 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9573999999999995e-05 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674954+0000", 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012254200000000001 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675033+0000", 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8707000000000004e-05 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714381+0000", 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039348053000000001 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714477+0000", 2024-09-12T22:04:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5650999999999996e-05 2024-09-12T22:04:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714516+0000", 2024-09-12T22:04:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9158e-05 2024-09-12T22:04:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714551+0000", 2024-09-12T22:04:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5648000000000002e-05 2024-09-12T22:04:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44131 5.0 5:013256f7:::benchmark_data_smithi043_32659_object44130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.594413836000001, 2024-09-12T22:04:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043388599, 2024-09-12T22:04:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44131 2024-09-12T22:04:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674780+0000", 2024-09-12T22:04:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674817+0000", 2024-09-12T22:04:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6859000000000001e-05 2024-09-12T22:04:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.501e-05 2024-09-12T22:04:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674838+0000", 2024-09-12T22:04:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-06 2024-09-12T22:04:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715161+0000", 2024-09-12T22:04:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.04032285 2024-09-12T22:04:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715317+0000", 2024-09-12T22:04:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015649199999999999 2024-09-12T22:04:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715463+0000", 2024-09-12T22:04:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145704 2024-09-12T22:04:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717480+0000", 2024-09-12T22:04:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020168220000000001 2024-09-12T22:04:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718079+0000", 2024-09-12T22:04:30.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000599115 2024-09-12T22:04:30.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718134+0000", 2024-09-12T22:04:30.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:04:30.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718168+0000", 2024-09-12T22:04:30.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4301000000000002e-05 2024-09-12T22:04:30.372 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.372 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44132 5.e 5:7634b859:::benchmark_data_smithi043_32659_object44131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.593746595999999, 2024-09-12T22:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039558587999999999, 2024-09-12T22:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44132 2024-09-12T22:04:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675448+0000", 2024-09-12T22:04:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3699999999999999e-07 2024-09-12T22:04:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675552+0000", 2024-09-12T22:04:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104294 2024-09-12T22:04:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675562+0000", 2024-09-12T22:04:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9629999999999993e-06 2024-09-12T22:04:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675569+0000", 2024-09-12T22:04:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8809999999999998e-06 2024-09-12T22:04:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675612+0000", 2024-09-12T22:04:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591000000000003e-05 2024-09-12T22:04:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675717+0000", 2024-09-12T22:04:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010497099999999999 2024-09-12T22:04:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675835+0000", 2024-09-12T22:04:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011793799999999999 2024-09-12T22:04:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713616+0000", 2024-09-12T22:04:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037781032999999999 2024-09-12T22:04:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714911+0000", 2024-09-12T22:04:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001294604 2024-09-12T22:04:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714964+0000", 2024-09-12T22:04:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3408000000000001e-05 2024-09-12T22:04:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715005+0000", 2024-09-12T22:04:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0967999999999998e-05 2024-09-12T22:04:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44133 5.b 5:d0a59edd:::benchmark_data_smithi043_32659_object44132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.593608816, 2024-09-12T22:04:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039513020000000003, 2024-09-12T22:04:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44133 2024-09-12T22:04:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675585+0000", 2024-09-12T22:04:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5499999999999998e-07 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675634+0000", 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8520999999999998e-05 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675641+0000", 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4440000000000002e-06 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675646+0000", 2024-09-12T22:04:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2660000000000001e-06 2024-09-12T22:04:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675692+0000", 2024-09-12T22:04:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5915999999999999e-05 2024-09-12T22:04:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675812+0000", 2024-09-12T22:04:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119419 2024-09-12T22:04:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675950+0000", 2024-09-12T22:04:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013831499999999999 2024-09-12T22:04:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713574+0000", 2024-09-12T22:04:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037623801999999998 2024-09-12T22:04:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715015+0000", 2024-09-12T22:04:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014410720000000001 2024-09-12T22:04:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715059+0000", 2024-09-12T22:04:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:04:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715097+0000", 2024-09-12T22:04:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8519000000000002e-05 2024-09-12T22:04:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:30.384 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:30.386 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:30.386 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:30.384+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:30.402 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:04:30.486 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:30.485+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:30.540 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:112182 5.6 5:68802682:::benchmark_data_smithi043_32659_object112181:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:30.533783+0000", 2024-09-12T22:04:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0045272300000000001, 2024-09-12T22:04:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045551059999999997, 2024-09-12T22:04:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112182 2024-09-12T22:04:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.533783+0000", 2024-09-12T22:04:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.533783+0000", 2024-09-12T22:04:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.533784+0000", 2024-09-12T22:04:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0999999999999997e-07 2024-09-12T22:04:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.533816+0000", 2024-09-12T22:04:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2267000000000001e-05 2024-09-12T22:04:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.533826+0000", 2024-09-12T22:04:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2890000000000003e-06 2024-09-12T22:04:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.533833+0000", 2024-09-12T22:04:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4209999999999998e-06 2024-09-12T22:04:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.538028+0000", 2024-09-12T22:04:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041945710000000002 2024-09-12T22:04:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.538174+0000", 2024-09-12T22:04:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014647 2024-09-12T22:04:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:112183 5.1 5:833cd484:::benchmark_data_smithi043_32659_object112182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:30.534324+0000", 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0039859780000000003, 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040830320000000003, 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112183 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534324+0000", 2024-09-12T22:04:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534324+0000", 2024-09-12T22:04:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534325+0000", 2024-09-12T22:04:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3399999999999998e-07 2024-09-12T22:04:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534412+0000", 2024-09-12T22:04:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6729000000000003e-05 2024-09-12T22:04:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534421+0000", 2024-09-12T22:04:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0489999999999993e-06 2024-09-12T22:04:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534428+0000", 2024-09-12T22:04:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0929999999999997e-06 2024-09-12T22:04:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535769+0000", 2024-09-12T22:04:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001340693 2024-09-12T22:04:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535883+0000", 2024-09-12T22:04:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113954 2024-09-12T22:04:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:112185 5.6 5.261865d6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:30.534714+0000", 2024-09-12T22:04:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0035960240000000002, 2024-09-12T22:04:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037518209999999998, 2024-09-12T22:04:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112185 2024-09-12T22:04:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534714+0000", 2024-09-12T22:04:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534714+0000", 2024-09-12T22:04:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534715+0000", 2024-09-12T22:04:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4399999999999999e-07 2024-09-12T22:04:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534764+0000", 2024-09-12T22:04:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8819999999999997e-05 2024-09-12T22:04:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534773+0000", 2024-09-12T22:04:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0010000000000007e-06 2024-09-12T22:04:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534779+0000", 2024-09-12T22:04:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1700000000000002e-06 2024-09-12T22:04:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:112186 5.2 5:4b739b81:::benchmark_data_smithi043_32659_object112185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:30.534985+0000", 2024-09-12T22:04:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0033254510000000001, 2024-09-12T22:04:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035332459999999999, 2024-09-12T22:04:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112186 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534985+0000", 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534985+0000", 2024-09-12T22:04:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534986+0000", 2024-09-12T22:04:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3900000000000004e-07 2024-09-12T22:04:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535062+0000", 2024-09-12T22:04:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6216000000000003e-05 2024-09-12T22:04:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535072+0000", 2024-09-12T22:04:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0412e-05 2024-09-12T22:04:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535078+0000", 2024-09-12T22:04:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9100000000000002e-06 2024-09-12T22:04:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535735+0000", 2024-09-12T22:04:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000657184 2024-09-12T22:04:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535845+0000", 2024-09-12T22:04:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110067 2024-09-12T22:04:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:112188 5.6 5.92ac5286 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:30.535126+0000", 2024-09-12T22:04:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0031842020000000001, 2024-09-12T22:04:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003452395, 2024-09-12T22:04:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112188 2024-09-12T22:04:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535126+0000", 2024-09-12T22:04:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535126+0000", 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535127+0000", 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8899999999999999e-07 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535207+0000", 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0041000000000002e-05 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535216+0000", 2024-09-12T22:04:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8300000000000002e-06 2024-09-12T22:04:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535221+0000", 2024-09-12T22:04:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6409999999999999e-06 2024-09-12T22:04:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:112189 5.1 5:8ea3b00c:::benchmark_data_smithi043_32659_object112188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:30.535230+0000", 2024-09-12T22:04:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.003080541, 2024-09-12T22:04:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034005229999999999, 2024-09-12T22:04:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112189 2024-09-12T22:04:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535230+0000", 2024-09-12T22:04:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535230+0000", 2024-09-12T22:04:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535230+0000", 2024-09-12T22:04:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9399999999999995e-07 2024-09-12T22:04:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535260+0000", 2024-09-12T22:04:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9462e-05 2024-09-12T22:04:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535268+0000", 2024-09-12T22:04:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8909999999999995e-06 2024-09-12T22:04:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535272+0000", 2024-09-12T22:04:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7369999999999997e-06 2024-09-12T22:04:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.537734+0000", 2024-09-12T22:04:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024617950000000001 2024-09-12T22:04:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.537835+0000", 2024-09-12T22:04:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107699999999999 2024-09-12T22:04:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:112190 5.5 5:ae345f9f:::benchmark_data_smithi043_32659_object112189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:30.535313+0000", 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.002997347, 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003378448, 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112190 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535313+0000", 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535313+0000", 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535313+0000", 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8100000000000003e-07 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535386+0000", 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2410000000000006e-05 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535394+0000", 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0970000000000006e-06 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535399+0000", 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9409999999999998e-06 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535439+0000", 2024-09-12T22:04:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0201999999999999e-05 2024-09-12T22:04:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.535579+0000", 2024-09-12T22:04:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014006899999999999 2024-09-12T22:04:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:112191 5.2 5:49d9108c:::benchmark_data_smithi043_32659_object112190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:30.536426+0000", 2024-09-12T22:04:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0018842900000000001, 2024-09-12T22:04:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023284870000000002, 2024-09-12T22:04:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112191 2024-09-12T22:04:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.536426+0000", 2024-09-12T22:04:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.536426+0000", 2024-09-12T22:04:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.536427+0000", 2024-09-12T22:04:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-12T22:04:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.536453+0000", 2024-09-12T22:04:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5627999999999999e-05 2024-09-12T22:04:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.536463+0000", 2024-09-12T22:04:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0674e-05 2024-09-12T22:04:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.536470+0000", 2024-09-12T22:04:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7150000000000001e-06 2024-09-12T22:04:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.537730+0000", 2024-09-12T22:04:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012602900000000001 2024-09-12T22:04:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.537880+0000", 2024-09-12T22:04:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015012200000000001 2024-09-12T22:04:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:112194 5.3 5:c7db768f:::benchmark_data_smithi043_32659_object112193:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:30.537769+0000", 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000541184, 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001046342, 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112194 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.537769+0000", 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.537769+0000", 2024-09-12T22:04:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.537770+0000", 2024-09-12T22:04:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.229e-06 2024-09-12T22:04:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.537834+0000", 2024-09-12T22:04:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3853e-05 2024-09-12T22:04:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.537843+0000", 2024-09-12T22:04:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5180000000000004e-06 2024-09-12T22:04:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.537850+0000", 2024-09-12T22:04:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.888e-06 2024-09-12T22:04:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.537910+0000", 2024-09-12T22:04:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0482000000000001e-05 2024-09-12T22:04:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.538026+0000", 2024-09-12T22:04:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115988 2024-09-12T22:04:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:112167 5.6 5:6fc4dd4f:::benchmark_data_smithi043_32659_object112166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:30.529590+0000", 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0087206769999999996, 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0092877649999999999, 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112167 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.529590+0000", 2024-09-12T22:04:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.529590+0000", 2024-09-12T22:04:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.529590+0000", 2024-09-12T22:04:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999998e-07 2024-09-12T22:04:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.529656+0000", 2024-09-12T22:04:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5538999999999997e-05 2024-09-12T22:04:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.529664+0000", 2024-09-12T22:04:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9459999999999998e-06 2024-09-12T22:04:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.529668+0000", 2024-09-12T22:04:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5959999999999997e-06 2024-09-12T22:04:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530486+0000", 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081807500000000003 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530609+0000", 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012274900000000001 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:112172 5.6 5:6442b961:::benchmark_data_smithi043_32659_object112171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:30.530381+0000", 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0079290019999999992, 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0085575100000000008, 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112172 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530381+0000", 2024-09-12T22:04:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530381+0000", 2024-09-12T22:04:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530382+0000", 2024-09-12T22:04:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9999999999999996e-07 2024-09-12T22:04:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530409+0000", 2024-09-12T22:04:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6872e-05 2024-09-12T22:04:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530418+0000", 2024-09-12T22:04:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4709999999999996e-06 2024-09-12T22:04:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530425+0000", 2024-09-12T22:04:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1859999999999997e-06 2024-09-12T22:04:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.532381+0000", 2024-09-12T22:04:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019561410000000002 2024-09-12T22:04:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.532514+0000", 2024-09-12T22:04:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013332200000000001 2024-09-12T22:04:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:112175 5.6 5:69f8b752:::benchmark_data_smithi043_32659_object112174:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:30.530491+0000", 2024-09-12T22:04:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0078188579999999997, 2024-09-12T22:04:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008508903, 2024-09-12T22:04:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112175 2024-09-12T22:04:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530491+0000", 2024-09-12T22:04:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530491+0000", 2024-09-12T22:04:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530492+0000", 2024-09-12T22:04:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9100000000000003e-07 2024-09-12T22:04:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530573+0000", 2024-09-12T22:04:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0856e-05 2024-09-12T22:04:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530584+0000", 2024-09-12T22:04:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0848e-05 2024-09-12T22:04:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530591+0000", 2024-09-12T22:04:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6989999999999997e-06 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534271+0000", 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003680184 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.534383+0000", 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011235600000000001 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:112176 5.6 5:6b375045:::benchmark_data_smithi043_32659_object112175:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:30.530601+0000", 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0077092239999999998, 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084652010000000003, 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112176 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530601+0000", 2024-09-12T22:04:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530601+0000", 2024-09-12T22:04:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530602+0000", 2024-09-12T22:04:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:04:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530629+0000", 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7555e-05 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530638+0000", 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0909999999999999e-06 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.530644+0000", 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.536289+0000", 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056450959999999996 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.536415+0000", 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126012 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:112180 5.1 5:89065c77:::benchmark_data_smithi043_32659_object112179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T22:04:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:30.533598+0000", 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0047119500000000003, 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00552989, 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112180 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.533598+0000", 2024-09-12T22:04:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.533598+0000", 2024-09-12T22:04:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.533600+0000", 2024-09-12T22:04:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.277e-06 2024-09-12T22:04:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.533662+0000", 2024-09-12T22:04:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2113999999999995e-05 2024-09-12T22:04:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.533678+0000", 2024-09-12T22:04:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6121e-05 2024-09-12T22:04:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.533685+0000", 2024-09-12T22:04:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8000000000000001e-06 2024-09-12T22:04:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.533795+0000", 2024-09-12T22:04:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110555 2024-09-12T22:04:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:30.533909+0000", 2024-09-12T22:04:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114055 2024-09-12T22:04:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 14 2024-09-12T22:04:30.598 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:30.600 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:30.600 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:30.598+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:30.700 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:04:30.700 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:30.699+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:30.750 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:30.750 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:30.750 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:30.750 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:30.750 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:30.763 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:30.808 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:30.806+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:30.812 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:30.830 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:30.830 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:30.849 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:30.849 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:30.852 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:30.852 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:30.902 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:30.901+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:30.912 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:30.912 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:30.927 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:31.004 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:31.002+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:31.080 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:31.081 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:31.092 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:31.104 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:31.103+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:31.192 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 37 16 114031 114015 192.577 173.5 0.00300703 0.0051903 2024-09-12T22:04:31.205 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:31.204+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:31.246 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:31.247 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:31.260 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:31.307 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:31.305+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:31.387 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-09-12T22:04:31.407 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:31.407 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:31.408 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:31.406+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:31.421 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:31.422 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-09-12T22:04:31.422 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:04:31.422 INFO:tasks.thrashosds.thrasher:Reweighting osd 1 to 0.31146587911315216 2024-09-12T22:04:31.422 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 0.31146587911315216 2024-09-12T22:04:31.509 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:31.507+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:31.570 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:31.570 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:31.582 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:31.609 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:31.608+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:31.710 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:31.709+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:31.775 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:31.775 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:31.789 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:31.830 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:31.829+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:31.913 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:31.911+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:31.982 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:31.982 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:31.996 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:32.040 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:32.039+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:32.113 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:32.112+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:32.140 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:32.141 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:32.153 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:32.192 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 38 16 116815 116799 192.088 174 0.00457813 0.00520352 2024-09-12T22:04:32.214 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:32.213+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:32.315 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:32.314+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:32.340 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:32.340 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:32.354 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:32.388 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.1 to 0.311466 (4fbc) 2024-09-12T22:04:32.416 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:32.415+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:32.473 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:32.474 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:32.482 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:32.526 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:32.525+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:32.584 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:32.585 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:32.593 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:32.619 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:32.618+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:32.720 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:32.719+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:32.736 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:32.736 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:32.745 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:32.821 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:32.820+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:32.853 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:04:32.888 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:32.888 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:32.897 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:32.940 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:32.939+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:32.972 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:32.990 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:32.990 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:33.000 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:33.000 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:33.008 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:33.009 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:33.009 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:33.012 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:33.012 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:33.049 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:33.048+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:33.123 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:33.122+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:33.150 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:33.150 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:33.151 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:33.151 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:33.151 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:33.159 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:33.192 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 39 16 117393 117377 188.088 36.125 0.020104 0.00520571 2024-09-12T22:04:33.243 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:33.242+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:33.304 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:33.304 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:33.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:33.305 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:33.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.305 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44102 5.0 5:0d5aa1ff:::benchmark_data_smithi043_32659_object44101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.305 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:33.305 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.677128590999999, 2024-09-12T22:04:33.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051636015, 2024-09-12T22:04:33.305 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.305 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.305 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.305 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.305 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.305 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.305 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44102 2024-09-12T22:04:33.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.306 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:33.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:33.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624875+0000", 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624930+0000", 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5256000000000001e-05 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624951+0000", 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0551999999999999e-05 2024-09-12T22:04:33.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624958+0000", 2024-09-12T22:04:33.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1849999999999998e-06 2024-09-12T22:04:33.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629885+0000", 2024-09-12T22:04:33.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049266120000000004 2024-09-12T22:04:33.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629999+0000", 2024-09-12T22:04:33.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011385 2024-09-12T22:04:33.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630125+0000", 2024-09-12T22:04:33.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012640500000000001 2024-09-12T22:04:33.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633338+0000", 2024-09-12T22:04:33.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032135559999999998 2024-09-12T22:04:33.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676425+0000", 2024-09-12T22:04:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043086753999999998 2024-09-12T22:04:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676472+0000", 2024-09-12T22:04:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6971999999999997e-05 2024-09-12T22:04:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676510+0000", 2024-09-12T22:04:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8096999999999998e-05 2024-09-12T22:04:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.311 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.311 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.311 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44103 5.8 5:170742c6:::benchmark_data_smithi043_32659_object44102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.311 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:33.311 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.677005439999999, 2024-09-12T22:04:33.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051500936999999997, 2024-09-12T22:04:33.311 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.311 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.311 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.311 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.311 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.311 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.312 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44103 2024-09-12T22:04:33.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.312 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:33.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:33.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624998+0000", 2024-09-12T22:04:33.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:33.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625061+0000", 2024-09-12T22:04:33.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2667000000000002e-05 2024-09-12T22:04:33.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625069+0000", 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999993e-06 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625077+0000", 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0090000000000007e-06 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629869+0000", 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047921769999999999 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629938+0000", 2024-09-12T22:04:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9542000000000006e-05 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630010+0000", 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1795e-05 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676348+0000", 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.046337830000000003 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676399+0000", 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1150000000000003e-05 2024-09-12T22:04:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676460+0000", 2024-09-12T22:04:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1142999999999994e-05 2024-09-12T22:04:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676498+0000", 2024-09-12T22:04:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8111000000000002e-05 2024-09-12T22:04:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.675707015, 2024-09-12T22:04:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.318 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:33.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:33.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:33.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:33.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:33.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:33.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:33.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:33.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:33.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:33.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:33.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:33.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:33.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:33.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:33.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:33.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:33.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:33.322 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.322 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.323 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.323 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44115 5.0 5:0ee09c30:::benchmark_data_smithi043_32659_object44114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.323 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:33.323 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.672934338000001, 2024-09-12T22:04:33.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082887358999999994, 2024-09-12T22:04:33.323 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.323 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.323 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.323 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.323 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.323 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.324 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44115 2024-09-12T22:04:33.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.324 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:33.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:33.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629070+0000", 2024-09-12T22:04:33.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1209999999999999e-06 2024-09-12T22:04:33.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629132+0000", 2024-09-12T22:04:33.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2557000000000004e-05 2024-09-12T22:04:33.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629147+0000", 2024-09-12T22:04:33.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4491999999999999e-05 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629156+0000", 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7089999999999997e-06 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631865+0000", 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00270835 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631932+0000", 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7322000000000004e-05 2024-09-12T22:04:33.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632095+0000", 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016314699999999999 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676360+0000", 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044264756000000002 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711854+0000", 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.03549389 2024-09-12T22:04:33.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711919+0000", 2024-09-12T22:04:33.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5024000000000006e-05 2024-09-12T22:04:33.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711956+0000", 2024-09-12T22:04:33.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6990999999999999e-05 2024-09-12T22:04:33.328 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.328 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.328 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.329 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44117 5.8 5:1ecb02e0:::benchmark_data_smithi043_32659_object44116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.329 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:33.329 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.672789517999998, 2024-09-12T22:04:33.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082354986000000005, 2024-09-12T22:04:33.329 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.329 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.329 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.329 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.329 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.329 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.329 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44117 2024-09-12T22:04:33.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.329 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:33.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:33.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629214+0000", 2024-09-12T22:04:33.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:33.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629315+0000", 2024-09-12T22:04:33.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010045800000000001 2024-09-12T22:04:33.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629328+0000", 2024-09-12T22:04:33.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3016e-05 2024-09-12T22:04:33.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629336+0000", 2024-09-12T22:04:33.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7229999999999993e-06 2024-09-12T22:04:33.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631856+0000", 2024-09-12T22:04:33.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025199300000000001 2024-09-12T22:04:33.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631954+0000", 2024-09-12T22:04:33.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7565999999999994e-05 2024-09-12T22:04:33.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632073+0000", 2024-09-12T22:04:33.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119677 2024-09-12T22:04:33.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676523+0000", 2024-09-12T22:04:33.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044449163 2024-09-12T22:04:33.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676612+0000", 2024-09-12T22:04:33.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9579000000000004e-05 2024-09-12T22:04:33.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711509+0000", 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.034897125000000001 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711568+0000", 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8996999999999998e-05 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44120 5.b 5:df1f2c5f:::benchmark_data_smithi043_32659_object44119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.334 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:33.335 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.670613856999999, 2024-09-12T22:04:33.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043861974999999997, 2024-09-12T22:04:33.335 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.335 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.335 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.335 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.335 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.335 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.335 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44120 2024-09-12T22:04:33.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.335 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:33.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:33.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631390+0000", 2024-09-12T22:04:33.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:04:33.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631444+0000", 2024-09-12T22:04:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-12T22:04:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631452+0000", 2024-09-12T22:04:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4610000000000008e-06 2024-09-12T22:04:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631458+0000", 2024-09-12T22:04:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:04:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631509+0000", 2024-09-12T22:04:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1442e-05 2024-09-12T22:04:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631627+0000", 2024-09-12T22:04:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011796800000000001 2024-09-12T22:04:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631814+0000", 2024-09-12T22:04:33.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018735400000000001 2024-09-12T22:04:33.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674612+0000", 2024-09-12T22:04:33.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042797287000000003 2024-09-12T22:04:33.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675160+0000", 2024-09-12T22:04:33.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000548187 2024-09-12T22:04:33.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675207+0000", 2024-09-12T22:04:33.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6833999999999999e-05 2024-09-12T22:04:33.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675251+0000", 2024-09-12T22:04:33.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4348000000000003e-05 2024-09-12T22:04:33.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.340 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.341 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.341 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:33.341 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.670306074999999, 2024-09-12T22:04:33.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:33.341 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.341 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.341 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.341 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.341 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.341 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.341 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:33.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:33.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:33.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:33.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:33.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:33.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44122 5.d 5:bfd04815:::benchmark_data_smithi043_32659_object44121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.670208023000001, 2024-09-12T22:04:33.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.080166395000000001, 2024-09-12T22:04:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44122 2024-09-12T22:04:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:04:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631853+0000", 2024-09-12T22:04:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7209000000000001e-05 2024-09-12T22:04:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631858+0000", 2024-09-12T22:04:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:04:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631862+0000", 2024-09-12T22:04:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.692e-06 2024-09-12T22:04:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631905+0000", 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3135e-05 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632032+0000", 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012740900000000001 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632166+0000", 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013318800000000001 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674894+0000", 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042728690999999999 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711875+0000", 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036980631 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711923+0000", 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8180000000000003e-05 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711961+0000", 2024-09-12T22:04:33.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8142000000000002e-05 2024-09-12T22:04:33.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.352 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.352 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44123 5.e 5:7d83ca89:::benchmark_data_smithi043_32659_object44122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.352 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:33.352 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.670076255000001, 2024-09-12T22:04:33.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043329329, 2024-09-12T22:04:33.352 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.352 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.352 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44123 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631928+0000", 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2699999999999998e-07 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631996+0000", 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8141999999999999e-05 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632004+0000", 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7600000000000008e-06 2024-09-12T22:04:33.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632010+0000", 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632069+0000", 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8260000000000001e-05 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632226+0000", 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015702199999999999 2024-09-12T22:04:33.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632337+0000", 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111069 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674909+0000", 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042571854999999999 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675184+0000", 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027561399999999998 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675222+0000", 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7710999999999999e-05 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675256+0000", 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4014000000000003e-05 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.357 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:33.358 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.669364808000001, 2024-09-12T22:04:33.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:33.358 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.358 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.358 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.358 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.358 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.358 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.358 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:33.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.358 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:33.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:33.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:33.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:33.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:33.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:33.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:33.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:33.363 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.363 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.363 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.363 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44098 5.0 e28/22 ondisk, result = 0)", 2024-09-12T22:04:33.363 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:33.363 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.668973993000002, 2024-09-12T22:04:33.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043332180999999997, 2024-09-12T22:04:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633030+0000", 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633035+0000", 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633043+0000", 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633048+0000", 2024-09-12T22:04:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5439999999999998e-06 2024-09-12T22:04:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633362+0000", 2024-09-12T22:04:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031397400000000001 2024-09-12T22:04:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633369+0000", 2024-09-12T22:04:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676361+0000", 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042991954999999998 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.668366888000001, 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:33.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:33.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:33.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:33.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:33.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:33.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:33.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:44125 5.9 e28/22 5:9022696f:::benchmark_data_smithi043_32659_object44124:head v 28'2753, mlcod=28'2751)", 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.668328023000001, 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042744011999999998, 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633676+0000", 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.44e-07 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633755+0000", 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9629000000000006e-05 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674386+0000", 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631364000000003 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674399+0000", 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2047e-05 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674453+0000", 2024-09-12T22:04:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4453999999999997e-05 2024-09-12T22:04:33.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674479+0000", 2024-09-12T22:04:33.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6064999999999999e-05 2024-09-12T22:04:33.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676381+0000", 2024-09-12T22:04:33.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001901874 2024-09-12T22:04:33.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676419+0000", 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7935000000000002e-05 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44103 5.8 e28/22 ondisk, result = 0)", 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.667822054999998, 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042322950999999998, 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634184+0000", 2024-09-12T22:04:33.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7690000000000001e-06 2024-09-12T22:04:33.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674407+0000", 2024-09-12T22:04:33.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040222750000000002 2024-09-12T22:04:33.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674417+0000", 2024-09-12T22:04:33.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0125e-05 2024-09-12T22:04:33.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676387+0000", 2024-09-12T22:04:33.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001970112 2024-09-12T22:04:33.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676394+0000", 2024-09-12T22:04:33.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:04:33.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676504+0000", 2024-09-12T22:04:33.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109621 2024-09-12T22:04:33.381 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.381 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.381 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.381 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44128 5.d 5:b9a92891:::benchmark_data_smithi043_32659_object44127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.381 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:33.381 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.627569265999998, 2024-09-12T22:04:33.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040118138999999997, 2024-09-12T22:04:33.381 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.381 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.381 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.381 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44128 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674435+0000", 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5960000000000001e-06 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674485+0000", 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0021000000000001e-05 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674495+0000", 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5189999999999998e-06 2024-09-12T22:04:33.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674500+0000", 2024-09-12T22:04:33.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:04:33.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674923+0000", 2024-09-12T22:04:33.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000423304 2024-09-12T22:04:33.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675027+0000", 2024-09-12T22:04:33.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103399 2024-09-12T22:04:33.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:33.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675141+0000", 2024-09-12T22:04:33.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114274 2024-09-12T22:04:33.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711649+0000", 2024-09-12T22:04:33.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036508011999999999 2024-09-12T22:04:33.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714466+0000", 2024-09-12T22:04:33.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028167370000000001 2024-09-12T22:04:33.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714508+0000", 2024-09-12T22:04:33.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2679000000000003e-05 2024-09-12T22:04:33.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714552+0000", 2024-09-12T22:04:33.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3528000000000001e-05 2024-09-12T22:04:33.386 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.387 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.387 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.387 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44129 5.0 5:0f626cda:::benchmark_data_smithi043_32659_object44128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.387 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:33.387 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.627493761, 2024-09-12T22:04:33.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042846404999999997, 2024-09-12T22:04:33.387 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.387 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.387 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.387 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.387 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.387 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.388 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44129 2024-09-12T22:04:33.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.388 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:33.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:33.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674510+0000", 2024-09-12T22:04:33.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1600000000000002e-07 2024-09-12T22:04:33.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674548+0000", 2024-09-12T22:04:33.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8075999999999999e-05 2024-09-12T22:04:33.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674689+0000", 2024-09-12T22:04:33.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014141499999999999 2024-09-12T22:04:33.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674696+0000", 2024-09-12T22:04:33.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4619999999999999e-06 2024-09-12T22:04:33.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713666+0000", 2024-09-12T22:04:33.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.038969072 2024-09-12T22:04:33.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713752+0000", 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6768999999999995e-05 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713835+0000", 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2774000000000004e-05 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717212+0000", 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033769389999999998 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717259+0000", 2024-09-12T22:04:33.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7218000000000001e-05 2024-09-12T22:04:33.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717310+0000", 2024-09-12T22:04:33.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1156999999999998e-05 2024-09-12T22:04:33.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717356+0000", 2024-09-12T22:04:33.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5107e-05 2024-09-12T22:04:33.392 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.392 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.392 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.393 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44130 5.4 5:27857918:::benchmark_data_smithi043_32659_object44129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.393 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:33.393 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.627295907000001, 2024-09-12T22:04:33.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039844412000000003, 2024-09-12T22:04:33.393 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.393 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.393 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.393 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.393 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.393 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.393 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44130 2024-09-12T22:04:33.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.394 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:33.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:33.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674708+0000", 2024-09-12T22:04:33.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4300000000000003e-07 2024-09-12T22:04:33.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674749+0000", 2024-09-12T22:04:33.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1254999999999997e-05 2024-09-12T22:04:33.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674756+0000", 2024-09-12T22:04:33.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3289999999999996e-06 2024-09-12T22:04:33.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674762+0000", 2024-09-12T22:04:33.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.852e-06 2024-09-12T22:04:33.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:33.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9573999999999995e-05 2024-09-12T22:04:33.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674954+0000", 2024-09-12T22:04:33.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012254200000000001 2024-09-12T22:04:33.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675033+0000", 2024-09-12T22:04:33.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8707000000000004e-05 2024-09-12T22:04:33.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714381+0000", 2024-09-12T22:04:33.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039348053000000001 2024-09-12T22:04:33.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714477+0000", 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5650999999999996e-05 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714516+0000", 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9158e-05 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714551+0000", 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5648000000000002e-05 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.399 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44131 5.0 5:013256f7:::benchmark_data_smithi043_32659_object44130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.399 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:33.399 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.627223440000002, 2024-09-12T22:04:33.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043388599, 2024-09-12T22:04:33.399 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.399 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.399 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.399 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.399 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.399 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.399 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44131 2024-09-12T22:04:33.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.400 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:33.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:33.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674780+0000", 2024-09-12T22:04:33.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:33.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674817+0000", 2024-09-12T22:04:33.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6859000000000001e-05 2024-09-12T22:04:33.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:33.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.501e-05 2024-09-12T22:04:33.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674838+0000", 2024-09-12T22:04:33.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-06 2024-09-12T22:04:33.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715161+0000", 2024-09-12T22:04:33.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.04032285 2024-09-12T22:04:33.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715317+0000", 2024-09-12T22:04:33.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015649199999999999 2024-09-12T22:04:33.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715463+0000", 2024-09-12T22:04:33.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145704 2024-09-12T22:04:33.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717480+0000", 2024-09-12T22:04:33.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020168220000000001 2024-09-12T22:04:33.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718079+0000", 2024-09-12T22:04:33.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000599115 2024-09-12T22:04:33.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718134+0000", 2024-09-12T22:04:33.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:04:33.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718168+0000", 2024-09-12T22:04:33.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4301000000000002e-05 2024-09-12T22:04:33.404 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.404 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.404 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.405 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44132 5.e 5:7634b859:::benchmark_data_smithi043_32659_object44131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.405 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:33.405 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.6265562, 2024-09-12T22:04:33.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039558587999999999, 2024-09-12T22:04:33.405 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.405 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.405 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.405 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.405 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.405 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.405 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44132 2024-09-12T22:04:33.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.406 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:33.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:33.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675448+0000", 2024-09-12T22:04:33.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3699999999999999e-07 2024-09-12T22:04:33.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675552+0000", 2024-09-12T22:04:33.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104294 2024-09-12T22:04:33.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675562+0000", 2024-09-12T22:04:33.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9629999999999993e-06 2024-09-12T22:04:33.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675569+0000", 2024-09-12T22:04:33.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8809999999999998e-06 2024-09-12T22:04:33.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675612+0000", 2024-09-12T22:04:33.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591000000000003e-05 2024-09-12T22:04:33.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675717+0000", 2024-09-12T22:04:33.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010497099999999999 2024-09-12T22:04:33.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675835+0000", 2024-09-12T22:04:33.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011793799999999999 2024-09-12T22:04:33.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713616+0000", 2024-09-12T22:04:33.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037781032999999999 2024-09-12T22:04:33.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714911+0000", 2024-09-12T22:04:33.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001294604 2024-09-12T22:04:33.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714964+0000", 2024-09-12T22:04:33.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3408000000000001e-05 2024-09-12T22:04:33.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715005+0000", 2024-09-12T22:04:33.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0967999999999998e-05 2024-09-12T22:04:33.410 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.410 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.410 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.411 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44133 5.b 5:d0a59edd:::benchmark_data_smithi043_32659_object44132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.411 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:33.411 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 28.62641842, 2024-09-12T22:04:33.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039513020000000003, 2024-09-12T22:04:33.411 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:33.411 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:33.411 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.411 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:33.411 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:33.411 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.411 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44133 2024-09-12T22:04:33.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.412 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:33.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:33.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:33.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:33.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:33.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:33.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:33.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675585+0000", 2024-09-12T22:04:33.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5499999999999998e-07 2024-09-12T22:04:33.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:33.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675634+0000", 2024-09-12T22:04:33.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8520999999999998e-05 2024-09-12T22:04:33.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:33.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675641+0000", 2024-09-12T22:04:33.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4440000000000002e-06 2024-09-12T22:04:33.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675646+0000", 2024-09-12T22:04:33.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2660000000000001e-06 2024-09-12T22:04:33.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:33.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675692+0000", 2024-09-12T22:04:33.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5915999999999999e-05 2024-09-12T22:04:33.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:33.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675812+0000", 2024-09-12T22:04:33.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119419 2024-09-12T22:04:33.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675950+0000", 2024-09-12T22:04:33.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013831499999999999 2024-09-12T22:04:33.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713574+0000", 2024-09-12T22:04:33.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037623801999999998 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715015+0000", 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014410720000000001 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715059+0000", 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715097+0000", 2024-09-12T22:04:33.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8519000000000002e-05 2024-09-12T22:04:33.417 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.417 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.417 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.417 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:33.417 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:33.417 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:33.417 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:04:33.418 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:33.417+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:33.419 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:33.519 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:33.518+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:33.521 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:33.521 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:33.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.522 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5.5a0ec61 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:33.522 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:33.522 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.110033853, 2024-09-12T22:04:33.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110054944, 2024-09-12T22:04:33.522 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.522 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.522 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for peered", 2024-09-12T22:04:33.522 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.522 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.522 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.522 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:04:33.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.522 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:33.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:33.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:04:33.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:04:33.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:04:33.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:04:33.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:04:33.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:04:33.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:04:33.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:04:33.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:04:33.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:04:33.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:33.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:04:33.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:04:33.525 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.525 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5.c062386c (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.10985392300000001, 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109915203, 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for peered", 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:04:33.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.527 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:33.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:33.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:04:33.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:04:33.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:04:33.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:04:33.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:04:33.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:04:33.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:04:33.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:04:33.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:04:33.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:04:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:04:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:04:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5.c9fe05c5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:33.532 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.10978748200000001, 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109882221, 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for peered", 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:04:33.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:04:33.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:33.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:04:33.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:04:33.536 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.536 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.536 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.536 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5.e108906c (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:33.536 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:33.536 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.109731039, 2024-09-12T22:04:33.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109857697, 2024-09-12T22:04:33.536 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for peered", 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:33.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:33.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:33.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:04:33.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:04:33.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:04:33.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:04:33.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:04:33.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:04:33.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:04:33.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:04:33.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:33.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:04:33.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:04:33.540 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.540 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.540 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.540 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5.17a40cc1 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:33.540 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:33.540 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.109662579, 2024-09-12T22:04:33.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10982143699999999, 2024-09-12T22:04:33.541 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.541 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.541 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for peered", 2024-09-12T22:04:33.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.541 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:04:33.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.541 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:33.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:04:33.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:04:33.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:04:33.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:04:33.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:04:33.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:04:33.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:04:33.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:33.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:04:33.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:04:33.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.544 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.544 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5.cbdf8513 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:33.544 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:33.544 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.10960484400000001, 2024-09-12T22:04:33.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109795195, 2024-09-12T22:04:33.545 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.545 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.545 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for peered", 2024-09-12T22:04:33.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.545 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:04:33.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.545 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:33.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:04:33.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:04:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:04:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5.1cc74865 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.109537152, 2024-09-12T22:04:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10975916300000001, 2024-09-12T22:04:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for peered", 2024-09-12T22:04:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:04:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:04:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:04:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:04:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:04:33.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:04:33.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:04:33.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:04:33.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:04:33.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:04:33.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:33.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:04:33.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:04:33.552 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.552 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.552 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.552 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5.cb0c0391 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:33.552 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:33.552 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.10948209, 2024-09-12T22:04:33.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10973679, 2024-09-12T22:04:33.553 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.553 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.553 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for peered", 2024-09-12T22:04:33.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.553 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:04:33.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.553 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:33.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:04:33.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:04:33.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:04:33.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:04:33.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:04:33.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:04:33.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:04:33.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:04:33.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:33.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:04:33.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:04:33.556 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.556 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.556 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.556 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.556 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:33.556 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 8 2024-09-12T22:04:33.556 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:33.557 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:33.620 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:33.619+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:33.660 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:33.660 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:33.660 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:33.660 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:33.660 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:33.669 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:33.753 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:33.752+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:33.814 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:33.814 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.362311751, 2024-09-12T22:04:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018534981999999998, 2024-09-12T22:04:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449723+0000", 2024-09-12T22:04:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449725+0000", 2024-09-12T22:04:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799999999999999e-06 2024-09-12T22:04:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449731+0000", 2024-09-12T22:04:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.801e-06 2024-09-12T22:04:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449745+0000", 2024-09-12T22:04:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4198e-05 2024-09-12T22:04:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449758+0000", 2024-09-12T22:04:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2858e-05 2024-09-12T22:04:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449815+0000", 2024-09-12T22:04:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6978999999999998e-05 2024-09-12T22:04:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-12T22:04:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2369999999999997e-06 2024-09-12T22:04:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457683+0000", 2024-09-12T22:04:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078622640000000008 2024-09-12T22:04:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457840+0000", 2024-09-12T22:04:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015715299999999999 2024-09-12T22:04:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457972+0000", 2024-09-12T22:04:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013179500000000001 2024-09-12T22:04:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462325+0000", 2024-09-12T22:04:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043526859999999997 2024-09-12T22:04:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468180+0000", 2024-09-12T22:04:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058557169999999999 2024-09-12T22:04:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468221+0000", 2024-09-12T22:04:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0673000000000002e-05 2024-09-12T22:04:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468258+0000", 2024-09-12T22:04:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7240999999999998e-05 2024-09-12T22:04:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.362259139999999, 2024-09-12T22:04:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018748032000000001, 2024-09-12T22:04:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449776+0000", 2024-09-12T22:04:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449779+0000", 2024-09-12T22:04:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4869999999999998e-06 2024-09-12T22:04:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449783+0000", 2024-09-12T22:04:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:04:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449791+0000", 2024-09-12T22:04:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2640000000000002e-06 2024-09-12T22:04:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449796+0000", 2024-09-12T22:04:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9370000000000001e-06 2024-09-12T22:04:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449915+0000", 2024-09-12T22:04:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118559 2024-09-12T22:04:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449920+0000", 2024-09-12T22:04:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.101e-06 2024-09-12T22:04:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458578+0000", 2024-09-12T22:04:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008657662 2024-09-12T22:04:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458978+0000", 2024-09-12T22:04:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00039977399999999998 2024-09-12T22:04:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459130+0000", 2024-09-12T22:04:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000152394 2024-09-12T22:04:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462793+0000", 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036628770000000001 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468451+0000", 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056577820000000001 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468501+0000", 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0609999999999998e-05 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468524+0000", 2024-09-12T22:04:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2804000000000001e-05 2024-09-12T22:04:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.362224439000002, 2024-09-12T22:04:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018816113999999998, 2024-09-12T22:04:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449811+0000", 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449821+0000", 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3360000000000001e-06 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449832+0000", 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1528e-05 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449836+0000", 2024-09-12T22:04:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-12T22:04:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459429+0000", 2024-09-12T22:04:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095926970000000007 2024-09-12T22:04:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459597+0000", 2024-09-12T22:04:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000168309 2024-09-12T22:04:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459829+0000", 2024-09-12T22:04:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231158 2024-09-12T22:04:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462796+0000", 2024-09-12T22:04:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029673849999999999 2024-09-12T22:04:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468558+0000", 2024-09-12T22:04:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057621449999999998 2024-09-12T22:04:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468592+0000", 2024-09-12T22:04:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4241e-05 2024-09-12T22:04:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468627+0000", 2024-09-12T22:04:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4511999999999998e-05 2024-09-12T22:04:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.362157410999998, 2024-09-12T22:04:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018845905, 2024-09-12T22:04:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449878+0000", 2024-09-12T22:04:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:04:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449881+0000", 2024-09-12T22:04:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.005e-06 2024-09-12T22:04:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449887+0000", 2024-09-12T22:04:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9050000000000002e-06 2024-09-12T22:04:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449892+0000", 2024-09-12T22:04:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2009999999999998e-06 2024-09-12T22:04:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460279+0000", 2024-09-12T22:04:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010386808000000001 2024-09-12T22:04:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460427+0000", 2024-09-12T22:04:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014789 2024-09-12T22:04:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.460572+0000", 2024-09-12T22:04:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014453099999999999 2024-09-12T22:04:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462799+0000", 2024-09-12T22:04:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002227049 2024-09-12T22:04:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468672+0000", 2024-09-12T22:04:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058730060000000001 2024-09-12T22:04:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468704+0000", 2024-09-12T22:04:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2421e-05 2024-09-12T22:04:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468724+0000", 2024-09-12T22:04:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9582e-05 2024-09-12T22:04:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.362053084000003, 2024-09-12T22:04:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018827507, 2024-09-12T22:04:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449982+0000", 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449983+0000", 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449986+0000", 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2739999999999999e-06 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.449999+0000", 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3349e-05 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450005+0000", 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.609e-06 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461006+0000", 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011000876 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461236+0000", 2024-09-12T22:04:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000230301 2024-09-12T22:04:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.461362+0000", 2024-09-12T22:04:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012541900000000001 2024-09-12T22:04:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.464797+0000", 2024-09-12T22:04:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034350840000000001 2024-09-12T22:04:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468754+0000", 2024-09-12T22:04:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039576689999999996 2024-09-12T22:04:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468784+0000", 2024-09-12T22:04:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9558000000000001e-05 2024-09-12T22:04:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468810+0000", 2024-09-12T22:04:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5752e-05 2024-09-12T22:04:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.362021212000002, 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018888559999999999, 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450014+0000", 2024-09-12T22:04:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450015+0000", 2024-09-12T22:04:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:04:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450018+0000", 2024-09-12T22:04:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3840000000000001e-06 2024-09-12T22:04:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450025+0000", 2024-09-12T22:04:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8859999999999998e-06 2024-09-12T22:04:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450030+0000", 2024-09-12T22:04:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4829999999999999e-06 2024-09-12T22:04:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465718+0000", 2024-09-12T22:04:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015688163000000001 2024-09-12T22:04:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.465793+0000", 2024-09-12T22:04:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4788000000000003e-05 2024-09-12T22:04:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466015+0000", 2024-09-12T22:04:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000221394 2024-09-12T22:04:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467628+0000", 2024-09-12T22:04:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016131190000000001 2024-09-12T22:04:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468849+0000", 2024-09-12T22:04:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012211699999999999 2024-09-12T22:04:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468878+0000", 2024-09-12T22:04:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8708e-05 2024-09-12T22:04:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468902+0000", 2024-09-12T22:04:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868e-05 2024-09-12T22:04:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:23 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.361997764999998, 2024-09-12T22:04:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021189669000000001, 2024-09-12T22:04:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450037+0000", 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450038+0000", 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450042+0000", 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7720000000000001e-06 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450058+0000", 2024-09-12T22:04:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6379999999999999e-05 2024-09-12T22:04:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450067+0000", 2024-09-12T22:04:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3870000000000001e-06 2024-09-12T22:04:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466409+0000", 2024-09-12T22:04:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016341418999999999 2024-09-12T22:04:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466467+0000", 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8613999999999998e-05 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466612+0000", 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014415000000000001 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467856+0000", 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012440039999999999 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471178+0000", 2024-09-12T22:04:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033227450000000002 2024-09-12T22:04:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471207+0000", 2024-09-12T22:04:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8571000000000001e-05 2024-09-12T22:04:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471227+0000", 2024-09-12T22:04:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0109999999999999e-05 2024-09-12T22:04:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.361957224999998, 2024-09-12T22:04:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021231197, 2024-09-12T22:04:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450078+0000", 2024-09-12T22:04:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450079+0000", 2024-09-12T22:04:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:04:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450083+0000", 2024-09-12T22:04:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1989999999999999e-06 2024-09-12T22:04:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450092+0000", 2024-09-12T22:04:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9400000000000008e-06 2024-09-12T22:04:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450097+0000", 2024-09-12T22:04:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:04:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466898+0000", 2024-09-12T22:04:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016801226999999998 2024-09-12T22:04:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.466975+0000", 2024-09-12T22:04:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6197000000000002e-05 2024-09-12T22:04:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.467158+0000", 2024-09-12T22:04:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183876 2024-09-12T22:04:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468270+0000", 2024-09-12T22:04:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001111229 2024-09-12T22:04:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471260+0000", 2024-09-12T22:04:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002989907 2024-09-12T22:04:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471289+0000", 2024-09-12T22:04:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9271000000000001e-05 2024-09-12T22:04:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471309+0000", 2024-09-12T22:04:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0302999999999999e-05 2024-09-12T22:04:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.361930624000003, 2024-09-12T22:04:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018145809999999998, 2024-09-12T22:04:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450105+0000", 2024-09-12T22:04:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450114+0000", 2024-09-12T22:04:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1849999999999993e-06 2024-09-12T22:04:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450121+0000", 2024-09-12T22:04:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1350000000000003e-06 2024-09-12T22:04:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450128+0000", 2024-09-12T22:04:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2040000000000002e-06 2024-09-12T22:04:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454085+0000", 2024-09-12T22:04:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00395736 2024-09-12T22:04:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454090+0000", 2024-09-12T22:04:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.378e-06 2024-09-12T22:04:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457076+0000", 2024-09-12T22:04:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002985747 2024-09-12T22:04:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457178+0000", 2024-09-12T22:04:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010242 2024-09-12T22:04:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.457452+0000", 2024-09-12T22:04:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027313000000000001 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462024+0000", 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045727040000000004 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468161+0000", 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061372019999999996 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468212+0000", 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0707000000000001e-05 2024-09-12T22:04:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.468250+0000", 2024-09-12T22:04:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8148000000000001e-05 2024-09-12T22:04:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.361243068999997, 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020127506999999999, 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450792+0000", 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450793+0000", 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2800000000000005e-07 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450813+0000", 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0063000000000001e-05 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450847+0000", 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3973000000000002e-05 2024-09-12T22:04:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.450862+0000", 2024-09-12T22:04:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5358000000000001e-05 2024-09-12T22:04:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454355+0000", 2024-09-12T22:04:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003492841 2024-09-12T22:04:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454359+0000", 2024-09-12T22:04:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-09-12T22:04:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.458704+0000", 2024-09-12T22:04:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043452459999999997 2024-09-12T22:04:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459009+0000", 2024-09-12T22:04:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030526199999999999 2024-09-12T22:04:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459143+0000", 2024-09-12T22:04:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013375 2024-09-12T22:04:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462690+0000", 2024-09-12T22:04:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035466579999999998 2024-09-12T22:04:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470863+0000", 2024-09-12T22:04:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0081734089999999995 2024-09-12T22:04:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470898+0000", 2024-09-12T22:04:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4445e-05 2024-09-12T22:04:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470920+0000", 2024-09-12T22:04:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1844e-05 2024-09-12T22:04:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:04:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.359712950000002, 2024-09-12T22:04:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018704596, 2024-09-12T22:04:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452322+0000", 2024-09-12T22:04:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452323+0000", 2024-09-12T22:04:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:04:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452337+0000", 2024-09-12T22:04:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:04:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452489+0000", 2024-09-12T22:04:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015167699999999999 2024-09-12T22:04:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.452498+0000", 2024-09-12T22:04:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9709999999999993e-06 2024-09-12T22:04:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454393+0000", 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001895171 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.454397+0000", 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4470000000000002e-06 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459570+0000", 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051728160000000002 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459718+0000", 2024-09-12T22:04:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014857800000000001 2024-09-12T22:04:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.459920+0000", 2024-09-12T22:04:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000202043 2024-09-12T22:04:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.462696+0000", 2024-09-12T22:04:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027756299999999999 2024-09-12T22:04:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.470963+0000", 2024-09-12T22:04:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082671359999999996 2024-09-12T22:04:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471000+0000", 2024-09-12T22:04:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6748999999999997e-05 2024-09-12T22:04:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:03:33.471027+0000", 2024-09-12T22:04:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7118e-05 2024-09-12T22:04:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.178737364, 2024-09-12T22:04:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79650 5.1 5:87bbf2de:::benchmark_data_smithi043_32659_object79649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.980552057000001, 2024-09-12T22:04:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021887977999999999, 2024-09-12T22:04:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79650 2024-09-12T22:04:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831484+0000", 2024-09-12T22:04:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:04:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831558+0000", 2024-09-12T22:04:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4556999999999998e-05 2024-09-12T22:04:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831567+0000", 2024-09-12T22:04:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3410000000000003e-06 2024-09-12T22:04:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831574+0000", 2024-09-12T22:04:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2559999999999996e-06 2024-09-12T22:04:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.832773+0000", 2024-09-12T22:04:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001199475 2024-09-12T22:04:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.832890+0000", 2024-09-12T22:04:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116768 2024-09-12T22:04:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.833027+0000", 2024-09-12T22:04:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000136527 2024-09-12T22:04:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.837448+0000", 2024-09-12T22:04:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044212130000000002 2024-09-12T22:04:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853313+0000", 2024-09-12T22:04:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015865016999999999 2024-09-12T22:04:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853344+0000", 2024-09-12T22:04:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1010000000000003e-05 2024-09-12T22:04:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853371+0000", 2024-09-12T22:04:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7092000000000001e-05 2024-09-12T22:04:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79651 5.1 5:82b16cba:::benchmark_data_smithi043_32659_object79650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.98022765, 2024-09-12T22:04:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021652616999999999, 2024-09-12T22:04:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79651 2024-09-12T22:04:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831807+0000", 2024-09-12T22:04:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831808+0000", 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4099999999999998e-07 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831886+0000", 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8184999999999998e-05 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831896+0000", 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0001e-05 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831902+0000", 2024-09-12T22:04:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7960000000000001e-06 2024-09-12T22:04:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835123+0000", 2024-09-12T22:04:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032211660000000001 2024-09-12T22:04:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835281+0000", 2024-09-12T22:04:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015780699999999999 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.835443+0000", 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016203499999999999 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.837588+0000", 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021443159999999998 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853402+0000", 2024-09-12T22:04:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015814528000000001 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853434+0000", 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1955999999999997e-05 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853460+0000", 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6086000000000001e-05 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79659 5.1 5:881dc852:::benchmark_data_smithi043_32659_object79658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.972354106000001, 2024-09-12T22:04:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019797940999999999, 2024-09-12T22:04:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79659 2024-09-12T22:04:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839681+0000", 2024-09-12T22:04:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839682+0000", 2024-09-12T22:04:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-12T22:04:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839723+0000", 2024-09-12T22:04:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0611999999999997e-05 2024-09-12T22:04:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839736+0000", 2024-09-12T22:04:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3285000000000001e-05 2024-09-12T22:04:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839755+0000", 2024-09-12T22:04:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8870000000000001e-05 2024-09-12T22:04:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839792+0000", 2024-09-12T22:04:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7162000000000001e-05 2024-09-12T22:04:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839876+0000", 2024-09-12T22:04:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4376999999999995e-05 2024-09-12T22:04:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.839980+0000", 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000103149 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.841622+0000", 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001642117 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859420+0000", 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017798538999999999 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859454+0000", 2024-09-12T22:04:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3315000000000002e-05 2024-09-12T22:04:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.859479+0000", 2024-09-12T22:04:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5384999999999998e-05 2024-09-12T22:04:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79661 5.2 5:4081316a:::benchmark_data_smithi043_32659_object79660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.96368118, 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.025955590000000001, 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79661 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848355+0000", 2024-09-12T22:04:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3009999999999999e-06 2024-09-12T22:04:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848410+0000", 2024-09-12T22:04:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639000000000003e-05 2024-09-12T22:04:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848426+0000", 2024-09-12T22:04:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5979000000000001e-05 2024-09-12T22:04:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848436+0000", 2024-09-12T22:04:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0227000000000001e-05 2024-09-12T22:04:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848479+0000", 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2450000000000002e-05 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848574+0000", 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5508999999999996e-05 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848667+0000", 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999997e-05 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.850764+0000", 2024-09-12T22:04:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020964920000000001 2024-09-12T22:04:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874250+0000", 2024-09-12T22:04:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.023486440000000001 2024-09-12T22:04:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874283+0000", 2024-09-12T22:04:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2552000000000003e-05 2024-09-12T22:04:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874310+0000", 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7001000000000001e-05 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79671 5.2 5:46f8404a:::benchmark_data_smithi043_32659_object79670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.958476843, 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021880646, 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79671 2024-09-12T22:04:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853558+0000", 2024-09-12T22:04:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853559+0000", 2024-09-12T22:04:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.012e-06 2024-09-12T22:04:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853609+0000", 2024-09-12T22:04:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9372000000000001e-05 2024-09-12T22:04:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853617+0000", 2024-09-12T22:04:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.055e-06 2024-09-12T22:04:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853621+0000", 2024-09-12T22:04:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:04:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853659+0000", 2024-09-12T22:04:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7981000000000001e-05 2024-09-12T22:04:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853750+0000", 2024-09-12T22:04:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0797000000000005e-05 2024-09-12T22:04:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853835+0000", 2024-09-12T22:04:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4958999999999998e-05 2024-09-12T22:04:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.855573+0000", 2024-09-12T22:04:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001737854 2024-09-12T22:04:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875378+0000", 2024-09-12T22:04:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019805146999999999 2024-09-12T22:04:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875412+0000", 2024-09-12T22:04:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3649999999999998e-05 2024-09-12T22:04:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.875439+0000", 2024-09-12T22:04:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7160000000000001e-05 2024-09-12T22:04:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:98916 5.5 5:a5cbea4a:::benchmark_data_smithi043_32659_object98915:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.855470+0000", 2024-09-12T22:04:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.9565655, 2024-09-12T22:04:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018007867, 2024-09-12T22:04:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 98916 2024-09-12T22:04:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855470+0000", 2024-09-12T22:04:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855470+0000", 2024-09-12T22:04:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855470+0000", 2024-09-12T22:04:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4300000000000003e-07 2024-09-12T22:04:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855504+0000", 2024-09-12T22:04:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3834000000000002e-05 2024-09-12T22:04:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855511+0000", 2024-09-12T22:04:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4170000000000003e-06 2024-09-12T22:04:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.855517+0000", 2024-09-12T22:04:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0039999999999996e-06 2024-09-12T22:04:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.857432+0000", 2024-09-12T22:04:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001914935 2024-09-12T22:04:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.857585+0000", 2024-09-12T22:04:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015281499999999999 2024-09-12T22:04:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.873343+0000", 2024-09-12T22:04:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015757693999999999 2024-09-12T22:04:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.873390+0000", 2024-09-12T22:04:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7438999999999998e-05 2024-09-12T22:04:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.873478+0000", 2024-09-12T22:04:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7186000000000002e-05 2024-09-12T22:04:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:99251 5.f 5:fe217d2d:::benchmark_data_smithi043_32659_object99250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.980015+0000", 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.8320197739999999, 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019280414999999999, 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 99251 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.980015+0000", 2024-09-12T22:04:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.980015+0000", 2024-09-12T22:04:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.980016+0000", 2024-09-12T22:04:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3200000000000004e-07 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.980107+0000", 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1305999999999996e-05 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.980126+0000", 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8141000000000001e-05 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.980133+0000", 2024-09-12T22:04:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3000000000000004e-06 2024-09-12T22:04:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.986715+0000", 2024-09-12T22:04:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065826239999999996 2024-09-12T22:04:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.986825+0000", 2024-09-12T22:04:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110011 2024-09-12T22:04:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.986950+0000", 2024-09-12T22:04:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124344 2024-09-12T22:04:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.989683+0000", 2024-09-12T22:04:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027328470000000001 2024-09-12T22:04:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.999211+0000", 2024-09-12T22:04:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095286810000000007 2024-09-12T22:04:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.999260+0000", 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8331999999999997e-05 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.999296+0000", 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6096999999999997e-05 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:99266 5.f 5:f6f96762:::benchmark_data_smithi043_32659_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T22:04:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:25.985521+0000", 2024-09-12T22:04:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.8265143200000002, 2024-09-12T22:04:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018059446999999999, 2024-09-12T22:04:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 99266 2024-09-12T22:04:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.985521+0000", 2024-09-12T22:04:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.985521+0000", 2024-09-12T22:04:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.985522+0000", 2024-09-12T22:04:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4600000000000003e-07 2024-09-12T22:04:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.985575+0000", 2024-09-12T22:04:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3659000000000002e-05 2024-09-12T22:04:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.985586+0000", 2024-09-12T22:04:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0321e-05 2024-09-12T22:04:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.985592+0000", 2024-09-12T22:04:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.584e-06 2024-09-12T22:04:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.991911+0000", 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063190099999999999 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.992071+0000", 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015939900000000001 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.992217+0000", 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000146384 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:25.996882+0000", 2024-09-12T22:04:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046648439999999996 2024-09-12T22:04:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:26.003476+0000", 2024-09-12T22:04:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065942079999999998 2024-09-12T22:04:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:26.003521+0000", 2024-09-12T22:04:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5024000000000001e-05 2024-09-12T22:04:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:26.003580+0000", 2024-09-12T22:04:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9168e-05 2024-09-12T22:04:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:33.933 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:33.935 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:33.935 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:33.933+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:34.035 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:34.034+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:34.042 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:34.043 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-12T22:04:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:34.051 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:34.136 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:34.135+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:34.192 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:2024-09-12T22:04:34.192568+0000 min lat: 0.00121163 max lat: 1.02216 avg lat: 0.00520571 2024-09-12T22:04:34.192 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T22:04:34.193 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 40 16 117393 117377 183.386 0 - 0.00520571 2024-09-12T22:04:34.194 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:34.195 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:34.195 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:34.195 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:34.195 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:34.203 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:34.248 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:34.247+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:34.307 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:34.308 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:34.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:34.308 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:34.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.308 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44102 5.0 5:0d5aa1ff:::benchmark_data_smithi043_32659_object44101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.308 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:34.308 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.680558297000001, 2024-09-12T22:04:34.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051636015, 2024-09-12T22:04:34.308 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.308 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.308 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.308 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.309 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.309 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.309 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44102 2024-09-12T22:04:34.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.309 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:34.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:34.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624875+0000", 2024-09-12T22:04:34.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:04:34.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624930+0000", 2024-09-12T22:04:34.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5256000000000001e-05 2024-09-12T22:04:34.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624951+0000", 2024-09-12T22:04:34.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0551999999999999e-05 2024-09-12T22:04:34.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624958+0000", 2024-09-12T22:04:34.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1849999999999998e-06 2024-09-12T22:04:34.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629885+0000", 2024-09-12T22:04:34.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049266120000000004 2024-09-12T22:04:34.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629999+0000", 2024-09-12T22:04:34.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011385 2024-09-12T22:04:34.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630125+0000", 2024-09-12T22:04:34.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012640500000000001 2024-09-12T22:04:34.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633338+0000", 2024-09-12T22:04:34.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032135559999999998 2024-09-12T22:04:34.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676425+0000", 2024-09-12T22:04:34.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043086753999999998 2024-09-12T22:04:34.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676472+0000", 2024-09-12T22:04:34.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6971999999999997e-05 2024-09-12T22:04:34.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676510+0000", 2024-09-12T22:04:34.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8096999999999998e-05 2024-09-12T22:04:34.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.314 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.315 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44103 5.8 5:170742c6:::benchmark_data_smithi043_32659_object44102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.315 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:34.315 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.680435146000001, 2024-09-12T22:04:34.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051500936999999997, 2024-09-12T22:04:34.315 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.315 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.315 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.316 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.316 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44103 2024-09-12T22:04:34.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.316 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:34.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:34.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624998+0000", 2024-09-12T22:04:34.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:34.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625061+0000", 2024-09-12T22:04:34.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2667000000000002e-05 2024-09-12T22:04:34.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625069+0000", 2024-09-12T22:04:34.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999993e-06 2024-09-12T22:04:34.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625077+0000", 2024-09-12T22:04:34.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0090000000000007e-06 2024-09-12T22:04:34.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629869+0000", 2024-09-12T22:04:34.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047921769999999999 2024-09-12T22:04:34.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629938+0000", 2024-09-12T22:04:34.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9542000000000006e-05 2024-09-12T22:04:34.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630010+0000", 2024-09-12T22:04:34.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1795e-05 2024-09-12T22:04:34.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676348+0000", 2024-09-12T22:04:34.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.046337830000000003 2024-09-12T22:04:34.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676399+0000", 2024-09-12T22:04:34.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1150000000000003e-05 2024-09-12T22:04:34.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676460+0000", 2024-09-12T22:04:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1142999999999994e-05 2024-09-12T22:04:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676498+0000", 2024-09-12T22:04:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8111000000000002e-05 2024-09-12T22:04:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.322 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:34.322 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.679136720999999, 2024-09-12T22:04:34.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:34.322 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.322 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.322 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.322 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.322 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.322 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.322 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:34.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.322 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:34.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:34.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:34.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:34.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:34.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:34.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:34.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:34.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:34.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:34.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:34.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:34.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:34.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:34.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:34.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:34.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:34.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:34.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:34.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:34.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:34.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:34.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:34.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:34.328 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.328 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.328 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.328 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44115 5.0 5:0ee09c30:::benchmark_data_smithi043_32659_object44114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.329 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:34.329 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.676364044, 2024-09-12T22:04:34.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082887358999999994, 2024-09-12T22:04:34.329 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.329 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.329 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.329 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.329 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.329 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.329 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44115 2024-09-12T22:04:34.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.329 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:34.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:34.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629070+0000", 2024-09-12T22:04:34.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1209999999999999e-06 2024-09-12T22:04:34.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629132+0000", 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2557000000000004e-05 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629147+0000", 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4491999999999999e-05 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629156+0000", 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7089999999999997e-06 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631865+0000", 2024-09-12T22:04:34.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00270835 2024-09-12T22:04:34.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631932+0000", 2024-09-12T22:04:34.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7322000000000004e-05 2024-09-12T22:04:34.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632095+0000", 2024-09-12T22:04:34.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016314699999999999 2024-09-12T22:04:34.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676360+0000", 2024-09-12T22:04:34.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044264756000000002 2024-09-12T22:04:34.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711854+0000", 2024-09-12T22:04:34.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.03549389 2024-09-12T22:04:34.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711919+0000", 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5024000000000006e-05 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711956+0000", 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6990999999999999e-05 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44117 5.8 5:1ecb02e0:::benchmark_data_smithi043_32659_object44116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.676219224, 2024-09-12T22:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082354986000000005, 2024-09-12T22:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44117 2024-09-12T22:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629214+0000", 2024-09-12T22:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629315+0000", 2024-09-12T22:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010045800000000001 2024-09-12T22:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629328+0000", 2024-09-12T22:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3016e-05 2024-09-12T22:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629336+0000", 2024-09-12T22:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7229999999999993e-06 2024-09-12T22:04:34.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631856+0000", 2024-09-12T22:04:34.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025199300000000001 2024-09-12T22:04:34.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631954+0000", 2024-09-12T22:04:34.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7565999999999994e-05 2024-09-12T22:04:34.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632073+0000", 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119677 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676523+0000", 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044449163 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676612+0000", 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9579000000000004e-05 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711509+0000", 2024-09-12T22:04:34.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.034897125000000001 2024-09-12T22:04:34.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711568+0000", 2024-09-12T22:04:34.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8996999999999998e-05 2024-09-12T22:04:34.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.340 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.340 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44120 5.b 5:df1f2c5f:::benchmark_data_smithi043_32659_object44119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.340 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:34.340 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.674043563000001, 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043861974999999997, 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44120 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631390+0000", 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631444+0000", 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631452+0000", 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4610000000000008e-06 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631458+0000", 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631509+0000", 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1442e-05 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631627+0000", 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011796800000000001 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631814+0000", 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018735400000000001 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674612+0000", 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042797287000000003 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675160+0000", 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000548187 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675207+0000", 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6833999999999999e-05 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675251+0000", 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4348000000000003e-05 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.345 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.346 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.346 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:34.346 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.673735781000001, 2024-09-12T22:04:34.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:34.346 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.346 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.346 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.346 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.346 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.346 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.346 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:34.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.347 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:34.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:34.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:34.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:34.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:34.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:34.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:34.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:34.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:34.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:34.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:34.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:34.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:34.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:34.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:34.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:34.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:34.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:34.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.352 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.352 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44122 5.d 5:bfd04815:::benchmark_data_smithi043_32659_object44121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.352 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:34.352 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.673637728999999, 2024-09-12T22:04:34.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.080166395000000001, 2024-09-12T22:04:34.352 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.352 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.352 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.352 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.352 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44122 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:34.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:04:34.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631853+0000", 2024-09-12T22:04:34.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7209000000000001e-05 2024-09-12T22:04:34.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631858+0000", 2024-09-12T22:04:34.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:04:34.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631862+0000", 2024-09-12T22:04:34.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.692e-06 2024-09-12T22:04:34.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631905+0000", 2024-09-12T22:04:34.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3135e-05 2024-09-12T22:04:34.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632032+0000", 2024-09-12T22:04:34.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012740900000000001 2024-09-12T22:04:34.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:34.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632166+0000", 2024-09-12T22:04:34.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013318800000000001 2024-09-12T22:04:34.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674894+0000", 2024-09-12T22:04:34.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042728690999999999 2024-09-12T22:04:34.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711875+0000", 2024-09-12T22:04:34.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036980631 2024-09-12T22:04:34.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711923+0000", 2024-09-12T22:04:34.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8180000000000003e-05 2024-09-12T22:04:34.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711961+0000", 2024-09-12T22:04:34.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8142000000000002e-05 2024-09-12T22:04:34.357 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.357 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.358 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.358 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44123 5.e 5:7d83ca89:::benchmark_data_smithi043_32659_object44122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.358 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:34.358 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.673505961, 2024-09-12T22:04:34.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043329329, 2024-09-12T22:04:34.358 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.358 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.358 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.358 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.358 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.358 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.359 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44123 2024-09-12T22:04:34.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.359 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:34.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:34.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631928+0000", 2024-09-12T22:04:34.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2699999999999998e-07 2024-09-12T22:04:34.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631996+0000", 2024-09-12T22:04:34.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8141999999999999e-05 2024-09-12T22:04:34.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632004+0000", 2024-09-12T22:04:34.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7600000000000008e-06 2024-09-12T22:04:34.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632010+0000", 2024-09-12T22:04:34.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:04:34.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632069+0000", 2024-09-12T22:04:34.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8260000000000001e-05 2024-09-12T22:04:34.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632226+0000", 2024-09-12T22:04:34.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015702199999999999 2024-09-12T22:04:34.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632337+0000", 2024-09-12T22:04:34.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111069 2024-09-12T22:04:34.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674909+0000", 2024-09-12T22:04:34.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042571854999999999 2024-09-12T22:04:34.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675184+0000", 2024-09-12T22:04:34.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027561399999999998 2024-09-12T22:04:34.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675222+0000", 2024-09-12T22:04:34.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7710999999999999e-05 2024-09-12T22:04:34.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675256+0000", 2024-09-12T22:04:34.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4014000000000003e-05 2024-09-12T22:04:34.365 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.365 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.365 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.365 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.365 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:34.365 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.672794514, 2024-09-12T22:04:34.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:34.365 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.365 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.365 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.366 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.366 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.366 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.366 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:34.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.366 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:34.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:34.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:34.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:34.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:34.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:34.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:34.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:34.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:34.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:34.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:34.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:34.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:34.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:34.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:34.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:34.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:34.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:34.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:34.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:34.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:34.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:34.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:34.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:34.371 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.371 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.371 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.371 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44098 5.0 e28/22 ondisk, result = 0)", 2024-09-12T22:04:34.371 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:34.371 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.672403699, 2024-09-12T22:04:34.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043332180999999997, 2024-09-12T22:04:34.372 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.372 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.372 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:34.372 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:34.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633030+0000", 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633035+0000", 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633043+0000", 2024-09-12T22:04:34.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:34.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633048+0000", 2024-09-12T22:04:34.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5439999999999998e-06 2024-09-12T22:04:34.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633362+0000", 2024-09-12T22:04:34.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031397400000000001 2024-09-12T22:04:34.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633369+0000", 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676361+0000", 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042991954999999998 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.375 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.376 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:34.376 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.671796594, 2024-09-12T22:04:34.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:34.376 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.376 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.376 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.376 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.376 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.376 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.376 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:34.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.376 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:34.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:34.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:34.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:34.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:34.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:34.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:34.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:34.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:34.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:34.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:34.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:34.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:34.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:34.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:44125 5.9 e28/22 5:9022696f:::benchmark_data_smithi043_32659_object44124:head v 28'2753, mlcod=28'2751)", 2024-09-12T22:04:34.381 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.671757728999999, 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042744011999999998, 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:34.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633676+0000", 2024-09-12T22:04:34.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.44e-07 2024-09-12T22:04:34.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633755+0000", 2024-09-12T22:04:34.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9629000000000006e-05 2024-09-12T22:04:34.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674386+0000", 2024-09-12T22:04:34.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631364000000003 2024-09-12T22:04:34.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674399+0000", 2024-09-12T22:04:34.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2047e-05 2024-09-12T22:04:34.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674453+0000", 2024-09-12T22:04:34.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4453999999999997e-05 2024-09-12T22:04:34.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674479+0000", 2024-09-12T22:04:34.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6064999999999999e-05 2024-09-12T22:04:34.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676381+0000", 2024-09-12T22:04:34.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001901874 2024-09-12T22:04:34.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676419+0000", 2024-09-12T22:04:34.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7935000000000002e-05 2024-09-12T22:04:34.386 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.386 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.386 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.386 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44103 5.8 e28/22 ondisk, result = 0)", 2024-09-12T22:04:34.386 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:34.386 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.671251761000001, 2024-09-12T22:04:34.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042322950999999998, 2024-09-12T22:04:34.387 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.387 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.387 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:34.387 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:34.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:34.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:34.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:04:34.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634184+0000", 2024-09-12T22:04:34.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7690000000000001e-06 2024-09-12T22:04:34.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674407+0000", 2024-09-12T22:04:34.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040222750000000002 2024-09-12T22:04:34.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674417+0000", 2024-09-12T22:04:34.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0125e-05 2024-09-12T22:04:34.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676387+0000", 2024-09-12T22:04:34.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001970112 2024-09-12T22:04:34.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676394+0000", 2024-09-12T22:04:34.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:04:34.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676504+0000", 2024-09-12T22:04:34.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109621 2024-09-12T22:04:34.390 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.390 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.390 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44128 5.d 5:b9a92891:::benchmark_data_smithi043_32659_object44127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.630998972, 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040118138999999997, 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44128 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:34.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:34.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674435+0000", 2024-09-12T22:04:34.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5960000000000001e-06 2024-09-12T22:04:34.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674485+0000", 2024-09-12T22:04:34.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0021000000000001e-05 2024-09-12T22:04:34.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674495+0000", 2024-09-12T22:04:34.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5189999999999998e-06 2024-09-12T22:04:34.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674500+0000", 2024-09-12T22:04:34.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:04:34.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674923+0000", 2024-09-12T22:04:34.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000423304 2024-09-12T22:04:34.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675027+0000", 2024-09-12T22:04:34.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103399 2024-09-12T22:04:34.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:34.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675141+0000", 2024-09-12T22:04:34.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114274 2024-09-12T22:04:34.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711649+0000", 2024-09-12T22:04:34.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036508011999999999 2024-09-12T22:04:34.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714466+0000", 2024-09-12T22:04:34.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028167370000000001 2024-09-12T22:04:34.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714508+0000", 2024-09-12T22:04:34.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2679000000000003e-05 2024-09-12T22:04:34.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714552+0000", 2024-09-12T22:04:34.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3528000000000001e-05 2024-09-12T22:04:34.397 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.397 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.397 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.397 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44129 5.0 5:0f626cda:::benchmark_data_smithi043_32659_object44128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.397 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:34.397 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.630923466999999, 2024-09-12T22:04:34.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042846404999999997, 2024-09-12T22:04:34.397 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.397 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44129 2024-09-12T22:04:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674510+0000", 2024-09-12T22:04:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1600000000000002e-07 2024-09-12T22:04:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674548+0000", 2024-09-12T22:04:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8075999999999999e-05 2024-09-12T22:04:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674689+0000", 2024-09-12T22:04:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014141499999999999 2024-09-12T22:04:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674696+0000", 2024-09-12T22:04:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4619999999999999e-06 2024-09-12T22:04:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713666+0000", 2024-09-12T22:04:34.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.038969072 2024-09-12T22:04:34.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713752+0000", 2024-09-12T22:04:34.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6768999999999995e-05 2024-09-12T22:04:34.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713835+0000", 2024-09-12T22:04:34.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2774000000000004e-05 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717212+0000", 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033769389999999998 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717259+0000", 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7218000000000001e-05 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717310+0000", 2024-09-12T22:04:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1156999999999998e-05 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717356+0000", 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5107e-05 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44130 5.4 5:27857918:::benchmark_data_smithi043_32659_object44129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.630725612999999, 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039844412000000003, 2024-09-12T22:04:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.404 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.404 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.404 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.404 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.404 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.404 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44130 2024-09-12T22:04:34.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.404 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674708+0000", 2024-09-12T22:04:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4300000000000003e-07 2024-09-12T22:04:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674749+0000", 2024-09-12T22:04:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1254999999999997e-05 2024-09-12T22:04:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674756+0000", 2024-09-12T22:04:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3289999999999996e-06 2024-09-12T22:04:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674762+0000", 2024-09-12T22:04:34.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.852e-06 2024-09-12T22:04:34.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:34.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9573999999999995e-05 2024-09-12T22:04:34.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674954+0000", 2024-09-12T22:04:34.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012254200000000001 2024-09-12T22:04:34.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675033+0000", 2024-09-12T22:04:34.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8707000000000004e-05 2024-09-12T22:04:34.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714381+0000", 2024-09-12T22:04:34.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039348053000000001 2024-09-12T22:04:34.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714477+0000", 2024-09-12T22:04:34.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5650999999999996e-05 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714516+0000", 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9158e-05 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714551+0000", 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5648000000000002e-05 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.410 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44131 5.0 5:013256f7:::benchmark_data_smithi043_32659_object44130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.410 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:34.410 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.630653146, 2024-09-12T22:04:34.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043388599, 2024-09-12T22:04:34.410 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.410 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.410 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.410 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.410 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.410 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.410 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44131 2024-09-12T22:04:34.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.410 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:34.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:34.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674780+0000", 2024-09-12T22:04:34.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:34.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674817+0000", 2024-09-12T22:04:34.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6859000000000001e-05 2024-09-12T22:04:34.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:34.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.501e-05 2024-09-12T22:04:34.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674838+0000", 2024-09-12T22:04:34.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-06 2024-09-12T22:04:34.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715161+0000", 2024-09-12T22:04:34.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.04032285 2024-09-12T22:04:34.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715317+0000", 2024-09-12T22:04:34.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015649199999999999 2024-09-12T22:04:34.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715463+0000", 2024-09-12T22:04:34.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145704 2024-09-12T22:04:34.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717480+0000", 2024-09-12T22:04:34.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020168220000000001 2024-09-12T22:04:34.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718079+0000", 2024-09-12T22:04:34.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000599115 2024-09-12T22:04:34.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718134+0000", 2024-09-12T22:04:34.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:04:34.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718168+0000", 2024-09-12T22:04:34.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4301000000000002e-05 2024-09-12T22:04:34.415 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.416 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.416 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.416 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44132 5.e 5:7634b859:::benchmark_data_smithi043_32659_object44131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.416 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:34.416 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.629985906000002, 2024-09-12T22:04:34.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039558587999999999, 2024-09-12T22:04:34.416 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.416 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.416 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.416 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.416 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.417 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.417 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44132 2024-09-12T22:04:34.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.417 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:34.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:34.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675448+0000", 2024-09-12T22:04:34.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3699999999999999e-07 2024-09-12T22:04:34.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675552+0000", 2024-09-12T22:04:34.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104294 2024-09-12T22:04:34.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675562+0000", 2024-09-12T22:04:34.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9629999999999993e-06 2024-09-12T22:04:34.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675569+0000", 2024-09-12T22:04:34.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8809999999999998e-06 2024-09-12T22:04:34.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675612+0000", 2024-09-12T22:04:34.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591000000000003e-05 2024-09-12T22:04:34.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675717+0000", 2024-09-12T22:04:34.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010497099999999999 2024-09-12T22:04:34.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675835+0000", 2024-09-12T22:04:34.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011793799999999999 2024-09-12T22:04:34.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713616+0000", 2024-09-12T22:04:34.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037781032999999999 2024-09-12T22:04:34.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714911+0000", 2024-09-12T22:04:34.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001294604 2024-09-12T22:04:34.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714964+0000", 2024-09-12T22:04:34.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3408000000000001e-05 2024-09-12T22:04:34.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715005+0000", 2024-09-12T22:04:34.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0967999999999998e-05 2024-09-12T22:04:34.422 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.422 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.422 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.422 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44133 5.b 5:d0a59edd:::benchmark_data_smithi043_32659_object44132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.422 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:34.422 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.629848125999999, 2024-09-12T22:04:34.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039513020000000003, 2024-09-12T22:04:34.422 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:34.422 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44133 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:34.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:34.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:34.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:34.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675585+0000", 2024-09-12T22:04:34.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5499999999999998e-07 2024-09-12T22:04:34.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:34.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675634+0000", 2024-09-12T22:04:34.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8520999999999998e-05 2024-09-12T22:04:34.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:34.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675641+0000", 2024-09-12T22:04:34.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4440000000000002e-06 2024-09-12T22:04:34.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675646+0000", 2024-09-12T22:04:34.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2660000000000001e-06 2024-09-12T22:04:34.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:34.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675692+0000", 2024-09-12T22:04:34.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5915999999999999e-05 2024-09-12T22:04:34.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:34.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675812+0000", 2024-09-12T22:04:34.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119419 2024-09-12T22:04:34.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675950+0000", 2024-09-12T22:04:34.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013831499999999999 2024-09-12T22:04:34.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713574+0000", 2024-09-12T22:04:34.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037623801999999998 2024-09-12T22:04:34.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:34.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715015+0000", 2024-09-12T22:04:34.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014410720000000001 2024-09-12T22:04:34.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:34.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715059+0000", 2024-09-12T22:04:34.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:04:34.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:34.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:34.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:34.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715097+0000", 2024-09-12T22:04:34.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8519000000000002e-05 2024-09-12T22:04:34.428 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.428 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.428 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.428 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:34.428 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:34.428 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:34.430 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-09-12T22:04:34.430 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:34.428+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:34.431 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:34.530 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:34.529+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:34.559 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:34.559 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:34.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.559 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117450 5.1 5:80faa800:::benchmark_data_smithi043_32659_object117449:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.554564+0000", 2024-09-12T22:04:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0040271719999999999, 2024-09-12T22:04:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040549109999999996, 2024-09-12T22:04:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117450 2024-09-12T22:04:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.554564+0000", 2024-09-12T22:04:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.554564+0000", 2024-09-12T22:04:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.554565+0000", 2024-09-12T22:04:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2900000000000002e-07 2024-09-12T22:04:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.554692+0000", 2024-09-12T22:04:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012633699999999999 2024-09-12T22:04:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.554699+0000", 2024-09-12T22:04:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3309999999999998e-06 2024-09-12T22:04:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.554704+0000", 2024-09-12T22:04:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1059999999999999e-06 2024-09-12T22:04:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.554754+0000", 2024-09-12T22:04:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9598000000000002e-05 2024-09-12T22:04:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.554888+0000", 2024-09-12T22:04:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000134332 2024-09-12T22:04:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555053+0000", 2024-09-12T22:04:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000164816 2024-09-12T22:04:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.558559+0000", 2024-09-12T22:04:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035063379999999999 2024-09-12T22:04:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:117452 5.9 e41/40 5:9f4d3dfc:::benchmark_data_smithi043_32659_object117451:head v 41'7383, mlcod=41'7381)", 2024-09-12T22:04:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.555307+0000", 2024-09-12T22:04:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0032848679999999998, 2024-09-12T22:04:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033928840000000001, 2024-09-12T22:04:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555307+0000", 2024-09-12T22:04:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555307+0000", 2024-09-12T22:04:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555307+0000", 2024-09-12T22:04:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:04:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555362+0000", 2024-09-12T22:04:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4642999999999998e-05 2024-09-12T22:04:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555372+0000", 2024-09-12T22:04:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0433e-05 2024-09-12T22:04:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555381+0000", 2024-09-12T22:04:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8289999999999997e-06 2024-09-12T22:04:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555418+0000", 2024-09-12T22:04:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-09-12T22:04:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555432+0000", 2024-09-12T22:04:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.435e-05 2024-09-12T22:04:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117454 5.1 5:8f7f583d:::benchmark_data_smithi043_32659_object117453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.555862+0000", 2024-09-12T22:04:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0027293959999999998, 2024-09-12T22:04:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002895852, 2024-09-12T22:04:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117454 2024-09-12T22:04:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555862+0000", 2024-09-12T22:04:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555862+0000", 2024-09-12T22:04:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555863+0000", 2024-09-12T22:04:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3480000000000001e-06 2024-09-12T22:04:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555906+0000", 2024-09-12T22:04:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2823e-05 2024-09-12T22:04:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555917+0000", 2024-09-12T22:04:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0761000000000001e-05 2024-09-12T22:04:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.555925+0000", 2024-09-12T22:04:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4839999999999998e-06 2024-09-12T22:04:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556930+0000", 2024-09-12T22:04:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001005679 2024-09-12T22:04:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557057+0000", 2024-09-12T22:04:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012685800000000001 2024-09-12T22:04:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557166+0000", 2024-09-12T22:04:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010883900000000001 2024-09-12T22:04:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:117450 5.1 e41/40 ondisk, result = 0)", 2024-09-12T22:04:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.557230+0000", 2024-09-12T22:04:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00136184, 2024-09-12T22:04:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001591145, 2024-09-12T22:04:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557230+0000", 2024-09-12T22:04:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557230+0000", 2024-09-12T22:04:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557230+0000", 2024-09-12T22:04:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:04:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557234+0000", 2024-09-12T22:04:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8920000000000002e-06 2024-09-12T22:04:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557249+0000", 2024-09-12T22:04:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-12T22:04:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557255+0000", 2024-09-12T22:04:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3489999999999997e-06 2024-09-12T22:04:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.558550+0000", 2024-09-12T22:04:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012948359999999999 2024-09-12T22:04:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.558555+0000", 2024-09-12T22:04:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:04:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117458 5.2 5:4da4d61f:::benchmark_data_smithi043_32659_object117457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.557411+0000", 2024-09-12T22:04:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0011806469999999999, 2024-09-12T22:04:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001467257, 2024-09-12T22:04:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117458 2024-09-12T22:04:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557411+0000", 2024-09-12T22:04:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557411+0000", 2024-09-12T22:04:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557412+0000", 2024-09-12T22:04:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-12T22:04:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557532+0000", 2024-09-12T22:04:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119918 2024-09-12T22:04:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557543+0000", 2024-09-12T22:04:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1085e-05 2024-09-12T22:04:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557549+0000", 2024-09-12T22:04:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.19e-06 2024-09-12T22:04:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557588+0000", 2024-09-12T22:04:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9104999999999999e-05 2024-09-12T22:04:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557673+0000", 2024-09-12T22:04:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5187999999999998e-05 2024-09-12T22:04:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:117459 5.9 e41/40 5:903dc6fb:::benchmark_data_smithi043_32659_object117458:head v 41'7384, mlcod=41'7381)", 2024-09-12T22:04:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.557964+0000", 2024-09-12T22:04:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00062733899999999998, 2024-09-12T22:04:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00097196299999999995, 2024-09-12T22:04:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557964+0000", 2024-09-12T22:04:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557964+0000", 2024-09-12T22:04:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.557965+0000", 2024-09-12T22:04:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1699999999999998e-07 2024-09-12T22:04:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.558030+0000", 2024-09-12T22:04:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4842e-05 2024-09-12T22:04:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.558042+0000", 2024-09-12T22:04:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2782999999999999e-05 2024-09-12T22:04:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.558053+0000", 2024-09-12T22:04:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0798999999999999e-05 2024-09-12T22:04:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.558536+0000", 2024-09-12T22:04:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048276100000000001 2024-09-12T22:04:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.558556+0000", 2024-09-12T22:04:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0166999999999999e-05 2024-09-12T22:04:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 6 2024-09-12T22:04:34.589 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:34.590 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:34.631 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:34.630+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:34.732 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:34.731+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:34.785 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:34.786 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:34.800 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:34.844 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:34.842+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:34.934 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:34.932+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:34.954 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:34.954 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:34.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:34.954 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:34.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.954 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:34.955 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:34.955 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.317194276999999, 2024-09-12T22:04:34.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:34.955 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:34.955 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:34.955 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.955 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:34.955 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:34.955 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.955 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:34.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.955 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:34.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:34.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:34.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:34.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:34.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:34.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:34.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:34.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:34.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:34.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:34.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:34.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:34.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:34.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:34.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:34.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:34.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:34.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:34.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:34.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:34.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:34.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:34.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:34.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:34.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:34.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:34.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:34.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:34.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:34.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:34.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:34.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:34.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:34.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:34.961 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.961 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:34.961 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.961 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79650 5.1 5:87bbf2de:::benchmark_data_smithi043_32659_object79649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:34.961 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:34.961 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.119008969999999, 2024-09-12T22:04:34.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021887977999999999, 2024-09-12T22:04:34.961 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:34.961 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:34.961 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.962 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:34.962 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:34.962 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.962 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79650 2024-09-12T22:04:34.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.962 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:34.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:34.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:34.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:34.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831483+0000", 2024-09-12T22:04:34.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:34.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831484+0000", 2024-09-12T22:04:34.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:04:34.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:34.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831558+0000", 2024-09-12T22:04:34.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4556999999999998e-05 2024-09-12T22:04:34.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:34.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831567+0000", 2024-09-12T22:04:34.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3410000000000003e-06 2024-09-12T22:04:34.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.831574+0000", 2024-09-12T22:04:34.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2559999999999996e-06 2024-09-12T22:04:34.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.832773+0000", 2024-09-12T22:04:34.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001199475 2024-09-12T22:04:34.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:34.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.832890+0000", 2024-09-12T22:04:34.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116768 2024-09-12T22:04:34.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.833027+0000", 2024-09-12T22:04:34.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000136527 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.837448+0000", 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044212130000000002 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853313+0000", 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015865016999999999 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853344+0000", 2024-09-12T22:04:34.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1010000000000003e-05 2024-09-12T22:04:34.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:34.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.853371+0000", 2024-09-12T22:04:34.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7092000000000001e-05 2024-09-12T22:04:34.967 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.967 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:34.967 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.967 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79661 5.2 5:4081316a:::benchmark_data_smithi043_32659_object79660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:34.967 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:34.967 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.102138093000001, 2024-09-12T22:04:34.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.025955590000000001, 2024-09-12T22:04:34.968 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:34.968 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:34.968 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.968 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:34.968 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:34.968 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.968 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79661 2024-09-12T22:04:34.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.968 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:34.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:34.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:34.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:34.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:34.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:34.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848355+0000", 2024-09-12T22:04:34.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3009999999999999e-06 2024-09-12T22:04:34.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:34.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848410+0000", 2024-09-12T22:04:34.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639000000000003e-05 2024-09-12T22:04:34.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:34.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848426+0000", 2024-09-12T22:04:34.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5979000000000001e-05 2024-09-12T22:04:34.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848436+0000", 2024-09-12T22:04:34.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0227000000000001e-05 2024-09-12T22:04:34.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848479+0000", 2024-09-12T22:04:34.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2450000000000002e-05 2024-09-12T22:04:34.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:34.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848574+0000", 2024-09-12T22:04:34.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5508999999999996e-05 2024-09-12T22:04:34.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:34.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848667+0000", 2024-09-12T22:04:34.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999997e-05 2024-09-12T22:04:34.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:34.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.850764+0000", 2024-09-12T22:04:34.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020964920000000001 2024-09-12T22:04:34.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874250+0000", 2024-09-12T22:04:34.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.023486440000000001 2024-09-12T22:04:34.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:34.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874283+0000", 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2552000000000003e-05 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874310+0000", 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7001000000000001e-05 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 1.5398881520000001, 2024-09-12T22:04:34.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:34.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:34.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:34.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:04:34.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:04:34.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:34.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:04:34.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:04:34.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:34.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:04:34.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:04:34.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:04:34.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:04:34.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:04:34.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:04:34.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:34.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:04:34.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:04:34.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:04:34.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:04:34.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:34.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:04:34.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:04:34.978 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.978 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:34.978 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.978 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:34.978 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:34.978 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 1.539708222, 2024-09-12T22:04:34.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:04:34.979 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:34.979 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:34.979 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:34.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:34.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:34.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.979 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:04:34.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.979 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:34.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:34.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:34.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:34.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:34.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:34.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:04:34.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:04:34.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:34.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:04:34.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:04:34.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:34.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:04:34.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:04:34.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:04:34.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:04:34.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:04:34.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:04:34.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:34.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:04:34.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:04:34.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:04:34.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:04:34.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:34.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:04:34.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:04:34.983 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.983 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:34.984 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.984 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:34.984 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:34.984 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 1.539641781, 2024-09-12T22:04:34.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:04:34.984 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:34.984 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:34.984 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:34.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:34.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:34.985 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.985 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:04:34.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.985 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:34.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:34.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:34.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:34.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:34.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:34.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:04:34.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:04:34.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:34.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:04:34.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:04:34.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:34.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:04:34.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:04:34.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:04:34.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:04:34.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:04:34.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:04:34.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:34.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:04:34.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:04:34.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:04:34.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:04:34.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:34.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:04:34.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:04:34.989 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.989 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:34.989 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.989 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 1.539585338, 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:34.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:34.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:34.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:34.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:34.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:34.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:34.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:34.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:04:34.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:04:34.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:34.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:04:34.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:04:34.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:04:34.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:04:34.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:04:34.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:04:34.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:34.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:04:34.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:04:34.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:34.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:04:34.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:04:34.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:34.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:04:34.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:04:34.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:34.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:04:34.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:04:34.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:34.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:04:34.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:04:34.996 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.996 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:34.996 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:34.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.996 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:34.996 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:34.996 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 1.5395168780000001, 2024-09-12T22:04:34.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:04:34.996 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:34.996 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:34.997 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:34.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:34.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:34.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:34.997 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:04:34.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.997 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:34.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:34.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:34.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:34.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:34.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:34.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:34.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:04:34.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:04:34.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:34.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:04:34.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:04:34.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:34.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:04:34.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:04:34.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:34.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:04:34.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:04:34.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:34.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:34.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:34.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:04:34.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:04:35.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:35.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:04:35.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:04:35.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:04:35.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:04:35.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:35.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:04:35.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:04:35.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:35.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:04:35.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:04:35.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:35.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:04:35.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:04:35.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:35.002 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 1.539459143, 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.003 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:04:35.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:04:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:04:35.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:04:35.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:35.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:04:35.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:04:35.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:35.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:04:35.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:04:35.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:35.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:04:35.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:04:35.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.009 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:35.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.009 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:35.009 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:35.009 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 1.539391451, 2024-09-12T22:04:35.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:04:35.010 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:35.010 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:35.010 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:35.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:35.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:35.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:35.010 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:04:35.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.010 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:35.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:35.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:35.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:35.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:35.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:35.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:35.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:04:35.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:35.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:04:35.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:04:35.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:35.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:04:35.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:04:35.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:35.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:04:35.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:04:35.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:04:35.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:04:35.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:35.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:04:35.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:04:35.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:04:35.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:04:35.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:35.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:04:35.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:04:35.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:35.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:04:35.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:04:35.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:35.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:04:35.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:04:35.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:35.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:04:35.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:04:35.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:35.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:04:35.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:04:35.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:35.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:04:35.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:04:35.017 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.017 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:35.017 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.017 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:35.017 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:35.017 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 1.539336389, 2024-09-12T22:04:35.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:04:35.017 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:35.017 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:35.017 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:35.018 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:35.018 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:35.018 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:35.018 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:04:35.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.018 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:35.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:35.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:35.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:35.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:04:35.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:04:35.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:35.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:04:35.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:04:35.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:04:35.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:04:35.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:35.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:04:35.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:04:35.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:04:35.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:04:35.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:35.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:04:35.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:04:35.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:35.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:04:35.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:04:35.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:04:35.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:35.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:04:35.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:04:35.024 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.024 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:35.024 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.024 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:35.024 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:35.024 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.49868886899999998, 2024-09-12T22:04:35.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:04:35.025 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:35.025 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:35.025 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:35.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:35.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:35.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:35.025 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:04:35.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.025 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:35.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:35.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:35.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:35.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:35.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:35.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:04:35.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:04:35.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:35.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:04:35.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:04:35.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:35.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:04:35.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:04:35.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:35.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:04:35.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:04:35.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:04:35.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:04:35.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:35.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:04:35.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:04:35.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:04:35.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:04:35.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:35.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:04:35.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:04:35.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:35.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:04:35.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:04:35.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:35.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:04:35.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:04:35.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:35.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:04:35.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:04:35.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:04:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:04:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:04:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:04:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.032 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:35.032 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:35.032 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.496075141, 2024-09-12T22:04:35.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:04:35.032 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:35.032 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:35.032 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:35.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:35.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:35.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:35.032 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:04:35.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.033 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:35.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:35.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:35.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:35.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:35.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:35.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:04:35.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:04:35.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:35.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:04:35.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:04:35.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:35.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:04:35.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:04:35.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:35.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:04:35.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:04:35.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:04:35.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:04:35.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:35.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:35.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:04:35.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:04:35.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:04:35.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:35.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:04:35.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:04:35.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:35.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:04:35.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:04:35.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:35.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:04:35.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:04:35.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:35.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:04:35.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:04:35.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:35.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:04:35.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:04:35.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:35.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:04:35.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:04:35.038 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.038 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:35.038 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.038 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117396 5.1 5:83c565df:::benchmark_data_smithi043_32659_object117395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:35.038 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.49593401799999998, 2024-09-12T22:04:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.090595995999999998, 2024-09-12T22:04:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117396 2024-09-12T22:04:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:35.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:35.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:35.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:35.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454559+0000", 2024-09-12T22:04:35.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:04:35.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:35.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454629+0000", 2024-09-12T22:04:35.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0036000000000005e-05 2024-09-12T22:04:35.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:35.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454641+0000", 2024-09-12T22:04:35.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2232000000000001e-05 2024-09-12T22:04:35.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:35.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454649+0000", 2024-09-12T22:04:35.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-12T22:04:35.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454697+0000", 2024-09-12T22:04:35.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8028000000000002e-05 2024-09-12T22:04:35.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:35.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454702+0000", 2024-09-12T22:04:35.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:04:35.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540467+0000", 2024-09-12T22:04:35.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085764217000000004 2024-09-12T22:04:35.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:35.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540596+0000", 2024-09-12T22:04:35.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129787 2024-09-12T22:04:35.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:35.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540774+0000", 2024-09-12T22:04:35.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017746799999999999 2024-09-12T22:04:35.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:35.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544679+0000", 2024-09-12T22:04:35.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003904996 2024-09-12T22:04:35.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545009+0000", 2024-09-12T22:04:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033056600000000002 2024-09-12T22:04:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545067+0000", 2024-09-12T22:04:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7871999999999997e-05 2024-09-12T22:04:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545154+0000", 2024-09-12T22:04:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6701999999999998e-05 2024-09-12T22:04:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.046 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:35.046 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.046 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117398 5.6 5:6d151138:::benchmark_data_smithi043_32659_object117397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:35.046 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:35.046 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.47463884699999997, 2024-09-12T22:04:35.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044999137000000002, 2024-09-12T22:04:35.046 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:35.046 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:35.046 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:35.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:35.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:35.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:35.047 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117398 2024-09-12T22:04:35.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.047 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:35.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:35.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:35.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:35.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:35.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:35.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475854+0000", 2024-09-12T22:04:35.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:04:35.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:35.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475914+0000", 2024-09-12T22:04:35.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9422999999999997e-05 2024-09-12T22:04:35.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:35.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475925+0000", 2024-09-12T22:04:35.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0881e-05 2024-09-12T22:04:35.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475930+0000", 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475974+0000", 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3810999999999998e-05 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475981+0000", 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1590000000000004e-06 2024-09-12T22:04:35.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504359+0000", 2024-09-12T22:04:35.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028377711 2024-09-12T22:04:35.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:35.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504526+0000", 2024-09-12T22:04:35.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167023 2024-09-12T22:04:35.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:35.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504661+0000", 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135148 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.506563+0000", 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901778 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520770+0000", 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014206724 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520803+0000", 2024-09-12T22:04:35.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3083000000000002e-05 2024-09-12T22:04:35.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:35.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520852+0000", 2024-09-12T22:04:35.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9543999999999999e-05 2024-09-12T22:04:35.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.052 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:35.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.052 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117399 5.3 5:ce33c2c7:::benchmark_data_smithi043_32659_object117398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:35.052 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:35.052 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.46986985399999998, 2024-09-12T22:04:35.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038176902999999998, 2024-09-12T22:04:35.053 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:35.053 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:35.053 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:35.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:35.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:35.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:35.053 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117399 2024-09-12T22:04:35.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.053 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:35.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:35.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:35.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480624+0000", 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.322e-06 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480670+0000", 2024-09-12T22:04:35.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6365000000000001e-05 2024-09-12T22:04:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480682+0000", 2024-09-12T22:04:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:04:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480689+0000", 2024-09-12T22:04:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:04:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480731+0000", 2024-09-12T22:04:35.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:04:35.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:35.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480738+0000", 2024-09-12T22:04:35.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:04:35.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513753+0000", 2024-09-12T22:04:35.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.033015125999999999 2024-09-12T22:04:35.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:35.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513935+0000", 2024-09-12T22:04:35.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018219500000000001 2024-09-12T22:04:35.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:35.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.514170+0000", 2024-09-12T22:04:35.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000234694 2024-09-12T22:04:35.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:35.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518462+0000", 2024-09-12T22:04:35.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004291563 2024-09-12T22:04:35.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:35.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518655+0000", 2024-09-12T22:04:35.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019362700000000001 2024-09-12T22:04:35.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:35.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518710+0000", 2024-09-12T22:04:35.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:04:35.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:35.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518799+0000", 2024-09-12T22:04:35.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9000999999999997e-05 2024-09-12T22:04:35.059 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.059 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:35.059 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.059 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117404 5.3 5:c26efda0:::benchmark_data_smithi043_32659_object117403:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:35.059 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.501966+0000", 2024-09-12T22:04:35.059 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.44852603200000002, 2024-09-12T22:04:35.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.029131555, 2024-09-12T22:04:35.059 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:35.059 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:35.059 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:35.059 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:35.060 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:35.060 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:35.060 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117404 2024-09-12T22:04:35.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.060 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:35.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:35.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.501966+0000", 2024-09-12T22:04:35.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:35.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.501966+0000", 2024-09-12T22:04:35.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:35.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.501967+0000", 2024-09-12T22:04:35.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.395e-06 2024-09-12T22:04:35.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:35.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.501993+0000", 2024-09-12T22:04:35.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5426e-05 2024-09-12T22:04:35.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:35.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.502003+0000", 2024-09-12T22:04:35.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:04:35.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:35.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.502011+0000", 2024-09-12T22:04:35.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.306e-06 2024-09-12T22:04:35.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.502072+0000", 2024-09-12T22:04:35.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1070999999999999e-05 2024-09-12T22:04:35.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:35.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.502082+0000", 2024-09-12T22:04:35.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0268999999999999e-05 2024-09-12T22:04:35.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.516386+0000", 2024-09-12T22:04:35.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014304051999999999 2024-09-12T22:04:35.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:35.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.516518+0000", 2024-09-12T22:04:35.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013170200000000001 2024-09-12T22:04:35.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:35.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.516691+0000", 2024-09-12T22:04:35.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017342 2024-09-12T22:04:35.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:35.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518808+0000", 2024-09-12T22:04:35.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002117173 2024-09-12T22:04:35.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.530967+0000", 2024-09-12T22:04:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0121586 2024-09-12T22:04:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.531027+0000", 2024-09-12T22:04:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0035999999999999e-05 2024-09-12T22:04:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.531098+0000", 2024-09-12T22:04:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0642000000000006e-05 2024-09-12T22:04:35.066 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.066 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:35.066 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.066 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117406 5.1 5:87497e79:::benchmark_data_smithi043_32659_object117405:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:35.066 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.512418+0000", 2024-09-12T22:04:35.066 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.43807428700000001, 2024-09-12T22:04:35.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.03314164, 2024-09-12T22:04:35.066 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:35.066 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:35.066 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:35.066 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:35.066 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117406 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512418+0000", 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512418+0000", 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:35.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512419+0000", 2024-09-12T22:04:35.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.716e-06 2024-09-12T22:04:35.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:35.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512469+0000", 2024-09-12T22:04:35.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9867000000000002e-05 2024-09-12T22:04:35.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:35.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512480+0000", 2024-09-12T22:04:35.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:04:35.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:35.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512490+0000", 2024-09-12T22:04:35.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7580000000000004e-06 2024-09-12T22:04:35.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512546+0000", 2024-09-12T22:04:35.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5985e-05 2024-09-12T22:04:35.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:35.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512555+0000", 2024-09-12T22:04:35.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1430000000000004e-06 2024-09-12T22:04:35.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542732+0000", 2024-09-12T22:04:35.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.030177240000000001 2024-09-12T22:04:35.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:35.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542860+0000", 2024-09-12T22:04:35.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012837499999999999 2024-09-12T22:04:35.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:35.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.543012+0000", 2024-09-12T22:04:35.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015160400000000001 2024-09-12T22:04:35.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:35.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545190+0000", 2024-09-12T22:04:35.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021785139999999999 2024-09-12T22:04:35.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:35.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545334+0000", 2024-09-12T22:04:35.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014330199999999999 2024-09-12T22:04:35.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:35.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545392+0000", 2024-09-12T22:04:35.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8415000000000002e-05 2024-09-12T22:04:35.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:35.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545559+0000", 2024-09-12T22:04:35.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016730299999999999 2024-09-12T22:04:35.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.072 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:35.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.072 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117407 5.c 5:3c61c1b7:::benchmark_data_smithi043_32659_object117406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:35.072 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:35.073 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.43666433999999998, 2024-09-12T22:04:35.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042860548999999998, 2024-09-12T22:04:35.073 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:35.073 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:35.073 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:35.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:35.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:35.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:35.073 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117407 2024-09-12T22:04:35.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.073 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:35.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:35.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513829+0000", 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:35.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513900+0000", 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1482000000000004e-05 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513909+0000", 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8370000000000003e-06 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513917+0000", 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513967+0000", 2024-09-12T22:04:35.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.007e-05 2024-09-12T22:04:35.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:35.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513975+0000", 2024-09-12T22:04:35.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5639999999999999e-06 2024-09-12T22:04:35.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542411+0000", 2024-09-12T22:04:35.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028436032999999999 2024-09-12T22:04:35.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:35.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542539+0000", 2024-09-12T22:04:35.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012777900000000001 2024-09-12T22:04:35.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:35.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542687+0000", 2024-09-12T22:04:35.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148343 2024-09-12T22:04:35.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:35.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548120+0000", 2024-09-12T22:04:35.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054333580000000001 2024-09-12T22:04:35.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:35.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556549+0000", 2024-09-12T22:04:35.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084288309999999995 2024-09-12T22:04:35.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:35.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556596+0000", 2024-09-12T22:04:35.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6458999999999997e-05 2024-09-12T22:04:35.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:35.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556688+0000", 2024-09-12T22:04:35.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2676999999999994e-05 2024-09-12T22:04:35.078 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.078 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117409 5.c 5:3558ef4c:::benchmark_data_smithi043_32659_object117408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.519089+0000", 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.43140354600000003, 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.037792457000000002, 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117409 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.079 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519089+0000", 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519089+0000", 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519089+0000", 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:04:35.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519111+0000", 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2339000000000001e-05 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519116+0000", 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2009999999999998e-06 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519121+0000", 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4859999999999999e-06 2024-09-12T22:04:35.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519163+0000", 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2369e-05 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519170+0000", 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0999999999999998e-06 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544355+0000", 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.025184933999999999 2024-09-12T22:04:35.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544504+0000", 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014907000000000001 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544674+0000", 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000169283 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548125+0000", 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034515700000000002 2024-09-12T22:04:35.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556750+0000", 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086251910000000008 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556800+0000", 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9033000000000003e-05 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556881+0000", 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1451000000000003e-05 2024-09-12T22:04:35.084 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.085 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:35.085 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.085 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:35.085 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:35.085 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:35.085 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:04:35.089 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:35.089 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:35.085+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:35.187 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:35.186+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:35.192 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 41 16 119099 119083 181.514 53.3125 0.00522368 0.00550667 2024-09-12T22:04:35.197 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:35.215 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:35.215 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:35.234 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:35.235 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:35.237 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:35.238 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:35.251 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:35.251 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:35.266 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:35.288 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:35.287+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:35.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~12s 2024-09-12T22:04:35.389 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:35.388+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:35.427 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:35.427 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:35.441 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:35.527 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:35.526+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:35.590 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:35.589+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:35.643 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:35.643 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:35.658 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:35.700 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:35.699+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:35.791 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:35.790+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:35.812 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:35.812 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:35.825 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:35.892 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:35.891+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:35.974 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:35.974 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:35.988 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:35.993 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:35.992+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:36.094 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:36.093+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:36.183 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:36.183 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:36.192 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 42 16 121720 121704 181.092 163.812 0.00403206 0.00551951 2024-09-12T22:04:36.194 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:36.194+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:36.196 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:36.295 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:36.294+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:36.360 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:36.361 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:36.376 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:36.417 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:36.416+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:36.431 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:04:36.497 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:36.496+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:36.578 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:36.578 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:36.593 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:36.598 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:36.597+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:36.699 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:36.698+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:36.748 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:36.748 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:36.763 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:36.805 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:36.804+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:36.901 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:36.900+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:36.916 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:36.917 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:36.928 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:37.001 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:37.000+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:37.081 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:37.081 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:37.094 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:37.104 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:37.101+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:37.193 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 43 16 124298 124282 180.628 161.125 0.00497233 0.00553373 2024-09-12T22:04:37.203 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:37.202+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:37.238 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:04:37.283 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:37.283 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:37.294 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:37.338 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:37.337+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:37.347 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:37.372 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:37.372 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:37.403 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:37.404 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:37.404 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-09-12T22:04:37.404 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:04:37.404 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-12T22:04:37.404 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T22:04:37.405 INFO:teuthology.orchestra.console.smithi047:Power on 2024-09-12T22:04:37.405 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-09-12T22:04:37.416 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:37.403+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:37.417 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:37.417 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:37.417 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-09-12T22:04:37.427 DEBUG:teuthology.orchestra.console.smithi047:power on output: Chassis Power Control: Up/On 2024-09-12T22:04:37.454 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:37.454 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:37.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.454 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:124941 5.c e42/40 5:3b098e40:::benchmark_data_smithi043_32659_object124940:head v 42'7775, mlcod=42'7772)", 2024-09-12T22:04:37.454 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:37.452076+0000", 2024-09-12T22:04:37.454 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00040549200000000003, 2024-09-12T22:04:37.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00042841400000000001, 2024-09-12T22:04:37.455 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.455 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.455 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:37.455 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452076+0000", 2024-09-12T22:04:37.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452076+0000", 2024-09-12T22:04:37.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452077+0000", 2024-09-12T22:04:37.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5699999999999998e-07 2024-09-12T22:04:37.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452082+0000", 2024-09-12T22:04:37.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9740000000000001e-06 2024-09-12T22:04:37.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452090+0000", 2024-09-12T22:04:37.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1249999999999993e-06 2024-09-12T22:04:37.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452096+0000", 2024-09-12T22:04:37.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2589999999999997e-06 2024-09-12T22:04:37.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452130+0000", 2024-09-12T22:04:37.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4020000000000003e-05 2024-09-12T22:04:37.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452142+0000", 2024-09-12T22:04:37.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2231e-05 2024-09-12T22:04:37.458 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.458 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.458 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.458 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:124943 5.f 5:feab38fd:::benchmark_data_smithi043_32659_object124942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:37.458 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:37.452220+0000", 2024-09-12T22:04:37.458 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00026226899999999998, 2024-09-12T22:04:37.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00035379699999999999, 2024-09-12T22:04:37.458 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.458 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.459 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:37.459 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.459 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.459 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.459 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 124943 2024-09-12T22:04:37.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.459 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452220+0000", 2024-09-12T22:04:37.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452220+0000", 2024-09-12T22:04:37.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452220+0000", 2024-09-12T22:04:37.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4399999999999999e-07 2024-09-12T22:04:37.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452281+0000", 2024-09-12T22:04:37.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0708999999999998e-05 2024-09-12T22:04:37.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452290+0000", 2024-09-12T22:04:37.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.217e-06 2024-09-12T22:04:37.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452297+0000", 2024-09-12T22:04:37.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5379999999999999e-06 2024-09-12T22:04:37.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452397+0000", 2024-09-12T22:04:37.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9765000000000005e-05 2024-09-12T22:04:37.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452528+0000", 2024-09-12T22:04:37.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013125499999999999 2024-09-12T22:04:37.462 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.462 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.462 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.462 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:124926 5.0 5:06ad78ae:::benchmark_data_smithi043_32659_object124925:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:37.462 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:37.445998+0000", 2024-09-12T22:04:37.463 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0064841179999999997, 2024-09-12T22:04:37.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0066244040000000004, 2024-09-12T22:04:37.463 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.463 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.463 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:37.463 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.463 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.463 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.463 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 124926 2024-09-12T22:04:37.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.463 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.445998+0000", 2024-09-12T22:04:37.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.445998+0000", 2024-09-12T22:04:37.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.445999+0000", 2024-09-12T22:04:37.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6099999999999999e-07 2024-09-12T22:04:37.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.446118+0000", 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119527 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.446129+0000", 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0740999999999999e-05 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.446135+0000", 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2570000000000004e-06 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.447490+0000", 2024-09-12T22:04:37.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0013553230000000001 2024-09-12T22:04:37.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.447611+0000", 2024-09-12T22:04:37.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012019399999999999 2024-09-12T22:04:37.466 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.466 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.466 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.467 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:124928 5.8 5:1e3adbf2:::benchmark_data_smithi043_32659_object124927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:37.467 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:37.447443+0000", 2024-09-12T22:04:37.467 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0050391999999999998, 2024-09-12T22:04:37.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0052244090000000002, 2024-09-12T22:04:37.467 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.467 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.467 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:37.467 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.467 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.467 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.467 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 124928 2024-09-12T22:04:37.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.467 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.447443+0000", 2024-09-12T22:04:37.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.447443+0000", 2024-09-12T22:04:37.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.447443+0000", 2024-09-12T22:04:37.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:04:37.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.447521+0000", 2024-09-12T22:04:37.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7435000000000007e-05 2024-09-12T22:04:37.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.447530+0000", 2024-09-12T22:04:37.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6959999999999994e-06 2024-09-12T22:04:37.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.447537+0000", 2024-09-12T22:04:37.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3080000000000002e-06 2024-09-12T22:04:37.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.447670+0000", 2024-09-12T22:04:37.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013277100000000001 2024-09-12T22:04:37.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.447798+0000", 2024-09-12T22:04:37.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012855599999999999 2024-09-12T22:04:37.470 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.470 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.470 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.471 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:124931 5.0 5:046bf430:::benchmark_data_smithi043_32659_object124930:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:37.471 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:37.449795+0000", 2024-09-12T22:04:37.471 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0026868410000000001, 2024-09-12T22:04:37.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0029178070000000001, 2024-09-12T22:04:37.471 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.471 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.471 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:37.471 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.471 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.471 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.471 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 124931 2024-09-12T22:04:37.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.472 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.472 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449795+0000", 2024-09-12T22:04:37.472 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.472 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449795+0000", 2024-09-12T22:04:37.472 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449796+0000", 2024-09-12T22:04:37.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.175e-06 2024-09-12T22:04:37.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449834+0000", 2024-09-12T22:04:37.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8309999999999997e-05 2024-09-12T22:04:37.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449846+0000", 2024-09-12T22:04:37.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1212e-05 2024-09-12T22:04:37.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449852+0000", 2024-09-12T22:04:37.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5379999999999999e-06 2024-09-12T22:04:37.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450043+0000", 2024-09-12T22:04:37.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019062800000000001 2024-09-12T22:04:37.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450154+0000", 2024-09-12T22:04:37.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000110769 2024-09-12T22:04:37.475 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.475 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.476 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.476 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:124932 5.0 5:09f09f70:::benchmark_data_smithi043_32659_object124931:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:37.476 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:37.449865+0000", 2024-09-12T22:04:37.476 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0026166230000000002, 2024-09-12T22:04:37.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0029094780000000001, 2024-09-12T22:04:37.477 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.477 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.477 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:37.477 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.477 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.477 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.477 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 124932 2024-09-12T22:04:37.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.477 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449865+0000", 2024-09-12T22:04:37.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449865+0000", 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449866+0000", 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0200000000000002e-07 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449923+0000", 2024-09-12T22:04:37.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7674999999999999e-05 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449931+0000", 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8800000000000008e-06 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449937+0000", 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2800000000000003e-06 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.451895+0000", 2024-09-12T22:04:37.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019587070000000001 2024-09-12T22:04:37.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.480 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.480 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452012+0000", 2024-09-12T22:04:37.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011646699999999999 2024-09-12T22:04:37.480 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.480 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.480 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.480 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:124934 5.4 5:24e4716e:::benchmark_data_smithi043_32659_object124933:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:37.480 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:37.449945+0000", 2024-09-12T22:04:37.480 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0025363859999999998, 2024-09-12T22:04:37.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028652579999999999, 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 124934 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449945+0000", 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.481 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449945+0000", 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449946+0000", 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449983+0000", 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6795999999999998e-05 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449990+0000", 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0319999999999998e-06 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.449995+0000", 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8500000000000002e-06 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450076+0000", 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1637000000000005e-05 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450231+0000", 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015451199999999999 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:124936 5.d 5:b9014e7e:::benchmark_data_smithi043_32659_object124935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:37.450006+0000", 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0024762679999999998, 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028742820000000001, 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:37.484 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 124936 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450006+0000", 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450006+0000", 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450006+0000", 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450089+0000", 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2562e-05 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450097+0000", 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450102+0000", 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3639999999999998e-06 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450158+0000", 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5865000000000001e-05 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450394+0000", 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00023533199999999999 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.487 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:37.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450552+0000", 2024-09-12T22:04:37.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000158228 2024-09-12T22:04:37.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:37.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452834+0000", 2024-09-12T22:04:37.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022821690000000001 2024-09-12T22:04:37.488 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.488 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.488 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.488 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:124938 5.f 5:fcc39986:::benchmark_data_smithi043_32659_object124937:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:37.489 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:37.450252+0000", 2024-09-12T22:04:37.489 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0022296780000000001, 2024-09-12T22:04:37.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00269397, 2024-09-12T22:04:37.489 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.489 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.489 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:37.489 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.489 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.489 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.489 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 124938 2024-09-12T22:04:37.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.489 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450252+0000", 2024-09-12T22:04:37.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450252+0000", 2024-09-12T22:04:37.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450253+0000", 2024-09-12T22:04:37.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:04:37.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450318+0000", 2024-09-12T22:04:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4571000000000002e-05 2024-09-12T22:04:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450327+0000", 2024-09-12T22:04:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0350000000000007e-06 2024-09-12T22:04:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450333+0000", 2024-09-12T22:04:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6839999999999999e-06 2024-09-12T22:04:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450384+0000", 2024-09-12T22:04:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0324999999999997e-05 2024-09-12T22:04:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450538+0000", 2024-09-12T22:04:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015486300000000001 2024-09-12T22:04:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450789+0000", 2024-09-12T22:04:37.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000250103 2024-09-12T22:04:37.493 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.493 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.493 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.493 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:124935 5.6 e42/40 5:6c9ca567:::benchmark_data_smithi043_32659_object124934:head v 42'7738, mlcod=42'7736)", 2024-09-12T22:04:37.493 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:37.450674+0000", 2024-09-12T22:04:37.493 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001808245, 2024-09-12T22:04:37.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023428899999999998, 2024-09-12T22:04:37.493 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.493 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.493 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:37.493 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450674+0000", 2024-09-12T22:04:37.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450674+0000", 2024-09-12T22:04:37.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450674+0000", 2024-09-12T22:04:37.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7700000000000004e-07 2024-09-12T22:04:37.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450684+0000", 2024-09-12T22:04:37.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3819999999999993e-06 2024-09-12T22:04:37.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450692+0000", 2024-09-12T22:04:37.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6880000000000005e-06 2024-09-12T22:04:37.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450699+0000", 2024-09-12T22:04:37.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5819999999999998e-06 2024-09-12T22:04:37.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450826+0000", 2024-09-12T22:04:37.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012667200000000001 2024-09-12T22:04:37.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450847+0000", 2024-09-12T22:04:37.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1282999999999999e-05 2024-09-12T22:04:37.497 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.497 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.497 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.497 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:124940 5.0 5.eee7c550 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:37.450905+0000", 2024-09-12T22:04:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001576605, 2024-09-12T22:04:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002167277, 2024-09-12T22:04:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 124940 2024-09-12T22:04:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450905+0000", 2024-09-12T22:04:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450905+0000", 2024-09-12T22:04:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450906+0000", 2024-09-12T22:04:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7300000000000005e-07 2024-09-12T22:04:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450964+0000", 2024-09-12T22:04:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7389999999999998e-05 2024-09-12T22:04:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450973+0000", 2024-09-12T22:04:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0520000000000007e-06 2024-09-12T22:04:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.450979+0000", 2024-09-12T22:04:37.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.212e-06 2024-09-12T22:04:37.501 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.501 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.501 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.501 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:124942 5.4 5:213293d9:::benchmark_data_smithi043_32659_object124941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:37.501 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:37.451986+0000", 2024-09-12T22:04:37.501 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000496143, 2024-09-12T22:04:37.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001141427, 2024-09-12T22:04:37.502 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.502 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.502 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:37.502 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.502 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.502 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.502 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 124942 2024-09-12T22:04:37.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.502 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.451986+0000", 2024-09-12T22:04:37.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.451986+0000", 2024-09-12T22:04:37.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.451987+0000", 2024-09-12T22:04:37.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4099999999999997e-07 2024-09-12T22:04:37.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452046+0000", 2024-09-12T22:04:37.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9274000000000002e-05 2024-09-12T22:04:37.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452055+0000", 2024-09-12T22:04:37.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5140000000000007e-06 2024-09-12T22:04:37.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452061+0000", 2024-09-12T22:04:37.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1079999999999998e-06 2024-09-12T22:04:37.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452108+0000", 2024-09-12T22:04:37.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6674000000000001e-05 2024-09-12T22:04:37.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:37.452227+0000", 2024-09-12T22:04:37.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118713 2024-09-12T22:04:37.505 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.505 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.505 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.505 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.505 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:37.505 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 12 2024-09-12T22:04:37.506 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:37.507 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:37.508 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:37.505+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:37.609 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:37.608+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:37.709 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:37.708+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:37.712 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:37.712 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:37.712 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:37.713 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:37.713 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:37.727 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:37.813 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:37.812+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:37.911 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:37.910+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:37.933 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:37.933 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:37.933 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:37.933 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:37.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.933 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44102 5.0 5:0d5aa1ff:::benchmark_data_smithi043_32659_object44101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:37.934 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:37.934 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.305887034000001, 2024-09-12T22:04:37.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051636015, 2024-09-12T22:04:37.934 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.934 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.934 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:37.934 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.934 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.934 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.934 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44102 2024-09-12T22:04:37.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.935 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:37.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:37.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624875+0000", 2024-09-12T22:04:37.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:04:37.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624930+0000", 2024-09-12T22:04:37.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5256000000000001e-05 2024-09-12T22:04:37.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624951+0000", 2024-09-12T22:04:37.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0551999999999999e-05 2024-09-12T22:04:37.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624958+0000", 2024-09-12T22:04:37.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1849999999999998e-06 2024-09-12T22:04:37.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629885+0000", 2024-09-12T22:04:37.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049266120000000004 2024-09-12T22:04:37.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629999+0000", 2024-09-12T22:04:37.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011385 2024-09-12T22:04:37.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:37.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630125+0000", 2024-09-12T22:04:37.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012640500000000001 2024-09-12T22:04:37.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.939 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:37.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633338+0000", 2024-09-12T22:04:37.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032135559999999998 2024-09-12T22:04:37.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.939 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:37.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676425+0000", 2024-09-12T22:04:37.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043086753999999998 2024-09-12T22:04:37.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:37.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676472+0000", 2024-09-12T22:04:37.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6971999999999997e-05 2024-09-12T22:04:37.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:37.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676510+0000", 2024-09-12T22:04:37.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8096999999999998e-05 2024-09-12T22:04:37.941 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.941 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.941 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.941 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44103 5.8 5:170742c6:::benchmark_data_smithi043_32659_object44102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:37.942 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:37.942 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.305763882999997, 2024-09-12T22:04:37.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051500936999999997, 2024-09-12T22:04:37.942 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.942 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.942 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:37.942 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.942 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.942 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.942 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44103 2024-09-12T22:04:37.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.943 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:37.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:37.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624998+0000", 2024-09-12T22:04:37.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:37.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625061+0000", 2024-09-12T22:04:37.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2667000000000002e-05 2024-09-12T22:04:37.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625069+0000", 2024-09-12T22:04:37.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999993e-06 2024-09-12T22:04:37.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625077+0000", 2024-09-12T22:04:37.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0090000000000007e-06 2024-09-12T22:04:37.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629869+0000", 2024-09-12T22:04:37.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047921769999999999 2024-09-12T22:04:37.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629938+0000", 2024-09-12T22:04:37.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9542000000000006e-05 2024-09-12T22:04:37.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.947 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:37.947 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630010+0000", 2024-09-12T22:04:37.947 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1795e-05 2024-09-12T22:04:37.947 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.947 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:37.948 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676348+0000", 2024-09-12T22:04:37.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.046337830000000003 2024-09-12T22:04:37.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.948 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:37.948 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676399+0000", 2024-09-12T22:04:37.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1150000000000003e-05 2024-09-12T22:04:37.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:37.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676460+0000", 2024-09-12T22:04:37.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1142999999999994e-05 2024-09-12T22:04:37.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:37.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676498+0000", 2024-09-12T22:04:37.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8111000000000002e-05 2024-09-12T22:04:37.949 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.949 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.950 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.950 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:37.950 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:37.950 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.304465458000003, 2024-09-12T22:04:37.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:37.950 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.950 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.950 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:37.950 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.950 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.950 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.951 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:37.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.951 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:37.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:37.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:37.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:37.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:37.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:37.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:37.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:37.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:37.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:37.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:37.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:37.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:37.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:37.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:37.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:37.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:37.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:37.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:37.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:37.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:37.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:37.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:37.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:37.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:37.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:37.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:37.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:37.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:37.956 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.956 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.957 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.957 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44115 5.0 5:0ee09c30:::benchmark_data_smithi043_32659_object44114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:37.957 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:37.957 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.301692781, 2024-09-12T22:04:37.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082887358999999994, 2024-09-12T22:04:37.957 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.957 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.957 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:37.957 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.957 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.958 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.958 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44115 2024-09-12T22:04:37.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.958 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:37.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:37.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629070+0000", 2024-09-12T22:04:37.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1209999999999999e-06 2024-09-12T22:04:37.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629132+0000", 2024-09-12T22:04:37.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2557000000000004e-05 2024-09-12T22:04:37.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629147+0000", 2024-09-12T22:04:37.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4491999999999999e-05 2024-09-12T22:04:37.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629156+0000", 2024-09-12T22:04:37.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7089999999999997e-06 2024-09-12T22:04:37.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631865+0000", 2024-09-12T22:04:37.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00270835 2024-09-12T22:04:37.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631932+0000", 2024-09-12T22:04:37.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7322000000000004e-05 2024-09-12T22:04:37.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:37.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632095+0000", 2024-09-12T22:04:37.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016314699999999999 2024-09-12T22:04:37.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:37.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676360+0000", 2024-09-12T22:04:37.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044264756000000002 2024-09-12T22:04:37.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:37.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711854+0000", 2024-09-12T22:04:37.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.03549389 2024-09-12T22:04:37.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:37.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711919+0000", 2024-09-12T22:04:37.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5024000000000006e-05 2024-09-12T22:04:37.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:37.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711956+0000", 2024-09-12T22:04:37.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6990999999999999e-05 2024-09-12T22:04:37.964 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.964 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.964 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.964 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44117 5.8 5:1ecb02e0:::benchmark_data_smithi043_32659_object44116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:37.964 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:37.964 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.301547960999997, 2024-09-12T22:04:37.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082354986000000005, 2024-09-12T22:04:37.965 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.965 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.965 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:37.965 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.965 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.965 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.965 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44117 2024-09-12T22:04:37.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.965 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:37.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:37.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629214+0000", 2024-09-12T22:04:37.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:37.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629315+0000", 2024-09-12T22:04:37.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010045800000000001 2024-09-12T22:04:37.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629328+0000", 2024-09-12T22:04:37.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3016e-05 2024-09-12T22:04:37.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629336+0000", 2024-09-12T22:04:37.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7229999999999993e-06 2024-09-12T22:04:37.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631856+0000", 2024-09-12T22:04:37.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025199300000000001 2024-09-12T22:04:37.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631954+0000", 2024-09-12T22:04:37.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7565999999999994e-05 2024-09-12T22:04:37.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:37.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632073+0000", 2024-09-12T22:04:37.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119677 2024-09-12T22:04:37.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:37.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676523+0000", 2024-09-12T22:04:37.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044449163 2024-09-12T22:04:37.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:37.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676612+0000", 2024-09-12T22:04:37.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9579000000000004e-05 2024-09-12T22:04:37.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:37.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711509+0000", 2024-09-12T22:04:37.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.034897125000000001 2024-09-12T22:04:37.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:37.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711568+0000", 2024-09-12T22:04:37.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8996999999999998e-05 2024-09-12T22:04:37.971 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.971 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.972 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.972 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44120 5.b 5:df1f2c5f:::benchmark_data_smithi043_32659_object44119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:37.972 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:37.972 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.299372300000002, 2024-09-12T22:04:37.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043861974999999997, 2024-09-12T22:04:37.972 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.972 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.972 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:37.972 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.972 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.973 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.973 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44120 2024-09-12T22:04:37.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.973 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:37.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:37.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631390+0000", 2024-09-12T22:04:37.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:04:37.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631444+0000", 2024-09-12T22:04:37.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-12T22:04:37.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631452+0000", 2024-09-12T22:04:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4610000000000008e-06 2024-09-12T22:04:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631458+0000", 2024-09-12T22:04:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:04:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631509+0000", 2024-09-12T22:04:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1442e-05 2024-09-12T22:04:37.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631627+0000", 2024-09-12T22:04:37.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011796800000000001 2024-09-12T22:04:37.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:37.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631814+0000", 2024-09-12T22:04:37.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018735400000000001 2024-09-12T22:04:37.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:37.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674612+0000", 2024-09-12T22:04:37.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042797287000000003 2024-09-12T22:04:37.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:37.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675160+0000", 2024-09-12T22:04:37.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000548187 2024-09-12T22:04:37.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:37.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675207+0000", 2024-09-12T22:04:37.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6833999999999999e-05 2024-09-12T22:04:37.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:37.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675251+0000", 2024-09-12T22:04:37.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4348000000000003e-05 2024-09-12T22:04:37.978 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.978 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.978 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.978 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:37.979 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:37.979 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.299064518000002, 2024-09-12T22:04:37.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:37.979 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.979 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.979 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:37.979 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.979 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.979 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.979 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:37.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.979 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:37.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:37.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:37.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:37.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:37.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:37.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:37.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:37.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:37.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:37.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:37.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:37.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:37.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:37.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:37.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:37.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:37.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:37.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:37.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:37.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:37.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:37.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:37.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:37.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:37.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:37.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:37.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:37.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:37.985 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.985 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.985 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.985 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44122 5.d 5:bfd04815:::benchmark_data_smithi043_32659_object44121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:37.985 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:37.986 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.298966466000003, 2024-09-12T22:04:37.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.080166395000000001, 2024-09-12T22:04:37.986 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.986 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.986 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:37.986 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.986 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.986 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.986 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44122 2024-09-12T22:04:37.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.986 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:37.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:37.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:37.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:04:37.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631853+0000", 2024-09-12T22:04:37.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7209000000000001e-05 2024-09-12T22:04:37.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631858+0000", 2024-09-12T22:04:37.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:04:37.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631862+0000", 2024-09-12T22:04:37.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.692e-06 2024-09-12T22:04:37.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631905+0000", 2024-09-12T22:04:37.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3135e-05 2024-09-12T22:04:37.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632032+0000", 2024-09-12T22:04:37.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012740900000000001 2024-09-12T22:04:37.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:37.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632166+0000", 2024-09-12T22:04:37.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013318800000000001 2024-09-12T22:04:37.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:37.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674894+0000", 2024-09-12T22:04:37.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042728690999999999 2024-09-12T22:04:37.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:37.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711875+0000", 2024-09-12T22:04:37.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036980631 2024-09-12T22:04:37.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711923+0000", 2024-09-12T22:04:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8180000000000003e-05 2024-09-12T22:04:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711961+0000", 2024-09-12T22:04:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8142000000000002e-05 2024-09-12T22:04:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.993 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44123 5.e 5:7d83ca89:::benchmark_data_smithi043_32659_object44122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:37.993 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:37.993 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.298834698, 2024-09-12T22:04:37.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043329329, 2024-09-12T22:04:37.993 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:37.993 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:37.993 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:37.993 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:37.993 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:37.993 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:37.993 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44123 2024-09-12T22:04:37.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.993 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:37.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:37.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:37.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:37.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:37.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:37.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:37.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631928+0000", 2024-09-12T22:04:37.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2699999999999998e-07 2024-09-12T22:04:37.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:37.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631996+0000", 2024-09-12T22:04:37.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8141999999999999e-05 2024-09-12T22:04:37.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:37.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632004+0000", 2024-09-12T22:04:37.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7600000000000008e-06 2024-09-12T22:04:37.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:37.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632010+0000", 2024-09-12T22:04:37.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:04:37.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:37.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632069+0000", 2024-09-12T22:04:37.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8260000000000001e-05 2024-09-12T22:04:37.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:37.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632226+0000", 2024-09-12T22:04:37.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015702199999999999 2024-09-12T22:04:37.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:37.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632337+0000", 2024-09-12T22:04:37.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111069 2024-09-12T22:04:37.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:37.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674909+0000", 2024-09-12T22:04:37.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042571854999999999 2024-09-12T22:04:37.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:37.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675184+0000", 2024-09-12T22:04:37.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027561399999999998 2024-09-12T22:04:37.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:37.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675222+0000", 2024-09-12T22:04:37.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7710999999999999e-05 2024-09-12T22:04:37.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:37.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:37.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:37.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675256+0000", 2024-09-12T22:04:37.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4014000000000003e-05 2024-09-12T22:04:37.999 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:37.999 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.000 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.000 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:38.000 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:38.000 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.298123251, 2024-09-12T22:04:38.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:38.000 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.000 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.000 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.000 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.000 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.001 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.001 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:38.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.001 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:38.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:38.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:38.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:38.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:38.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:38.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:38.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:38.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:38.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:38.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:38.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:38.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:38.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:38.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:38.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:38.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:38.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:38.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:38.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:38.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:38.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:38.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:38.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:38.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:38.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:38.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:38.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:38.007 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.007 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.008 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.008 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44098 5.0 e28/22 ondisk, result = 0)", 2024-09-12T22:04:38.008 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:38.008 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.297732435999997, 2024-09-12T22:04:38.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043332180999999997, 2024-09-12T22:04:38.008 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.008 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.008 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:38.008 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:38.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:38.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633030+0000", 2024-09-12T22:04:38.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:38.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633035+0000", 2024-09-12T22:04:38.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:04:38.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633043+0000", 2024-09-12T22:04:38.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:38.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633048+0000", 2024-09-12T22:04:38.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5439999999999998e-06 2024-09-12T22:04:38.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633362+0000", 2024-09-12T22:04:38.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031397400000000001 2024-09-12T22:04:38.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633369+0000", 2024-09-12T22:04:38.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:04:38.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:38.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676361+0000", 2024-09-12T22:04:38.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042991954999999998 2024-09-12T22:04:38.012 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.013 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.013 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.013 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:38.013 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:38.013 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.297125330999997, 2024-09-12T22:04:38.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:38.013 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.013 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.013 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.014 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.014 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.014 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.014 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:38.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.014 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:38.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:38.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:38.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:38.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:38.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:38.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:38.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:38.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:38.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:38.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:38.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:38.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:38.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:38.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:38.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:38.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:38.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:38.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:38.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:38.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:38.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:38.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:38.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:38.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:38.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:38.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:38.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:38.019 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.019 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.019 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.020 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:44125 5.9 e28/22 5:9022696f:::benchmark_data_smithi043_32659_object44124:head v 28'2753, mlcod=28'2751)", 2024-09-12T22:04:38.020 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:38.020 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.297086466000003, 2024-09-12T22:04:38.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042744011999999998, 2024-09-12T22:04:38.020 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.020 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.020 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.020 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:38.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:38.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633676+0000", 2024-09-12T22:04:38.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.44e-07 2024-09-12T22:04:38.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633755+0000", 2024-09-12T22:04:38.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9629000000000006e-05 2024-09-12T22:04:38.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674386+0000", 2024-09-12T22:04:38.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631364000000003 2024-09-12T22:04:38.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674399+0000", 2024-09-12T22:04:38.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2047e-05 2024-09-12T22:04:38.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674453+0000", 2024-09-12T22:04:38.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4453999999999997e-05 2024-09-12T22:04:38.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674479+0000", 2024-09-12T22:04:38.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6064999999999999e-05 2024-09-12T22:04:38.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:38.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676381+0000", 2024-09-12T22:04:38.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001901874 2024-09-12T22:04:38.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:38.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676419+0000", 2024-09-12T22:04:38.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7935000000000002e-05 2024-09-12T22:04:38.024 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.024 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.025 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.025 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44103 5.8 e28/22 ondisk, result = 0)", 2024-09-12T22:04:38.025 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:38.025 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.296580497999997, 2024-09-12T22:04:38.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042322950999999998, 2024-09-12T22:04:38.025 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.025 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.025 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:38.026 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:38.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:38.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:38.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:04:38.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634184+0000", 2024-09-12T22:04:38.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7690000000000001e-06 2024-09-12T22:04:38.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674407+0000", 2024-09-12T22:04:38.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040222750000000002 2024-09-12T22:04:38.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674417+0000", 2024-09-12T22:04:38.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0125e-05 2024-09-12T22:04:38.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676387+0000", 2024-09-12T22:04:38.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001970112 2024-09-12T22:04:38.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676394+0000", 2024-09-12T22:04:38.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:04:38.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:38.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676504+0000", 2024-09-12T22:04:38.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109621 2024-09-12T22:04:38.029 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.029 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.029 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.030 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44128 5.d 5:b9a92891:::benchmark_data_smithi043_32659_object44127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:38.030 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:38.030 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.256327708999997, 2024-09-12T22:04:38.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040118138999999997, 2024-09-12T22:04:38.030 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.030 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.030 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.030 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.030 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.030 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.030 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44128 2024-09-12T22:04:38.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.031 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:38.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:38.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674435+0000", 2024-09-12T22:04:38.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5960000000000001e-06 2024-09-12T22:04:38.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674485+0000", 2024-09-12T22:04:38.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0021000000000001e-05 2024-09-12T22:04:38.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674495+0000", 2024-09-12T22:04:38.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5189999999999998e-06 2024-09-12T22:04:38.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674500+0000", 2024-09-12T22:04:38.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:04:38.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674923+0000", 2024-09-12T22:04:38.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000423304 2024-09-12T22:04:38.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675027+0000", 2024-09-12T22:04:38.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103399 2024-09-12T22:04:38.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:38.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675141+0000", 2024-09-12T22:04:38.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114274 2024-09-12T22:04:38.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711649+0000", 2024-09-12T22:04:38.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036508011999999999 2024-09-12T22:04:38.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:38.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714466+0000", 2024-09-12T22:04:38.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028167370000000001 2024-09-12T22:04:38.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:38.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714508+0000", 2024-09-12T22:04:38.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2679000000000003e-05 2024-09-12T22:04:38.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:38.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714552+0000", 2024-09-12T22:04:38.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3528000000000001e-05 2024-09-12T22:04:38.036 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.036 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.036 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.036 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44129 5.0 5:0f626cda:::benchmark_data_smithi043_32659_object44128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:38.036 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:38.036 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.256252203999999, 2024-09-12T22:04:38.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042846404999999997, 2024-09-12T22:04:38.036 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.037 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.037 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.037 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.037 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.037 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.037 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44129 2024-09-12T22:04:38.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.037 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:38.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:38.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674510+0000", 2024-09-12T22:04:38.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1600000000000002e-07 2024-09-12T22:04:38.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674548+0000", 2024-09-12T22:04:38.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8075999999999999e-05 2024-09-12T22:04:38.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674689+0000", 2024-09-12T22:04:38.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014141499999999999 2024-09-12T22:04:38.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674696+0000", 2024-09-12T22:04:38.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4619999999999999e-06 2024-09-12T22:04:38.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713666+0000", 2024-09-12T22:04:38.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.038969072 2024-09-12T22:04:38.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713752+0000", 2024-09-12T22:04:38.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6768999999999995e-05 2024-09-12T22:04:38.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:38.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713835+0000", 2024-09-12T22:04:38.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2774000000000004e-05 2024-09-12T22:04:38.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:38.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717212+0000", 2024-09-12T22:04:38.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033769389999999998 2024-09-12T22:04:38.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717259+0000", 2024-09-12T22:04:38.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7218000000000001e-05 2024-09-12T22:04:38.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:38.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717310+0000", 2024-09-12T22:04:38.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1156999999999998e-05 2024-09-12T22:04:38.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:38.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717356+0000", 2024-09-12T22:04:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5107e-05 2024-09-12T22:04:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44130 5.4 5:27857918:::benchmark_data_smithi043_32659_object44129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.256054349999999, 2024-09-12T22:04:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039844412000000003, 2024-09-12T22:04:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.044 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.044 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.044 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.044 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44130 2024-09-12T22:04:38.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.044 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:38.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:38.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674708+0000", 2024-09-12T22:04:38.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4300000000000003e-07 2024-09-12T22:04:38.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674749+0000", 2024-09-12T22:04:38.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1254999999999997e-05 2024-09-12T22:04:38.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674756+0000", 2024-09-12T22:04:38.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3289999999999996e-06 2024-09-12T22:04:38.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674762+0000", 2024-09-12T22:04:38.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.852e-06 2024-09-12T22:04:38.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:38.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9573999999999995e-05 2024-09-12T22:04:38.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674954+0000", 2024-09-12T22:04:38.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012254200000000001 2024-09-12T22:04:38.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:38.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675033+0000", 2024-09-12T22:04:38.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8707000000000004e-05 2024-09-12T22:04:38.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714381+0000", 2024-09-12T22:04:38.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039348053000000001 2024-09-12T22:04:38.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:38.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714477+0000", 2024-09-12T22:04:38.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5650999999999996e-05 2024-09-12T22:04:38.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714516+0000", 2024-09-12T22:04:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9158e-05 2024-09-12T22:04:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714551+0000", 2024-09-12T22:04:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5648000000000002e-05 2024-09-12T22:04:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.050 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44131 5.0 5:013256f7:::benchmark_data_smithi043_32659_object44130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:38.050 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:38.050 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.255981882999997, 2024-09-12T22:04:38.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043388599, 2024-09-12T22:04:38.050 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.050 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.050 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.050 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.050 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.050 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.050 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44131 2024-09-12T22:04:38.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.050 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:38.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:38.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674780+0000", 2024-09-12T22:04:38.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:38.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674817+0000", 2024-09-12T22:04:38.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6859000000000001e-05 2024-09-12T22:04:38.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:38.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.501e-05 2024-09-12T22:04:38.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674838+0000", 2024-09-12T22:04:38.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-06 2024-09-12T22:04:38.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715161+0000", 2024-09-12T22:04:38.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.04032285 2024-09-12T22:04:38.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715317+0000", 2024-09-12T22:04:38.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015649199999999999 2024-09-12T22:04:38.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:38.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715463+0000", 2024-09-12T22:04:38.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145704 2024-09-12T22:04:38.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:38.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717480+0000", 2024-09-12T22:04:38.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020168220000000001 2024-09-12T22:04:38.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718079+0000", 2024-09-12T22:04:38.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000599115 2024-09-12T22:04:38.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:38.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718134+0000", 2024-09-12T22:04:38.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:04:38.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:38.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718168+0000", 2024-09-12T22:04:38.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4301000000000002e-05 2024-09-12T22:04:38.056 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.056 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.056 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.056 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44132 5.e 5:7634b859:::benchmark_data_smithi043_32659_object44131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:38.056 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:38.056 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.255314642999998, 2024-09-12T22:04:38.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039558587999999999, 2024-09-12T22:04:38.056 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.056 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.056 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.056 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.057 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.057 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.057 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44132 2024-09-12T22:04:38.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.057 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:38.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:38.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675448+0000", 2024-09-12T22:04:38.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3699999999999999e-07 2024-09-12T22:04:38.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675552+0000", 2024-09-12T22:04:38.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104294 2024-09-12T22:04:38.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675562+0000", 2024-09-12T22:04:38.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9629999999999993e-06 2024-09-12T22:04:38.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675569+0000", 2024-09-12T22:04:38.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8809999999999998e-06 2024-09-12T22:04:38.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675612+0000", 2024-09-12T22:04:38.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591000000000003e-05 2024-09-12T22:04:38.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675717+0000", 2024-09-12T22:04:38.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010497099999999999 2024-09-12T22:04:38.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:38.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675835+0000", 2024-09-12T22:04:38.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011793799999999999 2024-09-12T22:04:38.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713616+0000", 2024-09-12T22:04:38.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037781032999999999 2024-09-12T22:04:38.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:38.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714911+0000", 2024-09-12T22:04:38.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001294604 2024-09-12T22:04:38.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:38.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714964+0000", 2024-09-12T22:04:38.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3408000000000001e-05 2024-09-12T22:04:38.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:38.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715005+0000", 2024-09-12T22:04:38.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0967999999999998e-05 2024-09-12T22:04:38.062 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.062 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.062 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.063 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44133 5.b 5:d0a59edd:::benchmark_data_smithi043_32659_object44132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:38.063 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:38.063 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.255176863000003, 2024-09-12T22:04:38.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039513020000000003, 2024-09-12T22:04:38.063 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.063 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.063 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.063 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.063 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.063 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.063 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44133 2024-09-12T22:04:38.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.063 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:38.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:38.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675585+0000", 2024-09-12T22:04:38.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5499999999999998e-07 2024-09-12T22:04:38.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675634+0000", 2024-09-12T22:04:38.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8520999999999998e-05 2024-09-12T22:04:38.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675641+0000", 2024-09-12T22:04:38.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4440000000000002e-06 2024-09-12T22:04:38.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675646+0000", 2024-09-12T22:04:38.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2660000000000001e-06 2024-09-12T22:04:38.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675692+0000", 2024-09-12T22:04:38.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5915999999999999e-05 2024-09-12T22:04:38.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675812+0000", 2024-09-12T22:04:38.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119419 2024-09-12T22:04:38.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:38.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675950+0000", 2024-09-12T22:04:38.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013831499999999999 2024-09-12T22:04:38.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713574+0000", 2024-09-12T22:04:38.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037623801999999998 2024-09-12T22:04:38.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:38.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715015+0000", 2024-09-12T22:04:38.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014410720000000001 2024-09-12T22:04:38.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:38.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715059+0000", 2024-09-12T22:04:38.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:04:38.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:38.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715097+0000", 2024-09-12T22:04:38.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8519000000000002e-05 2024-09-12T22:04:38.069 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.069 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.069 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.069 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.070 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.070 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:38.071 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:38.070+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:38.072 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:38.172 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:38.171+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:38.193 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 44 16 126793 126777 180.066 155.938 0.0088725 0.00555067 2024-09-12T22:04:38.222 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:38.222 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:38.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.222 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:126870 5.c 5:33c895cc:::benchmark_data_smithi043_32659_object126869:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.218396+0000", 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0033807709999999999, 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003403086, 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 126870 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.218396+0000", 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.218396+0000", 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.218397+0000", 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0359999999999999e-06 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.218456+0000", 2024-09-12T22:04:38.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9330999999999998e-05 2024-09-12T22:04:38.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.218474+0000", 2024-09-12T22:04:38.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7300999999999999e-05 2024-09-12T22:04:38.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.218481+0000", 2024-09-12T22:04:38.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9240000000000007e-06 2024-09-12T22:04:38.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.218535+0000", 2024-09-12T22:04:38.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3032999999999999e-05 2024-09-12T22:04:38.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.218633+0000", 2024-09-12T22:04:38.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8728999999999996e-05 2024-09-12T22:04:38.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.218758+0000", 2024-09-12T22:04:38.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012434800000000001 2024-09-12T22:04:38.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.220649+0000", 2024-09-12T22:04:38.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00189135 2024-09-12T22:04:38.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.227 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.227 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:126872 5.6 5:622eeef2:::benchmark_data_smithi043_32659_object126871:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.227 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.219467+0000", 2024-09-12T22:04:38.227 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.002309972, 2024-09-12T22:04:38.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023922349999999999, 2024-09-12T22:04:38.227 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.228 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.228 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:38.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.228 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 126872 2024-09-12T22:04:38.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.228 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.219467+0000", 2024-09-12T22:04:38.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.219467+0000", 2024-09-12T22:04:38.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.219467+0000", 2024-09-12T22:04:38.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-12T22:04:38.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.219579+0000", 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111333 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.219589+0000", 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0098999999999999e-05 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.219596+0000", 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.939e-06 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.220253+0000", 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00065724200000000005 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.220378+0000", 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012539499999999999 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.220527+0000", 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014819900000000001 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:126876 5.7 5:ed53f0a3:::benchmark_data_smithi043_32659_object126875:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.219944+0000", 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0018327899999999999, 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019557620000000002, 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 126876 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.219944+0000", 2024-09-12T22:04:38.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.219944+0000", 2024-09-12T22:04:38.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.219945+0000", 2024-09-12T22:04:38.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7800000000000001e-07 2024-09-12T22:04:38.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.220005+0000", 2024-09-12T22:04:38.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0350000000000003e-05 2024-09-12T22:04:38.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.220016+0000", 2024-09-12T22:04:38.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0570999999999999e-05 2024-09-12T22:04:38.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.220021+0000", 2024-09-12T22:04:38.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8930000000000002e-06 2024-09-12T22:04:38.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.220065+0000", 2024-09-12T22:04:38.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3189999999999998e-05 2024-09-12T22:04:38.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.220151+0000", 2024-09-12T22:04:38.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5877000000000005e-05 2024-09-12T22:04:38.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.220269+0000", 2024-09-12T22:04:38.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118886 2024-09-12T22:04:38.236 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.236 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.236 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.236 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:126878 5.2 5:4b14a083:::benchmark_data_smithi043_32659_object126877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.236 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.221197+0000", 2024-09-12T22:04:38.236 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00058014500000000001, 2024-09-12T22:04:38.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074282799999999996, 2024-09-12T22:04:38.237 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.237 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.237 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:38.237 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.237 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.237 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.237 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 126878 2024-09-12T22:04:38.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.237 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221197+0000", 2024-09-12T22:04:38.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221197+0000", 2024-09-12T22:04:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221197+0000", 2024-09-12T22:04:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:04:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221254+0000", 2024-09-12T22:04:38.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7120999999999997e-05 2024-09-12T22:04:38.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221263+0000", 2024-09-12T22:04:38.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2889999999999998e-06 2024-09-12T22:04:38.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221268+0000", 2024-09-12T22:04:38.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9019999999999998e-06 2024-09-12T22:04:38.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221307+0000", 2024-09-12T22:04:38.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9226e-05 2024-09-12T22:04:38.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221385+0000", 2024-09-12T22:04:38.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7818000000000006e-05 2024-09-12T22:04:38.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.240 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.241 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:126879 5.2 5.c126a262 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.241 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.221708+0000", 2024-09-12T22:04:38.241 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.8547000000000006e-05, 2024-09-12T22:04:38.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026345699999999998, 2024-09-12T22:04:38.241 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.241 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.241 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:38.241 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.241 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.241 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.241 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 126879 2024-09-12T22:04:38.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.241 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221708+0000", 2024-09-12T22:04:38.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221708+0000", 2024-09-12T22:04:38.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221709+0000", 2024-09-12T22:04:38.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:04:38.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221742+0000", 2024-09-12T22:04:38.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2706000000000002e-05 2024-09-12T22:04:38.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221755+0000", 2024-09-12T22:04:38.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.289e-05 2024-09-12T22:04:38.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221761+0000", 2024-09-12T22:04:38.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8449999999999997e-06 2024-09-12T22:04:38.244 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.244 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.244 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.244 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:126876 5.7 e42/40)", 2024-09-12T22:04:38.244 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.221793+0000", 2024-09-12T22:04:38.244 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999843, 2024-09-12T22:04:38.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000205761, 2024-09-12T22:04:38.244 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.244 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.244 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:38.244 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221793+0000", 2024-09-12T22:04:38.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221793+0000", 2024-09-12T22:04:38.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221793+0000", 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221798+0000", 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7620000000000003e-06 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221808+0000", 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9799999999999993e-06 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.221815+0000", 2024-09-12T22:04:38.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6939999999999998e-06 2024-09-12T22:04:38.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.247 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.247 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:38.247 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 6 2024-09-12T22:04:38.247 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:38.248 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:38.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:38.272+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:38.374 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:38.373+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:38.396 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:38.396 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:38.396 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:38.396 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:38.396 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:38.408 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:38.475 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:38.474+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:38.565 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.929060139999997, 2024-09-12T22:04:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:79661 5.2 5:4081316a:::benchmark_data_smithi043_32659_object79660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T22:04:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.714003955999999, 2024-09-12T22:04:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.025955590000000001, 2024-09-12T22:04:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 79661 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848354+0000", 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848355+0000", 2024-09-12T22:04:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3009999999999999e-06 2024-09-12T22:04:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848410+0000", 2024-09-12T22:04:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639000000000003e-05 2024-09-12T22:04:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848426+0000", 2024-09-12T22:04:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5979000000000001e-05 2024-09-12T22:04:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848436+0000", 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0227000000000001e-05 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848479+0000", 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2450000000000002e-05 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848574+0000", 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5508999999999996e-05 2024-09-12T22:04:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.848667+0000", 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999997e-05 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.850764+0000", 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020964920000000001 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874250+0000", 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.023486440000000001 2024-09-12T22:04:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874283+0000", 2024-09-12T22:04:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2552000000000003e-05 2024-09-12T22:04:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:17.874310+0000", 2024-09-12T22:04:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7001000000000001e-05 2024-09-12T22:04:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.1517540149999999, 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:04:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:04:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:04:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:04:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:04:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:04:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:04:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:04:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:04:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:04:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.151574085, 2024-09-12T22:04:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:04:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:04:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:04:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:04:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:04:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:04:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:04:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.1515076439999996, 2024-09-12T22:04:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:04:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:04:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:04:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:04:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:04:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:04:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:04:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:04:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.1514512010000004, 2024-09-12T22:04:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:04:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:04:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:04:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:04:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:04:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:04:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:04:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:04:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:04:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:04:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:04:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:04:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:04:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:04:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:04:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:04:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:04:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:04:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.1513827409999999, 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.1513250060000004, 2024-09-12T22:04:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:04:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:04:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:04:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:04:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:04:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:04:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:04:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:04:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:04:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:04:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.1512573140000004, 2024-09-12T22:04:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:04:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:04:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:04:38.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:04:38.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:04:38.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:04:38.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:04:38.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:04:38.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:04:38.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:04:38.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:04:38.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:04:38.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:04:38.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:04:38.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:04:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:04:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:04:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:04:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:04:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:04:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:04:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:04:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:04:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:04:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:04:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:04:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.151202252, 2024-09-12T22:04:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:04:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:04:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:04:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:04:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:04:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:04:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:04:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:04:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:04:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:04:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:04:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:04:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:04:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:04:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:04:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:04:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:04:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:04:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:04:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:04:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:04:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:04:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:04:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:04:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:04:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:04:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:04:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.625 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:38.625 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:38.625 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.1105547319999998, 2024-09-12T22:04:38.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:04:38.625 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.625 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.625 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.625 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.625 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.625 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.625 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:04:38.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:04:38.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:04:38.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:04:38.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:04:38.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:04:38.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:04:38.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:04:38.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:04:38.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:04:38.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:04:38.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:04:38.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:04:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:04:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:04:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:04:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:04:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:04:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:04:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:04:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:04:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.1079410039999997, 2024-09-12T22:04:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:04:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:04:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:04:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:04:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:04:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:04:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:04:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:04:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:04:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:04:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:04:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:04:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:04:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:04:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:04:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:04:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:04:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:04:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:04:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:04:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:04:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:04:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:04:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:04:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:04:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:04:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:04:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117396 5.1 5:83c565df:::benchmark_data_smithi043_32659_object117395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.107799881, 2024-09-12T22:04:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.090595995999999998, 2024-09-12T22:04:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.639 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.639 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.639 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117396 2024-09-12T22:04:38.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.639 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:38.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:38.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454559+0000", 2024-09-12T22:04:38.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:04:38.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454629+0000", 2024-09-12T22:04:38.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0036000000000005e-05 2024-09-12T22:04:38.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454641+0000", 2024-09-12T22:04:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2232000000000001e-05 2024-09-12T22:04:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454649+0000", 2024-09-12T22:04:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-12T22:04:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454697+0000", 2024-09-12T22:04:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8028000000000002e-05 2024-09-12T22:04:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454702+0000", 2024-09-12T22:04:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:04:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540467+0000", 2024-09-12T22:04:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085764217000000004 2024-09-12T22:04:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540596+0000", 2024-09-12T22:04:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129787 2024-09-12T22:04:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540774+0000", 2024-09-12T22:04:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017746799999999999 2024-09-12T22:04:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544679+0000", 2024-09-12T22:04:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003904996 2024-09-12T22:04:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545009+0000", 2024-09-12T22:04:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033056600000000002 2024-09-12T22:04:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545067+0000", 2024-09-12T22:04:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7871999999999997e-05 2024-09-12T22:04:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545154+0000", 2024-09-12T22:04:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6701999999999998e-05 2024-09-12T22:04:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117398 5.6 5:6d151138:::benchmark_data_smithi043_32659_object117397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.0865047099999998, 2024-09-12T22:04:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044999137000000002, 2024-09-12T22:04:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117398 2024-09-12T22:04:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475854+0000", 2024-09-12T22:04:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475914+0000", 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9422999999999997e-05 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475925+0000", 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0881e-05 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475930+0000", 2024-09-12T22:04:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:04:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475974+0000", 2024-09-12T22:04:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3810999999999998e-05 2024-09-12T22:04:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475981+0000", 2024-09-12T22:04:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1590000000000004e-06 2024-09-12T22:04:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504359+0000", 2024-09-12T22:04:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028377711 2024-09-12T22:04:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504526+0000", 2024-09-12T22:04:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167023 2024-09-12T22:04:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504661+0000", 2024-09-12T22:04:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135148 2024-09-12T22:04:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.506563+0000", 2024-09-12T22:04:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901778 2024-09-12T22:04:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520770+0000", 2024-09-12T22:04:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014206724 2024-09-12T22:04:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520803+0000", 2024-09-12T22:04:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3083000000000002e-05 2024-09-12T22:04:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520852+0000", 2024-09-12T22:04:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9543999999999999e-05 2024-09-12T22:04:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117399 5.3 5:ce33c2c7:::benchmark_data_smithi043_32659_object117398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.0817357169999999, 2024-09-12T22:04:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038176902999999998, 2024-09-12T22:04:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117399 2024-09-12T22:04:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480624+0000", 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.322e-06 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480670+0000", 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6365000000000001e-05 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480682+0000", 2024-09-12T22:04:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:04:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480689+0000", 2024-09-12T22:04:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:04:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480731+0000", 2024-09-12T22:04:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:04:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480738+0000", 2024-09-12T22:04:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:04:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513753+0000", 2024-09-12T22:04:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.033015125999999999 2024-09-12T22:04:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513935+0000", 2024-09-12T22:04:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018219500000000001 2024-09-12T22:04:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.514170+0000", 2024-09-12T22:04:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000234694 2024-09-12T22:04:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518462+0000", 2024-09-12T22:04:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004291563 2024-09-12T22:04:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518655+0000", 2024-09-12T22:04:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019362700000000001 2024-09-12T22:04:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518710+0000", 2024-09-12T22:04:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:04:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518799+0000", 2024-09-12T22:04:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9000999999999997e-05 2024-09-12T22:04:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117404 5.3 5:c26efda0:::benchmark_data_smithi043_32659_object117403:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.501966+0000", 2024-09-12T22:04:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.0603918950000004, 2024-09-12T22:04:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.029131555, 2024-09-12T22:04:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117404 2024-09-12T22:04:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.501966+0000", 2024-09-12T22:04:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.501966+0000", 2024-09-12T22:04:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.501967+0000", 2024-09-12T22:04:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.395e-06 2024-09-12T22:04:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.501993+0000", 2024-09-12T22:04:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5426e-05 2024-09-12T22:04:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.502003+0000", 2024-09-12T22:04:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:04:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.502011+0000", 2024-09-12T22:04:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.306e-06 2024-09-12T22:04:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.502072+0000", 2024-09-12T22:04:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1070999999999999e-05 2024-09-12T22:04:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.502082+0000", 2024-09-12T22:04:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0268999999999999e-05 2024-09-12T22:04:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.516386+0000", 2024-09-12T22:04:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014304051999999999 2024-09-12T22:04:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.516518+0000", 2024-09-12T22:04:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013170200000000001 2024-09-12T22:04:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.516691+0000", 2024-09-12T22:04:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017342 2024-09-12T22:04:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518808+0000", 2024-09-12T22:04:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002117173 2024-09-12T22:04:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.530967+0000", 2024-09-12T22:04:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0121586 2024-09-12T22:04:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.531027+0000", 2024-09-12T22:04:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0035999999999999e-05 2024-09-12T22:04:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.531098+0000", 2024-09-12T22:04:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0642000000000006e-05 2024-09-12T22:04:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117406 5.1 5:87497e79:::benchmark_data_smithi043_32659_object117405:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.512418+0000", 2024-09-12T22:04:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.0499401500000003, 2024-09-12T22:04:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.03314164, 2024-09-12T22:04:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117406 2024-09-12T22:04:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512418+0000", 2024-09-12T22:04:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512418+0000", 2024-09-12T22:04:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512419+0000", 2024-09-12T22:04:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.716e-06 2024-09-12T22:04:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512469+0000", 2024-09-12T22:04:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9867000000000002e-05 2024-09-12T22:04:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512480+0000", 2024-09-12T22:04:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:04:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512490+0000", 2024-09-12T22:04:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7580000000000004e-06 2024-09-12T22:04:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512546+0000", 2024-09-12T22:04:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5985e-05 2024-09-12T22:04:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.512555+0000", 2024-09-12T22:04:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1430000000000004e-06 2024-09-12T22:04:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542732+0000", 2024-09-12T22:04:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.030177240000000001 2024-09-12T22:04:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542860+0000", 2024-09-12T22:04:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012837499999999999 2024-09-12T22:04:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.543012+0000", 2024-09-12T22:04:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015160400000000001 2024-09-12T22:04:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545190+0000", 2024-09-12T22:04:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021785139999999999 2024-09-12T22:04:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545334+0000", 2024-09-12T22:04:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014330199999999999 2024-09-12T22:04:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545392+0000", 2024-09-12T22:04:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8415000000000002e-05 2024-09-12T22:04:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545559+0000", 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016730299999999999 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117407 5.c 5:3c61c1b7:::benchmark_data_smithi043_32659_object117406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.0485302030000003, 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042860548999999998, 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117407 2024-09-12T22:04:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513829+0000", 2024-09-12T22:04:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-12T22:04:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513900+0000", 2024-09-12T22:04:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1482000000000004e-05 2024-09-12T22:04:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513909+0000", 2024-09-12T22:04:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8370000000000003e-06 2024-09-12T22:04:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513917+0000", 2024-09-12T22:04:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:04:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513967+0000", 2024-09-12T22:04:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.007e-05 2024-09-12T22:04:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513975+0000", 2024-09-12T22:04:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5639999999999999e-06 2024-09-12T22:04:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542411+0000", 2024-09-12T22:04:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028436032999999999 2024-09-12T22:04:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542539+0000", 2024-09-12T22:04:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012777900000000001 2024-09-12T22:04:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542687+0000", 2024-09-12T22:04:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148343 2024-09-12T22:04:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548120+0000", 2024-09-12T22:04:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054333580000000001 2024-09-12T22:04:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556549+0000", 2024-09-12T22:04:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084288309999999995 2024-09-12T22:04:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556596+0000", 2024-09-12T22:04:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6458999999999997e-05 2024-09-12T22:04:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556688+0000", 2024-09-12T22:04:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2676999999999994e-05 2024-09-12T22:04:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117409 5.c 5:3558ef4c:::benchmark_data_smithi043_32659_object117408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.519089+0000", 2024-09-12T22:04:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.0432694089999996, 2024-09-12T22:04:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.037792457000000002, 2024-09-12T22:04:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117409 2024-09-12T22:04:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519089+0000", 2024-09-12T22:04:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519089+0000", 2024-09-12T22:04:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519089+0000", 2024-09-12T22:04:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:04:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519111+0000", 2024-09-12T22:04:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2339000000000001e-05 2024-09-12T22:04:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519116+0000", 2024-09-12T22:04:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2009999999999998e-06 2024-09-12T22:04:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519121+0000", 2024-09-12T22:04:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4859999999999999e-06 2024-09-12T22:04:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519163+0000", 2024-09-12T22:04:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2369e-05 2024-09-12T22:04:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.519170+0000", 2024-09-12T22:04:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0999999999999998e-06 2024-09-12T22:04:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544355+0000", 2024-09-12T22:04:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.025184933999999999 2024-09-12T22:04:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544504+0000", 2024-09-12T22:04:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014907000000000001 2024-09-12T22:04:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544674+0000", 2024-09-12T22:04:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000169283 2024-09-12T22:04:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548125+0000", 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034515700000000002 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556750+0000", 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086251910000000008 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556800+0000", 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9033000000000003e-05 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556881+0000", 2024-09-12T22:04:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1451000000000003e-05 2024-09-12T22:04:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:125302 5.6 5:6f9bc890:::benchmark_data_smithi043_32659_object125301:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:37.591351+0000", 2024-09-12T22:04:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.97100732000000001, 2024-09-12T22:04:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.027003237999999999, 2024-09-12T22:04:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 125302 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:37.591351+0000", 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:37.591351+0000", 2024-09-12T22:04:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:37.591351+0000", 2024-09-12T22:04:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:04:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:37.591417+0000", 2024-09-12T22:04:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5129000000000006e-05 2024-09-12T22:04:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:37.591426+0000", 2024-09-12T22:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9770000000000006e-06 2024-09-12T22:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:37.591433+0000", 2024-09-12T22:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1720000000000001e-06 2024-09-12T22:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:37.607489+0000", 2024-09-12T22:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016055782000000001 2024-09-12T22:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:37.607609+0000", 2024-09-12T22:04:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012011299999999999 2024-09-12T22:04:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:37.607761+0000", 2024-09-12T22:04:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015218999999999999 2024-09-12T22:04:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:37.611631+0000", 2024-09-12T22:04:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038698080000000002 2024-09-12T22:04:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:37.618195+0000", 2024-09-12T22:04:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065646080000000004 2024-09-12T22:04:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:37.618260+0000", 2024-09-12T22:04:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4492999999999994e-05 2024-09-12T22:04:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:37.618354+0000", 2024-09-12T22:04:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4112999999999998e-05 2024-09-12T22:04:38.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.690 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:38.690 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:38.690 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:38.691 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:38.690+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:38.692 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:38.791 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:38.790+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:38.857 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:38.857 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:38.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.857 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128499 5.8 5:14a568e0:::benchmark_data_smithi043_32659_object128498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.857 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.847702+0000", 2024-09-12T22:04:38.857 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0070657259999999996, 2024-09-12T22:04:38.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0070937439999999999, 2024-09-12T22:04:38.858 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.858 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.858 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:38.858 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.858 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.858 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.858 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128499 2024-09-12T22:04:38.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.858 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.858 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.858 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.858 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847702+0000", 2024-09-12T22:04:38.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.859 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847702+0000", 2024-09-12T22:04:38.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.859 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847703+0000", 2024-09-12T22:04:38.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.066e-06 2024-09-12T22:04:38.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847746+0000", 2024-09-12T22:04:38.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3411999999999997e-05 2024-09-12T22:04:38.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847758+0000", 2024-09-12T22:04:38.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2245999999999999e-05 2024-09-12T22:04:38.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847766+0000", 2024-09-12T22:04:38.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6170000000000001e-06 2024-09-12T22:04:38.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.849119+0000", 2024-09-12T22:04:38.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00135278 2024-09-12T22:04:38.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.849247+0000", 2024-09-12T22:04:38.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000127871 2024-09-12T22:04:38.861 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.861 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.861 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.862 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128500 5.f 5:fd7c771f:::benchmark_data_smithi043_32659_object128499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.862 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.847787+0000", 2024-09-12T22:04:38.862 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0069806570000000004, 2024-09-12T22:04:38.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0070841519999999998, 2024-09-12T22:04:38.862 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.862 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.862 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:38.862 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.862 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.862 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.862 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128500 2024-09-12T22:04:38.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.863 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847787+0000", 2024-09-12T22:04:38.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847787+0000", 2024-09-12T22:04:38.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847787+0000", 2024-09-12T22:04:38.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6400000000000002e-07 2024-09-12T22:04:38.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847855+0000", 2024-09-12T22:04:38.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7379999999999995e-05 2024-09-12T22:04:38.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847864+0000", 2024-09-12T22:04:38.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8239999999999995e-06 2024-09-12T22:04:38.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847873+0000", 2024-09-12T22:04:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6410000000000008e-06 2024-09-12T22:04:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847920+0000", 2024-09-12T22:04:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7154000000000003e-05 2024-09-12T22:04:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.848056+0000", 2024-09-12T22:04:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013606800000000001 2024-09-12T22:04:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.848197+0000", 2024-09-12T22:04:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000140254 2024-09-12T22:04:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852645+0000", 2024-09-12T22:04:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0044480120000000003 2024-09-12T22:04:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128501 5.8 5:15e949fc:::benchmark_data_smithi043_32659_object128500:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.847891+0000", 2024-09-12T22:04:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0068765069999999996, 2024-09-12T22:04:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0070526540000000002, 2024-09-12T22:04:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128501 2024-09-12T22:04:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847891+0000", 2024-09-12T22:04:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847891+0000", 2024-09-12T22:04:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847891+0000", 2024-09-12T22:04:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9800000000000003e-07 2024-09-12T22:04:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847920+0000", 2024-09-12T22:04:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8900000000000001e-05 2024-09-12T22:04:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847929+0000", 2024-09-12T22:04:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:04:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.847935+0000", 2024-09-12T22:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8760000000000002e-06 2024-09-12T22:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851266+0000", 2024-09-12T22:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033316209999999999 2024-09-12T22:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851422+0000", 2024-09-12T22:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015535399999999999 2024-09-12T22:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128504 5.8 5:168daec3:::benchmark_data_smithi043_32659_object128503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.848158+0000", 2024-09-12T22:04:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0066096920000000003, 2024-09-12T22:04:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0068472999999999997, 2024-09-12T22:04:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128504 2024-09-12T22:04:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.848158+0000", 2024-09-12T22:04:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.848158+0000", 2024-09-12T22:04:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.848158+0000", 2024-09-12T22:04:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5799999999999998e-07 2024-09-12T22:04:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.848212+0000", 2024-09-12T22:04:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3845999999999999e-05 2024-09-12T22:04:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.848221+0000", 2024-09-12T22:04:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1249999999999999e-06 2024-09-12T22:04:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.848229+0000", 2024-09-12T22:04:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8150000000000006e-06 2024-09-12T22:04:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853353+0000", 2024-09-12T22:04:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005123987 2024-09-12T22:04:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853489+0000", 2024-09-12T22:04:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135745 2024-09-12T22:04:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128510 5.f 5:fec716c5:::benchmark_data_smithi043_32659_object128509:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.850581+0000", 2024-09-12T22:04:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0041862239999999997, 2024-09-12T22:04:38.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0044861670000000001, 2024-09-12T22:04:38.879 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.879 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.879 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:38.879 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.879 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.879 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.879 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128510 2024-09-12T22:04:38.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.879 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.879 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.850581+0000", 2024-09-12T22:04:38.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.850581+0000", 2024-09-12T22:04:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.850582+0000", 2024-09-12T22:04:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2240000000000001e-06 2024-09-12T22:04:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.850634+0000", 2024-09-12T22:04:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2172000000000001e-05 2024-09-12T22:04:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.850654+0000", 2024-09-12T22:04:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9201000000000001e-05 2024-09-12T22:04:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.850662+0000", 2024-09-12T22:04:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9990000000000008e-06 2024-09-12T22:04:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.850713+0000", 2024-09-12T22:04:38.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1851000000000002e-05 2024-09-12T22:04:38.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.850977+0000", 2024-09-12T22:04:38.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00026396900000000002 2024-09-12T22:04:38.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:38.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851133+0000", 2024-09-12T22:04:38.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000155859 2024-09-12T22:04:38.883 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.883 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.883 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.883 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128512 5.b 5:dd0736db:::benchmark_data_smithi043_32659_object128511:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.883 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.851309+0000", 2024-09-12T22:04:38.883 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0034578730000000002, 2024-09-12T22:04:38.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038228390000000002, 2024-09-12T22:04:38.883 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.883 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.883 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:38.884 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.884 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.884 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.884 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128512 2024-09-12T22:04:38.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.884 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851309+0000", 2024-09-12T22:04:38.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851309+0000", 2024-09-12T22:04:38.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851310+0000", 2024-09-12T22:04:38.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6799999999999999e-07 2024-09-12T22:04:38.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851373+0000", 2024-09-12T22:04:38.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2551999999999993e-05 2024-09-12T22:04:38.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851386+0000", 2024-09-12T22:04:38.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3329999999999999e-05 2024-09-12T22:04:38.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851394+0000", 2024-09-12T22:04:38.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6760000000000007e-06 2024-09-12T22:04:38.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852247+0000", 2024-09-12T22:04:38.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00085293700000000001 2024-09-12T22:04:38.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852361+0000", 2024-09-12T22:04:38.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011438399999999999 2024-09-12T22:04:38.887 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.887 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.887 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.887 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128511 5.7 e42/40 5:e914a634:::benchmark_data_smithi043_32659_object128510:head v 42'8093, mlcod=42'8091)", 2024-09-12T22:04:38.887 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.851513+0000", 2024-09-12T22:04:38.888 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0032539930000000002, 2024-09-12T22:04:38.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003676974, 2024-09-12T22:04:38.888 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.888 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.888 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:38.888 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851513+0000", 2024-09-12T22:04:38.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851513+0000", 2024-09-12T22:04:38.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851514+0000", 2024-09-12T22:04:38.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0600000000000001e-07 2024-09-12T22:04:38.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851518+0000", 2024-09-12T22:04:38.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8299999999999998e-06 2024-09-12T22:04:38.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851525+0000", 2024-09-12T22:04:38.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3869999999999997e-06 2024-09-12T22:04:38.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.851530+0000", 2024-09-12T22:04:38.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:04:38.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852623+0000", 2024-09-12T22:04:38.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001093096 2024-09-12T22:04:38.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852641+0000", 2024-09-12T22:04:38.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8020999999999999e-05 2024-09-12T22:04:38.891 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.891 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.891 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.891 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128513 5.1 e42/40 5:8241bab3:::benchmark_data_smithi043_32659_object128512:head v 42'7990, mlcod=42'7988)", 2024-09-12T22:04:38.891 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.852174+0000", 2024-09-12T22:04:38.892 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002593597, 2024-09-12T22:04:38.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030712679999999998, 2024-09-12T22:04:38.892 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.892 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.892 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:38.892 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852174+0000", 2024-09-12T22:04:38.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852174+0000", 2024-09-12T22:04:38.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852174+0000", 2024-09-12T22:04:38.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5199999999999996e-07 2024-09-12T22:04:38.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852179+0000", 2024-09-12T22:04:38.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.028e-06 2024-09-12T22:04:38.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852189+0000", 2024-09-12T22:04:38.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0139999999999999e-05 2024-09-12T22:04:38.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852196+0000", 2024-09-12T22:04:38.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:04:38.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852244+0000", 2024-09-12T22:04:38.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7583999999999997e-05 2024-09-12T22:04:38.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852262+0000", 2024-09-12T22:04:38.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8425000000000001e-05 2024-09-12T22:04:38.895 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.895 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.895 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.895 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128491 5.0 5:0760addc:::benchmark_data_smithi043_32659_object128490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.895 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.843683+0000", 2024-09-12T22:04:38.895 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.011084698, 2024-09-12T22:04:38.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011617827000000001, 2024-09-12T22:04:38.895 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128491 2024-09-12T22:04:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.843683+0000", 2024-09-12T22:04:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.843683+0000", 2024-09-12T22:04:38.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.843683+0000", 2024-09-12T22:04:38.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6300000000000005e-07 2024-09-12T22:04:38.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.843725+0000", 2024-09-12T22:04:38.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1686e-05 2024-09-12T22:04:38.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.843751+0000", 2024-09-12T22:04:38.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5930000000000001e-05 2024-09-12T22:04:38.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.843758+0000", 2024-09-12T22:04:38.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1609999999999997e-06 2024-09-12T22:04:38.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.845483+0000", 2024-09-12T22:04:38.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001724506 2024-09-12T22:04:38.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.845788+0000", 2024-09-12T22:04:38.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000305338 2024-09-12T22:04:38.899 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.899 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.899 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128514 5.8 5.4107bc98 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.852961+0000", 2024-09-12T22:04:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001806504, 2024-09-12T22:04:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023954549999999999, 2024-09-12T22:04:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128514 2024-09-12T22:04:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852961+0000", 2024-09-12T22:04:38.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852961+0000", 2024-09-12T22:04:38.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852962+0000", 2024-09-12T22:04:38.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1349999999999999e-06 2024-09-12T22:04:38.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.852999+0000", 2024-09-12T22:04:38.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7341e-05 2024-09-12T22:04:38.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853010+0000", 2024-09-12T22:04:38.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0757999999999999e-05 2024-09-12T22:04:38.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853017+0000", 2024-09-12T22:04:38.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4039999999999998e-06 2024-09-12T22:04:38.904 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.904 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.904 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.904 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128515 5.a 5:5f847959:::benchmark_data_smithi043_32659_object128514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.904 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.853030+0000", 2024-09-12T22:04:38.904 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001736848, 2024-09-12T22:04:38.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023788949999999998, 2024-09-12T22:04:38.905 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.905 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.905 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:38.905 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.905 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.905 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.905 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128515 2024-09-12T22:04:38.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.905 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853030+0000", 2024-09-12T22:04:38.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853030+0000", 2024-09-12T22:04:38.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853031+0000", 2024-09-12T22:04:38.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3099999999999998e-07 2024-09-12T22:04:38.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853064+0000", 2024-09-12T22:04:38.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2796000000000002e-05 2024-09-12T22:04:38.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853072+0000", 2024-09-12T22:04:38.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9840000000000001e-06 2024-09-12T22:04:38.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853078+0000", 2024-09-12T22:04:38.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9290000000000003e-06 2024-09-12T22:04:38.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853131+0000", 2024-09-12T22:04:38.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3276000000000003e-05 2024-09-12T22:04:38.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853309+0000", 2024-09-12T22:04:38.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017798299999999999 2024-09-12T22:04:38.909 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.909 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.909 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.910 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.910 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128517 5.f 5:f3cef606:::benchmark_data_smithi043_32659_object128516:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.910 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.853196+0000", 2024-09-12T22:04:38.910 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001571334, 2024-09-12T22:04:38.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022730060000000002, 2024-09-12T22:04:38.910 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.910 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.910 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:38.910 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.910 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.910 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.910 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128517 2024-09-12T22:04:38.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.911 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.911 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.911 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853196+0000", 2024-09-12T22:04:38.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853196+0000", 2024-09-12T22:04:38.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853197+0000", 2024-09-12T22:04:38.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9100000000000003e-07 2024-09-12T22:04:38.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853266+0000", 2024-09-12T22:04:38.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9175000000000001e-05 2024-09-12T22:04:38.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853277+0000", 2024-09-12T22:04:38.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0774999999999999e-05 2024-09-12T22:04:38.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853283+0000", 2024-09-12T22:04:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7830000000000001e-06 2024-09-12T22:04:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853449+0000", 2024-09-12T22:04:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016524399999999999 2024-09-12T22:04:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853582+0000", 2024-09-12T22:04:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013351199999999999 2024-09-12T22:04:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853794+0000", 2024-09-12T22:04:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00021177300000000001 2024-09-12T22:04:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128519 5.0 5.6f63cc0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.853524+0000", 2024-09-12T22:04:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001243068, 2024-09-12T22:04:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020116280000000001, 2024-09-12T22:04:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128519 2024-09-12T22:04:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853524+0000", 2024-09-12T22:04:38.917 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.917 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.917 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.917 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.917 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853524+0000", 2024-09-12T22:04:38.917 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.917 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.917 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.917 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.917 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853525+0000", 2024-09-12T22:04:38.917 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9199999999999999e-07 2024-09-12T22:04:38.917 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.917 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853611+0000", 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5974000000000001e-05 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853620+0000", 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8759999999999994e-06 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853627+0000", 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.613e-06 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.918 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.919 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.919 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128520 5.8 5.6895b4c8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:38.919 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.853639+0000", 2024-09-12T22:04:38.919 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0011287090000000001, 2024-09-12T22:04:38.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019501220000000001, 2024-09-12T22:04:38.919 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.919 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.919 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:38.919 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:38.920 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:38.920 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:38.920 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128520 2024-09-12T22:04:38.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.920 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.920 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.920 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853639+0000", 2024-09-12T22:04:38.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.921 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.921 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853639+0000", 2024-09-12T22:04:38.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.921 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.921 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853639+0000", 2024-09-12T22:04:38.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4300000000000002e-07 2024-09-12T22:04:38.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.922 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.922 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.922 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853681+0000", 2024-09-12T22:04:38.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1729e-05 2024-09-12T22:04:38.922 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.922 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.922 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.922 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853689+0000", 2024-09-12T22:04:38.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7279999999999995e-06 2024-09-12T22:04:38.922 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.922 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.922 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.922 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853694+0000", 2024-09-12T22:04:38.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0490000000000003e-06 2024-09-12T22:04:38.923 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.923 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.923 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.923 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.923 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128518 5.6 e42/40 5:6398ece8:::benchmark_data_smithi043_32659_object128517:head v 42'7970, mlcod=42'7968)", 2024-09-12T22:04:38.923 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.853745+0000", 2024-09-12T22:04:38.923 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001021849, 2024-09-12T22:04:38.923 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018999760000000001, 2024-09-12T22:04:38.923 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.923 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.923 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:38.923 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.924 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853745+0000", 2024-09-12T22:04:38.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.924 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.924 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853745+0000", 2024-09-12T22:04:38.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.924 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853746+0000", 2024-09-12T22:04:38.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1e-07 2024-09-12T22:04:38.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853749+0000", 2024-09-12T22:04:38.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9579999999999999e-06 2024-09-12T22:04:38.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853754+0000", 2024-09-12T22:04:38.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1510000000000003e-06 2024-09-12T22:04:38.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853757+0000", 2024-09-12T22:04:38.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7230000000000002e-06 2024-09-12T22:04:38.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853867+0000", 2024-09-12T22:04:38.927 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010939599999999999 2024-09-12T22:04:38.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.853888+0000", 2024-09-12T22:04:38.927 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1511000000000001e-05 2024-09-12T22:04:38.927 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.927 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.927 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.927 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128516 5.1 e42/40 5:82e4960b:::benchmark_data_smithi043_32659_object128515:head v 42'7991, mlcod=42'7988)", 2024-09-12T22:04:38.927 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.854361+0000", 2024-09-12T22:04:38.928 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000406637, 2024-09-12T22:04:38.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001342544, 2024-09-12T22:04:38.928 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:38.928 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:38.928 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:38.928 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:38.928 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:38.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.854361+0000", 2024-09-12T22:04:38.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:38.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.854361+0000", 2024-09-12T22:04:38.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:38.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:38.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.854361+0000", 2024-09-12T22:04:38.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0999999999999998e-07 2024-09-12T22:04:38.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:38.931 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.854367+0000", 2024-09-12T22:04:38.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:04:38.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:38.931 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.854375+0000", 2024-09-12T22:04:38.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6500000000000002e-06 2024-09-12T22:04:38.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:38.931 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.854381+0000", 2024-09-12T22:04:38.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9719999999999997e-06 2024-09-12T22:04:38.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.932 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:38.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.854425+0000", 2024-09-12T22:04:38.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3476999999999997e-05 2024-09-12T22:04:38.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:38.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:38.932 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:38.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.854454+0000", 2024-09-12T22:04:38.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9462e-05 2024-09-12T22:04:38.932 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.932 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:38.932 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.932 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:38.933 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:38.933 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 16 2024-09-12T22:04:38.933 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:38.934 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:38.935 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:38.933+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:39.036 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:39.034+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:39.061 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:39.061 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:39.061 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:39.061 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:39.061 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:39.069 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:39.136 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:39.135+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:39.193 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 45 16 129136 129120 179.319 146.438 0.00863348 0.00557428 2024-09-12T22:04:39.223 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44102 5.0 5:0d5aa1ff:::benchmark_data_smithi043_32659_object44101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.594771711, 2024-09-12T22:04:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051636015, 2024-09-12T22:04:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44102 2024-09-12T22:04:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624874+0000", 2024-09-12T22:04:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624875+0000", 2024-09-12T22:04:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:04:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624930+0000", 2024-09-12T22:04:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5256000000000001e-05 2024-09-12T22:04:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624951+0000", 2024-09-12T22:04:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0551999999999999e-05 2024-09-12T22:04:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624958+0000", 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1849999999999998e-06 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629885+0000", 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049266120000000004 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629999+0000", 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011385 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630125+0000", 2024-09-12T22:04:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012640500000000001 2024-09-12T22:04:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633338+0000", 2024-09-12T22:04:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032135559999999998 2024-09-12T22:04:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676425+0000", 2024-09-12T22:04:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043086753999999998 2024-09-12T22:04:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676472+0000", 2024-09-12T22:04:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6971999999999997e-05 2024-09-12T22:04:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676510+0000", 2024-09-12T22:04:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8096999999999998e-05 2024-09-12T22:04:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44103 5.8 5:170742c6:::benchmark_data_smithi043_32659_object44102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.594648560000003, 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.051500936999999997, 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44103 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624997+0000", 2024-09-12T22:04:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.624998+0000", 2024-09-12T22:04:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-12T22:04:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625061+0000", 2024-09-12T22:04:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2667000000000002e-05 2024-09-12T22:04:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625069+0000", 2024-09-12T22:04:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999993e-06 2024-09-12T22:04:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.625077+0000", 2024-09-12T22:04:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0090000000000007e-06 2024-09-12T22:04:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629869+0000", 2024-09-12T22:04:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047921769999999999 2024-09-12T22:04:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629938+0000", 2024-09-12T22:04:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9542000000000006e-05 2024-09-12T22:04:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630010+0000", 2024-09-12T22:04:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1795e-05 2024-09-12T22:04:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676348+0000", 2024-09-12T22:04:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.046337830000000003 2024-09-12T22:04:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676399+0000", 2024-09-12T22:04:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1150000000000003e-05 2024-09-12T22:04:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676460+0000", 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1142999999999994e-05 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676498+0000", 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8111000000000002e-05 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.593350135000001, 2024-09-12T22:04:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:39.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.238 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:39.238 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:39.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.238 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:39.238 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:39.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:39.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:39.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.239 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:39.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:39.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.239 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:39.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:39.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:39.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:39.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:39.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:39.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:39.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:39.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:39.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:39.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:39.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:39.241 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.241 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.241 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.242 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44115 5.0 5:0ee09c30:::benchmark_data_smithi043_32659_object44114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.242 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:39.242 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.590577457999999, 2024-09-12T22:04:39.242 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082887358999999994, 2024-09-12T22:04:39.242 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.242 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.242 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.242 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.242 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.242 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.242 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44115 2024-09-12T22:04:39.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.242 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:39.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.243 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629069+0000", 2024-09-12T22:04:39.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.243 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629070+0000", 2024-09-12T22:04:39.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1209999999999999e-06 2024-09-12T22:04:39.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.244 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629132+0000", 2024-09-12T22:04:39.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2557000000000004e-05 2024-09-12T22:04:39.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.244 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629147+0000", 2024-09-12T22:04:39.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4491999999999999e-05 2024-09-12T22:04:39.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.245 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629156+0000", 2024-09-12T22:04:39.245 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7089999999999997e-06 2024-09-12T22:04:39.245 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.245 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.245 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.245 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631865+0000", 2024-09-12T22:04:39.245 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00270835 2024-09-12T22:04:39.245 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.245 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.245 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.245 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631932+0000", 2024-09-12T22:04:39.245 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7322000000000004e-05 2024-09-12T22:04:39.245 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.246 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.246 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632095+0000", 2024-09-12T22:04:39.246 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016314699999999999 2024-09-12T22:04:39.246 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.246 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.246 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676360+0000", 2024-09-12T22:04:39.246 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044264756000000002 2024-09-12T22:04:39.246 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.246 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.246 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711854+0000", 2024-09-12T22:04:39.246 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.03549389 2024-09-12T22:04:39.247 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.247 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.247 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.247 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711919+0000", 2024-09-12T22:04:39.247 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5024000000000006e-05 2024-09-12T22:04:39.247 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.247 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.247 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.247 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711956+0000", 2024-09-12T22:04:39.247 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6990999999999999e-05 2024-09-12T22:04:39.247 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.247 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.248 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.248 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.248 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.248 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44117 5.8 5:1ecb02e0:::benchmark_data_smithi043_32659_object44116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.248 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:39.248 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.590432638000003, 2024-09-12T22:04:39.248 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.082354986000000005, 2024-09-12T22:04:39.248 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.248 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.248 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.248 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.248 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.248 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.249 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44117 2024-09-12T22:04:39.249 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.249 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.249 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.249 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.249 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:39.249 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.249 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.249 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.249 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.249 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629213+0000", 2024-09-12T22:04:39.249 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.249 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.249 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.250 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.250 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629214+0000", 2024-09-12T22:04:39.250 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5199999999999996e-07 2024-09-12T22:04:39.250 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.250 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.250 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.250 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629315+0000", 2024-09-12T22:04:39.250 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010045800000000001 2024-09-12T22:04:39.250 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.250 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.250 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.250 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629328+0000", 2024-09-12T22:04:39.250 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3016e-05 2024-09-12T22:04:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.629336+0000", 2024-09-12T22:04:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7229999999999993e-06 2024-09-12T22:04:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631856+0000", 2024-09-12T22:04:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025199300000000001 2024-09-12T22:04:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631954+0000", 2024-09-12T22:04:39.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7565999999999994e-05 2024-09-12T22:04:39.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632073+0000", 2024-09-12T22:04:39.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119677 2024-09-12T22:04:39.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676523+0000", 2024-09-12T22:04:39.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.044449163 2024-09-12T22:04:39.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676612+0000", 2024-09-12T22:04:39.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9579000000000004e-05 2024-09-12T22:04:39.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711509+0000", 2024-09-12T22:04:39.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.034897125000000001 2024-09-12T22:04:39.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711568+0000", 2024-09-12T22:04:39.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8996999999999998e-05 2024-09-12T22:04:39.253 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.254 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.254 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.254 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44120 5.b 5:df1f2c5f:::benchmark_data_smithi043_32659_object44119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.254 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:39.254 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.588256977, 2024-09-12T22:04:39.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043861974999999997, 2024-09-12T22:04:39.254 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.254 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.254 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.254 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.254 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.254 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.255 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44120 2024-09-12T22:04:39.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.255 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:39.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631389+0000", 2024-09-12T22:04:39.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631390+0000", 2024-09-12T22:04:39.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:04:39.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631444+0000", 2024-09-12T22:04:39.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-12T22:04:39.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631452+0000", 2024-09-12T22:04:39.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4610000000000008e-06 2024-09-12T22:04:39.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.257 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631458+0000", 2024-09-12T22:04:39.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:04:39.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.257 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631509+0000", 2024-09-12T22:04:39.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1442e-05 2024-09-12T22:04:39.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631627+0000", 2024-09-12T22:04:39.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011796800000000001 2024-09-12T22:04:39.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631814+0000", 2024-09-12T22:04:39.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018735400000000001 2024-09-12T22:04:39.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674612+0000", 2024-09-12T22:04:39.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042797287000000003 2024-09-12T22:04:39.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675160+0000", 2024-09-12T22:04:39.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000548187 2024-09-12T22:04:39.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675207+0000", 2024-09-12T22:04:39.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6833999999999999e-05 2024-09-12T22:04:39.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675251+0000", 2024-09-12T22:04:39.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4348000000000003e-05 2024-09-12T22:04:39.260 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.260 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.260 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.260 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.260 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:39.260 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.587949195, 2024-09-12T22:04:39.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:39.260 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.260 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.260 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.260 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.261 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.261 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.261 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:39.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.261 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:39.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:39.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:39.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:39.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:39.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:39.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:39.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:39.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:39.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:39.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:39.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:39.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:39.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:39.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:39.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:39.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:39.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:39.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:39.266 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.266 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.266 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.266 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44122 5.d 5:bfd04815:::benchmark_data_smithi043_32659_object44121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.266 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:39.266 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.587851143000002, 2024-09-12T22:04:39.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.080166395000000001, 2024-09-12T22:04:39.266 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.267 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.267 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.267 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.267 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.267 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.267 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44122 2024-09-12T22:04:39.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.267 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:39.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:39.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631795+0000", 2024-09-12T22:04:39.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:04:39.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631853+0000", 2024-09-12T22:04:39.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7209000000000001e-05 2024-09-12T22:04:39.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631858+0000", 2024-09-12T22:04:39.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:04:39.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631862+0000", 2024-09-12T22:04:39.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.692e-06 2024-09-12T22:04:39.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631905+0000", 2024-09-12T22:04:39.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3135e-05 2024-09-12T22:04:39.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632032+0000", 2024-09-12T22:04:39.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012740900000000001 2024-09-12T22:04:39.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:39.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632166+0000", 2024-09-12T22:04:39.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013318800000000001 2024-09-12T22:04:39.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674894+0000", 2024-09-12T22:04:39.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042728690999999999 2024-09-12T22:04:39.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711875+0000", 2024-09-12T22:04:39.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036980631 2024-09-12T22:04:39.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711923+0000", 2024-09-12T22:04:39.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8180000000000003e-05 2024-09-12T22:04:39.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711961+0000", 2024-09-12T22:04:39.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8142000000000002e-05 2024-09-12T22:04:39.272 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.272 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.272 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.273 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44123 5.e 5:7d83ca89:::benchmark_data_smithi043_32659_object44122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.273 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:39.273 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.587719374999999, 2024-09-12T22:04:39.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043329329, 2024-09-12T22:04:39.273 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.273 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.273 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.273 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.273 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.274 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.274 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44123 2024-09-12T22:04:39.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.274 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:39.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631927+0000", 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631928+0000", 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2699999999999998e-07 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631996+0000", 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8141999999999999e-05 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632004+0000", 2024-09-12T22:04:39.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7600000000000008e-06 2024-09-12T22:04:39.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632010+0000", 2024-09-12T22:04:39.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:04:39.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632069+0000", 2024-09-12T22:04:39.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8260000000000001e-05 2024-09-12T22:04:39.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632226+0000", 2024-09-12T22:04:39.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015702199999999999 2024-09-12T22:04:39.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632337+0000", 2024-09-12T22:04:39.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111069 2024-09-12T22:04:39.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674909+0000", 2024-09-12T22:04:39.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042571854999999999 2024-09-12T22:04:39.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675184+0000", 2024-09-12T22:04:39.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027561399999999998 2024-09-12T22:04:39.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675222+0000", 2024-09-12T22:04:39.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7710999999999999e-05 2024-09-12T22:04:39.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675256+0000", 2024-09-12T22:04:39.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4014000000000003e-05 2024-09-12T22:04:39.279 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.279 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.279 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.280 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.280 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:39.280 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.587007927999998, 2024-09-12T22:04:39.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:39.280 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.280 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.280 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.280 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.280 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.280 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.280 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:39.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.280 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:39.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:39.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:39.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:39.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:39.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:39.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:39.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:39.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:39.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:39.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:39.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:39.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:39.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:39.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:39.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:39.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:39.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:39.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:39.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:39.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:39.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:39.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:39.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:39.286 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.286 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.286 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.287 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44098 5.0 e28/22 ondisk, result = 0)", 2024-09-12T22:04:39.287 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:39.287 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.586617113000003, 2024-09-12T22:04:39.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043332180999999997, 2024-09-12T22:04:39.287 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.287 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.287 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:39.287 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:39.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633029+0000", 2024-09-12T22:04:39.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633030+0000", 2024-09-12T22:04:39.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:39.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633035+0000", 2024-09-12T22:04:39.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:04:39.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633043+0000", 2024-09-12T22:04:39.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:04:39.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633048+0000", 2024-09-12T22:04:39.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5439999999999998e-06 2024-09-12T22:04:39.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633362+0000", 2024-09-12T22:04:39.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031397400000000001 2024-09-12T22:04:39.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633369+0000", 2024-09-12T22:04:39.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:04:39.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676361+0000", 2024-09-12T22:04:39.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042991954999999998 2024-09-12T22:04:39.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.292 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.292 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.292 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:39.292 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.586010008000002, 2024-09-12T22:04:39.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:39.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:39.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:39.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:39.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:39.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:39.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:39.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:39.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:39.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:39.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:39.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:39.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:39.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:39.298 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.298 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.298 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.299 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:44125 5.9 e28/22 5:9022696f:::benchmark_data_smithi043_32659_object44124:head v 28'2753, mlcod=28'2751)", 2024-09-12T22:04:39.299 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:39.299 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.585971143000002, 2024-09-12T22:04:39.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042744011999999998, 2024-09-12T22:04:39.299 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.299 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.299 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.299 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:39.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633675+0000", 2024-09-12T22:04:39.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633676+0000", 2024-09-12T22:04:39.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.44e-07 2024-09-12T22:04:39.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633755+0000", 2024-09-12T22:04:39.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9629000000000006e-05 2024-09-12T22:04:39.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674386+0000", 2024-09-12T22:04:39.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631364000000003 2024-09-12T22:04:39.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674399+0000", 2024-09-12T22:04:39.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2047e-05 2024-09-12T22:04:39.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674453+0000", 2024-09-12T22:04:39.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4453999999999997e-05 2024-09-12T22:04:39.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674479+0000", 2024-09-12T22:04:39.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6064999999999999e-05 2024-09-12T22:04:39.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676381+0000", 2024-09-12T22:04:39.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001901874 2024-09-12T22:04:39.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676419+0000", 2024-09-12T22:04:39.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7935000000000002e-05 2024-09-12T22:04:39.304 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.304 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.304 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.304 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:44103 5.8 e28/22 ondisk, result = 0)", 2024-09-12T22:04:39.304 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:39.304 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.585465175000003, 2024-09-12T22:04:39.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042322950999999998, 2024-09-12T22:04:39.304 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.304 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.305 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:39.305 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:39.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:39.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634181+0000", 2024-09-12T22:04:39.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:04:39.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.634184+0000", 2024-09-12T22:04:39.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7690000000000001e-06 2024-09-12T22:04:39.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674407+0000", 2024-09-12T22:04:39.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040222750000000002 2024-09-12T22:04:39.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674417+0000", 2024-09-12T22:04:39.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0125e-05 2024-09-12T22:04:39.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676387+0000", 2024-09-12T22:04:39.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001970112 2024-09-12T22:04:39.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676394+0000", 2024-09-12T22:04:39.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:04:39.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676504+0000", 2024-09-12T22:04:39.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109621 2024-09-12T22:04:39.308 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.308 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.308 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.308 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44128 5.d 5:b9a92891:::benchmark_data_smithi043_32659_object44127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.308 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:39.308 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.545212386000003, 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040118138999999997, 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44128 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674434+0000", 2024-09-12T22:04:39.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674435+0000", 2024-09-12T22:04:39.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5960000000000001e-06 2024-09-12T22:04:39.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674485+0000", 2024-09-12T22:04:39.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0021000000000001e-05 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674495+0000", 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5189999999999998e-06 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674500+0000", 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674923+0000", 2024-09-12T22:04:39.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000423304 2024-09-12T22:04:39.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675027+0000", 2024-09-12T22:04:39.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103399 2024-09-12T22:04:39.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:39.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675141+0000", 2024-09-12T22:04:39.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114274 2024-09-12T22:04:39.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711649+0000", 2024-09-12T22:04:39.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.036508011999999999 2024-09-12T22:04:39.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714466+0000", 2024-09-12T22:04:39.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028167370000000001 2024-09-12T22:04:39.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714508+0000", 2024-09-12T22:04:39.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2679000000000003e-05 2024-09-12T22:04:39.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714552+0000", 2024-09-12T22:04:39.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3528000000000001e-05 2024-09-12T22:04:39.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.314 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.314 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44129 5.0 5:0f626cda:::benchmark_data_smithi043_32659_object44128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.314 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:39.314 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.545136880999998, 2024-09-12T22:04:39.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042846404999999997, 2024-09-12T22:04:39.314 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.314 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.315 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.315 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44129 2024-09-12T22:04:39.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.315 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:39.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674509+0000", 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674510+0000", 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1600000000000002e-07 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674548+0000", 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8075999999999999e-05 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674689+0000", 2024-09-12T22:04:39.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014141499999999999 2024-09-12T22:04:39.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674696+0000", 2024-09-12T22:04:39.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4619999999999999e-06 2024-09-12T22:04:39.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713666+0000", 2024-09-12T22:04:39.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.038969072 2024-09-12T22:04:39.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713752+0000", 2024-09-12T22:04:39.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6768999999999995e-05 2024-09-12T22:04:39.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713835+0000", 2024-09-12T22:04:39.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2774000000000004e-05 2024-09-12T22:04:39.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717212+0000", 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033769389999999998 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717259+0000", 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7218000000000001e-05 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717310+0000", 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1156999999999998e-05 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717356+0000", 2024-09-12T22:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5107e-05 2024-09-12T22:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44130 5.4 5:27857918:::benchmark_data_smithi043_32659_object44129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.544939026999998, 2024-09-12T22:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039844412000000003, 2024-09-12T22:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.321 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.321 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.321 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.321 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44130 2024-09-12T22:04:39.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.321 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:39.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674707+0000", 2024-09-12T22:04:39.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674708+0000", 2024-09-12T22:04:39.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4300000000000003e-07 2024-09-12T22:04:39.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674749+0000", 2024-09-12T22:04:39.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1254999999999997e-05 2024-09-12T22:04:39.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674756+0000", 2024-09-12T22:04:39.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3289999999999996e-06 2024-09-12T22:04:39.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674762+0000", 2024-09-12T22:04:39.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.852e-06 2024-09-12T22:04:39.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:39.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9573999999999995e-05 2024-09-12T22:04:39.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674954+0000", 2024-09-12T22:04:39.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012254200000000001 2024-09-12T22:04:39.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675033+0000", 2024-09-12T22:04:39.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8707000000000004e-05 2024-09-12T22:04:39.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714381+0000", 2024-09-12T22:04:39.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039348053000000001 2024-09-12T22:04:39.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714477+0000", 2024-09-12T22:04:39.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5650999999999996e-05 2024-09-12T22:04:39.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714516+0000", 2024-09-12T22:04:39.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9158e-05 2024-09-12T22:04:39.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714551+0000", 2024-09-12T22:04:39.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5648000000000002e-05 2024-09-12T22:04:39.326 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.326 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.326 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.326 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44131 5.0 5:013256f7:::benchmark_data_smithi043_32659_object44130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.326 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:39.326 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.544866560000003, 2024-09-12T22:04:39.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.043388599, 2024-09-12T22:04:39.327 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.327 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.327 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.327 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.327 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.327 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.327 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44131 2024-09-12T22:04:39.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.327 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:39.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674779+0000", 2024-09-12T22:04:39.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674780+0000", 2024-09-12T22:04:39.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:04:39.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674817+0000", 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6859000000000001e-05 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674832+0000", 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.501e-05 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674838+0000", 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-06 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715161+0000", 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.04032285 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715317+0000", 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015649199999999999 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715463+0000", 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145704 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717480+0000", 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020168220000000001 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718079+0000", 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000599115 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718134+0000", 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.718168+0000", 2024-09-12T22:04:39.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4301000000000002e-05 2024-09-12T22:04:39.332 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.332 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.332 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.332 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44132 5.e 5:7634b859:::benchmark_data_smithi043_32659_object44131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.332 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:39.332 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.544199319999997, 2024-09-12T22:04:39.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039558587999999999, 2024-09-12T22:04:39.332 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.332 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.332 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44132 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675447+0000", 2024-09-12T22:04:39.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675448+0000", 2024-09-12T22:04:39.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3699999999999999e-07 2024-09-12T22:04:39.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675552+0000", 2024-09-12T22:04:39.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104294 2024-09-12T22:04:39.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675562+0000", 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9629999999999993e-06 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675569+0000", 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8809999999999998e-06 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675612+0000", 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591000000000003e-05 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675717+0000", 2024-09-12T22:04:39.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010497099999999999 2024-09-12T22:04:39.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675835+0000", 2024-09-12T22:04:39.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011793799999999999 2024-09-12T22:04:39.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713616+0000", 2024-09-12T22:04:39.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037781032999999999 2024-09-12T22:04:39.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714911+0000", 2024-09-12T22:04:39.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001294604 2024-09-12T22:04:39.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.714964+0000", 2024-09-12T22:04:39.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3408000000000001e-05 2024-09-12T22:04:39.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715005+0000", 2024-09-12T22:04:39.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0967999999999998e-05 2024-09-12T22:04:39.337 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.337 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44133 5.b 5:d0a59edd:::benchmark_data_smithi043_32659_object44132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.544061540000001, 2024-09-12T22:04:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039513020000000003, 2024-09-12T22:04:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.339 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44133 2024-09-12T22:04:39.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.339 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:39.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:39.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:39.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:39.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675584+0000", 2024-09-12T22:04:39.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:39.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:39.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675585+0000", 2024-09-12T22:04:39.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5499999999999998e-07 2024-09-12T22:04:39.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:39.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675634+0000", 2024-09-12T22:04:39.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8520999999999998e-05 2024-09-12T22:04:39.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:39.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675641+0000", 2024-09-12T22:04:39.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4440000000000002e-06 2024-09-12T22:04:39.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675646+0000", 2024-09-12T22:04:39.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2660000000000001e-06 2024-09-12T22:04:39.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:39.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675692+0000", 2024-09-12T22:04:39.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5915999999999999e-05 2024-09-12T22:04:39.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:39.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675812+0000", 2024-09-12T22:04:39.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119419 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.675950+0000", 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013831499999999999 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713574+0000", 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037623801999999998 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715015+0000", 2024-09-12T22:04:39.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014410720000000001 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715059+0000", 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.715097+0000", 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8519000000000002e-05 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:39.343 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:39.344 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:39.345 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:39.346 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:39.343+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:39.418 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:04:39.423 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:04:39.446 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:39.444+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:39.497 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:39.497 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:39.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.497 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:129934 5.6 5:62189347:::benchmark_data_smithi043_32659_object129933:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:39.497 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.489545+0000", 2024-09-12T22:04:39.498 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0063804500000000002, 2024-09-12T22:04:39.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997, 2024-09-12T22:04:39.498 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:39.498 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:39.498 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:39.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:39.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:39.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.498 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 129934 2024-09-12T22:04:39.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.498 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:39.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:39.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.489545+0000", 2024-09-12T22:04:39.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:39.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:39.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.489545+0000", 2024-09-12T22:04:39.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:39.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:39.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.489545+0000", 2024-09-12T22:04:39.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2699999999999998e-07 2024-09-12T22:04:39.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:39.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.489600+0000", 2024-09-12T22:04:39.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4957999999999998e-05 2024-09-12T22:04:39.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:39.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.489611+0000", 2024-09-12T22:04:39.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0478e-05 2024-09-12T22:04:39.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.489618+0000", 2024-09-12T22:04:39.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0589999999999997e-06 2024-09-12T22:04:39.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:39.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.489717+0000", 2024-09-12T22:04:39.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9400000000000004e-05 2024-09-12T22:04:39.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:39.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.489884+0000", 2024-09-12T22:04:39.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016690699999999999 2024-09-12T22:04:39.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:39.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.490241+0000", 2024-09-12T22:04:39.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035652399999999999 2024-09-12T22:04:39.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:39.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.494862+0000", 2024-09-12T22:04:39.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004621628 2024-09-12T22:04:39.503 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.503 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:39.503 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.503 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:129935 5.6 5:6aef86b0:::benchmark_data_smithi043_32659_object129934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:39.503 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.489641+0000", 2024-09-12T22:04:39.503 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.006284057, 2024-09-12T22:04:39.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064090509999999998, 2024-09-12T22:04:39.503 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:39.504 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:39.504 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:39.504 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:39.504 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:39.504 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.504 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 129935 2024-09-12T22:04:39.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.504 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:39.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:39.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.489641+0000", 2024-09-12T22:04:39.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:39.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:39.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.489641+0000", 2024-09-12T22:04:39.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:39.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:39.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.489642+0000", 2024-09-12T22:04:39.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2399999999999998e-07 2024-09-12T22:04:39.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:39.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.489724+0000", 2024-09-12T22:04:39.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2855999999999994e-05 2024-09-12T22:04:39.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:39.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.489733+0000", 2024-09-12T22:04:39.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6139999999999992e-06 2024-09-12T22:04:39.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.489743+0000", 2024-09-12T22:04:39.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9639999999999998e-06 2024-09-12T22:04:39.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:39.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.492684+0000", 2024-09-12T22:04:39.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029409140000000002 2024-09-12T22:04:39.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:39.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.492831+0000", 2024-09-12T22:04:39.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000147513 2024-09-12T22:04:39.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:39.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.493001+0000", 2024-09-12T22:04:39.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016926699999999999 2024-09-12T22:04:39.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:39.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.495263+0000", 2024-09-12T22:04:39.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022618320000000001 2024-09-12T22:04:39.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.508 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:39.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.508 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:129939 5.7 5:e6d87a10:::benchmark_data_smithi043_32659_object129938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:39.508 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.491443+0000", 2024-09-12T22:04:39.508 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.004482176, 2024-09-12T22:04:39.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046937569999999998, 2024-09-12T22:04:39.509 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:39.509 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:39.509 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:39.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:39.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:39.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.509 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 129939 2024-09-12T22:04:39.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.509 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:39.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:39.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.491443+0000", 2024-09-12T22:04:39.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:39.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:39.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.491443+0000", 2024-09-12T22:04:39.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:39.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:39.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.491444+0000", 2024-09-12T22:04:39.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7499999999999998e-07 2024-09-12T22:04:39.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:39.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.491497+0000", 2024-09-12T22:04:39.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3436000000000001e-05 2024-09-12T22:04:39.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:39.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.491508+0000", 2024-09-12T22:04:39.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:04:39.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.491514+0000", 2024-09-12T22:04:39.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2620000000000004e-06 2024-09-12T22:04:39.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:39.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.491823+0000", 2024-09-12T22:04:39.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030929900000000002 2024-09-12T22:04:39.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:39.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.491988+0000", 2024-09-12T22:04:39.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016478700000000001 2024-09-12T22:04:39.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:39.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.492157+0000", 2024-09-12T22:04:39.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016880899999999999 2024-09-12T22:04:39.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:39.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.494789+0000", 2024-09-12T22:04:39.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026316500000000001 2024-09-12T22:04:39.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.514 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:39.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.514 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:129940 5.3 5:c9375fb4:::benchmark_data_smithi043_32659_object129939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:39.514 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.491845+0000", 2024-09-12T22:04:39.514 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0040802920000000001, 2024-09-12T22:04:39.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043742310000000001, 2024-09-12T22:04:39.514 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:39.515 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:39.515 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:39.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:39.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:39.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.515 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 129940 2024-09-12T22:04:39.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.515 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:39.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:39.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.491845+0000", 2024-09-12T22:04:39.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:39.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:39.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.491845+0000", 2024-09-12T22:04:39.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:39.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:39.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.491846+0000", 2024-09-12T22:04:39.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7199999999999997e-07 2024-09-12T22:04:39.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:39.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.491928+0000", 2024-09-12T22:04:39.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1909999999999993e-05 2024-09-12T22:04:39.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:39.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.491955+0000", 2024-09-12T22:04:39.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7288e-05 2024-09-12T22:04:39.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.491977+0000", 2024-09-12T22:04:39.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1738000000000001e-05 2024-09-12T22:04:39.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:39.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.492035+0000", 2024-09-12T22:04:39.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8693999999999997e-05 2024-09-12T22:04:39.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:39.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.492174+0000", 2024-09-12T22:04:39.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013881200000000001 2024-09-12T22:04:39.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:39.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.492340+0000", 2024-09-12T22:04:39.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000165549 2024-09-12T22:04:39.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:39.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.495008+0000", 2024-09-12T22:04:39.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00266841 2024-09-12T22:04:39.519 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.519 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:39.519 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.519 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:129944 5.2 5:4a44486c:::benchmark_data_smithi043_32659_object129943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:39.519 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.493258+0000", 2024-09-12T22:04:39.520 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.002666964, 2024-09-12T22:04:39.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0030384460000000002, 2024-09-12T22:04:39.520 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:39.520 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:39.520 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:39.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:39.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:39.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.520 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 129944 2024-09-12T22:04:39.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.520 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:39.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.493258+0000", 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.493258+0000", 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.493259+0000", 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0139999999999999e-06 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:39.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.493307+0000", 2024-09-12T22:04:39.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:04:39.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:39.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.493317+0000", 2024-09-12T22:04:39.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.007e-05 2024-09-12T22:04:39.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.493324+0000", 2024-09-12T22:04:39.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.007e-06 2024-09-12T22:04:39.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:39.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.494186+0000", 2024-09-12T22:04:39.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00086171700000000002 2024-09-12T22:04:39.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:39.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.494348+0000", 2024-09-12T22:04:39.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016180799999999999 2024-09-12T22:04:39.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:39.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.496221+0000", 2024-09-12T22:04:39.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001873738 2024-09-12T22:04:39.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:39.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.496252+0000", 2024-09-12T22:04:39.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0378999999999998e-05 2024-09-12T22:04:39.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:39.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.496298+0000", 2024-09-12T22:04:39.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6304999999999998e-05 2024-09-12T22:04:39.525 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.525 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:39.525 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.525 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:129948 5.f e42/40 5:f7dfcda7:::benchmark_data_smithi043_32659_object129947:head v 42'8160, mlcod=42'8156)", 2024-09-12T22:04:39.525 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.495285+0000", 2024-09-12T22:04:39.525 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00063997299999999995, 2024-09-12T22:04:39.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010896910000000001, 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.495285+0000", 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.495285+0000", 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:39.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.495286+0000", 2024-09-12T22:04:39.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8999999999999996e-07 2024-09-12T22:04:39.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:39.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.495345+0000", 2024-09-12T22:04:39.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.906e-05 2024-09-12T22:04:39.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:39.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.495353+0000", 2024-09-12T22:04:39.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8150000000000006e-06 2024-09-12T22:04:39.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.495357+0000", 2024-09-12T22:04:39.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.544e-06 2024-09-12T22:04:39.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:39.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.495395+0000", 2024-09-12T22:04:39.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7413000000000002e-05 2024-09-12T22:04:39.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:39.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.495409+0000", 2024-09-12T22:04:39.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4168000000000001e-05 2024-09-12T22:04:39.529 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.529 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:39.529 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.529 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:129951 5.c 5:3dabb66c:::benchmark_data_smithi043_32659_object129950:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:39.529 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.496110+0000", 2024-09-12T22:04:39.529 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.999815, 2024-09-12T22:04:39.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032650399999999998, 2024-09-12T22:04:39.529 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 129951 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.496110+0000", 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:39.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.496110+0000", 2024-09-12T22:04:39.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:39.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:39.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.496111+0000", 2024-09-12T22:04:39.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:04:39.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:39.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.496172+0000", 2024-09-12T22:04:39.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0936000000000001e-05 2024-09-12T22:04:39.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:39.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.496183+0000", 2024-09-12T22:04:39.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.076e-05 2024-09-12T22:04:39.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:39.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.496190+0000", 2024-09-12T22:04:39.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5340000000000002e-06 2024-09-12T22:04:39.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:39.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.496238+0000", 2024-09-12T22:04:39.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7346999999999999e-05 2024-09-12T22:04:39.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:39.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:39.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:39.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.496364+0000", 2024-09-12T22:04:39.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126709 2024-09-12T22:04:39.533 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.533 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:39.533 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.533 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:39.533 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:39.533 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 7 2024-09-12T22:04:39.533 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:39.534 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:39.546 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:39.545+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:39.554 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:39.574 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:39.575 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:39.580 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:39.580 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:39.647 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:39.646+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:39.685 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:39.685 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:39.698 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:39.748 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:39.746+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:39.849 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:39.847+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:39.856 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:39.856 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:39.869 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:39.950 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:39.949+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:40.029 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:40.030 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:40.044 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:40.086 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:40.085+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:40.152 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:40.151+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:40.193 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 46 16 131747 131731 178.968 163.188 0.00732797 0.00558518 2024-09-12T22:04:40.250 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:40.250 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:40.253 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:40.252+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:40.263 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:40.354 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:40.353+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:40.412 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-09-12T22:04:40.455 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:40.454+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:40.473 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:40.473 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:40.486 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:40.556 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:40.555+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:40.640 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:40.640 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:40.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:40.695 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:40.694+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:40.758 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:40.756+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:40.807 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:40.808 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:40.819 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:40.860 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:40.859+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:40.959 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:40.958+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:41.014 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:41.014 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:41.028 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:41.073 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:41.072+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:41.161 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:41.160+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:41.186 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:41.186 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:41.193 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 47 16 134303 134287 178.558 159.75 0.00563054 0.00559787 2024-09-12T22:04:41.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~18s 2024-09-12T22:04:41.200 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:41.285 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:41.284+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:41.363 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:41.362+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:41.400 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:41.401 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:41.415 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:41.427 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:04:41.500 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:41.499+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:41.539 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-09-12T22:04:41.539 INFO:teuthology.orchestra.console.smithi047:Power on completed 2024-09-12T22:04:41.564 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:41.563+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:41.581 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:04:41.614 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:41.614 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:41.629 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:41.640 DEBUG:teuthology.orchestra.console.smithi047:Waiting for login prompt 2024-09-12T22:04:41.640 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi047 2024-09-12T22:04:41.672 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:41.671+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:41.693 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:41.712 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:41.712 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:41.732 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:41.732 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:41.735 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:41.735 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:41.766 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:41.766+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:41.776 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:41.776 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:41.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.776 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:135781 5.6 5:6bebefc6:::benchmark_data_smithi043_32659_object135780:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:41.777 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:41.772292+0000", 2024-09-12T22:04:41.777 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0029530709999999998, 2024-09-12T22:04:41.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029769079999999999, 2024-09-12T22:04:41.777 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:41.777 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:41.777 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:41.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:41.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:41.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:41.777 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 135781 2024-09-12T22:04:41.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.777 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:41.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:41.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.772292+0000", 2024-09-12T22:04:41.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:41.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.772292+0000", 2024-09-12T22:04:41.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:41.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.772293+0000", 2024-09-12T22:04:41.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1699999999999997e-07 2024-09-12T22:04:41.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:41.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.772345+0000", 2024-09-12T22:04:41.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2571000000000002e-05 2024-09-12T22:04:41.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:41.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.772354+0000", 2024-09-12T22:04:41.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2310000000000002e-06 2024-09-12T22:04:41.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:41.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.772361+0000", 2024-09-12T22:04:41.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3779999999999998e-06 2024-09-12T22:04:41.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:41.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.772838+0000", 2024-09-12T22:04:41.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000476928 2024-09-12T22:04:41.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:41.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.772967+0000", 2024-09-12T22:04:41.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012963199999999999 2024-09-12T22:04:41.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:41.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.773064+0000", 2024-09-12T22:04:41.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6277e-05 2024-09-12T22:04:41.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.781 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:41.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.781 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:135783 5.6 5:6286e64d:::benchmark_data_smithi043_32659_object135782:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:41.781 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:41.773185+0000", 2024-09-12T22:04:41.781 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.002060021, 2024-09-12T22:04:41.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021326180000000002, 2024-09-12T22:04:41.782 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:41.782 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:41.782 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:41.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:41.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:41.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:41.782 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 135783 2024-09-12T22:04:41.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.782 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:41.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:41.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.773185+0000", 2024-09-12T22:04:41.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:41.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.773185+0000", 2024-09-12T22:04:41.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:41.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.773186+0000", 2024-09-12T22:04:41.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9400000000000004e-07 2024-09-12T22:04:41.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:41.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.773241+0000", 2024-09-12T22:04:41.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5155999999999998e-05 2024-09-12T22:04:41.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:41.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.773250+0000", 2024-09-12T22:04:41.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6909999999999992e-06 2024-09-12T22:04:41.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:41.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.773257+0000", 2024-09-12T22:04:41.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9430000000000003e-06 2024-09-12T22:04:41.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:41.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774831+0000", 2024-09-12T22:04:41.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015737940000000001 2024-09-12T22:04:41.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:41.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774989+0000", 2024-09-12T22:04:41.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015837800000000001 2024-09-12T22:04:41.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:41.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.775185+0000", 2024-09-12T22:04:41.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019587700000000001 2024-09-12T22:04:41.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.786 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:41.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.786 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:135782 5.f e43/40 5:fc135101:::benchmark_data_smithi043_32659_object135781:head v 43'8538, mlcod=43'8536)", 2024-09-12T22:04:41.786 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:41.774071+0000", 2024-09-12T22:04:41.786 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001173515, 2024-09-12T22:04:41.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0013098059999999999, 2024-09-12T22:04:41.786 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:41.786 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:41.786 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:41.786 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:41.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:41.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774071+0000", 2024-09-12T22:04:41.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:41.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774071+0000", 2024-09-12T22:04:41.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:41.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774072+0000", 2024-09-12T22:04:41.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.44e-07 2024-09-12T22:04:41.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:41.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774141+0000", 2024-09-12T22:04:41.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9591000000000005e-05 2024-09-12T22:04:41.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:41.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774150+0000", 2024-09-12T22:04:41.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:04:41.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:41.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774158+0000", 2024-09-12T22:04:41.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5290000000000003e-06 2024-09-12T22:04:41.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:41.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774204+0000", 2024-09-12T22:04:41.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5729000000000002e-05 2024-09-12T22:04:41.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:41.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774226+0000", 2024-09-12T22:04:41.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2441000000000001e-05 2024-09-12T22:04:41.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.789 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:41.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.790 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:135775 5.9 e43/40 5:9fb7471e:::benchmark_data_smithi043_32659_object135774:head v 43'8546, mlcod=43'8543)", 2024-09-12T22:04:41.790 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:41.774172+0000", 2024-09-12T22:04:41.790 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0010724269999999999, 2024-09-12T22:04:41.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012664359999999999, 2024-09-12T22:04:41.790 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:41.790 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:41.790 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:41.790 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:41.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:41.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774172+0000", 2024-09-12T22:04:41.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:41.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774172+0000", 2024-09-12T22:04:41.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:41.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774173+0000", 2024-09-12T22:04:41.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8500000000000002e-07 2024-09-12T22:04:41.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:41.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774205+0000", 2024-09-12T22:04:41.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2669999999999997e-05 2024-09-12T22:04:41.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:41.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774221+0000", 2024-09-12T22:04:41.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6028999999999998e-05 2024-09-12T22:04:41.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:41.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774226+0000", 2024-09-12T22:04:41.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.639e-06 2024-09-12T22:04:41.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:41.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774299+0000", 2024-09-12T22:04:41.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3277999999999999e-05 2024-09-12T22:04:41.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:41.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774327+0000", 2024-09-12T22:04:41.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7608999999999999e-05 2024-09-12T22:04:41.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.793 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:41.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.793 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:135768 5.7 e43/40 ondisk, result = 0)", 2024-09-12T22:04:41.794 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:41.775387+0000", 2024-09-12T22:04:41.794 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9998579, 2024-09-12T22:04:41.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8826000000000006e-05, 2024-09-12T22:04:41.794 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:41.794 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:41.794 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:41.794 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:41.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:41.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.775387+0000", 2024-09-12T22:04:41.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:41.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.775387+0000", 2024-09-12T22:04:41.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:41.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.775388+0000", 2024-09-12T22:04:41.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6400000000000002e-07 2024-09-12T22:04:41.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:41.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.775394+0000", 2024-09-12T22:04:41.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0950000000000001e-06 2024-09-12T22:04:41.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:41.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.775405+0000", 2024-09-12T22:04:41.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1409e-05 2024-09-12T22:04:41.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:41.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.775412+0000", 2024-09-12T22:04:41.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7739999999999999e-06 2024-09-12T22:04:41.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:41.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.775453+0000", 2024-09-12T22:04:41.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0871000000000002e-05 2024-09-12T22:04:41.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:41.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.775461+0000", 2024-09-12T22:04:41.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9349999999999994e-06 2024-09-12T22:04:41.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.797 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:41.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.797 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:135768 5.7 5:ec775163:::benchmark_data_smithi043_32659_object135767:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:41.797 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:41.768035+0000", 2024-09-12T22:04:41.797 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0072102080000000001, 2024-09-12T22:04:41.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0074813869999999999, 2024-09-12T22:04:41.798 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:41.798 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:41.798 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:41.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:41.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:41.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:41.798 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 135768 2024-09-12T22:04:41.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.798 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:41.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:41.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768035+0000", 2024-09-12T22:04:41.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:41.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768035+0000", 2024-09-12T22:04:41.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:41.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768035+0000", 2024-09-12T22:04:41.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6300000000000005e-07 2024-09-12T22:04:41.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:41.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768147+0000", 2024-09-12T22:04:41.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111428 2024-09-12T22:04:41.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:41.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768157+0000", 2024-09-12T22:04:41.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9809999999999998e-06 2024-09-12T22:04:41.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:41.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768168+0000", 2024-09-12T22:04:41.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0898e-05 2024-09-12T22:04:41.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:41.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.769984+0000", 2024-09-12T22:04:41.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018162219999999999 2024-09-12T22:04:41.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:41.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.770159+0000", 2024-09-12T22:04:41.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017526900000000001 2024-09-12T22:04:41.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:41.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.770366+0000", 2024-09-12T22:04:41.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000207424 2024-09-12T22:04:41.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:41.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.775216+0000", 2024-09-12T22:04:41.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048491699999999999 2024-09-12T22:04:41.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:41.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.775466+0000", 2024-09-12T22:04:41.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000250368 2024-09-12T22:04:41.802 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.802 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:41.802 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.803 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:135770 5.1 5:8e8125b1:::benchmark_data_smithi043_32659_object135769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:41.803 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:41.768505+0000", 2024-09-12T22:04:41.803 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0067392670000000002, 2024-09-12T22:04:41.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070709099999999997, 2024-09-12T22:04:41.803 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:41.803 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:41.803 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:41.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:41.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:41.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:41.803 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 135770 2024-09-12T22:04:41.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.803 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:41.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:41.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768505+0000", 2024-09-12T22:04:41.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:41.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768505+0000", 2024-09-12T22:04:41.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:41.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768506+0000", 2024-09-12T22:04:41.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4099999999999997e-07 2024-09-12T22:04:41.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:41.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768628+0000", 2024-09-12T22:04:41.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121569 2024-09-12T22:04:41.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:41.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768639+0000", 2024-09-12T22:04:41.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0851e-05 2024-09-12T22:04:41.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:41.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768649+0000", 2024-09-12T22:04:41.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346000000000001e-05 2024-09-12T22:04:41.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:41.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768703+0000", 2024-09-12T22:04:41.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4018999999999999e-05 2024-09-12T22:04:41.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:41.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768838+0000", 2024-09-12T22:04:41.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000134575 2024-09-12T22:04:41.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:41.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.768992+0000", 2024-09-12T22:04:41.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015429199999999999 2024-09-12T22:04:41.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:41.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774227+0000", 2024-09-12T22:04:41.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0052351869999999997 2024-09-12T22:04:41.807 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.807 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:41.807 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.807 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:135774 5.1 5:8d7d1302:::benchmark_data_smithi043_32659_object135773:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:41.807 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:41.769679+0000", 2024-09-12T22:04:41.807 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0055657199999999997, 2024-09-12T22:04:41.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059891320000000003, 2024-09-12T22:04:41.808 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:41.808 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:41.808 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:41.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:41.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:41.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:41.808 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 135774 2024-09-12T22:04:41.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.808 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:41.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:41.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.769679+0000", 2024-09-12T22:04:41.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:41.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.769679+0000", 2024-09-12T22:04:41.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:41.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.769680+0000", 2024-09-12T22:04:41.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.029e-06 2024-09-12T22:04:41.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:41.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.769748+0000", 2024-09-12T22:04:41.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8325999999999996e-05 2024-09-12T22:04:41.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:41.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.769762+0000", 2024-09-12T22:04:41.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.329e-05 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.769770+0000", 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3729999999999993e-06 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.771029+0000", 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012593560000000001 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.771125+0000", 2024-09-12T22:04:41.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5896999999999993e-05 2024-09-12T22:04:41.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:41.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.771210+0000", 2024-09-12T22:04:41.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4919000000000005e-05 2024-09-12T22:04:41.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:41.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.774497+0000", 2024-09-12T22:04:41.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032866900000000001 2024-09-12T22:04:41.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.812 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:41.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.813 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:135776 5.7 5:e729f176:::benchmark_data_smithi043_32659_object135775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:41.813 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:41.771015+0000", 2024-09-12T22:04:41.813 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0042301109999999999, 2024-09-12T22:04:41.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004734991, 2024-09-12T22:04:41.813 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:41.813 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:41.813 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:41.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:41.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:41.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:41.813 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 135776 2024-09-12T22:04:41.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.814 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:41.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:41.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.771015+0000", 2024-09-12T22:04:41.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:41.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.771015+0000", 2024-09-12T22:04:41.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:41.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:41.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.771016+0000", 2024-09-12T22:04:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:04:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.771092+0000", 2024-09-12T22:04:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6512000000000002e-05 2024-09-12T22:04:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.771102+0000", 2024-09-12T22:04:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0328e-05 2024-09-12T22:04:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.771110+0000", 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4619999999999999e-06 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.772819+0000", 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001709529 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.772961+0000", 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014117000000000001 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:41.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.773115+0000", 2024-09-12T22:04:41.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015395400000000001 2024-09-12T22:04:41.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:41.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:41.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:41.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:41.775678+0000", 2024-09-12T22:04:41.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0025636919999999998 2024-09-12T22:04:41.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.817 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:41.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:41.817 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:41.817 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 9 2024-09-12T22:04:41.817 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:41.819 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:41.867 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:41.866+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:41.968 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:41.967+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:42.009 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:42.010 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:42.010 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:42.010 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:42.010 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:42.021 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:42.069 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:42.068+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:42.169 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:42.168+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:42.193 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 48 16 136889 136873 178.205 161.625 0.00580974 0.00560887 2024-09-12T22:04:42.219 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:42.219 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:42.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:42.219 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:42.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.219 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:42.219 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:42.219 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.582143440000003, 2024-09-12T22:04:42.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:42.220 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.220 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.220 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.220 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.220 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.220 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.220 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:42.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.220 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:42.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:42.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:42.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:42.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:42.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:42.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:42.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:42.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:42.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:42.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:42.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:42.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:42.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:42.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.225 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.225 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:42.225 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:42.225 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.8048373150000003, 2024-09-12T22:04:42.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:04:42.225 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.226 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.226 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:42.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.226 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:04:42.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.226 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:42.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:42.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:04:42.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:04:42.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:04:42.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:04:42.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:04:42.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:04:42.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:04:42.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:04:42.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:04:42.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:04:42.230 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.230 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.230 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.230 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:42.230 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:42.230 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.8046573850000005, 2024-09-12T22:04:42.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:04:42.230 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.230 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.230 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:42.230 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:04:42.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:04:42.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:04:42.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:04:42.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:04:42.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:04:42.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:04:42.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:04:42.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:04:42.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:04:42.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:42.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:04:42.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.8045909439999992, 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:42.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:42.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:04:42.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:04:42.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:04:42.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:04:42.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:04:42.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:04:42.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:04:42.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:04:42.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:04:42.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:04:42.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:42.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:04:42.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:04:42.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:04:42.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:04:42.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:04:42.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:04:42.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.239 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.239 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:42.239 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:42.239 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.8045345009999991, 2024-09-12T22:04:42.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:04:42.240 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.240 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.240 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.240 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:04:42.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.240 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:42.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:42.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:42.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:42.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:04:42.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:04:42.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:42.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:04:42.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:04:42.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:04:42.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:04:42.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:04:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:04:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:04:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:04:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:04:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:04:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:04:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.246 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.246 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.246 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:42.246 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:42.246 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.8044660409999995, 2024-09-12T22:04:42.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:04:42.246 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.246 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.246 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.246 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.246 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.247 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:04:42.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.247 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:42.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:42.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:04:42.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:04:42.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:04:42.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:04:42.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:04:42.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:04:42.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:04:42.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:04:42.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:04:42.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:04:42.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:04:42.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:04:42.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:04:42.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:04:42.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:04:42.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:04:42.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:04:42.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:04:42.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:04:42.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:04:42.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:04:42.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.252 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.253 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:42.253 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:42.253 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.8044083059999991, 2024-09-12T22:04:42.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:04:42.253 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.253 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.253 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.253 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:04:42.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.253 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:04:42.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:04:42.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:04:42.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:04:42.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:42.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:04:42.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:04:42.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:04:42.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:04:42.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:04:42.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:04:42.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:04:42.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:04:42.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:04:42.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.8043406140000009, 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.259 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:42.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:04:42.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:04:42.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:04:42.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:04:42.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:04:42.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:04:42.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:04:42.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:04:42.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:04:42.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:42.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:04:42.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:04:42.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:04:42.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:04:42.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:04:42.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:04:42.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:04:42.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:04:42.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:04:42.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:04:42.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.265 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.265 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:42.265 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:42.265 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.8042855519999996, 2024-09-12T22:04:42.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:04:42.266 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.266 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.266 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.266 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:04:42.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.266 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:42.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:42.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:42.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:04:42.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:04:42.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:04:42.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:04:42.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:04:42.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:04:42.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:04:42.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:04:42.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:04:42.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:42.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:04:42.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:04:42.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:04:42.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:04:42.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:04:42.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:04:42.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:04:42.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:04:42.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:04:42.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:04:42.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:04:42.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:04:42.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:42.273 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.7636380320000002, 2024-09-12T22:04:42.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:04:42.273 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.273 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.273 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.273 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.273 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.273 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.273 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:04:42.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.273 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:42.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:42.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:04:42.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:04:42.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:04:42.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:04:42.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:04:42.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:04:42.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:04:42.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:04:42.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:04:42.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:04:42.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:42.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:04:42.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:04:42.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:04:42.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:04:42.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:04:42.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:04:42.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:04:42.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:04:42.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:04:42.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:04:42.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:04:42.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:04:42.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:04:42.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:04:42.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:04:42.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:04:42.279 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.279 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.279 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.279 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:42.279 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:42.279 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.7610243040000002, 2024-09-12T22:04:42.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:04:42.280 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.280 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.280 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.280 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.280 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.280 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.280 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:04:42.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.280 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:42.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:42.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:04:42.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:04:42.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:04:42.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:04:42.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:42.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:42.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:04:42.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:04:42.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:04:42.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:04:42.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:04:42.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:04:42.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:04:42.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:04:42.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:04:42.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.285 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117396 5.1 5:83c565df:::benchmark_data_smithi043_32659_object117395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.7608831809999996, 2024-09-12T22:04:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.090595995999999998, 2024-09-12T22:04:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.287 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117396 2024-09-12T22:04:42.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.287 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:42.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:42.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454559+0000", 2024-09-12T22:04:42.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:04:42.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454629+0000", 2024-09-12T22:04:42.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0036000000000005e-05 2024-09-12T22:04:42.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454641+0000", 2024-09-12T22:04:42.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2232000000000001e-05 2024-09-12T22:04:42.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454649+0000", 2024-09-12T22:04:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-12T22:04:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454697+0000", 2024-09-12T22:04:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8028000000000002e-05 2024-09-12T22:04:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454702+0000", 2024-09-12T22:04:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540467+0000", 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085764217000000004 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540596+0000", 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129787 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540774+0000", 2024-09-12T22:04:42.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017746799999999999 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544679+0000", 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003904996 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545009+0000", 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033056600000000002 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545067+0000", 2024-09-12T22:04:42.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7871999999999997e-05 2024-09-12T22:04:42.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545154+0000", 2024-09-12T22:04:42.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6701999999999998e-05 2024-09-12T22:04:42.292 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.292 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.292 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.292 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117398 5.6 5:6d151138:::benchmark_data_smithi043_32659_object117397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:42.292 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:42.292 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.7395880100000003, 2024-09-12T22:04:42.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044999137000000002, 2024-09-12T22:04:42.293 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.293 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.293 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.293 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117398 2024-09-12T22:04:42.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.293 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:42.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:42.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475854+0000", 2024-09-12T22:04:42.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:04:42.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475914+0000", 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9422999999999997e-05 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475925+0000", 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0881e-05 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475930+0000", 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475974+0000", 2024-09-12T22:04:42.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3810999999999998e-05 2024-09-12T22:04:42.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:42.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475981+0000", 2024-09-12T22:04:42.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1590000000000004e-06 2024-09-12T22:04:42.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504359+0000", 2024-09-12T22:04:42.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028377711 2024-09-12T22:04:42.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504526+0000", 2024-09-12T22:04:42.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167023 2024-09-12T22:04:42.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504661+0000", 2024-09-12T22:04:42.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135148 2024-09-12T22:04:42.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.506563+0000", 2024-09-12T22:04:42.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901778 2024-09-12T22:04:42.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520770+0000", 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014206724 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520803+0000", 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3083000000000002e-05 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520852+0000", 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9543999999999999e-05 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.298 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.299 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.299 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117399 5.3 5:ce33c2c7:::benchmark_data_smithi043_32659_object117398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:42.299 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:42.299 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.7348190169999995, 2024-09-12T22:04:42.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038176902999999998, 2024-09-12T22:04:42.299 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.299 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.299 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.299 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.299 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.299 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.300 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117399 2024-09-12T22:04:42.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.300 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:42.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:42.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480624+0000", 2024-09-12T22:04:42.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.322e-06 2024-09-12T22:04:42.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480670+0000", 2024-09-12T22:04:42.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6365000000000001e-05 2024-09-12T22:04:42.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480682+0000", 2024-09-12T22:04:42.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:04:42.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480689+0000", 2024-09-12T22:04:42.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:04:42.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480731+0000", 2024-09-12T22:04:42.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480738+0000", 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513753+0000", 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.033015125999999999 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513935+0000", 2024-09-12T22:04:42.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018219500000000001 2024-09-12T22:04:42.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.514170+0000", 2024-09-12T22:04:42.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000234694 2024-09-12T22:04:42.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518462+0000", 2024-09-12T22:04:42.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004291563 2024-09-12T22:04:42.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518655+0000", 2024-09-12T22:04:42.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019362700000000001 2024-09-12T22:04:42.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518710+0000", 2024-09-12T22:04:42.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:04:42.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518799+0000", 2024-09-12T22:04:42.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9000999999999997e-05 2024-09-12T22:04:42.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.306 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.306 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117407 5.c 5:3c61c1b7:::benchmark_data_smithi043_32659_object117406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:42.306 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:42.306 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.7016135029999999, 2024-09-12T22:04:42.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042860548999999998, 2024-09-12T22:04:42.306 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.306 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.306 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.306 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.306 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.307 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117407 2024-09-12T22:04:42.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.307 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:42.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:42.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513829+0000", 2024-09-12T22:04:42.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-12T22:04:42.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513900+0000", 2024-09-12T22:04:42.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1482000000000004e-05 2024-09-12T22:04:42.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513909+0000", 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8370000000000003e-06 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513917+0000", 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513967+0000", 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.007e-05 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513975+0000", 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5639999999999999e-06 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542411+0000", 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028436032999999999 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542539+0000", 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012777900000000001 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542687+0000", 2024-09-12T22:04:42.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148343 2024-09-12T22:04:42.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548120+0000", 2024-09-12T22:04:42.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054333580000000001 2024-09-12T22:04:42.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556549+0000", 2024-09-12T22:04:42.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084288309999999995 2024-09-12T22:04:42.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556596+0000", 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6458999999999997e-05 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556688+0000", 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2676999999999994e-05 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:42.312 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.2158102080000002, 2024-09-12T22:04:42.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:04:42.313 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.313 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.313 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.313 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.313 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.313 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.313 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:04:42.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.313 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:42.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:42.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:04:42.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:04:42.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:04:42.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:04:42.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:04:42.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:04:42.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:04:42.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:04:42.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:04:42.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:04:42.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:04:42.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:04:42.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:04:42.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:04:42.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:04:42.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:04:42.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:04:42.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:04:42.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:04:42.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:04:42.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:04:42.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:04:42.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.319 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.320 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:42.320 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:42.320 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.21533172, 2024-09-12T22:04:42.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:04:42.320 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.320 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.320 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.320 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:04:42.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.320 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:42.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:42.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:42.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:04:42.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:04:42.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:04:42.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:04:42.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:04:42.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:04:42.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:04:42.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:04:42.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:04:42.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:04:42.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:04:42.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:04:42.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:04:42.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:04:42.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:04:42.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:04:42.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:04:42.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:04:42.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:04:42.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:04:42.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:04:42.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.2128364199999999, 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.326 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:04:42.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.327 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:42.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:42.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:04:42.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:04:42.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:04:42.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:04:42.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:04:42.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:04:42.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:04:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:04:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:04:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:04:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:04:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:04:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:04:42.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:04:42.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:04:42.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:04:42.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:04:42.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.332 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:42.332 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:42.332 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.2117556289999998, 2024-09-12T22:04:42.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:04:42.332 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.332 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.332 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.332 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.332 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.332 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.332 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:04:42.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:42.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:04:42.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:04:42.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:04:42.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:04:42.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:04:42.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:04:42.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:04:42.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:04:42.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:04:42.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:04:42.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:04:42.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:42.337 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.210520067, 2024-09-12T22:04:42.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:04:42.338 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:42.338 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:42.338 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:42.338 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:42.338 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:42.338 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.338 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:04:42.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.338 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:42.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:42.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:42.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:04:42.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:04:42.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:42.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:04:42.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:04:42.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:04:42.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:04:42.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:42.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:04:42.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:04:42.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:04:42.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:04:42.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:42.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:04:42.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:04:42.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:42.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:42.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:42.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:04:42.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:04:42.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.343 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:42.343 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:42.343 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:42.345 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:42.345 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:42.343+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:42.427 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:04:42.445 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:42.444+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:42.517 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:42.517 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:42.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.517 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:137722 5.b 5:dfc92a68:::benchmark_data_smithi043_32659_object137721:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:42.517 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.511304+0000", 2024-09-12T22:04:42.517 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0028813789999999999, 2024-09-12T22:04:42.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00290837, 2024-09-12T22:04:42.517 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.517 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.518 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:42.518 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:42.518 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:42.518 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.518 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 137722 2024-09-12T22:04:42.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.518 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511304+0000", 2024-09-12T22:04:42.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511304+0000", 2024-09-12T22:04:42.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511305+0000", 2024-09-12T22:04:42.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.217e-06 2024-09-12T22:04:42.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511385+0000", 2024-09-12T22:04:42.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0481000000000004e-05 2024-09-12T22:04:42.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511399+0000", 2024-09-12T22:04:42.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3760999999999999e-05 2024-09-12T22:04:42.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511407+0000", 2024-09-12T22:04:42.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2020000000000004e-06 2024-09-12T22:04:42.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511466+0000", 2024-09-12T22:04:42.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8381000000000002e-05 2024-09-12T22:04:42.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:42.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511582+0000", 2024-09-12T22:04:42.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116424 2024-09-12T22:04:42.521 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.521 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.521 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.521 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:137723 5.a 5:5be7327c:::benchmark_data_smithi043_32659_object137722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:42.521 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.511427+0000", 2024-09-12T22:04:42.521 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0027580230000000001, 2024-09-12T22:04:42.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002914593, 2024-09-12T22:04:42.522 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.522 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.522 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:42.522 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:42.522 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:42.522 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.522 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 137723 2024-09-12T22:04:42.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.522 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511427+0000", 2024-09-12T22:04:42.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511427+0000", 2024-09-12T22:04:42.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511428+0000", 2024-09-12T22:04:42.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6499999999999999e-07 2024-09-12T22:04:42.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511461+0000", 2024-09-12T22:04:42.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3308e-05 2024-09-12T22:04:42.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511470+0000", 2024-09-12T22:04:42.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6999999999999997e-06 2024-09-12T22:04:42.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511477+0000", 2024-09-12T22:04:42.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6819999999999997e-06 2024-09-12T22:04:42.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511528+0000", 2024-09-12T22:04:42.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1397000000000003e-05 2024-09-12T22:04:42.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:42.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511672+0000", 2024-09-12T22:04:42.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014443600000000001 2024-09-12T22:04:42.525 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.525 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.525 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.525 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:137724 5.f 5:ff2ab932:::benchmark_data_smithi043_32659_object137723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:42.526 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.511497+0000", 2024-09-12T22:04:42.526 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0026885210000000001, 2024-09-12T22:04:42.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0029168280000000002, 2024-09-12T22:04:42.526 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.526 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.526 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:42.526 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:42.526 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:42.526 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.526 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 137724 2024-09-12T22:04:42.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.526 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511497+0000", 2024-09-12T22:04:42.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511497+0000", 2024-09-12T22:04:42.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511497+0000", 2024-09-12T22:04:42.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0999999999999998e-07 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511548+0000", 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0575999999999998e-05 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511558+0000", 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9010000000000006e-06 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511565+0000", 2024-09-12T22:04:42.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0129999999999996e-06 2024-09-12T22:04:42.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512142+0000", 2024-09-12T22:04:42.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00057714099999999998 2024-09-12T22:04:42.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:42.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512256+0000", 2024-09-12T22:04:42.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011387000000000001 2024-09-12T22:04:42.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:42.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512386+0000", 2024-09-12T22:04:42.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013045400000000001 2024-09-12T22:04:42.530 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.530 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.530 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.530 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:137725 5.8 5:1cb413ae:::benchmark_data_smithi043_32659_object137724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:42.530 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.511662+0000", 2024-09-12T22:04:42.530 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002522935, 2024-09-12T22:04:42.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028188940000000002, 2024-09-12T22:04:42.530 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.530 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.530 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:42.530 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:42.531 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:42.531 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.531 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 137725 2024-09-12T22:04:42.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.531 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.531 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.531 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511662+0000", 2024-09-12T22:04:42.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.531 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.531 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511662+0000", 2024-09-12T22:04:42.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511663+0000", 2024-09-12T22:04:42.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0800000000000004e-07 2024-09-12T22:04:42.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511762+0000", 2024-09-12T22:04:42.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9042000000000005e-05 2024-09-12T22:04:42.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511772+0000", 2024-09-12T22:04:42.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4269999999999997e-06 2024-09-12T22:04:42.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511778+0000", 2024-09-12T22:04:42.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9e-06 2024-09-12T22:04:42.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511883+0000", 2024-09-12T22:04:42.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104109 2024-09-12T22:04:42.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:42.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512194+0000", 2024-09-12T22:04:42.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031159800000000001 2024-09-12T22:04:42.534 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.534 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.534 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.534 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:137721 5.c e43/40 5:3a2648dd:::benchmark_data_smithi043_32659_object137720:head v 43'8541, mlcod=43'8537)", 2024-09-12T22:04:42.534 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.511782+0000", 2024-09-12T22:04:42.534 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002403058, 2024-09-12T22:04:42.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027598340000000001, 2024-09-12T22:04:42.535 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.535 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.535 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:42.535 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511782+0000", 2024-09-12T22:04:42.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511782+0000", 2024-09-12T22:04:42.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511783+0000", 2024-09-12T22:04:42.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2499999999999995e-07 2024-09-12T22:04:42.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511787+0000", 2024-09-12T22:04:42.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.318e-06 2024-09-12T22:04:42.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511795+0000", 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0600000000000008e-06 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511800+0000", 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0289999999999996e-06 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511856+0000", 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5532000000000003e-05 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:42.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511873+0000", 2024-09-12T22:04:42.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7416000000000001e-05 2024-09-12T22:04:42.538 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.538 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.538 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.538 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:137727 5.d 5:b0caef90:::benchmark_data_smithi043_32659_object137726:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:42.538 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.511989+0000", 2024-09-12T22:04:42.538 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002195869, 2024-09-12T22:04:42.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026073759999999998, 2024-09-12T22:04:42.538 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.538 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.539 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:42.539 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:42.539 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:42.539 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.539 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 137727 2024-09-12T22:04:42.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.539 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.539 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511989+0000", 2024-09-12T22:04:42.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511989+0000", 2024-09-12T22:04:42.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.511990+0000", 2024-09-12T22:04:42.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3799999999999996e-07 2024-09-12T22:04:42.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512056+0000", 2024-09-12T22:04:42.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5411000000000001e-05 2024-09-12T22:04:42.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512065+0000", 2024-09-12T22:04:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2499999999999995e-06 2024-09-12T22:04:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512071+0000", 2024-09-12T22:04:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3520000000000003e-06 2024-09-12T22:04:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512123+0000", 2024-09-12T22:04:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2225999999999998e-05 2024-09-12T22:04:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:42.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512246+0000", 2024-09-12T22:04:42.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012243900000000001 2024-09-12T22:04:42.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:42.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512371+0000", 2024-09-12T22:04:42.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012507800000000001 2024-09-12T22:04:42.542 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.542 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.542 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.543 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:137726 5.5 e43/40 5:a11e377c:::benchmark_data_smithi043_32659_object137725:head v 43'8583, mlcod=43'8580)", 2024-09-12T22:04:42.543 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.512897+0000", 2024-09-12T22:04:42.543 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0012885920000000001, 2024-09-12T22:04:42.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00176279, 2024-09-12T22:04:42.543 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.543 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.543 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:42.543 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512897+0000", 2024-09-12T22:04:42.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512897+0000", 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512897+0000", 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.98e-07 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512900+0000", 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2059999999999999e-06 2024-09-12T22:04:42.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512905+0000", 2024-09-12T22:04:42.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1880000000000001e-06 2024-09-12T22:04:42.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.512909+0000", 2024-09-12T22:04:42.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.597e-06 2024-09-12T22:04:42.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513982+0000", 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0010728479999999999 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514052+0000", 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0377999999999996e-05 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:137728 5.1 e43/40 5:84c9dbe7:::benchmark_data_smithi043_32659_object137727:head v 43'8557, mlcod=43'8555)", 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.513838+0000", 2024-09-12T22:04:42.546 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00034728200000000003, 2024-09-12T22:04:42.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00087739700000000003, 2024-09-12T22:04:42.547 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.547 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.547 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:42.547 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513838+0000", 2024-09-12T22:04:42.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513838+0000", 2024-09-12T22:04:42.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513839+0000", 2024-09-12T22:04:42.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4099999999999998e-07 2024-09-12T22:04:42.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513847+0000", 2024-09-12T22:04:42.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7169999999999997e-06 2024-09-12T22:04:42.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513855+0000", 2024-09-12T22:04:42.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9910000000000002e-06 2024-09-12T22:04:42.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513861+0000", 2024-09-12T22:04:42.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0179999999999998e-06 2024-09-12T22:04:42.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513907+0000", 2024-09-12T22:04:42.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5444000000000001e-05 2024-09-12T22:04:42.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:42.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513927+0000", 2024-09-12T22:04:42.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0548e-05 2024-09-12T22:04:42.550 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.550 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.550 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.550 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:137730 5.8 5:1ed3fd57:::benchmark_data_smithi043_32659_object137729:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:42.550 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.513909+0000", 2024-09-12T22:04:42.550 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00027612099999999999, 2024-09-12T22:04:42.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00086180499999999999, 2024-09-12T22:04:42.551 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.551 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.551 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:42.551 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:42.551 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:42.551 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.551 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 137730 2024-09-12T22:04:42.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.551 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.551 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513909+0000", 2024-09-12T22:04:42.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513909+0000", 2024-09-12T22:04:42.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513910+0000", 2024-09-12T22:04:42.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9399999999999993e-07 2024-09-12T22:04:42.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513975+0000", 2024-09-12T22:04:42.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4692999999999999e-05 2024-09-12T22:04:42.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513985+0000", 2024-09-12T22:04:42.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9459999999999993e-06 2024-09-12T22:04:42.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513991+0000", 2024-09-12T22:04:42.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8029999999999999e-06 2024-09-12T22:04:42.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514031+0000", 2024-09-12T22:04:42.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9848000000000002e-05 2024-09-12T22:04:42.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:42.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514145+0000", 2024-09-12T22:04:42.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011406899999999999 2024-09-12T22:04:42.554 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.554 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.555 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.555 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:137731 5.b 5:dcf1d63e:::benchmark_data_smithi043_32659_object137730:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:42.555 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.514016+0000", 2024-09-12T22:04:42.555 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00016883299999999999, 2024-09-12T22:04:42.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00082375199999999997, 2024-09-12T22:04:42.555 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.555 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.555 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:42.555 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:42.556 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:42.556 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.556 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 137731 2024-09-12T22:04:42.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.556 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.556 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514016+0000", 2024-09-12T22:04:42.556 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.556 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514016+0000", 2024-09-12T22:04:42.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.557 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.557 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514017+0000", 2024-09-12T22:04:42.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8599999999999998e-07 2024-09-12T22:04:42.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.557 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.557 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514049+0000", 2024-09-12T22:04:42.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2199000000000001e-05 2024-09-12T22:04:42.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514057+0000", 2024-09-12T22:04:42.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5700000000000004e-06 2024-09-12T22:04:42.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514063+0000", 2024-09-12T22:04:42.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8130000000000001e-06 2024-09-12T22:04:42.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514111+0000", 2024-09-12T22:04:42.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8646999999999997e-05 2024-09-12T22:04:42.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:42.559 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514329+0000", 2024-09-12T22:04:42.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00021727899999999999 2024-09-12T22:04:42.559 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.559 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.559 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.559 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:137732 5.b 5.4f16820b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:42.560 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.514205+0000", 2024-09-12T22:04:42.560 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9999804, 2024-09-12T22:04:42.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00069203099999999996, 2024-09-12T22:04:42.560 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.560 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.560 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:42.560 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:42.560 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:42.560 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.560 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 137732 2024-09-12T22:04:42.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.560 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514205+0000", 2024-09-12T22:04:42.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514205+0000", 2024-09-12T22:04:42.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514205+0000", 2024-09-12T22:04:42.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4600000000000005e-07 2024-09-12T22:04:42.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514282+0000", 2024-09-12T22:04:42.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6290000000000003e-05 2024-09-12T22:04:42.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514290+0000", 2024-09-12T22:04:42.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4479999999999994e-06 2024-09-12T22:04:42.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514297+0000", 2024-09-12T22:04:42.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6089999999999997e-06 2024-09-12T22:04:42.563 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.563 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.563 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.563 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDPGPush(5.6 43/40 [PushOp(5:62bcbd86:::benchmark_data_smithi043_32659_object86419:head, version: 34'5311, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:62bcbd86:::benchmark_data_smithi043_32659_object86419:head@34'5311, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T22:04:42.563 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.514265+0000", 2024-09-12T22:04:42.563 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9999204, 2024-09-12T22:04:42.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00070453499999999995, 2024-09-12T22:04:42.563 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.563 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.563 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:42.563 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514265+0000", 2024-09-12T22:04:42.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514265+0000", 2024-09-12T22:04:42.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514266+0000", 2024-09-12T22:04:42.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:04:42.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514353+0000", 2024-09-12T22:04:42.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7282999999999998e-05 2024-09-12T22:04:42.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514369+0000", 2024-09-12T22:04:42.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6127e-05 2024-09-12T22:04:42.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514391+0000", 2024-09-12T22:04:42.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2458000000000001e-05 2024-09-12T22:04:42.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514531+0000", 2024-09-12T22:04:42.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013998299999999999 2024-09-12T22:04:42.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:42.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514544+0000", 2024-09-12T22:04:42.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2588e-05 2024-09-12T22:04:42.566 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.566 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.567 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.567 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 43/43 lb 5:62bb667e:::benchmark_data_smithi043_32659_object38537:head)", 2024-09-12T22:04:42.567 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.514427+0000", 2024-09-12T22:04:42.567 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9997582, 2024-09-12T22:04:42.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00059374999999999999, 2024-09-12T22:04:42.567 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.567 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.567 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:42.567 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.567 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.567 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514427+0000", 2024-09-12T22:04:42.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514427+0000", 2024-09-12T22:04:42.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514427+0000", 2024-09-12T22:04:42.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.08e-07 2024-09-12T22:04:42.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514435+0000", 2024-09-12T22:04:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3520000000000001e-06 2024-09-12T22:04:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514443+0000", 2024-09-12T22:04:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5399999999999996e-06 2024-09-12T22:04:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514449+0000", 2024-09-12T22:04:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.066e-06 2024-09-12T22:04:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:137729 5.5 e43/40)", 2024-09-12T22:04:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.514682+0000", 2024-09-12T22:04:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9995036, 2024-09-12T22:04:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00037854499999999999, 2024-09-12T22:04:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514682+0000", 2024-09-12T22:04:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514682+0000", 2024-09-12T22:04:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514682+0000", 2024-09-12T22:04:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:04:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514688+0000", 2024-09-12T22:04:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8390000000000003e-06 2024-09-12T22:04:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514696+0000", 2024-09-12T22:04:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3839999999999997e-06 2024-09-12T22:04:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514703+0000", 2024-09-12T22:04:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9600000000000003e-06 2024-09-12T22:04:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:137733 5.e 5.cea17a2e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.514763+0000", 2024-09-12T22:04:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9994226, 2024-09-12T22:04:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000339186, 2024-09-12T22:04:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:04:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 137733 2024-09-12T22:04:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514763+0000", 2024-09-12T22:04:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514763+0000", 2024-09-12T22:04:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514764+0000", 2024-09-12T22:04:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.85e-07 2024-09-12T22:04:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514827+0000", 2024-09-12T22:04:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3424999999999997e-05 2024-09-12T22:04:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514889+0000", 2024-09-12T22:04:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2051000000000006e-05 2024-09-12T22:04:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514898+0000", 2024-09-12T22:04:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4610000000000008e-06 2024-09-12T22:04:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.515099+0000", 2024-09-12T22:04:42.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020099199999999999 2024-09-12T22:04:42.577 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.577 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.577 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.577 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:137734 5.e 5.a0a501de (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:42.577 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.514910+0000", 2024-09-12T22:04:42.577 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9992747, 2024-09-12T22:04:42.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000247989, 2024-09-12T22:04:42.577 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.578 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.578 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:42.578 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:42.578 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:42.578 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.578 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 137734 2024-09-12T22:04:42.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.578 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514910+0000", 2024-09-12T22:04:42.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514910+0000", 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514911+0000", 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9800000000000003e-07 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514947+0000", 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5321000000000003e-05 2024-09-12T22:04:42.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514955+0000", 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7120000000000006e-06 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514960+0000", 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9599999999999999e-06 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.580 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:137724 5.f e43/40)", 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.515048+0000", 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9991369, 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000155499, 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.515048+0000", 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.581 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.515048+0000", 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.515049+0000", 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.515052+0000", 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2320000000000001e-06 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.515059+0000", 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9210000000000003e-06 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.515064+0000", 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7809999999999996e-06 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:137714 5.9 5:985ae1f7:::benchmark_data_smithi043_32659_object137713:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.507451+0000", 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0067338789999999999, 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.007798747, 2024-09-12T22:04:42.583 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.584 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.584 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:42.584 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:42.584 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:42.584 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.584 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 137714 2024-09-12T22:04:42.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.584 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.585 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.507451+0000", 2024-09-12T22:04:42.585 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.585 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.585 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.585 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.585 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.507451+0000", 2024-09-12T22:04:42.585 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.585 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.585 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.585 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.585 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.507452+0000", 2024-09-12T22:04:42.585 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:04:42.585 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.585 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.507484+0000", 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1732e-05 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.507491+0000", 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3819999999999998e-06 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.507496+0000", 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.074e-06 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.509441+0000", 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001945345 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.509560+0000", 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011814 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.509692+0000", 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000132096 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.513054+0000", 2024-09-12T22:04:42.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033627520000000001 2024-09-12T22:04:42.588 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.588 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.588 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.588 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:137716 5.5 e43/40 5:a880f0b2:::benchmark_data_smithi043_32659_object137715:head v 43'8582, mlcod=43'8579)", 2024-09-12T22:04:42.588 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.508864+0000", 2024-09-12T22:04:42.588 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0053212909999999997, 2024-09-12T22:04:42.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0064591170000000003, 2024-09-12T22:04:42.588 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.589 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.589 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:42.589 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.589 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.589 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.589 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.508864+0000", 2024-09-12T22:04:42.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.589 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.589 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.589 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.508864+0000", 2024-09-12T22:04:42.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.508865+0000", 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8599999999999998e-07 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.508870+0000", 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8579999999999996e-06 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.508880+0000", 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.508885+0000", 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7470000000000002e-06 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.508977+0000", 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1681000000000005e-05 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.508996+0000", 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9287999999999999e-05 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.591 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:137719 5.d 5:b79c124a:::benchmark_data_smithi043_32659_object137718:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:42.509297+0000", 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0048885719999999999, 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0060826930000000001, 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 137719 2024-09-12T22:04:42.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.509297+0000", 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.509297+0000", 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.509297+0000", 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6199999999999996e-07 2024-09-12T22:04:42.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.509361+0000", 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3610999999999998e-05 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.509372+0000", 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1034e-05 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.509379+0000", 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5220000000000004e-06 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.594 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.509420+0000", 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1498000000000001e-05 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.509534+0000", 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114262 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.509670+0000", 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135341 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:42.514040+0000", 2024-09-12T22:04:42.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043706780000000002 2024-09-12T22:04:42.596 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.596 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:42.596 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.596 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:42.596 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:42.596 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 20 2024-09-12T22:04:42.596 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:42.597 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:42.596+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:42.598 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:42.698 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:42.697+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:42.799 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:42.799 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:42.799 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:42.799 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:42.799 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:42.799 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:42.797+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:42.812 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:42.900 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:42.899+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:43.000 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:42.999+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:43.012 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.383287654999997, 2024-09-12T22:04:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.377886715000002, 2024-09-12T22:04:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.376945448000001, 2024-09-12T22:04:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.375947527999998, 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0121988289999999, 2024-09-12T22:04:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:04:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:04:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:04:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:04:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:04:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:04:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:04:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:04:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:04:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:04:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:04:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:04:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:04:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:04:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:04:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:04:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:04:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:04:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:04:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:04:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:04:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:04:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:04:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0115656240000002, 2024-09-12T22:04:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:04:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:04:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:04:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:04:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:04:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:04:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:04:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:04:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:04:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:04:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:04:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:04:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:04:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:04:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:04:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:04:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:04:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:04:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:04:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:04:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0097459610000001, 2024-09-12T22:04:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:04:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:04:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:04:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:04:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:04:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:04:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:04:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:04:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:04:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:04:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:04:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:04:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0095783340000004, 2024-09-12T22:04:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:04:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:04:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:04:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:04:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:04:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:04:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:04:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:04:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:04:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:04:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:04:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:04:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:04:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:43.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:04:43.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:04:43.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:04:43.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:04:43.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:04:43.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0094376699999996, 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:43.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:43.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:04:43.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:04:43.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:04:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:04:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:04:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:04:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:04:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:04:43.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:04:43.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:04:43.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:04:43.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:04:43.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0092121470000004, 2024-09-12T22:04:43.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:04:43.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:04:43.068 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.068 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.068 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.068 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.068 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:43.068 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0090924430000001, 2024-09-12T22:04:43.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:04:43.068 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.069 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.069 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.069 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:43.069 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:43.069 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.069 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:04:43.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.069 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:43.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:43.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:04:43.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:04:43.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:04:43.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:04:43.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:04:43.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:04:43.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:04:43.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:43.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:04:43.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:04:43.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:04:43.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:04:43.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:43.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:04:43.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:04:43.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:04:43.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:04:43.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:04:43.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:04:43.074 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.074 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.074 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.074 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:04:43.074 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:43.074 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0085011609999999, 2024-09-12T22:04:43.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:04:43.075 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.075 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.075 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:43.075 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:43.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:43.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:04:43.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:04:43.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:04:43.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:04:43.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:04:43.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:04:43.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:04:43.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:04:43.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:04:43.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:04:43.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:04:43.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:04:43.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:04:43.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:04:43.078 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.078 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.078 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.078 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:04:43.078 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:43.079 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0082775929999999, 2024-09-12T22:04:43.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:04:43.079 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.079 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.079 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.079 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:43.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:04:43.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:04:43.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:04:43.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:04:43.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:04:43.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:04:43.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:04:43.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:04:43.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:04:43.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:04:43.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:04:43.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:04:43.082 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.083 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.083 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.083 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.083 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:43.083 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0081861119999997, 2024-09-12T22:04:43.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:04:43.083 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.083 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.083 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.083 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:43.083 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:43.084 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.084 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:04:43.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.084 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:43.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:43.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:04:43.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:04:43.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:04:43.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:04:43.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:04:43.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:04:43.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:04:43.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:04:43.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:04:43.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:04:43.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:04:43.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:04:43.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:43.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:04:43.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:04:43.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:04:43.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:04:43.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:04:43.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:04:43.088 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.088 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.088 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.089 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.089 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:43.089 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0073973079999998, 2024-09-12T22:04:43.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:04:43.089 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.089 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.089 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.089 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:43.089 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:43.089 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.089 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:04:43.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.090 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:43.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:43.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:04:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:04:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:04:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:04:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:04:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:04:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:04:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:04:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:04:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:04:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:04:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:04:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:43.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:04:43.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:04:43.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:04:43.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:04:43.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:04:43.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0071331680000002, 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:43.094 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:04:43.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:04:43.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:04:43.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:04:43.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:04:43.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:04:43.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:04:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:04:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:04:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:04:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:04:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:04:43.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:04:43.099 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.099 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.099 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.099 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:04:43.099 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:43.099 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0066281930000001, 2024-09-12T22:04:43.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:04:43.100 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.100 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.100 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.100 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:43.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:43.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:04:43.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:04:43.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:04:43.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:04:43.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:04:43.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:04:43.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.102 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:04:43.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:04:43.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.102 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:04:43.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:04:43.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:04:43.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:04:43.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:04:43.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:04:43.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:04:43.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:04:43.103 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.103 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.104 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.104 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:04:43.104 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:43.104 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0054987649999996, 2024-09-12T22:04:43.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:04:43.104 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.104 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.104 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.104 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:43.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:43.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:43.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:04:43.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:04:43.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:04:43.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:04:43.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:04:43.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:04:43.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:04:43.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:04:43.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:04:43.108 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.108 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.108 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.108 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.108 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:43.109 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0047443229999997, 2024-09-12T22:04:43.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:04:43.109 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.109 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.109 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.109 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:43.109 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:43.109 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.109 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:04:43.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.109 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:04:43.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:04:43.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:04:43.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:04:43.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:04:43.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:04:43.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:04:43.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:04:43.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:04:43.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:04:43.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:43.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:04:43.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:04:43.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:04:43.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:04:43.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:43.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:04:43.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:04:43.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:04:43.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:04:43.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:04:43.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:04:43.114 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.114 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.114 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.114 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:04:43.114 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:43.114 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.0040652210000003, 2024-09-12T22:04:43.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:04:43.115 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:43.115 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:43.115 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.115 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:43.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:43.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:43.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:43.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:43.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:43.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:43.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:04:43.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:04:43.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:43.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:04:43.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:04:43.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:43.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:04:43.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:04:43.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:04:43.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:04:43.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:43.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:04:43.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:04:43.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:43.118 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:04:43.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:04:43.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:43.118 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:04:43.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:04:43.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:43.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:43.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:43.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:04:43.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:04:43.119 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.119 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.119 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.119 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:43.119 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:43.119 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:43.121 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:43.119+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:43.121 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:43.193 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 49 16 139480 139464 177.873 161.938 0.00898691 0.00561949 2024-09-12T22:04:43.221 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:43.220+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:43.277 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:43.277 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:43.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.277 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:139664 5.7 5:ecd5c581:::benchmark_data_smithi043_32659_object139663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:43.277 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:43.270010+0000", 2024-09-12T22:04:43.277 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0057835009999999999, 2024-09-12T22:04:43.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058117799999999999, 2024-09-12T22:04:43.277 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.278 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.278 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:43.278 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.278 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.278 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.278 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 139664 2024-09-12T22:04:43.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.278 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270010+0000", 2024-09-12T22:04:43.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270010+0000", 2024-09-12T22:04:43.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270011+0000", 2024-09-12T22:04:43.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7600000000000006e-07 2024-09-12T22:04:43.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270108+0000", 2024-09-12T22:04:43.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6972000000000006e-05 2024-09-12T22:04:43.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270120+0000", 2024-09-12T22:04:43.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2235999999999999e-05 2024-09-12T22:04:43.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270128+0000", 2024-09-12T22:04:43.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7559999999999999e-06 2024-09-12T22:04:43.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270175+0000", 2024-09-12T22:04:43.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7336000000000002e-05 2024-09-12T22:04:43.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270268+0000", 2024-09-12T22:04:43.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3004999999999995e-05 2024-09-12T22:04:43.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270352+0000", 2024-09-12T22:04:43.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3638000000000001e-05 2024-09-12T22:04:43.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.275210+0000", 2024-09-12T22:04:43.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048577209999999997 2024-09-12T22:04:43.282 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.282 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.282 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.282 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:139665 5.7 5:e4f3f2b8:::benchmark_data_smithi043_32659_object139664:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:43.282 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:43.270146+0000", 2024-09-12T22:04:43.282 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0056472140000000002, 2024-09-12T22:04:43.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057548770000000003, 2024-09-12T22:04:43.282 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 139665 2024-09-12T22:04:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270146+0000", 2024-09-12T22:04:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270146+0000", 2024-09-12T22:04:43.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270147+0000", 2024-09-12T22:04:43.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-12T22:04:43.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270198+0000", 2024-09-12T22:04:43.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0498000000000003e-05 2024-09-12T22:04:43.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270207+0000", 2024-09-12T22:04:43.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3149999999999998e-06 2024-09-12T22:04:43.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270215+0000", 2024-09-12T22:04:43.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3659999999999992e-06 2024-09-12T22:04:43.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.271646+0000", 2024-09-12T22:04:43.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001430969 2024-09-12T22:04:43.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.271763+0000", 2024-09-12T22:04:43.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011674499999999999 2024-09-12T22:04:43.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.271909+0000", 2024-09-12T22:04:43.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000146267 2024-09-12T22:04:43.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.275216+0000", 2024-09-12T22:04:43.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033066390000000001 2024-09-12T22:04:43.287 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.287 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.287 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.287 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:139666 5.7 5:ed25fa78:::benchmark_data_smithi043_32659_object139665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:43.287 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:43.270227+0000", 2024-09-12T22:04:43.287 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0055671399999999999, 2024-09-12T22:04:43.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057487249999999997, 2024-09-12T22:04:43.287 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.287 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.288 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:43.288 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.288 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.288 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.288 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 139666 2024-09-12T22:04:43.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.288 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270227+0000", 2024-09-12T22:04:43.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270227+0000", 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270227+0000", 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9200000000000001e-07 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270263+0000", 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6128999999999999e-05 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270272+0000", 2024-09-12T22:04:43.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1759999999999999e-06 2024-09-12T22:04:43.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270279+0000", 2024-09-12T22:04:43.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6390000000000003e-06 2024-09-12T22:04:43.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.273278+0000", 2024-09-12T22:04:43.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029990910000000002 2024-09-12T22:04:43.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.273414+0000", 2024-09-12T22:04:43.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135883 2024-09-12T22:04:43.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.273610+0000", 2024-09-12T22:04:43.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000195448 2024-09-12T22:04:43.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.291 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.292 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:139672 5.c 5:39f8330f:::benchmark_data_smithi043_32659_object139671:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:43.292 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:43.270513+0000", 2024-09-12T22:04:43.292 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0052804540000000004, 2024-09-12T22:04:43.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055289550000000003, 2024-09-12T22:04:43.292 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.292 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.292 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:43.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.292 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 139672 2024-09-12T22:04:43.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.292 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270513+0000", 2024-09-12T22:04:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270513+0000", 2024-09-12T22:04:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270514+0000", 2024-09-12T22:04:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2300000000000001e-07 2024-09-12T22:04:43.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270601+0000", 2024-09-12T22:04:43.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6741000000000002e-05 2024-09-12T22:04:43.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270611+0000", 2024-09-12T22:04:43.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0740999999999999e-05 2024-09-12T22:04:43.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.270618+0000", 2024-09-12T22:04:43.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:04:43.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.272345+0000", 2024-09-12T22:04:43.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017274530000000001 2024-09-12T22:04:43.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.272497+0000", 2024-09-12T22:04:43.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015201 2024-09-12T22:04:43.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.272666+0000", 2024-09-12T22:04:43.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016884800000000001 2024-09-12T22:04:43.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.275161+0000", 2024-09-12T22:04:43.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024955580000000002 2024-09-12T22:04:43.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.296 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.296 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:139679 5.5 5:a0c3b63a:::benchmark_data_smithi043_32659_object139678:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:43.296 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:43.271749+0000", 2024-09-12T22:04:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0040446079999999999, 2024-09-12T22:04:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043708990000000001, 2024-09-12T22:04:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 139679 2024-09-12T22:04:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.271749+0000", 2024-09-12T22:04:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.271749+0000", 2024-09-12T22:04:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.271750+0000", 2024-09-12T22:04:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6099999999999999e-07 2024-09-12T22:04:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.271802+0000", 2024-09-12T22:04:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2142999999999999e-05 2024-09-12T22:04:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.271814+0000", 2024-09-12T22:04:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2255e-05 2024-09-12T22:04:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.271822+0000", 2024-09-12T22:04:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6909999999999997e-06 2024-09-12T22:04:43.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.272570+0000", 2024-09-12T22:04:43.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074795299999999999 2024-09-12T22:04:43.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.272672+0000", 2024-09-12T22:04:43.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101414 2024-09-12T22:04:43.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.272799+0000", 2024-09-12T22:04:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012714399999999999 2024-09-12T22:04:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.274786+0000", 2024-09-12T22:04:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019874559999999999 2024-09-12T22:04:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:139677 5.f e43/40 5:f4d590c8:::benchmark_data_smithi043_32659_object139676:head v 43'8785, mlcod=43'8783)", 2024-09-12T22:04:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:43.272128+0000", 2024-09-12T22:04:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0036654259999999998, 2024-09-12T22:04:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040592839999999998, 2024-09-12T22:04:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.272128+0000", 2024-09-12T22:04:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.272128+0000", 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.272129+0000", 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.272191+0000", 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1908000000000004e-05 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.272204+0000", 2024-09-12T22:04:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3512e-05 2024-09-12T22:04:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.272211+0000", 2024-09-12T22:04:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7859999999999999e-06 2024-09-12T22:04:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.273255+0000", 2024-09-12T22:04:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001044023 2024-09-12T22:04:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.273275+0000", 2024-09-12T22:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9349999999999999e-05 2024-09-12T22:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:139678 5.f e43/40 5:ffb22a49:::benchmark_data_smithi043_32659_object139677:head v 43'8786, mlcod=43'8783)", 2024-09-12T22:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:43.274402+0000", 2024-09-12T22:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001392183, 2024-09-12T22:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001839486, 2024-09-12T22:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.306 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:43.306 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.274402+0000", 2024-09-12T22:04:43.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.274402+0000", 2024-09-12T22:04:43.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.274402+0000", 2024-09-12T22:04:43.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8299999999999997e-07 2024-09-12T22:04:43.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.274454+0000", 2024-09-12T22:04:43.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1841000000000001e-05 2024-09-12T22:04:43.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.274462+0000", 2024-09-12T22:04:43.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5590000000000006e-06 2024-09-12T22:04:43.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.274469+0000", 2024-09-12T22:04:43.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2740000000000004e-06 2024-09-12T22:04:43.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.274606+0000", 2024-09-12T22:04:43.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013703000000000001 2024-09-12T22:04:43.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.274622+0000", 2024-09-12T22:04:43.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5736999999999999e-05 2024-09-12T22:04:43.309 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.309 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.309 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.309 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:139681 5.3 5:c224e2e1:::benchmark_data_smithi043_32659_object139680:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T22:04:43.309 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:43.274892+0000", 2024-09-12T22:04:43.309 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00090183799999999997, 2024-09-12T22:04:43.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0014039499999999999, 2024-09-12T22:04:43.309 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.309 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.309 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:43.309 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.309 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.310 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.310 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 139681 2024-09-12T22:04:43.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.310 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.274892+0000", 2024-09-12T22:04:43.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.274892+0000", 2024-09-12T22:04:43.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.274893+0000", 2024-09-12T22:04:43.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:04:43.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.275001+0000", 2024-09-12T22:04:43.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108355 2024-09-12T22:04:43.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.275008+0000", 2024-09-12T22:04:43.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.092e-06 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.275013+0000", 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6280000000000004e-06 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.275061+0000", 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8579999999999999e-05 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.275172+0000", 2024-09-12T22:04:43.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011069900000000001 2024-09-12T22:04:43.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:43.275268+0000", 2024-09-12T22:04:43.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6389000000000002e-05 2024-09-12T22:04:43.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.313 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.313 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:43.313 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 8 2024-09-12T22:04:43.313 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:43.314 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:43.322 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:43.321+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:43.423 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:43.422+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:43.424 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-09-12T22:04:43.508 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:43.508 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:43.509 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:43.522 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:43.523 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:43.522+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:43.624 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:43.623+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:43.679 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.042031711, 2024-09-12T22:04:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.264725586000001, 2024-09-12T22:04:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:04:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:04:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:04:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:04:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:04:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:04:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:04:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:04:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:04:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:04:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:04:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:04:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:04:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:04:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:04:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:04:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.264545655999999, 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:04:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:04:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:04:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:04:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:04:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:04:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:04:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.264479215, 2024-09-12T22:04:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:04:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:04:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:04:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:04:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:04:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:04:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.264422772, 2024-09-12T22:04:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:04:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:04:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.264354312, 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:04:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:04:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:04:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:04:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:04:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:04:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:04:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:04:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:04:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:04:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:04:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:04:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:04:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:04:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:04:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:04:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:04:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:04:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:04:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:04:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.264296577, 2024-09-12T22:04:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:04:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:04:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:04:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:04:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:04:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:04:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:04:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:04:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:04:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:04:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:04:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:04:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:04:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:04:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:04:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:04:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:04:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:04:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:04:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:04:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:04:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:04:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:04:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:04:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:04:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:04:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:04:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.264228885, 2024-09-12T22:04:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:04:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:04:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:04:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:04:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:04:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:04:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:04:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:04:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:04:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:04:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:04:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:04:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:04:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:04:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:04:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:04:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:04:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:04:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:04:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:04:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:04:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:04:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:04:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:04:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:04:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:04:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:04:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.264173823, 2024-09-12T22:04:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:04:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:04:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:04:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:04:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:04:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:04:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:04:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:04:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:04:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:04:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:04:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:04:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:04:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:04:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:04:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:04:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:04:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:04:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:04:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:04:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:04:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:04:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:04:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:04:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:04:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:04:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:04:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.2235263029999999, 2024-09-12T22:04:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:04:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:04:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:04:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:04:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:04:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:04:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:04:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:04:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:04:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:04:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:04:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:04:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:04:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:04:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:04:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:04:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:04:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:04:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:04:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:04:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:04:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:04:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.2209125749999998, 2024-09-12T22:04:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:04:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:04:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:04:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:04:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:04:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:04:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:04:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:04:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:04:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:04:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:04:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:04:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:04:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:04:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:04:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:04:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117396 5.1 5:83c565df:::benchmark_data_smithi043_32659_object117395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.2207714519999993, 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.090595995999999998, 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117396 2024-09-12T22:04:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454559+0000", 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454629+0000", 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0036000000000005e-05 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454641+0000", 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2232000000000001e-05 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454649+0000", 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454697+0000", 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8028000000000002e-05 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454702+0000", 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540467+0000", 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085764217000000004 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540596+0000", 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129787 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540774+0000", 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017746799999999999 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544679+0000", 2024-09-12T22:04:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003904996 2024-09-12T22:04:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545009+0000", 2024-09-12T22:04:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033056600000000002 2024-09-12T22:04:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545067+0000", 2024-09-12T22:04:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7871999999999997e-05 2024-09-12T22:04:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545154+0000", 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6701999999999998e-05 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117398 5.6 5:6d151138:::benchmark_data_smithi043_32659_object117397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.1994762810000008, 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044999137000000002, 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117398 2024-09-12T22:04:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475854+0000", 2024-09-12T22:04:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:04:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475914+0000", 2024-09-12T22:04:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9422999999999997e-05 2024-09-12T22:04:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475925+0000", 2024-09-12T22:04:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0881e-05 2024-09-12T22:04:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475930+0000", 2024-09-12T22:04:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:04:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475974+0000", 2024-09-12T22:04:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3810999999999998e-05 2024-09-12T22:04:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475981+0000", 2024-09-12T22:04:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1590000000000004e-06 2024-09-12T22:04:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504359+0000", 2024-09-12T22:04:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028377711 2024-09-12T22:04:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504526+0000", 2024-09-12T22:04:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167023 2024-09-12T22:04:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504661+0000", 2024-09-12T22:04:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135148 2024-09-12T22:04:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.506563+0000", 2024-09-12T22:04:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901778 2024-09-12T22:04:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520770+0000", 2024-09-12T22:04:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014206724 2024-09-12T22:04:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520803+0000", 2024-09-12T22:04:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3083000000000002e-05 2024-09-12T22:04:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520852+0000", 2024-09-12T22:04:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9543999999999999e-05 2024-09-12T22:04:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117399 5.3 5:ce33c2c7:::benchmark_data_smithi043_32659_object117398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.194707288, 2024-09-12T22:04:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038176902999999998, 2024-09-12T22:04:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117399 2024-09-12T22:04:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480624+0000", 2024-09-12T22:04:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.322e-06 2024-09-12T22:04:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480670+0000", 2024-09-12T22:04:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6365000000000001e-05 2024-09-12T22:04:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480682+0000", 2024-09-12T22:04:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:04:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480689+0000", 2024-09-12T22:04:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:04:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480731+0000", 2024-09-12T22:04:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:04:43.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:43.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480738+0000", 2024-09-12T22:04:43.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:04:43.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513753+0000", 2024-09-12T22:04:43.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.033015125999999999 2024-09-12T22:04:43.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513935+0000", 2024-09-12T22:04:43.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018219500000000001 2024-09-12T22:04:43.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.514170+0000", 2024-09-12T22:04:43.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000234694 2024-09-12T22:04:43.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518462+0000", 2024-09-12T22:04:43.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004291563 2024-09-12T22:04:43.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518655+0000", 2024-09-12T22:04:43.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019362700000000001 2024-09-12T22:04:43.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518710+0000", 2024-09-12T22:04:43.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:04:43.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518799+0000", 2024-09-12T22:04:43.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9000999999999997e-05 2024-09-12T22:04:43.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.777 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117407 5.c 5:3c61c1b7:::benchmark_data_smithi043_32659_object117406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.1615017739999995, 2024-09-12T22:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042860548999999998, 2024-09-12T22:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117407 2024-09-12T22:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513829+0000", 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513900+0000", 2024-09-12T22:04:43.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1482000000000004e-05 2024-09-12T22:04:43.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513909+0000", 2024-09-12T22:04:43.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8370000000000003e-06 2024-09-12T22:04:43.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513917+0000", 2024-09-12T22:04:43.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:04:43.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513967+0000", 2024-09-12T22:04:43.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.007e-05 2024-09-12T22:04:43.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:43.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513975+0000", 2024-09-12T22:04:43.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5639999999999999e-06 2024-09-12T22:04:43.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542411+0000", 2024-09-12T22:04:43.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028436032999999999 2024-09-12T22:04:43.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542539+0000", 2024-09-12T22:04:43.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012777900000000001 2024-09-12T22:04:43.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542687+0000", 2024-09-12T22:04:43.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148343 2024-09-12T22:04:43.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548120+0000", 2024-09-12T22:04:43.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054333580000000001 2024-09-12T22:04:43.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556549+0000", 2024-09-12T22:04:43.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084288309999999995 2024-09-12T22:04:43.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556596+0000", 2024-09-12T22:04:43.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6458999999999997e-05 2024-09-12T22:04:43.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556688+0000", 2024-09-12T22:04:43.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2676999999999994e-05 2024-09-12T22:04:43.785 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.785 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.785 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.785 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.785 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:43.785 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.6756984790000002, 2024-09-12T22:04:43.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:04:43.785 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.785 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.786 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.786 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.786 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.786 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.786 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:04:43.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.786 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:43.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:04:43.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:04:43.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:04:43.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:04:43.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:04:43.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:04:43.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:04:43.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:04:43.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:04:43.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:04:43.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:04:43.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:04:43.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:04:43.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:04:43.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:04:43.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:04:43.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:04:43.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:04:43.791 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.792 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.792 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.792 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.792 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:43.792 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.6752199909999996, 2024-09-12T22:04:43.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:04:43.792 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.792 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.792 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:04:43.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:04:43.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:04:43.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:04:43.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:04:43.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:04:43.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:04:43.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:04:43.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:04:43.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:04:43.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:04:43.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:04:43.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:04:43.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:04:43.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:04:43.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:04:43.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:04:43.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.798 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.798 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.798 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:43.798 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.672724691, 2024-09-12T22:04:43.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:04:43.798 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.798 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.798 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.799 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:04:43.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.799 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:43.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:43.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:04:43.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:04:43.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:04:43.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:04:43.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:04:43.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:04:43.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:04:43.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:04:43.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:04:43.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:04:43.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:04:43.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:04:43.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:04:43.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:04:43.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:04:43.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:04:43.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:04:43.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:04:43.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:04:43.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:04:43.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:04:43.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:04:43.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.804 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.804 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.804 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:43.804 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.6716439000000003, 2024-09-12T22:04:43.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:04:43.804 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.804 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:04:43.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:04:43.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:04:43.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:04:43.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:04:43.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:04:43.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:04:43.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:04:43.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:04:43.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:04:43.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:04:43.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:04:43.810 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.810 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.810 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.810 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:43.810 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:43.810 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.6704083379999997, 2024-09-12T22:04:43.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:04:43.811 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:43.811 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:43.811 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:43.811 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:43.811 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:43.811 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:43.811 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:04:43.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.811 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:43.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:43.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:43.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:43.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:43.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:43.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:43.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:04:43.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:43.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:43.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:04:43.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:04:43.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:43.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:04:43.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:04:43.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:43.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:04:43.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:04:43.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:43.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:04:43.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:04:43.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:43.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:04:43.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:04:43.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:43.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:04:43.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:04:43.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:04:43.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:43.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:43.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:43.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:04:43.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:04:43.816 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.816 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.816 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.816 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:43.816 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:43.816 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:43.817 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:04:43.819 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:43.819 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:43.816+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:43.919 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:43.918+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:43.930 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:43.948 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:43.949 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:43.968 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:43.968 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:43.971 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:44.092 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:44.093 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:44.094 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:44.094 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:44.094 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:44.092+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:44.196 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 50 16 142069 142053 177.551 161.812 0.00430722 0.00562971 2024-09-12T22:04:44.196 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:44.195+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:44.292 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:44.293 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:44.297 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:44.296+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:44.305 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:44.397 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:44.397+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:44.499 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:44.499 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:44.499 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:44.498+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:44.512 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:44.600 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:44.599+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:44.669 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:44.669 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:44.682 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:44.700 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:44.699+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:44.801 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:44.800+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:44.878 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:44.879 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:44.892 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:44.937 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:44.936+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:45.003 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:45.002+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:45.042 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:45.043 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:45.055 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:45.104 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:45.102+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:45.193 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 51 16 144615 144599 177.19 159.125 0.00683529 0.00564115 2024-09-12T22:04:45.206 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:45.205+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:45.222 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:45.222 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:45.237 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:45.305 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:45.304+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:45.406 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:45.405+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:45.438 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:04:45.440 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:45.440 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:45.453 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:45.507 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:45.505+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:45.607 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:45.606+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:45.651 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:45.651 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:45.665 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:45.710 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:45.709+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:45.810 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:45.808+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:45.815 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:45.816 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:45.829 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:45.913 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:45.912+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:46.011 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:46.010+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:46.018 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:46.018 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:46.031 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:46.093 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:04:46.112 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:46.111+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:46.193 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 52 16 147199 147183 176.888 161.5 0.0074533 0.00565078 2024-09-12T22:04:46.204 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:46.213 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:46.212+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:46.224 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:46.224 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:46.227 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:46.227 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:46.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:46.228 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:46.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.228 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:46.228 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:46.228 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.591045565999998, 2024-09-12T22:04:46.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:46.228 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.228 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.228 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.228 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:46.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.229 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:46.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:46.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:46.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:46.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:46.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:46.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:46.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:46.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:46.233 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.813739440999999, 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:46.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:04:46.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:04:46.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:04:46.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:04:46.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.237 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.813559510999999, 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:04:46.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:04:46.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:04:46.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:04:46.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:04:46.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:04:46.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:04:46.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:46.242 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.81349307, 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:04:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.246 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.247 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:46.247 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:46.247 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.813436627, 2024-09-12T22:04:46.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:04:46.247 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.247 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.247 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.247 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:04:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.253 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:46.253 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:46.253 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.813368167, 2024-09-12T22:04:46.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:04:46.253 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.253 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.253 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.253 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:04:46.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.253 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:46.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:46.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:04:46.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:04:46.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:04:46.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:04:46.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:04:46.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:04:46.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:04:46.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:04:46.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:04:46.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:04:46.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:46.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:04:46.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:04:46.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:04:46.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:04:46.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:04:46.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:04:46.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:04:46.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:04:46.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:04:46.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:04:46.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:04:46.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:04:46.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:04:46.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.813310432, 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:04:46.259 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:04:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:04:46.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:04:46.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:04:46.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:04:46.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:04:46.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:04:46.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:04:46.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:04:46.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:04:46.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:04:46.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:04:46.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:04:46.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.265 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:46.266 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:46.266 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.81324274, 2024-09-12T22:04:46.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:04:46.266 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.266 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.266 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.266 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:04:46.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.266 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:04:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:04:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:04:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:04:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:04:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:04:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:04:46.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:04:46.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:46.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:04:46.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:04:46.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:04:46.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:04:46.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:04:46.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:04:46.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:04:46.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:04:46.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:04:46.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:04:46.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:04:46.272 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.272 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.272 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.272 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:46.272 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:46.272 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.813187678, 2024-09-12T22:04:46.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:04:46.272 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.272 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.272 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.272 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.272 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:04:46.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:04:46.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:04:46.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:04:46.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:04:46.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:04:46.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:04:46.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.772540158, 2024-09-12T22:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:04:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:04:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:04:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:04:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:04:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:04:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:04:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:04:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:04:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:04:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:04:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:04:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:04:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:04:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:04:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:04:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:04:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.76992643, 2024-09-12T22:04:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:04:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:04:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:04:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:04:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:04:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:04:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:04:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:04:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:04:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:04:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117396 5.1 5:83c565df:::benchmark_data_smithi043_32659_object117395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.769785306999999, 2024-09-12T22:04:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.090595995999999998, 2024-09-12T22:04:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117396 2024-09-12T22:04:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454559+0000", 2024-09-12T22:04:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:04:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454629+0000", 2024-09-12T22:04:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0036000000000005e-05 2024-09-12T22:04:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454641+0000", 2024-09-12T22:04:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2232000000000001e-05 2024-09-12T22:04:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454649+0000", 2024-09-12T22:04:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-12T22:04:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454697+0000", 2024-09-12T22:04:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8028000000000002e-05 2024-09-12T22:04:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454702+0000", 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540467+0000", 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085764217000000004 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540596+0000", 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129787 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540774+0000", 2024-09-12T22:04:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017746799999999999 2024-09-12T22:04:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544679+0000", 2024-09-12T22:04:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003904996 2024-09-12T22:04:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545009+0000", 2024-09-12T22:04:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033056600000000002 2024-09-12T22:04:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545067+0000", 2024-09-12T22:04:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7871999999999997e-05 2024-09-12T22:04:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545154+0000", 2024-09-12T22:04:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6701999999999998e-05 2024-09-12T22:04:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117398 5.6 5:6d151138:::benchmark_data_smithi043_32659_object117397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.748490136000001, 2024-09-12T22:04:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044999137000000002, 2024-09-12T22:04:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117398 2024-09-12T22:04:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475854+0000", 2024-09-12T22:04:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:04:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475914+0000", 2024-09-12T22:04:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9422999999999997e-05 2024-09-12T22:04:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475925+0000", 2024-09-12T22:04:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0881e-05 2024-09-12T22:04:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475930+0000", 2024-09-12T22:04:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:04:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475974+0000", 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3810999999999998e-05 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475981+0000", 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1590000000000004e-06 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504359+0000", 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028377711 2024-09-12T22:04:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504526+0000", 2024-09-12T22:04:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167023 2024-09-12T22:04:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504661+0000", 2024-09-12T22:04:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135148 2024-09-12T22:04:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.506563+0000", 2024-09-12T22:04:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901778 2024-09-12T22:04:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520770+0000", 2024-09-12T22:04:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014206724 2024-09-12T22:04:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520803+0000", 2024-09-12T22:04:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3083000000000002e-05 2024-09-12T22:04:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520852+0000", 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9543999999999999e-05 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117399 5.3 5:ce33c2c7:::benchmark_data_smithi043_32659_object117398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.743721143, 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038176902999999998, 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117399 2024-09-12T22:04:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480624+0000", 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.322e-06 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480670+0000", 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6365000000000001e-05 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480682+0000", 2024-09-12T22:04:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480689+0000", 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480731+0000", 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480738+0000", 2024-09-12T22:04:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:04:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513753+0000", 2024-09-12T22:04:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.033015125999999999 2024-09-12T22:04:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513935+0000", 2024-09-12T22:04:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018219500000000001 2024-09-12T22:04:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.514170+0000", 2024-09-12T22:04:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000234694 2024-09-12T22:04:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518462+0000", 2024-09-12T22:04:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004291563 2024-09-12T22:04:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518655+0000", 2024-09-12T22:04:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019362700000000001 2024-09-12T22:04:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518710+0000", 2024-09-12T22:04:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:04:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518799+0000", 2024-09-12T22:04:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9000999999999997e-05 2024-09-12T22:04:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117407 5.c 5:3c61c1b7:::benchmark_data_smithi043_32659_object117406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.710515629, 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042860548999999998, 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117407 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513829+0000", 2024-09-12T22:04:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-12T22:04:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513900+0000", 2024-09-12T22:04:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1482000000000004e-05 2024-09-12T22:04:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513909+0000", 2024-09-12T22:04:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8370000000000003e-06 2024-09-12T22:04:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513917+0000", 2024-09-12T22:04:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:04:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513967+0000", 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.007e-05 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513975+0000", 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5639999999999999e-06 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542411+0000", 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028436032999999999 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542539+0000", 2024-09-12T22:04:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012777900000000001 2024-09-12T22:04:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542687+0000", 2024-09-12T22:04:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148343 2024-09-12T22:04:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548120+0000", 2024-09-12T22:04:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054333580000000001 2024-09-12T22:04:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556549+0000", 2024-09-12T22:04:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084288309999999995 2024-09-12T22:04:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556596+0000", 2024-09-12T22:04:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6458999999999997e-05 2024-09-12T22:04:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556688+0000", 2024-09-12T22:04:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2676999999999994e-05 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.2247123340000003, 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:04:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:04:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:04:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:04:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:04:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:04:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:04:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:04:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:04:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:04:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:04:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:04:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:04:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:04:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:04:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:04:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:04:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:04:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:04:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:04:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:04:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:04:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:04:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.2242338459999997, 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:04:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:04:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:04:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:04:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:04:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:04:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:04:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:04:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:04:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:04:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:04:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:04:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:04:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:04:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:04:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.2217385460000001, 2024-09-12T22:04:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:04:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:04:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:04:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:04:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:04:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:04:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:04:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:04:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:04:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:04:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:04:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:04:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:04:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:04:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:04:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:04:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:04:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:04:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.2206577550000004, 2024-09-12T22:04:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:04:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:04:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:04:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:04:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:04:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:04:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:04:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:04:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:04:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:04:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:04:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:04:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:04:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:04:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:04:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:04:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:04:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:04:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:04:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:04:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:04:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.2194221929999998, 2024-09-12T22:04:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:04:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:04:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:04:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:04:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:04:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:04:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:04:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:04:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:04:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:46.346 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:46.346 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:46.347 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:46.348 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:46.348 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:46.345+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:46.348 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:46.349 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:46.431 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-09-12T22:04:46.448 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:46.446+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:46.506 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:46.506 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:46.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.506 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:147999 5.f 5:fe6b2283:::benchmark_data_smithi043_32659_object147998:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:46.506 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:46.503775+0000", 2024-09-12T22:04:46.506 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00054882300000000004, 2024-09-12T22:04:46.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00056793800000000004, 2024-09-12T22:04:46.507 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.507 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.507 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:46.507 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.507 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.507 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.507 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 147999 2024-09-12T22:04:46.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.507 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503775+0000", 2024-09-12T22:04:46.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503775+0000", 2024-09-12T22:04:46.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503776+0000", 2024-09-12T22:04:46.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6400000000000002e-07 2024-09-12T22:04:46.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.509 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503809+0000", 2024-09-12T22:04:46.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3172e-05 2024-09-12T22:04:46.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.509 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503816+0000", 2024-09-12T22:04:46.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.306e-06 2024-09-12T22:04:46.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.510 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503827+0000", 2024-09-12T22:04:46.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1158000000000001e-05 2024-09-12T22:04:46.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.510 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503879+0000", 2024-09-12T22:04:46.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1925000000000002e-05 2024-09-12T22:04:46.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.504022+0000", 2024-09-12T22:04:46.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014308300000000001 2024-09-12T22:04:46.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:46.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.504265+0000", 2024-09-12T22:04:46.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00024274799999999999 2024-09-12T22:04:46.511 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.511 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.511 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.512 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:148000 5.d 5:be45a788:::benchmark_data_smithi043_32659_object147999:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:46.512 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:46.504057+0000", 2024-09-12T22:04:46.512 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000267001, 2024-09-12T22:04:46.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033287099999999999, 2024-09-12T22:04:46.512 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.512 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.512 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:46.512 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.512 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.512 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.513 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 148000 2024-09-12T22:04:46.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.513 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.504057+0000", 2024-09-12T22:04:46.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.504057+0000", 2024-09-12T22:04:46.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.504058+0000", 2024-09-12T22:04:46.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5000000000000001e-07 2024-09-12T22:04:46.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.504123+0000", 2024-09-12T22:04:46.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4956000000000006e-05 2024-09-12T22:04:46.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.504131+0000", 2024-09-12T22:04:46.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2930000000000001e-06 2024-09-12T22:04:46.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.504137+0000", 2024-09-12T22:04:46.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9649999999999996e-06 2024-09-12T22:04:46.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.516 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.504185+0000", 2024-09-12T22:04:46.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7892000000000002e-05 2024-09-12T22:04:46.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.516 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.516 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.504294+0000", 2024-09-12T22:04:46.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010948 2024-09-12T22:04:46.516 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.516 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.516 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.517 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:147979 5.b 5:df05bde5:::benchmark_data_smithi043_32659_object147978:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:46.517 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:46.494165+0000", 2024-09-12T22:04:46.517 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.010158594, 2024-09-12T22:04:46.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010261655, 2024-09-12T22:04:46.517 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.517 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.517 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:46.517 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.517 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.517 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.518 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 147979 2024-09-12T22:04:46.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.518 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.494165+0000", 2024-09-12T22:04:46.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.494165+0000", 2024-09-12T22:04:46.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.494166+0000", 2024-09-12T22:04:46.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5600000000000004e-07 2024-09-12T22:04:46.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.494228+0000", 2024-09-12T22:04:46.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1427999999999995e-05 2024-09-12T22:04:46.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.494237+0000", 2024-09-12T22:04:46.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8090000000000004e-06 2024-09-12T22:04:46.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.494245+0000", 2024-09-12T22:04:46.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5650000000000004e-06 2024-09-12T22:04:46.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.496056+0000", 2024-09-12T22:04:46.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018108449999999999 2024-09-12T22:04:46.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.496129+0000", 2024-09-12T22:04:46.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3208999999999997e-05 2024-09-12T22:04:46.521 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.521 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.521 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.522 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:147980 5.3 e45/40 5:c9d35abd:::benchmark_data_smithi043_32659_object147979:head v 45'9229, mlcod=45'9225)", 2024-09-12T22:04:46.522 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:46.495627+0000", 2024-09-12T22:04:46.522 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0086965189999999998, 2024-09-12T22:04:46.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0088339019999999994, 2024-09-12T22:04:46.522 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.522 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.522 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:46.522 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.495627+0000", 2024-09-12T22:04:46.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.495627+0000", 2024-09-12T22:04:46.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.495628+0000", 2024-09-12T22:04:46.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6300000000000004e-07 2024-09-12T22:04:46.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.495632+0000", 2024-09-12T22:04:46.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3780000000000003e-06 2024-09-12T22:04:46.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.495642+0000", 2024-09-12T22:04:46.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5670000000000001e-06 2024-09-12T22:04:46.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.495648+0000", 2024-09-12T22:04:46.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2600000000000002e-06 2024-09-12T22:04:46.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.499542+0000", 2024-09-12T22:04:46.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003893199 2024-09-12T22:04:46.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.499560+0000", 2024-09-12T22:04:46.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8737999999999999e-05 2024-09-12T22:04:46.526 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.526 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.526 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.526 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:147983 5.3 e45/40 5:ccc3fd47:::benchmark_data_smithi043_32659_object147982:head v 45'9230, mlcod=45'9225)", 2024-09-12T22:04:46.526 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:46.497529+0000", 2024-09-12T22:04:46.526 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0067952899999999998, 2024-09-12T22:04:46.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0069647019999999997, 2024-09-12T22:04:46.526 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.526 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.527 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:46.527 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.497529+0000", 2024-09-12T22:04:46.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.497529+0000", 2024-09-12T22:04:46.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.497529+0000", 2024-09-12T22:04:46.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:04:46.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.497534+0000", 2024-09-12T22:04:46.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.578e-06 2024-09-12T22:04:46.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.497543+0000", 2024-09-12T22:04:46.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6169999999999996e-06 2024-09-12T22:04:46.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.497550+0000", 2024-09-12T22:04:46.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2999999999999998e-06 2024-09-12T22:04:46.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.501333+0000", 2024-09-12T22:04:46.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037833350000000001 2024-09-12T22:04:46.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.501352+0000", 2024-09-12T22:04:46.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9555000000000002e-05 2024-09-12T22:04:46.531 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.531 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.531 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.531 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:147986 5.b 5:d4239c8f:::benchmark_data_smithi043_32659_object147985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:46.531 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:46.497593+0000", 2024-09-12T22:04:46.531 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0067313260000000001, 2024-09-12T22:04:46.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0069323170000000003, 2024-09-12T22:04:46.531 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.531 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.531 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:46.532 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.532 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.532 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.532 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 147986 2024-09-12T22:04:46.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.532 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.497593+0000", 2024-09-12T22:04:46.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.497593+0000", 2024-09-12T22:04:46.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.497593+0000", 2024-09-12T22:04:46.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2900000000000003e-07 2024-09-12T22:04:46.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.497642+0000", 2024-09-12T22:04:46.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8701e-05 2024-09-12T22:04:46.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.497650+0000", 2024-09-12T22:04:46.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9580000000000007e-06 2024-09-12T22:04:46.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.497654+0000", 2024-09-12T22:04:46.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.403e-06 2024-09-12T22:04:46.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.504043+0000", 2024-09-12T22:04:46.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0063890700000000002 2024-09-12T22:04:46.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.504170+0000", 2024-09-12T22:04:46.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000126656 2024-09-12T22:04:46.536 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.536 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.536 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.536 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:147989 5.4 5:2ab28ce8:::benchmark_data_smithi043_32659_object147988:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:46.536 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:46.499750+0000", 2024-09-12T22:04:46.537 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0045742919999999998, 2024-09-12T22:04:46.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0048134079999999999, 2024-09-12T22:04:46.537 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.537 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.537 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:46.537 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.537 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.537 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.537 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 147989 2024-09-12T22:04:46.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.537 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.499750+0000", 2024-09-12T22:04:46.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.499750+0000", 2024-09-12T22:04:46.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.539 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.499750+0000", 2024-09-12T22:04:46.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9899999999999999e-07 2024-09-12T22:04:46.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.539 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.499846+0000", 2024-09-12T22:04:46.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5223999999999995e-05 2024-09-12T22:04:46.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.499856+0000", 2024-09-12T22:04:46.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0390999999999999e-05 2024-09-12T22:04:46.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.499861+0000", 2024-09-12T22:04:46.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3800000000000002e-06 2024-09-12T22:04:46.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.499915+0000", 2024-09-12T22:04:46.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3633e-05 2024-09-12T22:04:46.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.499999+0000", 2024-09-12T22:04:46.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3566000000000006e-05 2024-09-12T22:04:46.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:46.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.504570+0000", 2024-09-12T22:04:46.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045718859999999998 2024-09-12T22:04:46.542 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.542 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.542 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.542 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:147991 5.4 5:2991d9a1:::benchmark_data_smithi043_32659_object147990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:46.542 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:46.500674+0000", 2024-09-12T22:04:46.542 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0036502689999999998, 2024-09-12T22:04:46.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0039617050000000003, 2024-09-12T22:04:46.543 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.543 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.543 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:46.543 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.543 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.543 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.543 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 147991 2024-09-12T22:04:46.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.543 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.500674+0000", 2024-09-12T22:04:46.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.500674+0000", 2024-09-12T22:04:46.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.500674+0000", 2024-09-12T22:04:46.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:04:46.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.500783+0000", 2024-09-12T22:04:46.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000108955 2024-09-12T22:04:46.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.500792+0000", 2024-09-12T22:04:46.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4009999999999997e-06 2024-09-12T22:04:46.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.546 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.546 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.500798+0000", 2024-09-12T22:04:46.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4919999999999998e-06 2024-09-12T22:04:46.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.546 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.546 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.501419+0000", 2024-09-12T22:04:46.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00062065500000000001 2024-09-12T22:04:46.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.501571+0000", 2024-09-12T22:04:46.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015181600000000001 2024-09-12T22:04:46.547 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.547 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.547 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.547 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:147992 5.4 5:2c05cc93:::benchmark_data_smithi043_32659_object147991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:46.547 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:46.500815+0000", 2024-09-12T22:04:46.547 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0035087819999999998, 2024-09-12T22:04:46.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038876689999999998, 2024-09-12T22:04:46.548 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.548 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.548 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:46.548 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.548 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.548 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.548 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 147992 2024-09-12T22:04:46.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.548 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.500815+0000", 2024-09-12T22:04:46.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.500815+0000", 2024-09-12T22:04:46.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.500816+0000", 2024-09-12T22:04:46.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5700000000000002e-07 2024-09-12T22:04:46.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.500860+0000", 2024-09-12T22:04:46.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3906000000000003e-05 2024-09-12T22:04:46.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.500868+0000", 2024-09-12T22:04:46.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:04:46.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.551 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.500874+0000", 2024-09-12T22:04:46.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5350000000000001e-06 2024-09-12T22:04:46.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.551 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503029+0000", 2024-09-12T22:04:46.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002154212 2024-09-12T22:04:46.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503160+0000", 2024-09-12T22:04:46.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013139599999999999 2024-09-12T22:04:46.552 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.552 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.552 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.552 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:147995 5.3 e45/40 5:c7dc67e2:::benchmark_data_smithi043_32659_object147994:head v 45'9231, mlcod=45'9225)", 2024-09-12T22:04:46.552 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:46.501246+0000", 2024-09-12T22:04:46.552 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0030774629999999999, 2024-09-12T22:04:46.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035192959999999999, 2024-09-12T22:04:46.553 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.553 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.553 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:46.553 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.501246+0000", 2024-09-12T22:04:46.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.501246+0000", 2024-09-12T22:04:46.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.501247+0000", 2024-09-12T22:04:46.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1800000000000001e-07 2024-09-12T22:04:46.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.501251+0000", 2024-09-12T22:04:46.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9330000000000003e-06 2024-09-12T22:04:46.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.501259+0000", 2024-09-12T22:04:46.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2490000000000001e-06 2024-09-12T22:04:46.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.501265+0000", 2024-09-12T22:04:46.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8250000000000001e-06 2024-09-12T22:04:46.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.556 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.502752+0000", 2024-09-12T22:04:46.556 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014867089999999999 2024-09-12T22:04:46.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.556 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.502771+0000", 2024-09-12T22:04:46.556 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9242999999999999e-05 2024-09-12T22:04:46.556 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.556 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.556 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.557 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:147974 5.b 5:d4503e96:::benchmark_data_smithi043_32659_object147973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:46.557 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:46.492977+0000", 2024-09-12T22:04:46.557 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.011346767000000001, 2024-09-12T22:04:46.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011870119, 2024-09-12T22:04:46.557 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.557 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.557 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:46.557 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.557 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.557 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.558 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 147974 2024-09-12T22:04:46.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.558 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.492977+0000", 2024-09-12T22:04:46.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.492977+0000", 2024-09-12T22:04:46.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.559 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.492978+0000", 2024-09-12T22:04:46.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1230000000000001e-06 2024-09-12T22:04:46.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.559 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.493115+0000", 2024-09-12T22:04:46.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013652099999999999 2024-09-12T22:04:46.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.560 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.560 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.493124+0000", 2024-09-12T22:04:46.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9420000000000001e-06 2024-09-12T22:04:46.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.560 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.560 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.493131+0000", 2024-09-12T22:04:46.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0210000000000002e-06 2024-09-12T22:04:46.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.493194+0000", 2024-09-12T22:04:46.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3260000000000001e-05 2024-09-12T22:04:46.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.493312+0000", 2024-09-12T22:04:46.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118114 2024-09-12T22:04:46.561 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.561 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.561 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.562 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:147997 5.0 5:0565e493:::benchmark_data_smithi043_32659_object147996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:46.562 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:46.503025+0000", 2024-09-12T22:04:46.562 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0012990009999999999, 2024-09-12T22:04:46.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018924790000000001, 2024-09-12T22:04:46.562 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.562 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.562 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:46.562 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.562 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.562 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.563 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 147997 2024-09-12T22:04:46.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.563 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.563 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.563 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503025+0000", 2024-09-12T22:04:46.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.563 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.563 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503025+0000", 2024-09-12T22:04:46.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503026+0000", 2024-09-12T22:04:46.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.223e-06 2024-09-12T22:04:46.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503086+0000", 2024-09-12T22:04:46.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0158000000000002e-05 2024-09-12T22:04:46.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503094+0000", 2024-09-12T22:04:46.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0930000000000003e-06 2024-09-12T22:04:46.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503099+0000", 2024-09-12T22:04:46.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8629999999999999e-06 2024-09-12T22:04:46.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503151+0000", 2024-09-12T22:04:46.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2148999999999998e-05 2024-09-12T22:04:46.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503272+0000", 2024-09-12T22:04:46.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000120171 2024-09-12T22:04:46.566 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.566 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.567 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.567 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:147998 5.a 5:586f78ba:::benchmark_data_smithi043_32659_object147997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:46.567 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:46.503688+0000", 2024-09-12T22:04:46.567 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000636099, 2024-09-12T22:04:46.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0013021420000000001, 2024-09-12T22:04:46.567 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.567 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.567 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:46.567 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.567 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.568 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.568 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 147998 2024-09-12T22:04:46.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.568 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503688+0000", 2024-09-12T22:04:46.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503688+0000", 2024-09-12T22:04:46.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503689+0000", 2024-09-12T22:04:46.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:04:46.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503741+0000", 2024-09-12T22:04:46.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2377999999999999e-05 2024-09-12T22:04:46.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.570 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.570 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503753+0000", 2024-09-12T22:04:46.570 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1959e-05 2024-09-12T22:04:46.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.570 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.570 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503759+0000", 2024-09-12T22:04:46.570 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4400000000000002e-06 2024-09-12T22:04:46.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503807+0000", 2024-09-12T22:04:46.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7409e-05 2024-09-12T22:04:46.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:46.503923+0000", 2024-09-12T22:04:46.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011578099999999999 2024-09-12T22:04:46.571 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.571 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.571 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.572 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.572 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:46.572 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 13 2024-09-12T22:04:46.572 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:46.573 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:46.572+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:46.574 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:46.675 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:46.673+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:46.732 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:46.733 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:46.733 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:46.733 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:46.733 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:46.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:46.775 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:46.774+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:46.877 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:46.876+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:46.941 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:46.942 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:46.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:46.942 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:46.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.942 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:46.942 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:46.942 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.312825498999999, 2024-09-12T22:04:46.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:46.942 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.942 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.942 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.942 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.943 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.943 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.943 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:46.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.943 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:46.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:46.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:46.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:46.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:46.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:46.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:46.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:46.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:46.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:46.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:46.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:46.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.947 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:46.947 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:46.947 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:46.947 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.947 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.947 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:46.947 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:46.947 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.947 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:46.947 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:46.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:46.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.948 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:46.948 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:46.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:46.948 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.948 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.948 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.948 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:46.949 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:46.949 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.307424558999998, 2024-09-12T22:04:46.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:46.949 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.949 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.949 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.949 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.949 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.949 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.949 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:46.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.949 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:46.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:46.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:46.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:46.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:46.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:46.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:46.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:46.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:46.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:46.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:46.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:46.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:46.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:46.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:46.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:46.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:46.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:46.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:46.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:46.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.306483292000003, 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:46.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:46.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:46.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:46.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:46.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:46.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:46.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:46.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:46.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:46.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:46.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:46.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:46.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:46.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:46.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:46.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:46.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:46.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:46.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:46.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:46.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.305485372, 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:46.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:46.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:46.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:46.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:46.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:46.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:46.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:46.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.9417366730000003, 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.966 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:04:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:46.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:46.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:04:46.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:04:46.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:04:46.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:04:46.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:04:46.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:04:46.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:04:46.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:04:46.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:04:46.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:04:46.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:04:46.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:46.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:04:46.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:04:46.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:46.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:04:46.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:04:46.972 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.972 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.972 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.972 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:46.972 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:46.972 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.9411034679999997, 2024-09-12T22:04:46.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:04:46.972 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.972 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.973 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.973 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.973 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.973 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.973 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:04:46.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.973 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:46.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:46.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:04:46.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:04:46.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:04:46.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:04:46.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:04:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:04:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:04:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:04:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:04:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:04:46.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:04:46.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:04:46.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:46.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:04:46.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:04:46.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:46.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:04:46.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:04:46.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:46.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:04:46.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:04:46.977 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.977 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.977 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.977 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:46.977 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:46.977 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.9392838049999996, 2024-09-12T22:04:46.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:04:46.978 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.978 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.978 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.978 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.978 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.978 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.978 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:04:46.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.978 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:46.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:46.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:04:46.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:04:46.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:04:46.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:04:46.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:04:46.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:04:46.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:04:46.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:04:46.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:04:46.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:04:46.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:04:46.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:04:46.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:46.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:04:46.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:04:46.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:46.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:04:46.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:04:46.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:46.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:04:46.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:04:46.982 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.982 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.982 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.983 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:46.983 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:46.983 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.9391161779999999, 2024-09-12T22:04:46.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:04:46.983 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.983 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.983 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.983 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.983 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.983 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.983 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:04:46.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.984 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:46.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:46.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.988 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:04:46.988 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:46.988 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.938975514, 2024-09-12T22:04:46.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:04:46.988 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.988 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.988 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.988 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:46.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:46.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:04:46.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:04:46.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:46.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:04:46.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:04:46.992 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.992 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.992 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.992 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:46.992 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:46.992 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.9387499909999999, 2024-09-12T22:04:46.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:04:46.992 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.992 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.992 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.993 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.993 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.993 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.993 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:04:46.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.993 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:46.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:46.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:04:46.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:04:46.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:46.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:04:46.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:04:46.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:46.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:04:46.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:04:46.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:46.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:04:46.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:04:46.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:46.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:04:46.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:04:46.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:46.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:04:46.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:04:46.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:46.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:04:46.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:04:46.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:46.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:04:46.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:04:46.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:46.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:04:46.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:04:46.997 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.997 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:46.997 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:46.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.997 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:46.998 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:46.998 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.9386302869999996, 2024-09-12T22:04:46.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:04:46.998 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:46.998 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:46.998 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:46.998 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:46.998 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:46.998 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:46.998 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:04:46.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.998 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:46.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:46.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:46.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:46.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:46.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:46.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:46.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:46.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:46.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:04:46.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:04:47.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:04:47.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:04:47.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:04:47.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:04:47.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:04:47.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:04:47.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:04:47.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:04:47.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:04:47.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:04:47.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:47.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:04:47.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:04:47.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:04:47.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:04:47.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:47.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:04:47.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:04:47.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:47.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:04:47.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:04:47.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:47.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:04:47.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:04:47.003 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.003 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.003 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.004 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:04:47.004 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:47.004 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.9380390050000003, 2024-09-12T22:04:47.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:04:47.004 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.004 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.004 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:47.004 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:47.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:47.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:04:47.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:04:47.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:04:47.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:04:47.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:04:47.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:04:47.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:04:47.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:04:47.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:04:47.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:04:47.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:04:47.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:04:47.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:47.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:04:47.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:04:47.007 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.008 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.008 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.008 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:04:47.008 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:47.008 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.9378154370000003, 2024-09-12T22:04:47.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:04:47.008 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.008 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.008 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.008 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:47.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:47.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:47.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:04:47.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:04:47.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:04:47.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:04:47.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:04:47.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:04:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:47.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:04:47.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:04:47.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:47.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:04:47.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:04:47.012 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.012 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.012 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.013 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:47.013 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:47.013 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.9377239560000001, 2024-09-12T22:04:47.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:04:47.013 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.013 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.013 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.013 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:47.013 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:47.013 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.013 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:04:47.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.014 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:47.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:47.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:04:47.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:04:47.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:04:47.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:04:47.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:04:47.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:04:47.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:04:47.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:04:47.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:04:47.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:04:47.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:04:47.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:04:47.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:04:47.018 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.018 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.018 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.018 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:47.018 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:47.018 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.9369351520000002, 2024-09-12T22:04:47.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:04:47.018 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.018 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.018 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.018 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:47.018 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.022 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.9366710119999997, 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.023 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:47.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:47.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:04:47.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:04:47.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:04:47.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:04:47.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:04:47.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:04:47.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:04:47.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:04:47.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:04:47.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:04:47.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:47.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:04:47.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:04:47.028 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.028 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.028 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.028 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:04:47.028 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:47.028 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.9361660369999996, 2024-09-12T22:04:47.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:04:47.028 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.029 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.029 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.029 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:47.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:47.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:04:47.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:04:47.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:04:47.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:04:47.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:04:47.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:04:47.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:04:47.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:04:47.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:04:47.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:04:47.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:04:47.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:04:47.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:47.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:04:47.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:04:47.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:47.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:04:47.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:04:47.033 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.033 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.033 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.033 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:04:47.033 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:47.033 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.935036609, 2024-09-12T22:04:47.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:04:47.033 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.033 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.033 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:47.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:04:47.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:04:47.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:04:47.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:04:47.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:04:47.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:04:47.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:04:47.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:04:47.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:04:47.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:04:47.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:04:47.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:47.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:04:47.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:04:47.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:47.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:04:47.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:04:47.037 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.037 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.037 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.038 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:47.038 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:47.038 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.9342821670000001, 2024-09-12T22:04:47.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:04:47.038 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.038 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.038 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.038 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:47.038 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:47.038 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.038 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:04:47.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.038 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:47.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:04:47.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:04:47.043 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.043 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.043 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.043 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:04:47.043 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:47.043 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.9336030649999998, 2024-09-12T22:04:47.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:04:47.043 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.044 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.044 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.044 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:47.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:47.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:04:47.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:04:47.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:04:47.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:04:47.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:04:47.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:04:47.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:04:47.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:04:47.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:04:47.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:04:47.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.047 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.048 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.048 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.048 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.048 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:47.049 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:47.047+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:47.050 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:47.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~23s 2024-09-12T22:04:47.149 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:47.148+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:47.193 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 53 15 149733 149718 176.54 158.438 0.00493939 0.00566206 2024-09-12T22:04:47.200 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:149739 5.9 e45/40)", 2024-09-12T22:04:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:47.198295+0000", 2024-09-12T22:04:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000822618, 2024-09-12T22:04:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00083694499999999996, 2024-09-12T22:04:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198295+0000", 2024-09-12T22:04:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198295+0000", 2024-09-12T22:04:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198295+0000", 2024-09-12T22:04:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0100000000000001e-07 2024-09-12T22:04:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198328+0000", 2024-09-12T22:04:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3216999999999997e-05 2024-09-12T22:04:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198335+0000", 2024-09-12T22:04:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.861e-06 2024-09-12T22:04:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198340+0000", 2024-09-12T22:04:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:04:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:149752 5.c 5:30f41d6d:::benchmark_data_smithi043_32659_object149751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:47.198695+0000", 2024-09-12T22:04:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00042223299999999999, 2024-09-12T22:04:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000478333, 2024-09-12T22:04:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 149752 2024-09-12T22:04:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198695+0000", 2024-09-12T22:04:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198695+0000", 2024-09-12T22:04:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198696+0000", 2024-09-12T22:04:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8100000000000003e-07 2024-09-12T22:04:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198762+0000", 2024-09-12T22:04:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5775e-05 2024-09-12T22:04:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198770+0000", 2024-09-12T22:04:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9390000000000003e-06 2024-09-12T22:04:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198775+0000", 2024-09-12T22:04:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3540000000000002e-06 2024-09-12T22:04:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198824+0000", 2024-09-12T22:04:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9252000000000002e-05 2024-09-12T22:04:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198956+0000", 2024-09-12T22:04:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013215500000000001 2024-09-12T22:04:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.199106+0000", 2024-09-12T22:04:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000149331 2024-09-12T22:04:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:149737 5.5 5:a41d7e1d:::benchmark_data_smithi043_32659_object149736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:47.195516+0000", 2024-09-12T22:04:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0036018220000000002, 2024-09-12T22:04:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037030700000000001, 2024-09-12T22:04:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 149737 2024-09-12T22:04:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.195516+0000", 2024-09-12T22:04:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.195516+0000", 2024-09-12T22:04:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.195517+0000", 2024-09-12T22:04:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3349999999999999e-06 2024-09-12T22:04:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.195574+0000", 2024-09-12T22:04:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7045e-05 2024-09-12T22:04:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.195588+0000", 2024-09-12T22:04:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3575e-05 2024-09-12T22:04:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.195597+0000", 2024-09-12T22:04:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0759999999999992e-06 2024-09-12T22:04:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.196267+0000", 2024-09-12T22:04:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000670515 2024-09-12T22:04:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.196362+0000", 2024-09-12T22:04:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4398e-05 2024-09-12T22:04:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.196483+0000", 2024-09-12T22:04:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012108999999999999 2024-09-12T22:04:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197987+0000", 2024-09-12T22:04:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015040139999999999 2024-09-12T22:04:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:149743 5.6 5:6b80410c:::benchmark_data_smithi043_32659_object149742:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:47.197771+0000", 2024-09-12T22:04:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001346171, 2024-09-12T22:04:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0014890249999999999, 2024-09-12T22:04:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 149743 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197771+0000", 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197771+0000", 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197772+0000", 2024-09-12T22:04:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:04:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197883+0000", 2024-09-12T22:04:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111263 2024-09-12T22:04:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197893+0000", 2024-09-12T22:04:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7459999999999995e-06 2024-09-12T22:04:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197904+0000", 2024-09-12T22:04:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0919e-05 2024-09-12T22:04:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197953+0000", 2024-09-12T22:04:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8721000000000003e-05 2024-09-12T22:04:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198063+0000", 2024-09-12T22:04:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110266 2024-09-12T22:04:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198151+0000", 2024-09-12T22:04:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8293000000000003e-05 2024-09-12T22:04:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "MOSDPGPushReply(5.6 45/40 [PushReplyOp(5:643ab01f:::benchmark_data_smithi043_32659_object108424:head)])", 2024-09-12T22:04:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:47.197886+0000", 2024-09-12T22:04:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00123185, 2024-09-12T22:04:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0014117559999999999, 2024-09-12T22:04:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197886+0000", 2024-09-12T22:04:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197886+0000", 2024-09-12T22:04:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197886+0000", 2024-09-12T22:04:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.72e-07 2024-09-12T22:04:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197893+0000", 2024-09-12T22:04:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0650000000000001e-06 2024-09-12T22:04:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197900+0000", 2024-09-12T22:04:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9809999999999997e-06 2024-09-12T22:04:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197906+0000", 2024-09-12T22:04:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7790000000000001e-06 2024-09-12T22:04:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:149744 5.1 5:83d8aa5a:::benchmark_data_smithi043_32659_object149743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:47.197928+0000", 2024-09-12T22:04:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0011890449999999999, 2024-09-12T22:04:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001395603, 2024-09-12T22:04:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 149744 2024-09-12T22:04:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197928+0000", 2024-09-12T22:04:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197928+0000", 2024-09-12T22:04:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197929+0000", 2024-09-12T22:04:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1300000000000001e-07 2024-09-12T22:04:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197974+0000", 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4993000000000001e-05 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197982+0000", 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.197988+0000", 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198037+0000", 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8884999999999997e-05 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198168+0000", 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131462 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198340+0000", 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000171869 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:149747 5.1 5.e0db0891 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:47.198081+0000", 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0010359169999999999, 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012799020000000001, 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 149747 2024-09-12T22:04:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198081+0000", 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198081+0000", 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198082+0000", 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4000000000000001e-07 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198152+0000", 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0259000000000006e-05 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198159+0000", 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1619999999999996e-06 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198163+0000", 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0779999999999997e-06 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:149748 5.1 5.260f43b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:47.198185+0000", 2024-09-12T22:04:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000932765, 2024-09-12T22:04:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001205268, 2024-09-12T22:04:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 149748 2024-09-12T22:04:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198185+0000", 2024-09-12T22:04:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198185+0000", 2024-09-12T22:04:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198185+0000", 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8999999999999996e-07 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198301+0000", 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115594 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198307+0000", 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.55e-06 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:47.198311+0000", 2024-09-12T22:04:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7100000000000001e-06 2024-09-12T22:04:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 8 2024-09-12T22:04:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:47.232 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:47.277 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:47.276+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:47.351 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:47.351+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:47.382 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:47.383 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:47.397 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:47.481 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:47.480+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:47.553 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:47.552+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:47.594 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.957861043000001, 2024-09-12T22:04:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.180554918, 2024-09-12T22:04:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:04:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:04:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:04:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:04:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:04:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:04:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:04:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:04:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:04:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:04:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:04:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:04:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:04:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:04:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:04:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:04:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:04:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.180374988000001, 2024-09-12T22:04:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:04:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:04:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:04:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:04:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:04:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:04:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:04:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:04:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:04:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:04:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:04:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:04:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:04:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:04:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:04:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:04:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:04:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.180308546999999, 2024-09-12T22:04:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:04:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:04:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:04:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:04:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:04:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:04:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:04:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.180252103999999, 2024-09-12T22:04:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:04:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:04:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:04:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:04:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:04:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:04:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:04:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:04:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:04:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:04:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:04:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:04:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:04:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:04:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:04:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:04:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:04:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:04:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:04:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:04:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:04:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:04:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:04:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:04:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:04:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:04:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.180183644, 2024-09-12T22:04:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:04:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:04:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:04:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:04:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:04:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:04:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:04:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:04:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:04:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:04:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:04:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:04:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:04:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:04:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:04:47.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:04:47.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:04:47.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:04:47.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:04:47.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:04:47.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:04:47.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:04:47.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:04:47.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:04:47.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.180125908999999, 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.629 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.630 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:04:47.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.630 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:47.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:47.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:47.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:04:47.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:04:47.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:04:47.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:04:47.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:04:47.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:04:47.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:04:47.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:04:47.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:04:47.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:47.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:04:47.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:04:47.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:04:47.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:04:47.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:04:47.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:04:47.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:04:47.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:04:47.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:04:47.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:04:47.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:04:47.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:04:47.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:47.636 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:47.637 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.180058216999999, 2024-09-12T22:04:47.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:04:47.637 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.637 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.637 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.637 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:04:47.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.637 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:47.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:47.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:47.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:04:47.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:04:47.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:04:47.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:04:47.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:47.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:04:47.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:04:47.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:04:47.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:04:47.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:04:47.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:04:47.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:04:47.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:04:47.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:04:47.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:04:47.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:04:47.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:04:47.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:04:47.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:04:47.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:04:47.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:04:47.643 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.643 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.643 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.644 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:47.644 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:47.644 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.180003155, 2024-09-12T22:04:47.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:04:47.644 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.644 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.644 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.644 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.644 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.644 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.644 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:04:47.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.644 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:47.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:47.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:47.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:04:47.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:04:47.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:04:47.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:04:47.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:04:47.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:04:47.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:04:47.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:04:47.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:04:47.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:47.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:04:47.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:04:47.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:04:47.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:04:47.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:04:47.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:04:47.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:04:47.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:04:47.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:04:47.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:04:47.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:04:47.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:04:47.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:04:47.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:04:47.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:04:47.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:04:47.651 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.651 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.651 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.651 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:47.651 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:47.651 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.139355634999999, 2024-09-12T22:04:47.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:04:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:04:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:47.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:04:47.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:04:47.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:04:47.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:04:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:04:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:04:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:04:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:04:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:04:47.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:04:47.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:47.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:04:47.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:04:47.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:04:47.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:04:47.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:04:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:04:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:04:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:04:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:04:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:04:47.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:04:47.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:04:47.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:04:47.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:04:47.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:04:47.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:04:47.658 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.658 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.658 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.658 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:47.658 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:47.658 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.136741906999999, 2024-09-12T22:04:47.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:04:47.658 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.658 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.659 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.659 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:04:47.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.659 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:47.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:47.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:04:47.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:04:47.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:04:47.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:04:47.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:04:47.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:04:47.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:04:47.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:04:47.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:04:47.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:04:47.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:47.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:47.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:04:47.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:04:47.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:04:47.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:04:47.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:04:47.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:04:47.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:04:47.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:04:47.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:04:47.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:04:47.664 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.664 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.665 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117396 5.1 5:83c565df:::benchmark_data_smithi043_32659_object117395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:47.665 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:47.665 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.136600784000001, 2024-09-12T22:04:47.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.090595995999999998, 2024-09-12T22:04:47.665 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.665 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.665 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117396 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454559+0000", 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454629+0000", 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0036000000000005e-05 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454641+0000", 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2232000000000001e-05 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454649+0000", 2024-09-12T22:04:47.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-12T22:04:47.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454697+0000", 2024-09-12T22:04:47.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8028000000000002e-05 2024-09-12T22:04:47.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:47.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454702+0000", 2024-09-12T22:04:47.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:04:47.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540467+0000", 2024-09-12T22:04:47.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085764217000000004 2024-09-12T22:04:47.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540596+0000", 2024-09-12T22:04:47.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129787 2024-09-12T22:04:47.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540774+0000", 2024-09-12T22:04:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017746799999999999 2024-09-12T22:04:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544679+0000", 2024-09-12T22:04:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003904996 2024-09-12T22:04:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545009+0000", 2024-09-12T22:04:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033056600000000002 2024-09-12T22:04:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545067+0000", 2024-09-12T22:04:47.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7871999999999997e-05 2024-09-12T22:04:47.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545154+0000", 2024-09-12T22:04:47.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6701999999999998e-05 2024-09-12T22:04:47.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.671 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.672 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117398 5.6 5:6d151138:::benchmark_data_smithi043_32659_object117397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:47.672 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:47.672 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.115305613, 2024-09-12T22:04:47.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044999137000000002, 2024-09-12T22:04:47.672 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.672 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.672 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.672 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117398 2024-09-12T22:04:47.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.672 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:47.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:47.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475854+0000", 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475914+0000", 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9422999999999997e-05 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475925+0000", 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0881e-05 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475930+0000", 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475974+0000", 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3810999999999998e-05 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475981+0000", 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1590000000000004e-06 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504359+0000", 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028377711 2024-09-12T22:04:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504526+0000", 2024-09-12T22:04:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167023 2024-09-12T22:04:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504661+0000", 2024-09-12T22:04:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135148 2024-09-12T22:04:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.506563+0000", 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901778 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520770+0000", 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014206724 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520803+0000", 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3083000000000002e-05 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520852+0000", 2024-09-12T22:04:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9543999999999999e-05 2024-09-12T22:04:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117399 5.3 5:ce33c2c7:::benchmark_data_smithi043_32659_object117398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.11053662, 2024-09-12T22:04:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038176902999999998, 2024-09-12T22:04:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117399 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480624+0000", 2024-09-12T22:04:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.322e-06 2024-09-12T22:04:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480670+0000", 2024-09-12T22:04:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6365000000000001e-05 2024-09-12T22:04:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480682+0000", 2024-09-12T22:04:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480689+0000", 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480731+0000", 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480738+0000", 2024-09-12T22:04:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513753+0000", 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.033015125999999999 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513935+0000", 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018219500000000001 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.514170+0000", 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000234694 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518462+0000", 2024-09-12T22:04:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004291563 2024-09-12T22:04:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518655+0000", 2024-09-12T22:04:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019362700000000001 2024-09-12T22:04:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518710+0000", 2024-09-12T22:04:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:04:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518799+0000", 2024-09-12T22:04:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9000999999999997e-05 2024-09-12T22:04:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117407 5.c 5:3c61c1b7:::benchmark_data_smithi043_32659_object117406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.077331106000001, 2024-09-12T22:04:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042860548999999998, 2024-09-12T22:04:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117407 2024-09-12T22:04:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513829+0000", 2024-09-12T22:04:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-12T22:04:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513900+0000", 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1482000000000004e-05 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513909+0000", 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8370000000000003e-06 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513917+0000", 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:04:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513967+0000", 2024-09-12T22:04:47.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.007e-05 2024-09-12T22:04:47.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:47.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513975+0000", 2024-09-12T22:04:47.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5639999999999999e-06 2024-09-12T22:04:47.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542411+0000", 2024-09-12T22:04:47.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028436032999999999 2024-09-12T22:04:47.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542539+0000", 2024-09-12T22:04:47.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012777900000000001 2024-09-12T22:04:47.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542687+0000", 2024-09-12T22:04:47.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148343 2024-09-12T22:04:47.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548120+0000", 2024-09-12T22:04:47.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054333580000000001 2024-09-12T22:04:47.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556549+0000", 2024-09-12T22:04:47.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084288309999999995 2024-09-12T22:04:47.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556596+0000", 2024-09-12T22:04:47.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6458999999999997e-05 2024-09-12T22:04:47.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556688+0000", 2024-09-12T22:04:47.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2676999999999994e-05 2024-09-12T22:04:47.691 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.691 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.691 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.691 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:47.691 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:47.692 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.5915278110000006, 2024-09-12T22:04:47.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:04:47.692 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.692 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.692 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.692 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:04:47.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.692 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:47.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:47.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:04:47.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:04:47.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:04:47.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:04:47.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:04:47.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:04:47.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:04:47.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:04:47.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:04:47.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:04:47.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:04:47.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:04:47.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:04:47.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:04:47.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:04:47.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:04:47.698 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.698 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.698 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.698 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:47.698 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:47.698 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.591049323, 2024-09-12T22:04:47.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:04:47.698 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.698 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.698 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:47.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:04:47.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:04:47.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:04:47.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:04:47.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:04:47.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:04:47.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:04:47.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:04:47.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:04:47.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:04:47.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:04:47.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:04:47.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:04:47.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:04:47.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:04:47.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:04:47.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:04:47.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:04:47.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:04:47.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:04:47.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:04:47.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.5885540230000004, 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.704 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:04:47.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:04:47.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:04:47.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:04:47.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:04:47.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:04:47.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:04:47.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:04:47.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:04:47.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:04:47.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:04:47.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.710 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:47.710 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:47.710 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.5874732320000007, 2024-09-12T22:04:47.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:04:47.710 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.710 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.710 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.710 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.710 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.710 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.710 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:04:47.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.710 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:47.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:47.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:47.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:04:47.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:04:47.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:04:47.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:04:47.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:04:47.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:04:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:04:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:04:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:04:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:04:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:04:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:04:47.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:04:47.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:04:47.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:04:47.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:04:47.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:04:47.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.715 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.5862376699999992, 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:47.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:04:47.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:04:47.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:04:47.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:04:47.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:04:47.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:47.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:04:47.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:04:47.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:47.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:47.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:47.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:04:47.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:04:47.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.721 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:47.721 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:47.721 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:47.723 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:47.723 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:47.721+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:47.823 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:47.822+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:47.878 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:151457 5.c e45/40 5:3d4424ab:::benchmark_data_smithi043_32659_object151456:head v 45'9478, mlcod=45'9476)", 2024-09-12T22:04:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:47.875447+0000", 2024-09-12T22:04:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0021950469999999999, 2024-09-12T22:04:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022137580000000001, 2024-09-12T22:04:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875447+0000", 2024-09-12T22:04:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875447+0000", 2024-09-12T22:04:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875448+0000", 2024-09-12T22:04:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:04:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875452+0000", 2024-09-12T22:04:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3270000000000002e-06 2024-09-12T22:04:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875466+0000", 2024-09-12T22:04:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4204e-05 2024-09-12T22:04:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875473+0000", 2024-09-12T22:04:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4690000000000002e-06 2024-09-12T22:04:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875520+0000", 2024-09-12T22:04:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7372e-05 2024-09-12T22:04:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875539+0000", 2024-09-12T22:04:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9130000000000001e-05 2024-09-12T22:04:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:151449 5.3 e45/40 5:cb0cdfd1:::benchmark_data_smithi043_32659_object151448:head v 45'9431, mlcod=45'9427)", 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:47.876490+0000", 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001152183, 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001214293, 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.876490+0000", 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.876490+0000", 2024-09-12T22:04:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.876491+0000", 2024-09-12T22:04:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9599999999999999e-07 2024-09-12T22:04:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.876496+0000", 2024-09-12T22:04:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1660000000000002e-06 2024-09-12T22:04:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.876505+0000", 2024-09-12T22:04:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2269999999999999e-06 2024-09-12T22:04:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.876511+0000", 2024-09-12T22:04:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.127e-06 2024-09-12T22:04:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.876574+0000", 2024-09-12T22:04:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2706000000000006e-05 2024-09-12T22:04:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.876594+0000", 2024-09-12T22:04:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0040000000000001e-05 2024-09-12T22:04:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:151456 5.5 e45/40 5:a23a8357:::benchmark_data_smithi043_32659_object151455:head v 45'9433, mlcod=45'9429)", 2024-09-12T22:04:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:47.877316+0000", 2024-09-12T22:04:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00032609000000000002, 2024-09-12T22:04:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00042103399999999998, 2024-09-12T22:04:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877316+0000", 2024-09-12T22:04:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877316+0000", 2024-09-12T22:04:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877317+0000", 2024-09-12T22:04:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8500000000000001e-07 2024-09-12T22:04:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877322+0000", 2024-09-12T22:04:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3329999999999996e-06 2024-09-12T22:04:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877332+0000", 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6209999999999999e-06 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877338+0000", 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3589999999999996e-06 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877379+0000", 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0787000000000001e-05 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877392+0000", 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2928999999999999e-05 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:151455 5.9 e45/40 ondisk, result = 0)", 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:47.877629+0000", 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 1.3366e-05, 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000137255, 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877629+0000", 2024-09-12T22:04:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877629+0000", 2024-09-12T22:04:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877629+0000", 2024-09-12T22:04:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.51e-07 2024-09-12T22:04:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877632+0000", 2024-09-12T22:04:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7590000000000002e-06 2024-09-12T22:04:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877639+0000", 2024-09-12T22:04:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.25e-06 2024-09-12T22:04:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877644+0000", 2024-09-12T22:04:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1000000000000003e-06 2024-09-12T22:04:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877692+0000", 2024-09-12T22:04:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7596000000000003e-05 2024-09-12T22:04:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877699+0000", 2024-09-12T22:04:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.554e-06 2024-09-12T22:04:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:151462 5.8 5:1e0a4482:::benchmark_data_smithi043_32659_object151461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:47.877656+0000", 2024-09-12T22:04:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9999857, 2024-09-12T22:04:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000161619, 2024-09-12T22:04:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:04:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 151462 2024-09-12T22:04:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877656+0000", 2024-09-12T22:04:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877656+0000", 2024-09-12T22:04:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877658+0000", 2024-09-12T22:04:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.471e-06 2024-09-12T22:04:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877706+0000", 2024-09-12T22:04:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7933999999999999e-05 2024-09-12T22:04:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877719+0000", 2024-09-12T22:04:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2685e-05 2024-09-12T22:04:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877726+0000", 2024-09-12T22:04:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4059999999999999e-06 2024-09-12T22:04:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877775+0000", 2024-09-12T22:04:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9011999999999998e-05 2024-09-12T22:04:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:151455 5.9 5:9df044de:::benchmark_data_smithi043_32659_object151454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:47.874677+0000", 2024-09-12T22:04:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0029648890000000001, 2024-09-12T22:04:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031812530000000002, 2024-09-12T22:04:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 151455 2024-09-12T22:04:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.874677+0000", 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.874677+0000", 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.874679+0000", 2024-09-12T22:04:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2920000000000001e-06 2024-09-12T22:04:47.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.874749+0000", 2024-09-12T22:04:47.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0152000000000002e-05 2024-09-12T22:04:47.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.874760+0000", 2024-09-12T22:04:47.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1106e-05 2024-09-12T22:04:47.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.874767+0000", 2024-09-12T22:04:47.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8040000000000004e-06 2024-09-12T22:04:47.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.874826+0000", 2024-09-12T22:04:47.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000002e-05 2024-09-12T22:04:47.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.874918+0000", 2024-09-12T22:04:47.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2584999999999995e-05 2024-09-12T22:04:47.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:47.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875008+0000", 2024-09-12T22:04:47.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9357000000000005e-05 2024-09-12T22:04:47.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:47.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877084+0000", 2024-09-12T22:04:47.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020759260000000001 2024-09-12T22:04:47.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:47.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877706+0000", 2024-09-12T22:04:47.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00062255800000000005 2024-09-12T22:04:47.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:47.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877769+0000", 2024-09-12T22:04:47.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2834000000000002e-05 2024-09-12T22:04:47.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:47.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.877859+0000", 2024-09-12T22:04:47.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9438999999999995e-05 2024-09-12T22:04:47.903 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.904 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.904 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.904 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:151460 5.8 5:13c3eb7c:::benchmark_data_smithi043_32659_object151459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T22:04:47.904 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:47.875078+0000", 2024-09-12T22:04:47.904 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00256427, 2024-09-12T22:04:47.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028377680000000001, 2024-09-12T22:04:47.904 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:47.904 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:47.904 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:47.904 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:47.904 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:47.904 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:47.905 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 151460 2024-09-12T22:04:47.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.905 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:47.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:47.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875078+0000", 2024-09-12T22:04:47.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:47.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875078+0000", 2024-09-12T22:04:47.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:47.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:47.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875079+0000", 2024-09-12T22:04:47.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7300000000000004e-07 2024-09-12T22:04:47.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:47.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875137+0000", 2024-09-12T22:04:47.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7667000000000002e-05 2024-09-12T22:04:47.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:47.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875147+0000", 2024-09-12T22:04:47.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:04:47.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:47.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875154+0000", 2024-09-12T22:04:47.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0790000000000003e-06 2024-09-12T22:04:47.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:47.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875210+0000", 2024-09-12T22:04:47.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6023000000000002e-05 2024-09-12T22:04:47.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:47.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:47.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:47.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:47.875348+0000", 2024-09-12T22:04:47.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013768299999999999 2024-09-12T22:04:47.908 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.908 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:47.908 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.908 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:47.908 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:47.908 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 7 2024-09-12T22:04:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:47.909 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:47.924 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:47.923+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:48.027 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:48.025+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:48.105 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:48.105 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:48.105 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:48.120 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:48.161 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:48.160+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:48.193 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 54 16 152245 152229 176.176 156.938 0.00801649 0.00567357 2024-09-12T22:04:48.228 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:48.226+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:48.319 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:48.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:48.320 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:48.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.320 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:48.320 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:48.320 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.690221344999998, 2024-09-12T22:04:48.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:48.320 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.320 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.320 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.320 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:48.320 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:48.320 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:48.320 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:48.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.321 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:48.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:48.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:48.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:48.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:48.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:48.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:48.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:48.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:48.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:48.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:48.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:48.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:48.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:48.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:48.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:48.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:48.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:48.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:48.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:48.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:48.326 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.326 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.326 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.326 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.684820404999996, 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:48.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:48.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:48.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:48.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:48.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:48.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:48.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:48.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:48.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:48.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:48.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.683879138000002, 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.332 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.333 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:48.333 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:48.333 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:48.333 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:48.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.333 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:48.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:48.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:48.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:48.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:48.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:48.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:48.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:48.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:48.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:48.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:48.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:48.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:48.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:48.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:48.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:48.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:48.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:48.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:48.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:48.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:48.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:48.338 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.338 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.338 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.338 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:48.338 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:48.338 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.682881217999999, 2024-09-12T22:04:48.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:48.339 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.339 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.339 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.339 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:48.339 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:48.339 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:48.339 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:48.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.339 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:48.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:48.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:48.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:48.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:48.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:48.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:48.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:48.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:48.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:48.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:48.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:48.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:48.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:48.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:48.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:48.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:48.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:48.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:48.344 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.344 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.344 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.344 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:48.344 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:48.344 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3191325190000001, 2024-09-12T22:04:48.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:04:48.344 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.344 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.345 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.345 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:48.345 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:48.345 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:48.345 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:04:48.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.345 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:48.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:04:48.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:04:48.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:48.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:04:48.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:04:48.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:48.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:04:48.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:04:48.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:48.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:04:48.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:04:48.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:04:48.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:04:48.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:04:48.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:04:48.350 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.350 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.350 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.350 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:48.350 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:48.350 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3184993140000003, 2024-09-12T22:04:48.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:04:48.350 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.350 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.350 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.350 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:48.350 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:04:48.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:04:48.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:04:48.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:04:48.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:04:48.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:04:48.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:04:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:04:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:04:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:04:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:04:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:04:48.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:48.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:04:48.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:04:48.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:04:48.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:04:48.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:04:48.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:04:48.355 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.355 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.355 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.355 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:48.355 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:48.355 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3166796509999994, 2024-09-12T22:04:48.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:04:48.355 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.355 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.355 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.355 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:48.356 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:48.356 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:48.356 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:04:48.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.356 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:48.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:48.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:04:48.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:04:48.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:04:48.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:04:48.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:04:48.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:04:48.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:48.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:04:48.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:04:48.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:04:48.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:04:48.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:04:48.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:04:48.360 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.360 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.360 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.360 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:48.360 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:48.360 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3165120239999997, 2024-09-12T22:04:48.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:04:48.360 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.360 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.360 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.361 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:48.361 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:48.361 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:48.361 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:04:48.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.361 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:48.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:48.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:04:48.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:48.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:04:48.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:04:48.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:04:48.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:04:48.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:04:48.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:04:48.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:04:48.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:04:48.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:04:48.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:04:48.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:48.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:04:48.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:04:48.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:04:48.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:04:48.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:04:48.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:04:48.365 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.365 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.365 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.365 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:04:48.365 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:48.365 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3163713599999998, 2024-09-12T22:04:48.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:04:48.365 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.366 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.366 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.366 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:48.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:48.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:04:48.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:04:48.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:04:48.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:04:48.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:04:48.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:04:48.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:04:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:04:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:04:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:04:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:04:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:04:48.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:04:48.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:04:48.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:04:48.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:04:48.369 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.369 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.369 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.370 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:48.370 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:48.370 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3161458370000005, 2024-09-12T22:04:48.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:04:48.370 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.370 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.370 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.370 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:48.370 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:48.370 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:48.370 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:04:48.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:04:48.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:04:48.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:04:48.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:04:48.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:04:48.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:04:48.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:04:48.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:04:48.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:04:48.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:04:48.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:04:48.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:04:48.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:48.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:04:48.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:04:48.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:04:48.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:04:48.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:04:48.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:04:48.374 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3160261329999994, 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:48.375 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:04:48.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.376 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:48.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:48.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:04:48.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:04:48.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:04:48.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:04:48.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:04:48.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:04:48.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:48.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:04:48.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:04:48.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:48.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:04:48.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:04:48.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:48.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:04:48.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:04:48.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:04:48.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:04:48.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:04:48.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:04:48.380 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.380 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.380 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.381 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:04:48.381 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:48.381 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3154348509999991, 2024-09-12T22:04:48.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:04:48.381 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.381 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.381 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:48.381 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:48.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:48.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:04:48.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:04:48.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:04:48.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:04:48.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:04:48.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.384 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:04:48.385 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:48.385 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.315211283, 2024-09-12T22:04:48.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:04:48.385 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.385 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.385 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.385 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:48.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:48.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:48.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:04:48.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:04:48.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:04:48.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:04:48.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:04:48.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:04:48.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:04:48.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:04:48.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:04:48.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:04:48.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:04:48.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:04:48.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:04:48.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:04:48.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:04:48.389 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.389 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.389 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.389 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:48.389 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:48.389 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3151198019999999, 2024-09-12T22:04:48.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:04:48.389 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.389 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.389 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.389 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:48.389 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:04:48.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:04:48.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:04:48.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:04:48.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:04:48.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:04:48.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:48.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:04:48.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:04:48.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:04:48.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:04:48.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:04:48.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:04:48.394 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.394 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.394 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.394 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:48.394 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:48.394 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3143309979999991, 2024-09-12T22:04:48.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:04:48.394 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.394 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.394 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.395 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:48.395 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:48.395 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:48.395 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:04:48.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.395 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:48.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:48.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:04:48.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:04:48.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:04:48.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:04:48.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:04:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:04:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:04:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:04:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:04:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:04:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:04:48.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:04:48.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:48.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:04:48.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:04:48.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:04:48.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3140668580000003, 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.399 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:04:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:04:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3135618830000002, 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:04:48.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:04:48.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:04:48.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:04:48.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:04:48.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:04:48.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:04:48.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:04:48.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:04:48.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:04:48.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:04:48.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:04:48.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:04:48.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:04:48.408 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.408 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.408 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.408 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:04:48.408 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:48.408 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3124324549999997, 2024-09-12T22:04:48.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:04:48.408 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.408 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.409 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.409 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:48.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:48.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3116780129999999, 2024-09-12T22:04:48.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:04:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:04:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:04:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:04:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:04:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:04:48.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:04:48.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:04:48.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:04:48.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:04:48.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:48.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:04:48.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:04:48.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:48.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:04:48.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:04:48.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:04:48.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:04:48.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:04:48.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:04:48.418 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.418 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.418 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.418 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:04:48.418 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:48.418 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3109989110000004, 2024-09-12T22:04:48.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:04:48.418 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:48.418 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:48.418 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:04:48.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:04:48.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:04:48.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:04:48.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:48.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:48.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:48.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:04:48.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:04:48.422 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.422 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.422 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.422 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:48.422 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:48.423 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:04:48.424 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:48.422+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:48.425 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:48.447 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:04:48.524 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:48.523+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:48.539 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:48.557 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:48.557 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:48.576 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:48.577 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:48.580 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:48.580 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:48.580 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:48.581 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:48.591 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:48.625 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:48.624+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:48.726 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:48.725+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:48.787 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:48.787 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:48.801 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:48.844 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:48.843+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:48.928 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:48.927+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:48.952 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:48.952 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:48.965 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:49.029 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:49.028+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:49.128 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:49.130 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:49.128+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:49.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:49.194 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 55 16 154770 154754 175.842 157.812 0.00391219 0.00568445 2024-09-12T22:04:49.231 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:49.230+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:49.309 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:49.351 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:49.350+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:49.432 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-09-12T22:04:49.433 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:49.432+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:49.526 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:49.567 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:49.566+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:49.634 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:49.633+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:49.688 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:49.774 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:49.773+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:49.837 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:49.836+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:49.885 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:49.886 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:49.898 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:49.938 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:49.936+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:50.038 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:50.037+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:50.093 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:50.093 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:50.106 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:50.150 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:50.149+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:50.194 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 56 16 157282 157266 175.505 157 0.00860984 0.00569539 2024-09-12T22:04:50.240 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:50.239+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:50.262 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:50.262 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:50.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:50.359 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:50.358+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:50.443 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:50.442+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:50.491 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:50.575 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:50.574+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:50.581 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:04:50.644 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:50.643+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:50.696 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:50.705 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:50.716 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:50.716 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:50.736 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:50.736 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:50.739 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:50.740 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:50.747 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:50.746+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:50.846 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:50.844+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:50.856 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:50.857 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:50.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.857 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:158861 5.d e46/40 5:b270859c:::benchmark_data_smithi043_32659_object158860:head v 46'9784, mlcod=46'9781)", 2024-09-12T22:04:50.857 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:50.852614+0000", 2024-09-12T22:04:50.857 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0014854790000000001, 2024-09-12T22:04:50.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015034029999999999, 2024-09-12T22:04:50.857 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:50.857 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:50.857 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:50.857 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:50.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:50.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852614+0000", 2024-09-12T22:04:50.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:50.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852614+0000", 2024-09-12T22:04:50.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:50.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852615+0000", 2024-09-12T22:04:50.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2799999999999996e-07 2024-09-12T22:04:50.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:50.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852680+0000", 2024-09-12T22:04:50.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5401999999999995e-05 2024-09-12T22:04:50.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:50.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852692+0000", 2024-09-12T22:04:50.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2456999999999999e-05 2024-09-12T22:04:50.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:50.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852701+0000", 2024-09-12T22:04:50.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1189999999999997e-06 2024-09-12T22:04:50.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:50.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852745+0000", 2024-09-12T22:04:50.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4067999999999999e-05 2024-09-12T22:04:50.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:50.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852764+0000", 2024-09-12T22:04:50.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9233e-05 2024-09-12T22:04:50.861 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.861 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:50.861 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.861 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:158863 5.3 5:cf16d9c0:::benchmark_data_smithi043_32659_object158862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:50.861 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:50.852841+0000", 2024-09-12T22:04:50.861 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0012583570000000001, 2024-09-12T22:04:50.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001337862, 2024-09-12T22:04:50.861 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:50.862 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:50.862 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:50.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:50.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:50.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:50.862 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 158863 2024-09-12T22:04:50.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.862 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:50.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:50.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852841+0000", 2024-09-12T22:04:50.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:50.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852841+0000", 2024-09-12T22:04:50.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:50.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852842+0000", 2024-09-12T22:04:50.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1909999999999999e-06 2024-09-12T22:04:50.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:50.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852931+0000", 2024-09-12T22:04:50.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8403e-05 2024-09-12T22:04:50.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:50.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852945+0000", 2024-09-12T22:04:50.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.43e-05 2024-09-12T22:04:50.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:50.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852952+0000", 2024-09-12T22:04:50.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:04:50.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:50.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853004+0000", 2024-09-12T22:04:50.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1805000000000003e-05 2024-09-12T22:04:50.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:50.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853139+0000", 2024-09-12T22:04:50.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013495599999999999 2024-09-12T22:04:50.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:50.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853291+0000", 2024-09-12T22:04:50.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000151941 2024-09-12T22:04:50.869 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.869 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:50.869 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.869 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:158864 5.6 5:68c2264f:::benchmark_data_smithi043_32659_object158863:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:50.869 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:50.853158+0000", 2024-09-12T22:04:50.870 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00094096900000000005, 2024-09-12T22:04:50.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001090291, 2024-09-12T22:04:50.870 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:50.870 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:50.870 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:50.870 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:50.870 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:50.870 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:50.870 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 158864 2024-09-12T22:04:50.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.870 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:50.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:50.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853158+0000", 2024-09-12T22:04:50.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:50.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853158+0000", 2024-09-12T22:04:50.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:50.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853159+0000", 2024-09-12T22:04:50.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9999999999999997e-07 2024-09-12T22:04:50.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:50.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853211+0000", 2024-09-12T22:04:50.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1619000000000002e-05 2024-09-12T22:04:50.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:50.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853221+0000", 2024-09-12T22:04:50.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0339999999999999e-05 2024-09-12T22:04:50.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:50.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853227+0000", 2024-09-12T22:04:50.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3099999999999997e-06 2024-09-12T22:04:50.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:50.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853793+0000", 2024-09-12T22:04:50.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056592899999999995 2024-09-12T22:04:50.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:50.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853965+0000", 2024-09-12T22:04:50.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000171232 2024-09-12T22:04:50.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:50.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854112+0000", 2024-09-12T22:04:50.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000147515 2024-09-12T22:04:50.874 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.874 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:50.874 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.875 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:158866 5.7 5:e8c7cd5c:::benchmark_data_smithi043_32659_object158865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:50.875 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:50.853331+0000", 2024-09-12T22:04:50.875 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00076887199999999998, 2024-09-12T22:04:50.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00097424299999999996, 2024-09-12T22:04:50.876 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:50.876 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:50.876 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:50.876 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:50.876 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:50.877 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:50.877 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 158866 2024-09-12T22:04:50.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.877 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:50.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:50.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853331+0000", 2024-09-12T22:04:50.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:50.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853331+0000", 2024-09-12T22:04:50.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:50.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853331+0000", 2024-09-12T22:04:50.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2099999999999996e-07 2024-09-12T22:04:50.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:50.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853399+0000", 2024-09-12T22:04:50.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8029999999999997e-05 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853407+0000", 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0059999999999992e-06 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853421+0000", 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3351e-05 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854175+0000", 2024-09-12T22:04:50.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075421099999999997 2024-09-12T22:04:50.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:50.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854311+0000", 2024-09-12T22:04:50.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013610799999999999 2024-09-12T22:04:50.880 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.880 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:50.880 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.880 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:158865 5.f e46/40)", 2024-09-12T22:04:50.880 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:50.853733+0000", 2024-09-12T22:04:50.880 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00036676599999999998, 2024-09-12T22:04:50.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00062295899999999997, 2024-09-12T22:04:50.881 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:50.881 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:50.881 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:50.881 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:50.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:50.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853733+0000", 2024-09-12T22:04:50.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:50.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853733+0000", 2024-09-12T22:04:50.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:50.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853733+0000", 2024-09-12T22:04:50.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6000000000000004e-07 2024-09-12T22:04:50.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:50.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853797+0000", 2024-09-12T22:04:50.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3601000000000003e-05 2024-09-12T22:04:50.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:50.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853807+0000", 2024-09-12T22:04:50.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0318e-05 2024-09-12T22:04:50.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:50.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.853813+0000", 2024-09-12T22:04:50.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2620000000000004e-06 2024-09-12T22:04:50.883 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.883 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:50.883 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.883 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:158867 5.3 5.e0d733e3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:50.883 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:50.854145+0000", 2024-09-12T22:04:50.883 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999542, 2024-09-12T22:04:50.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023764399999999999, 2024-09-12T22:04:50.884 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:50.884 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:50.884 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:50.884 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:50.884 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:50.884 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:50.884 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 158867 2024-09-12T22:04:50.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.884 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:50.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:50.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854145+0000", 2024-09-12T22:04:50.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:50.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854145+0000", 2024-09-12T22:04:50.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:50.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854146+0000", 2024-09-12T22:04:50.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6200000000000006e-07 2024-09-12T22:04:50.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:50.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854260+0000", 2024-09-12T22:04:50.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011341300000000001 2024-09-12T22:04:50.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:50.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854271+0000", 2024-09-12T22:04:50.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1083e-05 2024-09-12T22:04:50.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:50.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854277+0000", 2024-09-12T22:04:50.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6889999999999998e-06 2024-09-12T22:04:50.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.887 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:50.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.887 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:158868 5.2 5.352fef22 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:50.887 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:50.854308+0000", 2024-09-12T22:04:50.887 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9997916, 2024-09-12T22:04:50.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012703700000000001, 2024-09-12T22:04:50.888 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:50.888 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:50.888 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:50.888 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:50.888 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:50.888 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:50.888 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 158868 2024-09-12T22:04:50.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.888 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:50.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:50.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854308+0000", 2024-09-12T22:04:50.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:50.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854308+0000", 2024-09-12T22:04:50.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:50.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854309+0000", 2024-09-12T22:04:50.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:04:50.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:50.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854356+0000", 2024-09-12T22:04:50.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7076999999999997e-05 2024-09-12T22:04:50.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:50.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854364+0000", 2024-09-12T22:04:50.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2260000000000005e-06 2024-09-12T22:04:50.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:50.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854369+0000", 2024-09-12T22:04:50.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2209999999999996e-06 2024-09-12T22:04:50.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:50.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854422+0000", 2024-09-12T22:04:50.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2596000000000003e-05 2024-09-12T22:04:50.891 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.891 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:50.891 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.891 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:158869 5.6 5.21bb79c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:50.891 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:50.854383+0000", 2024-09-12T22:04:50.891 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9997163, 2024-09-12T22:04:50.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109687, 2024-09-12T22:04:50.891 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:50.891 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:50.892 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:50.892 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:50.892 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:50.892 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:50.892 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 158869 2024-09-12T22:04:50.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.892 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:50.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:50.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854383+0000", 2024-09-12T22:04:50.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:50.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854383+0000", 2024-09-12T22:04:50.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:50.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854383+0000", 2024-09-12T22:04:50.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5699999999999998e-07 2024-09-12T22:04:50.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:50.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854427+0000", 2024-09-12T22:04:50.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3353000000000003e-05 2024-09-12T22:04:50.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:50.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854434+0000", 2024-09-12T22:04:50.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1180000000000003e-06 2024-09-12T22:04:50.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:50.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854439+0000", 2024-09-12T22:04:50.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9679999999999997e-06 2024-09-12T22:04:50.894 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.894 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:50.894 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.895 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:158871 5.1 5.9a18e791 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:50.895 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:50.854447+0000", 2024-09-12T22:04:50.895 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9996529, 2024-09-12T22:04:50.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9936e-05, 2024-09-12T22:04:50.895 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:50.895 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:50.895 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:50.895 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:50.895 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:50.895 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:50.895 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 158871 2024-09-12T22:04:50.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.895 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:50.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:50.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854447+0000", 2024-09-12T22:04:50.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:50.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854447+0000", 2024-09-12T22:04:50.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:50.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854447+0000", 2024-09-12T22:04:50.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.89e-07 2024-09-12T22:04:50.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:50.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854471+0000", 2024-09-12T22:04:50.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3493e-05 2024-09-12T22:04:50.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:50.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854477+0000", 2024-09-12T22:04:50.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2809999999999997e-06 2024-09-12T22:04:50.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:50.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.854482+0000", 2024-09-12T22:04:50.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6539999999999998e-06 2024-09-12T22:04:50.898 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.898 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:50.898 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.899 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:158851 5.f e46/40 5:fc199774:::benchmark_data_smithi043_32659_object158850:head v 46'9974, mlcod=46'9971)", 2024-09-12T22:04:50.899 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:50.848504+0000", 2024-09-12T22:04:50.899 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0055954539999999997, 2024-09-12T22:04:50.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061943800000000002, 2024-09-12T22:04:50.899 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:50.899 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:50.899 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:50.899 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:50.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:50.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.848504+0000", 2024-09-12T22:04:50.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:50.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.848504+0000", 2024-09-12T22:04:50.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:50.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.848505+0000", 2024-09-12T22:04:50.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:04:50.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:50.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.848575+0000", 2024-09-12T22:04:50.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0704999999999995e-05 2024-09-12T22:04:50.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:50.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.848583+0000", 2024-09-12T22:04:50.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9330000000000001e-06 2024-09-12T22:04:50.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:50.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.848590+0000", 2024-09-12T22:04:50.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2990000000000002e-06 2024-09-12T22:04:50.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:50.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.849694+0000", 2024-09-12T22:04:50.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001104432 2024-09-12T22:04:50.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:50.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.849709+0000", 2024-09-12T22:04:50.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4537e-05 2024-09-12T22:04:50.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.904 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:50.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.905 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:158857 5.7 5:e88cbdf3:::benchmark_data_smithi043_32659_object158856:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:50.905 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:50.850012+0000", 2024-09-12T22:04:50.905 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0040874379999999997, 2024-09-12T22:04:50.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047469239999999996, 2024-09-12T22:04:50.905 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:50.905 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:50.905 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:50.905 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:50.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:50.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:50.906 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 158857 2024-09-12T22:04:50.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.906 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:50.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:50.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850012+0000", 2024-09-12T22:04:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850012+0000", 2024-09-12T22:04:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850013+0000", 2024-09-12T22:04:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5120000000000001e-06 2024-09-12T22:04:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850114+0000", 2024-09-12T22:04:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100896 2024-09-12T22:04:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850130+0000", 2024-09-12T22:04:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5296000000000001e-05 2024-09-12T22:04:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850139+0000", 2024-09-12T22:04:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8829999999999995e-06 2024-09-12T22:04:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850200+0000", 2024-09-12T22:04:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1588999999999996e-05 2024-09-12T22:04:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850340+0000", 2024-09-12T22:04:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014000699999999999 2024-09-12T22:04:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850498+0000", 2024-09-12T22:04:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015784699999999999 2024-09-12T22:04:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:158858 5.7 5:e05cd8eb:::benchmark_data_smithi043_32659_object158857:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:50.850165+0000", 2024-09-12T22:04:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0039342090000000001, 2024-09-12T22:04:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046623630000000001, 2024-09-12T22:04:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 158858 2024-09-12T22:04:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850165+0000", 2024-09-12T22:04:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850165+0000", 2024-09-12T22:04:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850166+0000", 2024-09-12T22:04:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:04:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850232+0000", 2024-09-12T22:04:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5907000000000004e-05 2024-09-12T22:04:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850242+0000", 2024-09-12T22:04:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0173000000000001e-05 2024-09-12T22:04:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.850249+0000", 2024-09-12T22:04:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8519999999999998e-06 2024-09-12T22:04:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852182+0000", 2024-09-12T22:04:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001933305 2024-09-12T22:04:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852304+0000", 2024-09-12T22:04:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121642 2024-09-12T22:04:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:50.852423+0000", 2024-09-12T22:04:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011949499999999999 2024-09-12T22:04:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 12 2024-09-12T22:04:50.917 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:50.918 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:50.959 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:50.958+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:51.048 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:51.047+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:51.107 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:51.107 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:51.107 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:51.107 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:51.108 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:51.120 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:51.164 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:51.163+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:51.194 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 57 16 159747 159731 175.129 154.062 0.00301123 0.00570755 2024-09-12T22:04:51.251 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:51.249+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:51.278 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:51.278 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:51.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:51.278 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:51.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.278 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:51.278 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:51.278 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.641094117999998, 2024-09-12T22:04:51.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:51.279 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.279 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.279 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.279 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:51.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.280 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:51.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:51.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:51.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:51.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:51.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:51.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:51.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:51.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:51.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:51.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:51.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:51.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:51.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:51.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:51.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:51.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:51.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:51.287 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.287 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.287 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.288 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:51.288 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:51.288 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.863787992999999, 2024-09-12T22:04:51.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:04:51.288 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.288 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.288 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:51.288 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.289 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.289 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.289 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:04:51.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.289 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:51.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:51.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:04:51.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:04:51.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:04:51.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:04:51.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:04:51.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:04:51.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:04:51.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:04:51.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:04:51.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:04:51.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:51.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:04:51.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:04:51.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:04:51.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:04:51.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:04:51.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:04:51.295 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.296 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.296 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:51.296 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:51.296 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.863608063000001, 2024-09-12T22:04:51.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:04:51.296 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.297 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.297 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:51.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.297 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:04:51.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.297 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:51.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:51.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:04:51.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:04:51.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:04:51.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:04:51.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:04:51.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:04:51.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:04:51.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:04:51.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:04:51.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:04:51.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:51.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:04:51.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:04:51.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:04:51.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:04:51.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:04:51.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:04:51.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.303 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.303 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:51.304 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:51.304 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.863541622, 2024-09-12T22:04:51.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:04:51.304 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.304 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.304 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:51.304 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.304 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.305 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.305 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:04:51.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.305 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:51.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:51.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:04:51.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:04:51.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:04:51.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:04:51.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:04:51.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:04:51.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:04:51.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:04:51.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:04:51.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:04:51.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:51.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:04:51.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:04:51.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:04:51.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:04:51.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:04:51.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:04:51.310 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.310 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.310 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.310 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:51.310 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.863485179000001, 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:51.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:51.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:51.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:51.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:04:51.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:04:51.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:04:51.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:04:51.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:04:51.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:04:51.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:04:51.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:04:51.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:51.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:04:51.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:04:51.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:04:51.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:04:51.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:04:51.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:04:51.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:04:51.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:04:51.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:04:51.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:04:51.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:04:51.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:04:51.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:04:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:04:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:04:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:04:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.863416719, 2024-09-12T22:04:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:04:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:04:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:51.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:51.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:04:51.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:04:51.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:04:51.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:04:51.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:04:51.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:04:51.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:04:51.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:04:51.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:04:51.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:04:51.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:51.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:04:51.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:04:51.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:04:51.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:04:51.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:04:51.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:04:51.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:04:51.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:04:51.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:04:51.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:04:51.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:04:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:04:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:04:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:04:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:04:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:04:51.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.326 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.326 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:51.326 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:51.326 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.863358984000001, 2024-09-12T22:04:51.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:04:51.326 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.326 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.326 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.327 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.327 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.327 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:04:51.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.327 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:51.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:51.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:51.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:04:51.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:04:51.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:04:51.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:04:51.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:04:51.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:04:51.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:04:51.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:04:51.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:04:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:04:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:04:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:04:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:04:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:04:51.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:04:51.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:04:51.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:04:51.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:04:51.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:04:51.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.332 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.333 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.333 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:51.333 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:51.333 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.863291292, 2024-09-12T22:04:51.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:04:51.333 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.333 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.333 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.334 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:04:51.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.334 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:51.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:51.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:51.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:04:51.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:04:51.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:04:51.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:04:51.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:04:51.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:04:51.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:04:51.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:04:51.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:04:51.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:51.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:04:51.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:04:51.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:04:51.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:04:51.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:04:51.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:04:51.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:04:51.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:04:51.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:04:51.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:04:51.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:04:51.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.340 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.340 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:51.340 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:51.340 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.863236229999998, 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:51.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:51.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:04:51.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:04:51.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:04:51.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:04:51.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:04:51.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:04:51.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:04:51.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:04:51.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:04:51.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:51.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:04:51.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:04:51.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:04:51.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:04:51.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:04:51.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:04:51.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:04:51.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:04:51.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:04:51.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:04:51.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.347 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.348 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.348 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:51.348 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:51.348 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.822588710000002, 2024-09-12T22:04:51.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:04:51.348 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.348 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.348 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.348 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.348 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.348 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:04:51.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:04:51.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:04:51.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:04:51.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:04:51.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:04:51.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:04:51.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:04:51.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:04:51.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:04:51.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:51.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:04:51.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:04:51.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:04:51.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:04:51.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:04:51.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:04:51.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:04:51.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:04:51.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:04:51.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:04:51.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.355 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:51.355 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:51.355 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.819974982000002, 2024-09-12T22:04:51.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:04:51.355 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.355 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.355 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:04:51.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.356 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:51.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:51.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:04:51.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:04:51.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:04:51.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:04:51.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:51.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:51.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:04:51.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:04:51.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:04:51.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:04:51.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:04:51.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:04:51.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:04:51.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:04:51.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:04:51.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:04:51.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:04:51.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:04:51.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:04:51.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:04:51.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:04:51.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.361 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.362 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117396 5.1 5:83c565df:::benchmark_data_smithi043_32659_object117395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:51.362 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:51.362 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.819833858999999, 2024-09-12T22:04:51.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.090595995999999998, 2024-09-12T22:04:51.362 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.362 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.362 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.362 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117396 2024-09-12T22:04:51.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.363 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:51.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:51.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454559+0000", 2024-09-12T22:04:51.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:04:51.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454629+0000", 2024-09-12T22:04:51.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0036000000000005e-05 2024-09-12T22:04:51.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454641+0000", 2024-09-12T22:04:51.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2232000000000001e-05 2024-09-12T22:04:51.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454649+0000", 2024-09-12T22:04:51.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-12T22:04:51.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454697+0000", 2024-09-12T22:04:51.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8028000000000002e-05 2024-09-12T22:04:51.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:51.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454702+0000", 2024-09-12T22:04:51.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:04:51.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540467+0000", 2024-09-12T22:04:51.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085764217000000004 2024-09-12T22:04:51.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540596+0000", 2024-09-12T22:04:51.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129787 2024-09-12T22:04:51.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540774+0000", 2024-09-12T22:04:51.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017746799999999999 2024-09-12T22:04:51.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544679+0000", 2024-09-12T22:04:51.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003904996 2024-09-12T22:04:51.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545009+0000", 2024-09-12T22:04:51.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033056600000000002 2024-09-12T22:04:51.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545067+0000", 2024-09-12T22:04:51.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7871999999999997e-05 2024-09-12T22:04:51.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545154+0000", 2024-09-12T22:04:51.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6701999999999998e-05 2024-09-12T22:04:51.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.369 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.369 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117398 5.6 5:6d151138:::benchmark_data_smithi043_32659_object117397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:51.369 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:51.370 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.798538688000001, 2024-09-12T22:04:51.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044999137000000002, 2024-09-12T22:04:51.370 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.370 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.370 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.370 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117398 2024-09-12T22:04:51.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.370 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:51.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:51.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475854+0000", 2024-09-12T22:04:51.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:04:51.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475914+0000", 2024-09-12T22:04:51.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9422999999999997e-05 2024-09-12T22:04:51.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475925+0000", 2024-09-12T22:04:51.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0881e-05 2024-09-12T22:04:51.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475930+0000", 2024-09-12T22:04:51.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:04:51.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475974+0000", 2024-09-12T22:04:51.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3810999999999998e-05 2024-09-12T22:04:51.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:51.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475981+0000", 2024-09-12T22:04:51.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1590000000000004e-06 2024-09-12T22:04:51.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504359+0000", 2024-09-12T22:04:51.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028377711 2024-09-12T22:04:51.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504526+0000", 2024-09-12T22:04:51.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167023 2024-09-12T22:04:51.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504661+0000", 2024-09-12T22:04:51.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135148 2024-09-12T22:04:51.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.506563+0000", 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901778 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520770+0000", 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014206724 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520803+0000", 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3083000000000002e-05 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520852+0000", 2024-09-12T22:04:51.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9543999999999999e-05 2024-09-12T22:04:51.376 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.376 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.376 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.376 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117399 5.3 5:ce33c2c7:::benchmark_data_smithi043_32659_object117398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:51.376 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:51.376 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.793769695000002, 2024-09-12T22:04:51.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038176902999999998, 2024-09-12T22:04:51.376 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.376 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.376 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.377 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.377 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.377 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.377 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117399 2024-09-12T22:04:51.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.377 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:51.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:51.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480624+0000", 2024-09-12T22:04:51.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.322e-06 2024-09-12T22:04:51.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480670+0000", 2024-09-12T22:04:51.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6365000000000001e-05 2024-09-12T22:04:51.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480682+0000", 2024-09-12T22:04:51.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:04:51.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480689+0000", 2024-09-12T22:04:51.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:04:51.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480731+0000", 2024-09-12T22:04:51.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:04:51.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:51.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480738+0000", 2024-09-12T22:04:51.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:04:51.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513753+0000", 2024-09-12T22:04:51.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.033015125999999999 2024-09-12T22:04:51.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513935+0000", 2024-09-12T22:04:51.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018219500000000001 2024-09-12T22:04:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.514170+0000", 2024-09-12T22:04:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000234694 2024-09-12T22:04:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518462+0000", 2024-09-12T22:04:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004291563 2024-09-12T22:04:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518655+0000", 2024-09-12T22:04:51.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019362700000000001 2024-09-12T22:04:51.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518710+0000", 2024-09-12T22:04:51.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:04:51.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518799+0000", 2024-09-12T22:04:51.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9000999999999997e-05 2024-09-12T22:04:51.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.382 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.383 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.383 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117407 5.c 5:3c61c1b7:::benchmark_data_smithi043_32659_object117406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:51.383 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:51.383 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.760564180999999, 2024-09-12T22:04:51.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042860548999999998, 2024-09-12T22:04:51.383 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.383 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.383 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.383 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117407 2024-09-12T22:04:51.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.384 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:51.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:51.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513829+0000", 2024-09-12T22:04:51.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-12T22:04:51.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513900+0000", 2024-09-12T22:04:51.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1482000000000004e-05 2024-09-12T22:04:51.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513909+0000", 2024-09-12T22:04:51.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8370000000000003e-06 2024-09-12T22:04:51.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513917+0000", 2024-09-12T22:04:51.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:04:51.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513967+0000", 2024-09-12T22:04:51.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.007e-05 2024-09-12T22:04:51.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:51.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513975+0000", 2024-09-12T22:04:51.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5639999999999999e-06 2024-09-12T22:04:51.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542411+0000", 2024-09-12T22:04:51.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028436032999999999 2024-09-12T22:04:51.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542539+0000", 2024-09-12T22:04:51.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012777900000000001 2024-09-12T22:04:51.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542687+0000", 2024-09-12T22:04:51.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148343 2024-09-12T22:04:51.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548120+0000", 2024-09-12T22:04:51.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054333580000000001 2024-09-12T22:04:51.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556549+0000", 2024-09-12T22:04:51.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084288309999999995 2024-09-12T22:04:51.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556596+0000", 2024-09-12T22:04:51.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6458999999999997e-05 2024-09-12T22:04:51.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556688+0000", 2024-09-12T22:04:51.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2676999999999994e-05 2024-09-12T22:04:51.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.389 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.389 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:51.389 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:51.390 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.274760885999999, 2024-09-12T22:04:51.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:04:51.390 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.390 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.390 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.390 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:04:51.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.390 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:51.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:51.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:04:51.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:04:51.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:04:51.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:04:51.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:04:51.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:04:51.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:04:51.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:04:51.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:04:51.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:04:51.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:04:51.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:04:51.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:04:51.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:04:51.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:04:51.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:04:51.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:04:51.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:04:51.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:04:51.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:04:51.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:04:51.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:04:51.395 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.395 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.395 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.395 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:51.395 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:51.395 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.274282398, 2024-09-12T22:04:51.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:04:51.396 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.396 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.396 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.396 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.396 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.396 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.396 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:04:51.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.396 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:51.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:51.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:51.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:04:51.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:04:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:04:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:04:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:04:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:04:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:04:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:04:51.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:04:51.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:04:51.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:04:51.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:04:51.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:04:51.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:04:51.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:04:51.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:04:51.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:04:51.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:04:51.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:04:51.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:04:51.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:04:51.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.401 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.401 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:51.401 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:51.401 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.271787098000001, 2024-09-12T22:04:51.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:04:51.402 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.402 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.402 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.402 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:04:51.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.402 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:51.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:04:51.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:04:51.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:04:51.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:04:51.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:04:51.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:04:51.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:04:51.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:04:51.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:04:51.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:04:51.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:04:51.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:04:51.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:04:51.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:04:51.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:04:51.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:04:51.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:04:51.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:04:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:04:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.270706306999999, 2024-09-12T22:04:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:04:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:51.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:51.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:04:51.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:04:51.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:04:51.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:04:51.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:04:51.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:04:51.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:04:51.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:04:51.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:04:51.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:04:51.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:04:51.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:04:51.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:04:51.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:04:51.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:04:51.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:04:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:04:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:04:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:04:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:04:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:04:51.413 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.413 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.413 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.413 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:51.413 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:51.413 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.269470745, 2024-09-12T22:04:51.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:04:51.413 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:51.413 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:51.413 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:51.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:51.414 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:51.414 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.414 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:04:51.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.414 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:51.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:51.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:51.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:51.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:51.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:04:51.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:04:51.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:04:51.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:04:51.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:51.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:04:51.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:04:51.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:51.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:04:51.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:04:51.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:51.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:04:51.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:04:51.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:51.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:04:51.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:04:51.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:51.419 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:51.419 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:51.420 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:51.419+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:51.420 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:51.447 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:04:51.520 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:51.519+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:51.574 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:51.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.574 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:160688 5.c e46/40 5:3babb79a:::benchmark_data_smithi043_32659_object160687:head v 46'10074, mlcod=46'10071)", 2024-09-12T22:04:51.574 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:51.569937+0000", 2024-09-12T22:04:51.575 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001607254, 2024-09-12T22:04:51.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0016295249999999999, 2024-09-12T22:04:51.575 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:51.575 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:51.575 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:51.575 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:51.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:51.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.569937+0000", 2024-09-12T22:04:51.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.569937+0000", 2024-09-12T22:04:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.569938+0000", 2024-09-12T22:04:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.569944+0000", 2024-09-12T22:04:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9950000000000002e-06 2024-09-12T22:04:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.569953+0000", 2024-09-12T22:04:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5720000000000003e-06 2024-09-12T22:04:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.569958+0000", 2024-09-12T22:04:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4920000000000001e-06 2024-09-12T22:04:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.570002+0000", 2024-09-12T22:04:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4320000000000003e-05 2024-09-12T22:04:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.570020+0000", 2024-09-12T22:04:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7790000000000001e-05 2024-09-12T22:04:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:160690 5.b 5.331e432b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:51.584 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:51.570839+0000", 2024-09-12T22:04:51.584 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00070556700000000004, 2024-09-12T22:04:51.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00079204799999999995, 2024-09-12T22:04:51.584 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:51.584 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 160690 2024-09-12T22:04:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.570839+0000", 2024-09-12T22:04:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.570839+0000", 2024-09-12T22:04:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:51.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.570841+0000", 2024-09-12T22:04:51.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.573e-06 2024-09-12T22:04:51.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.589 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.589 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:51.589 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.570893+0000", 2024-09-12T22:04:51.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2534000000000002e-05 2024-09-12T22:04:51.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.589 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:51.590 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.570904+0000", 2024-09-12T22:04:51.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0722e-05 2024-09-12T22:04:51.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.570910+0000", 2024-09-12T22:04:51.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:04:51.591 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.591 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:51.591 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.592 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:160691 5.d 5:bbfe428f:::benchmark_data_smithi043_32659_object160690:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:51.592 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:51.571126+0000", 2024-09-12T22:04:51.592 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00041823000000000001, 2024-09-12T22:04:51.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00056622499999999995, 2024-09-12T22:04:51.593 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:51.593 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:51.593 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:51.594 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:51.594 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:51.594 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.594 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 160691 2024-09-12T22:04:51.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.595 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:51.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:51.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571126+0000", 2024-09-12T22:04:51.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:51.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571126+0000", 2024-09-12T22:04:51.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.597 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:51.597 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571127+0000", 2024-09-12T22:04:51.597 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7300000000000005e-07 2024-09-12T22:04:51.597 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.597 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:51.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571199+0000", 2024-09-12T22:04:51.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2217000000000003e-05 2024-09-12T22:04:51.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:51.599 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571211+0000", 2024-09-12T22:04:51.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1412e-05 2024-09-12T22:04:51.599 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.599 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.599 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571218+0000", 2024-09-12T22:04:51.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:04:51.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.600 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.600 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:51.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571264+0000", 2024-09-12T22:04:51.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6631999999999997e-05 2024-09-12T22:04:51.601 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.601 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.601 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:51.601 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571378+0000", 2024-09-12T22:04:51.601 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114226 2024-09-12T22:04:51.602 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.602 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.602 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:51.602 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571506+0000", 2024-09-12T22:04:51.602 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000127539 2024-09-12T22:04:51.602 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.603 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:51.603 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.603 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.603 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.603 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:160692 5.a 5:5db96595:::benchmark_data_smithi043_32659_object160691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:51.603 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:51.571265+0000", 2024-09-12T22:04:51.604 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00027979300000000002, 2024-09-12T22:04:51.604 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00050206600000000001, 2024-09-12T22:04:51.604 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:51.604 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:51.604 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:51.605 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:51.605 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:51.605 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.605 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 160692 2024-09-12T22:04:51.605 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.605 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:51.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:51.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571265+0000", 2024-09-12T22:04:51.606 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.607 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:51.607 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571265+0000", 2024-09-12T22:04:51.607 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.608 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:51.608 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571265+0000", 2024-09-12T22:04:51.608 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7899999999999998e-07 2024-09-12T22:04:51.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.608 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:51.609 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571385+0000", 2024-09-12T22:04:51.609 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011966100000000001 2024-09-12T22:04:51.609 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.609 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.609 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:51.610 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571394+0000", 2024-09-12T22:04:51.610 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6610000000000006e-06 2024-09-12T22:04:51.610 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.610 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.610 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.610 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571411+0000", 2024-09-12T22:04:51.611 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7070000000000001e-05 2024-09-12T22:04:51.611 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.611 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.611 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:51.611 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571460+0000", 2024-09-12T22:04:51.611 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9539999999999997e-05 2024-09-12T22:04:51.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:51.612 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571623+0000", 2024-09-12T22:04:51.612 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016289200000000001 2024-09-12T22:04:51.613 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.613 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:51.613 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.613 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.613 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.613 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:160693 5.e 5:769927d4:::benchmark_data_smithi043_32659_object160692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:51.614 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:51.571426+0000", 2024-09-12T22:04:51.614 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000118322, 2024-09-12T22:04:51.614 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00041490100000000002, 2024-09-12T22:04:51.614 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:51.614 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:51.615 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:51.615 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:51.615 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:51.615 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.615 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 160693 2024-09-12T22:04:51.615 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.616 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:51.616 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.616 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:51.616 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571426+0000", 2024-09-12T22:04:51.616 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.617 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.617 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.617 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:51.617 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571426+0000", 2024-09-12T22:04:51.617 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.618 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:51.618 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571427+0000", 2024-09-12T22:04:51.618 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8500000000000001e-07 2024-09-12T22:04:51.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.619 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.619 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:51.619 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571525+0000", 2024-09-12T22:04:51.619 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8342000000000001e-05 2024-09-12T22:04:51.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.620 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:51.620 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571533+0000", 2024-09-12T22:04:51.620 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3820000000000004e-06 2024-09-12T22:04:51.620 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.621 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.621 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571541+0000", 2024-09-12T22:04:51.621 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2779999999999996e-06 2024-09-12T22:04:51.621 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.621 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.622 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:51.622 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571592+0000", 2024-09-12T22:04:51.622 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1560000000000001e-05 2024-09-12T22:04:51.622 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.622 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.622 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:51.623 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571720+0000", 2024-09-12T22:04:51.623 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000127677 2024-09-12T22:04:51.623 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.623 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:51.623 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.624 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:160696 5.4 5:20b46003:::benchmark_data_smithi043_32659_object160695:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:51.624 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:51.571685+0000", 2024-09-12T22:04:51.624 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9998598, 2024-09-12T22:04:51.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022626600000000001, 2024-09-12T22:04:51.625 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:51.625 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:51.625 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:04:51.626 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:51.626 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:51.626 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.626 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 160696 2024-09-12T22:04:51.627 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.627 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:51.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.627 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:51.627 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571685+0000", 2024-09-12T22:04:51.627 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:51.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571685+0000", 2024-09-12T22:04:51.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.629 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.629 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.629 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:51.629 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571686+0000", 2024-09-12T22:04:51.629 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.009e-06 2024-09-12T22:04:51.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:51.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571758+0000", 2024-09-12T22:04:51.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2465999999999994e-05 2024-09-12T22:04:51.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:51.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571768+0000", 2024-09-12T22:04:51.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0182e-05 2024-09-12T22:04:51.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571775+0000", 2024-09-12T22:04:51.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0199999999999997e-06 2024-09-12T22:04:51.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.633 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:51.633 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571841+0000", 2024-09-12T22:04:51.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5641000000000004e-05 2024-09-12T22:04:51.633 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.633 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:51.633 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.634 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:160689 5.c e46/40)", 2024-09-12T22:04:51.634 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:51.571827+0000", 2024-09-12T22:04:51.634 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9997177, 2024-09-12T22:04:51.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000139061, 2024-09-12T22:04:51.635 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:51.635 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:51.635 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:51.635 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:51.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:51.636 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571827+0000", 2024-09-12T22:04:51.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:51.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571827+0000", 2024-09-12T22:04:51.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.637 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:51.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571828+0000", 2024-09-12T22:04:51.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4799999999999997e-07 2024-09-12T22:04:51.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:51.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571833+0000", 2024-09-12T22:04:51.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:04:51.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:51.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571841+0000", 2024-09-12T22:04:51.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6979999999999998e-06 2024-09-12T22:04:51.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.640 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571847+0000", 2024-09-12T22:04:51.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9479999999999996e-06 2024-09-12T22:04:51.640 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.640 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:51.640 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.640 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:160694 5.5 e46/40 5:a5578728:::benchmark_data_smithi043_32659_object160693:head v 46'10024, mlcod=46'10022)", 2024-09-12T22:04:51.640 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:51.571879+0000", 2024-09-12T22:04:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9996653, 2024-09-12T22:04:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013213600000000001, 2024-09-12T22:04:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571879+0000", 2024-09-12T22:04:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571879+0000", 2024-09-12T22:04:51.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:51.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571880+0000", 2024-09-12T22:04:51.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8500000000000002e-07 2024-09-12T22:04:51.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:51.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571884+0000", 2024-09-12T22:04:51.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.783e-06 2024-09-12T22:04:51.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:51.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571891+0000", 2024-09-12T22:04:51.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9909999999999996e-06 2024-09-12T22:04:51.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571896+0000", 2024-09-12T22:04:51.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0599999999999998e-06 2024-09-12T22:04:51.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:51.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571953+0000", 2024-09-12T22:04:51.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7318000000000002e-05 2024-09-12T22:04:51.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:51.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571971+0000", 2024-09-12T22:04:51.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7643e-05 2024-09-12T22:04:51.644 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.644 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:51.644 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.644 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:160697 5.e 5.64f9fb0e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:51.644 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:51.571878+0000", 2024-09-12T22:04:51.644 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9996662, 2024-09-12T22:04:51.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018550500000000001, 2024-09-12T22:04:51.644 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:51.644 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:51.645 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:51.645 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:51.645 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:51.645 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.645 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 160697 2024-09-12T22:04:51.645 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.645 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:51.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.645 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:51.645 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571878+0000", 2024-09-12T22:04:51.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:51.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571878+0000", 2024-09-12T22:04:51.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:51.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571879+0000", 2024-09-12T22:04:51.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3900000000000004e-07 2024-09-12T22:04:51.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:51.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571924+0000", 2024-09-12T22:04:51.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4795000000000001e-05 2024-09-12T22:04:51.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.649 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:51.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571932+0000", 2024-09-12T22:04:51.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2409999999999995e-06 2024-09-12T22:04:51.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.649 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.649 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571939+0000", 2024-09-12T22:04:51.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2729999999999997e-06 2024-09-12T22:04:51.649 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.649 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:51.650 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.650 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.650 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:160680 5.9 5:9c6d869f:::benchmark_data_smithi043_32659_object160679:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:51.650 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:51.567132+0000", 2024-09-12T22:04:51.650 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0044120390000000004, 2024-09-12T22:04:51.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004985527, 2024-09-12T22:04:51.650 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:51.650 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:51.650 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:51.650 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:51.650 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:51.650 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.650 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 160680 2024-09-12T22:04:51.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.651 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:51.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.651 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:51.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567132+0000", 2024-09-12T22:04:51.651 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.651 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:51.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567132+0000", 2024-09-12T22:04:51.651 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.651 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:51.652 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567133+0000", 2024-09-12T22:04:51.652 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1699999999999998e-07 2024-09-12T22:04:51.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.652 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:51.652 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567162+0000", 2024-09-12T22:04:51.652 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8649e-05 2024-09-12T22:04:51.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.652 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:51.652 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567172+0000", 2024-09-12T22:04:51.652 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:04:51.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567177+0000", 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1120000000000004e-06 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567218+0000", 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0905999999999998e-05 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567348+0000", 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013055799999999999 2024-09-12T22:04:51.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.654 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:51.654 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567500+0000", 2024-09-12T22:04:51.654 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015159799999999999 2024-09-12T22:04:51.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.654 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:51.654 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.570418+0000", 2024-09-12T22:04:51.654 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0029182710000000001 2024-09-12T22:04:51.654 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.654 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:51.654 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:160681 5.b 5:db83b3ae:::benchmark_data_smithi043_32659_object160680:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:51.567241+0000", 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0043038490000000002, 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049528100000000002, 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 160681 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.655 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:51.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567241+0000", 2024-09-12T22:04:51.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.656 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:51.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567241+0000", 2024-09-12T22:04:51.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.656 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:51.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567242+0000", 2024-09-12T22:04:51.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.71e-07 2024-09-12T22:04:51.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:51.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567339+0000", 2024-09-12T22:04:51.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7581e-05 2024-09-12T22:04:51.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:51.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567346+0000", 2024-09-12T22:04:51.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-06 2024-09-12T22:04:51.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567350+0000", 2024-09-12T22:04:51.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4479999999999996e-06 2024-09-12T22:04:51.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:51.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567397+0000", 2024-09-12T22:04:51.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6829000000000002e-05 2024-09-12T22:04:51.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:51.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567530+0000", 2024-09-12T22:04:51.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013304899999999999 2024-09-12T22:04:51.658 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.658 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:51.658 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:160684 5.8 5:11991d66:::benchmark_data_smithi043_32659_object160683:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:51.567547+0000", 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0039969999999999997, 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047073610000000002, 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 160684 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:51.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567547+0000", 2024-09-12T22:04:51.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:51.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567547+0000", 2024-09-12T22:04:51.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:51.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567548+0000", 2024-09-12T22:04:51.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3499999999999996e-07 2024-09-12T22:04:51.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:51.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567599+0000", 2024-09-12T22:04:51.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0611e-05 2024-09-12T22:04:51.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:51.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567606+0000", 2024-09-12T22:04:51.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4950000000000002e-06 2024-09-12T22:04:51.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567620+0000", 2024-09-12T22:04:51.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3485999999999999e-05 2024-09-12T22:04:51.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:51.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.570012+0000", 2024-09-12T22:04:51.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023918839999999999 2024-09-12T22:04:51.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:51.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.570107+0000", 2024-09-12T22:04:51.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5693999999999996e-05 2024-09-12T22:04:51.662 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.662 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:51.662 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:160686 5.e 5:70f9281b:::benchmark_data_smithi043_32659_object160685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:51.567632+0000", 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0039129509999999996, 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004682004, 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 160686 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.663 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567632+0000", 2024-09-12T22:04:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567632+0000", 2024-09-12T22:04:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567632+0000", 2024-09-12T22:04:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4000000000000002e-07 2024-09-12T22:04:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567666+0000", 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3589e-05 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567673+0000", 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8019999999999992e-06 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567677+0000", 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0999999999999997e-06 2024-09-12T22:04:51.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:51.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567717+0000", 2024-09-12T22:04:51.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9827999999999999e-05 2024-09-12T22:04:51.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:51.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567831+0000", 2024-09-12T22:04:51.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000113294 2024-09-12T22:04:51.666 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.666 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:51.666 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.667 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:160687 5.8 5:1d4b0977:::benchmark_data_smithi043_32659_object160686:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:51.667 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:51.567687+0000", 2024-09-12T22:04:51.667 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0038570050000000002, 2024-09-12T22:04:51.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046908399999999999, 2024-09-12T22:04:51.667 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:51.667 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:51.667 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:51.667 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:51.667 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:51.667 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:51.667 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 160687 2024-09-12T22:04:51.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.667 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:51.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567687+0000", 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567687+0000", 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567688+0000", 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567719+0000", 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1052e-05 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567727+0000", 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5870000000000004e-06 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.567732+0000", 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5740000000000003e-06 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571813+0000", 2024-09-12T22:04:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040803489999999996 2024-09-12T22:04:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:51.571947+0000", 2024-09-12T22:04:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013408800000000001 2024-09-12T22:04:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 14 2024-09-12T22:04:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:51.672 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:51.672 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:51.671+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:51.772 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:51.771+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:51.873 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:51.872+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:51.876 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:51.876 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:51.876 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:51.890 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:51.974 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:51.973+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:52.051 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:52.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:52.052 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:52.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.052 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:52.052 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:52.052 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 47.421869246, 2024-09-12T22:04:52.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:52.052 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.052 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.052 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.052 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:52.052 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:52.053 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.053 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:52.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.053 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:52.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:52.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:52.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:52.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:52.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:52.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:52.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:52.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:52.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:52.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:52.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:52.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:52.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:52.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:52.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:52.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:52.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:52.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:52.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:52.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:52.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:52.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:52.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:52.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:52.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:52.060 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.060 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.060 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.061 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:52.061 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:52.061 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 47.416468305999999, 2024-09-12T22:04:52.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:52.061 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.061 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.061 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.061 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:52.061 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:52.061 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.061 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:52.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.062 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:52.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:52.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:52.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:52.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:52.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:52.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:52.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:52.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:52.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:52.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:52.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:52.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:52.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:52.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:52.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:52.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:52.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:52.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:52.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:52.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 47.415527038999997, 2024-09-12T22:04:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.068 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:52.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:52.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:52.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:52.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:52.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:52.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:52.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:52.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:52.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:52.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:52.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:52.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:52.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:52.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:52.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:52.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:52.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:52.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:52.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:52.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:52.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:52.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:52.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:52.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:52.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:52.072 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.073 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.073 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.073 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:52.073 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:52.073 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 47.414529119000001, 2024-09-12T22:04:52.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:52.073 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.073 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.073 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.073 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:52.073 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:52.074 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.074 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:52.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.074 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:52.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:52.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:52.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:52.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:52.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:52.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:52.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:52.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:52.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:52.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:52.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:52.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:52.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:52.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:52.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:52.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:52.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:52.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:52.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.050780420000001, 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.079 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:04:52.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.080 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:52.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:52.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:52.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:04:52.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:04:52.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:04:52.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:04:52.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:04:52.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:04:52.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:04:52.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:04:52.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:04:52.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:04:52.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:04:52.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:52.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:04:52.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:04:52.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:04:52.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:04:52.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:04:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:04:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:04:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:04:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:04:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:04:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.085 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.085 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.085 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:52.085 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.050147215000001, 2024-09-12T22:04:52.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:04:52.085 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.085 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.085 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.085 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:52.085 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:52.085 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.085 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:04:52.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.086 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:52.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:52.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:04:52.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:04:52.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:04:52.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:04:52.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:04:52.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:04:52.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:04:52.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:04:52.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:04:52.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:04:52.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:04:52.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:04:52.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:52.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:04:52.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:04:52.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:04:52.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:04:52.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:04:52.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:04:52.090 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.090 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.090 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.090 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.090 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:52.090 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.048327552, 2024-09-12T22:04:52.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:04:52.090 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.090 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.090 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.091 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:52.091 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:52.091 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.091 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:04:52.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.091 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:52.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:52.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:04:52.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:04:52.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:04:52.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:04:52.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:04:52.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:04:52.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:04:52.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:04:52.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:04:52.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:04:52.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:04:52.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:04:52.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:52.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:04:52.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:04:52.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:04:52.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:04:52.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:04:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:04:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.048159925, 2024-09-12T22:04:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:04:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.096 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.096 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.096 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:52.096 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:52.096 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.096 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:04:52.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.096 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:52.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:52.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:04:52.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:52.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:04:52.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:04:52.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:04:52.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:04:52.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:04:52.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:04:52.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:04:52.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:04:52.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:04:52.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:04:52.100 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.100 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.100 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.100 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:04:52.100 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:52.101 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.048019261, 2024-09-12T22:04:52.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:04:52.101 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.101 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.101 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.101 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:52.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:52.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.102 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:04:52.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:04:52.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.102 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:04:52.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:04:52.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:04:52.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:04:52.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:04:52.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:04:52.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:04:52.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:04:52.104 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.105 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.105 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.105 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.105 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:52.105 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.047793737999999, 2024-09-12T22:04:52.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:04:52.105 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.105 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.105 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.105 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:52.105 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:52.105 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.106 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:04:52.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.106 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:52.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:52.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:04:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:04:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:04:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:04:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:04:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:04:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:04:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:04:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:04:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:04:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:04:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:04:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.047674034, 2024-09-12T22:04:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:04:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:04:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:04:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:04:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:04:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:04:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:04:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:04:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:04:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:04:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:04:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:04:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:04:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:04:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.047082752, 2024-09-12T22:04:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:04:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:04:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:04:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:04:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:04:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:04:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:04:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:04:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:04:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:04:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:04:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:04:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:04:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:04:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:04:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.046859184000001, 2024-09-12T22:04:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:04:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:04:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:04:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:04:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:04:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:04:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:04:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:04:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:04:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:04:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:04:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:04:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:04:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:04:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:04:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:04:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.046767703, 2024-09-12T22:04:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:04:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:04:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:04:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:04:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:04:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:04:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:04:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:04:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:04:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:04:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:04:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:04:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:04:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:04:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:04:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:04:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:04:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:04:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:04:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:04:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.045978899, 2024-09-12T22:04:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:04:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:04:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:04:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:04:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:04:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:04:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:04:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:04:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:04:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:04:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:04:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:04:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.045714759000001, 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:04:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:04:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:04:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:04:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:04:52.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:04:52.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.138 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:04:52.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:04:52.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.138 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:04:52.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:04:52.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:04:52.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:04:52.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:04:52.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:04:52.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:52.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:04:52.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:04:52.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.140 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:04:52.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:04:52.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.140 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:04:52.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:04:52.140 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.140 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.140 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.141 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:04:52.141 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:52.141 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.045209784000001, 2024-09-12T22:04:52.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:04:52.141 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.141 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.141 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.141 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:52.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.142 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.142 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:52.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.142 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.142 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.142 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:04:52.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:04:52.142 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.142 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.142 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:04:52.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:04:52.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.143 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.143 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.143 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:04:52.143 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:04:52.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.143 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.143 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.143 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:04:52.143 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:04:52.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.143 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.143 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.143 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:04:52.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:04:52.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:04:52.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:04:52.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:04:52.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:04:52.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:04:52.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:04:52.145 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.145 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.145 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.145 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:04:52.145 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:52.145 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.044080356, 2024-09-12T22:04:52.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:04:52.145 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.145 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.146 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.146 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:52.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:52.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.148 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:04:52.148 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:04:52.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.148 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.148 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:04:52.148 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:04:52.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.148 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.148 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:04:52.148 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:04:52.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.149 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.149 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:04:52.149 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:04:52.149 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.149 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.149 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.149 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:04:52.149 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:04:52.149 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.149 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.149 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.149 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.149 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.149 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.150 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:52.150 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.043325914, 2024-09-12T22:04:52.150 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:04:52.150 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.150 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.150 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.150 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:52.150 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:52.150 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.150 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:04:52.150 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.150 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.150 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.150 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.151 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.152 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:04:52.152 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:04:52.152 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.152 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.152 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.152 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:04:52.152 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:04:52.152 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.152 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.152 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.152 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:04:52.152 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:04:52.153 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.153 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.153 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:04:52.153 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:04:52.153 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.153 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.153 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:04:52.153 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:04:52.153 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.153 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.153 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:52.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:04:52.154 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:04:52.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.154 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.154 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.154 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:04:52.154 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:04:52.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.154 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.154 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:52.154 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:04:52.154 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:04:52.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.154 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:04:52.155 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:52.156 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.042646811999999, 2024-09-12T22:04:52.156 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:04:52.156 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:52.156 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:52.156 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.156 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:52.156 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.156 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:52.156 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:52.156 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.156 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.156 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.156 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:52.156 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:52.157 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:52.157 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.157 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.157 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:52.157 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:04:52.157 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:04:52.157 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.157 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.157 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:52.157 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:04:52.157 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:04:52.157 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.157 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.157 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:52.158 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.159 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:52.160 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:52.161 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:52.160+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:52.161 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:52.194 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 58 16 162271 162255 174.829 157.75 0.00722632 0.00571744 2024-09-12T22:04:52.261 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:52.260+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:52.316 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:52.316 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:52.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.317 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:162584 5.9 e46/40 5:9095a00f:::benchmark_data_smithi043_32659_object162583:head v 46'10255, mlcod=46'10253)", 2024-09-12T22:04:52.317 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:52.314184+0000", 2024-09-12T22:04:52.317 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00066719499999999998, 2024-09-12T22:04:52.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00068481499999999997, 2024-09-12T22:04:52.317 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.317 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.317 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:52.317 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314184+0000", 2024-09-12T22:04:52.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314184+0000", 2024-09-12T22:04:52.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314185+0000", 2024-09-12T22:04:52.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:04:52.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314240+0000", 2024-09-12T22:04:52.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5676e-05 2024-09-12T22:04:52.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314250+0000", 2024-09-12T22:04:52.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2480000000000002e-06 2024-09-12T22:04:52.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314256+0000", 2024-09-12T22:04:52.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3040000000000001e-06 2024-09-12T22:04:52.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314295+0000", 2024-09-12T22:04:52.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8665999999999999e-05 2024-09-12T22:04:52.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314314+0000", 2024-09-12T22:04:52.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.963e-05 2024-09-12T22:04:52.321 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.321 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.321 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.322 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:162566 5.5 e46/40)", 2024-09-12T22:04:52.322 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:52.314276+0000", 2024-09-12T22:04:52.322 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00057541099999999996, 2024-09-12T22:04:52.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00062661200000000002, 2024-09-12T22:04:52.322 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.322 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.323 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:52.323 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314276+0000", 2024-09-12T22:04:52.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314276+0000", 2024-09-12T22:04:52.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314276+0000", 2024-09-12T22:04:52.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0400000000000002e-07 2024-09-12T22:04:52.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314279+0000", 2024-09-12T22:04:52.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1670000000000002e-06 2024-09-12T22:04:52.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314286+0000", 2024-09-12T22:04:52.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6690000000000006e-06 2024-09-12T22:04:52.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314291+0000", 2024-09-12T22:04:52.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0440000000000003e-06 2024-09-12T22:04:52.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.326 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:162566 5.5 5:aecabdd0:::benchmark_data_smithi043_32659_object162565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:52.308746+0000", 2024-09-12T22:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.006105315, 2024-09-12T22:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061905229999999999, 2024-09-12T22:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 162566 2024-09-12T22:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.308746+0000", 2024-09-12T22:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.308746+0000", 2024-09-12T22:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.308747+0000", 2024-09-12T22:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2589999999999999e-06 2024-09-12T22:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.308797+0000", 2024-09-12T22:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9880999999999999e-05 2024-09-12T22:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.308810+0000", 2024-09-12T22:04:52.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2663000000000001e-05 2024-09-12T22:04:52.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.308821+0000", 2024-09-12T22:04:52.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0628999999999999e-05 2024-09-12T22:04:52.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.308863+0000", 2024-09-12T22:04:52.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2215000000000002e-05 2024-09-12T22:04:52.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.309029+0000", 2024-09-12T22:04:52.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016647799999999999 2024-09-12T22:04:52.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.309160+0000", 2024-09-12T22:04:52.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130402 2024-09-12T22:04:52.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313781+0000", 2024-09-12T22:04:52.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046208990000000004 2024-09-12T22:04:52.334 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.334 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.334 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.334 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:162573 5.6 5:64adf1fe:::benchmark_data_smithi043_32659_object162572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:52.335 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:52.311178+0000", 2024-09-12T22:04:52.335 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0036732829999999998, 2024-09-12T22:04:52.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038033239999999999, 2024-09-12T22:04:52.335 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.335 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.335 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:52.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.336 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 162573 2024-09-12T22:04:52.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.336 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311178+0000", 2024-09-12T22:04:52.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311178+0000", 2024-09-12T22:04:52.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311180+0000", 2024-09-12T22:04:52.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.421e-06 2024-09-12T22:04:52.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311272+0000", 2024-09-12T22:04:52.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2231000000000005e-05 2024-09-12T22:04:52.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311284+0000", 2024-09-12T22:04:52.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1960999999999999e-05 2024-09-12T22:04:52.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311291+0000", 2024-09-12T22:04:52.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9489999999999999e-06 2024-09-12T22:04:52.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311340+0000", 2024-09-12T22:04:52.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9718000000000001e-05 2024-09-12T22:04:52.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311514+0000", 2024-09-12T22:04:52.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017331900000000001 2024-09-12T22:04:52.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311737+0000", 2024-09-12T22:04:52.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022363099999999999 2024-09-12T22:04:52.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.340 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.340 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:162574 5.7 5:e945d4f3:::benchmark_data_smithi043_32659_object162573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:52.340 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:52.311308+0000", 2024-09-12T22:04:52.340 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0035431130000000001, 2024-09-12T22:04:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037135200000000001, 2024-09-12T22:04:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 162574 2024-09-12T22:04:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311308+0000", 2024-09-12T22:04:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311308+0000", 2024-09-12T22:04:52.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311309+0000", 2024-09-12T22:04:52.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9299999999999998e-07 2024-09-12T22:04:52.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311342+0000", 2024-09-12T22:04:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3535999999999999e-05 2024-09-12T22:04:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311350+0000", 2024-09-12T22:04:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3540000000000002e-06 2024-09-12T22:04:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311355+0000", 2024-09-12T22:04:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2979999999999999e-06 2024-09-12T22:04:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311401+0000", 2024-09-12T22:04:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5840999999999997e-05 2024-09-12T22:04:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311646+0000", 2024-09-12T22:04:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000245345 2024-09-12T22:04:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311778+0000", 2024-09-12T22:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000132228 2024-09-12T22:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313914+0000", 2024-09-12T22:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021351260000000002 2024-09-12T22:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:162577 5.5 5:a037b2fa:::benchmark_data_smithi043_32659_object162576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:52.311436+0000", 2024-09-12T22:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0034156170000000001, 2024-09-12T22:04:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036457870000000002, 2024-09-12T22:04:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 162577 2024-09-12T22:04:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311436+0000", 2024-09-12T22:04:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311436+0000", 2024-09-12T22:04:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311436+0000", 2024-09-12T22:04:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6300000000000005e-07 2024-09-12T22:04:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311491+0000", 2024-09-12T22:04:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4626999999999997e-05 2024-09-12T22:04:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311499+0000", 2024-09-12T22:04:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6229999999999997e-06 2024-09-12T22:04:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311505+0000", 2024-09-12T22:04:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4520000000000002e-06 2024-09-12T22:04:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311622+0000", 2024-09-12T22:04:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117125 2024-09-12T22:04:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311777+0000", 2024-09-12T22:04:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015473900000000001 2024-09-12T22:04:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.311925+0000", 2024-09-12T22:04:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000147923 2024-09-12T22:04:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:162578 5.5 5:a4b80255:::benchmark_data_smithi043_32659_object162577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:52.312441+0000", 2024-09-12T22:04:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0024108269999999999, 2024-09-12T22:04:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026816869999999999, 2024-09-12T22:04:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 162578 2024-09-12T22:04:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.312441+0000", 2024-09-12T22:04:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.312441+0000", 2024-09-12T22:04:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.312441+0000", 2024-09-12T22:04:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7800000000000001e-07 2024-09-12T22:04:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.312494+0000", 2024-09-12T22:04:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.291e-05 2024-09-12T22:04:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.312503+0000", 2024-09-12T22:04:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4349999999999997e-06 2024-09-12T22:04:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.312507+0000", 2024-09-12T22:04:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8189999999999999e-06 2024-09-12T22:04:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313819+0000", 2024-09-12T22:04:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001311794 2024-09-12T22:04:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313946+0000", 2024-09-12T22:04:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126828 2024-09-12T22:04:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.314100+0000", 2024-09-12T22:04:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015363599999999999 2024-09-12T22:04:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:162579 5.c 5:38917a34:::benchmark_data_smithi043_32659_object162578:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:52.313383+0000", 2024-09-12T22:04:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0014679750000000001, 2024-09-12T22:04:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017794830000000001, 2024-09-12T22:04:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 162579 2024-09-12T22:04:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313383+0000", 2024-09-12T22:04:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313383+0000", 2024-09-12T22:04:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313384+0000", 2024-09-12T22:04:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9299999999999997e-07 2024-09-12T22:04:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313456+0000", 2024-09-12T22:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2186000000000003e-05 2024-09-12T22:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313463+0000", 2024-09-12T22:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0219999999999999e-06 2024-09-12T22:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313468+0000", 2024-09-12T22:04:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.408e-06 2024-09-12T22:04:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313512+0000", 2024-09-12T22:04:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4298999999999997e-05 2024-09-12T22:04:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313635+0000", 2024-09-12T22:04:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122889 2024-09-12T22:04:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313780+0000", 2024-09-12T22:04:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014499599999999999 2024-09-12T22:04:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:162581 5.2 5:4451fd9f:::benchmark_data_smithi043_32659_object162580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:52.313480+0000", 2024-09-12T22:04:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0013710739999999999, 2024-09-12T22:04:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017207430000000001, 2024-09-12T22:04:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 162581 2024-09-12T22:04:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313480+0000", 2024-09-12T22:04:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313480+0000", 2024-09-12T22:04:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313481+0000", 2024-09-12T22:04:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9800000000000004e-07 2024-09-12T22:04:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313560+0000", 2024-09-12T22:04:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9147999999999995e-05 2024-09-12T22:04:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313567+0000", 2024-09-12T22:04:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3509999999999996e-06 2024-09-12T22:04:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313574+0000", 2024-09-12T22:04:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9160000000000004e-06 2024-09-12T22:04:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313627+0000", 2024-09-12T22:04:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2793000000000001e-05 2024-09-12T22:04:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313730+0000", 2024-09-12T22:04:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102599 2024-09-12T22:04:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:162583 5.c 5.b8ad491c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:52.313595+0000", 2024-09-12T22:04:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001255969, 2024-09-12T22:04:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016378460000000001, 2024-09-12T22:04:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 162583 2024-09-12T22:04:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313595+0000", 2024-09-12T22:04:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313595+0000", 2024-09-12T22:04:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313596+0000", 2024-09-12T22:04:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3200000000000005e-07 2024-09-12T22:04:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313712+0000", 2024-09-12T22:04:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115506 2024-09-12T22:04:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313729+0000", 2024-09-12T22:04:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7297999999999999e-05 2024-09-12T22:04:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313740+0000", 2024-09-12T22:04:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1532000000000001e-05 2024-09-12T22:04:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:162585 5.c 5.5faa94dc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:52.313765+0000", 2024-09-12T22:04:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001086453, 2024-09-12T22:04:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015172689999999999, 2024-09-12T22:04:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 162585 2024-09-12T22:04:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313765+0000", 2024-09-12T22:04:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313765+0000", 2024-09-12T22:04:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313766+0000", 2024-09-12T22:04:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:04:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313806+0000", 2024-09-12T22:04:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0083000000000002e-05 2024-09-12T22:04:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313813+0000", 2024-09-12T22:04:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4599999999999997e-06 2024-09-12T22:04:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313830+0000", 2024-09-12T22:04:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6626999999999999e-05 2024-09-12T22:04:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:162586 5.c 5.eddaa7dc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T22:04:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:52.313854+0000", 2024-09-12T22:04:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00099722200000000008, 2024-09-12T22:04:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001481848, 2024-09-12T22:04:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 162586 2024-09-12T22:04:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313854+0000", 2024-09-12T22:04:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313854+0000", 2024-09-12T22:04:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313855+0000", 2024-09-12T22:04:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9999999999999997e-07 2024-09-12T22:04:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313883+0000", 2024-09-12T22:04:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8047000000000001e-05 2024-09-12T22:04:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313890+0000", 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.503e-06 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:52.313896+0000", 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8089999999999998e-06 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 12 2024-09-12T22:04:52.377 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:52.379 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:52.379 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:52.377+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:52.444 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-09-12T22:04:52.479 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:52.478+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:52.568 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:52.569 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:52.569 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:52.569 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:52.569 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:52.580 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:52.579+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:52.581 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:52.681 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:52.680+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:52.738 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.100689207999999, 2024-09-12T22:04:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.323383083, 2024-09-12T22:04:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:04:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:04:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:04:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:04:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:04:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:04:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:04:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:04:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:04:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:04:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:04:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:04:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:04:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:04:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:04:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:04:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:04:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:04:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.323203153000001, 2024-09-12T22:04:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:04:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:04:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:04:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:04:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:04:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:04:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:04:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:04:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:04:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:04:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:04:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:04:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:04:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:04:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.323136712, 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:04:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:04:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:04:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:04:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:04:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:04:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:04:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:04:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:04:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:04:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:04:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.323080268999998, 2024-09-12T22:04:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:04:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:04:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:04:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:04:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:04:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:04:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:04:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:04:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:04:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:04:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:04:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:04:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:04:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.323011809, 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:04:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:04:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:04:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:04:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:04:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:04:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:04:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:04:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:04:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:04:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:04:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:04:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:04:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:04:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:04:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.322954073999998, 2024-09-12T22:04:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:04:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:04:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:04:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:04:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:04:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:04:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:04:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:04:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:04:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:04:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:04:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:04:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:04:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:04:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:04:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:04:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:04:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.322886382, 2024-09-12T22:04:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:04:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:04:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:04:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:04:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:04:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:04:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:04:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:04:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:04:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:04:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:04:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:04:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:04:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:04:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.322831319999999, 2024-09-12T22:04:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:04:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:04:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:04:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:04:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:04:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:04:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:04:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:04:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:04:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:04:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.282183799999999, 2024-09-12T22:04:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:04:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:04:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:04:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:04:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:04:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:04:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:04:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:04:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:04:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:04:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:04:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:04:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:04:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:04:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.279570071999999, 2024-09-12T22:04:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:04:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:04:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:04:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:04:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:04:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:04:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:04:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:04:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:04:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:04:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:04:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:04:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:04:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:04:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:04:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:04:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:04:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:04:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:04:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:04:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:04:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:04:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117396 5.1 5:83c565df:::benchmark_data_smithi043_32659_object117395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.279428949, 2024-09-12T22:04:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.090595995999999998, 2024-09-12T22:04:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117396 2024-09-12T22:04:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:52.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:52.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454559+0000", 2024-09-12T22:04:52.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:04:52.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454629+0000", 2024-09-12T22:04:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0036000000000005e-05 2024-09-12T22:04:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454641+0000", 2024-09-12T22:04:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2232000000000001e-05 2024-09-12T22:04:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454649+0000", 2024-09-12T22:04:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-12T22:04:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454697+0000", 2024-09-12T22:04:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8028000000000002e-05 2024-09-12T22:04:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454702+0000", 2024-09-12T22:04:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:04:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540467+0000", 2024-09-12T22:04:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085764217000000004 2024-09-12T22:04:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540596+0000", 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129787 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540774+0000", 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017746799999999999 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544679+0000", 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003904996 2024-09-12T22:04:52.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545009+0000", 2024-09-12T22:04:52.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033056600000000002 2024-09-12T22:04:52.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545067+0000", 2024-09-12T22:04:52.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7871999999999997e-05 2024-09-12T22:04:52.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545154+0000", 2024-09-12T22:04:52.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6701999999999998e-05 2024-09-12T22:04:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117398 5.6 5:6d151138:::benchmark_data_smithi043_32659_object117397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.258133778000001, 2024-09-12T22:04:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044999137000000002, 2024-09-12T22:04:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.820 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.821 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.821 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117398 2024-09-12T22:04:52.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.821 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:52.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:52.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475854+0000", 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475914+0000", 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9422999999999997e-05 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475925+0000", 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0881e-05 2024-09-12T22:04:52.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475930+0000", 2024-09-12T22:04:52.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:04:52.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475974+0000", 2024-09-12T22:04:52.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3810999999999998e-05 2024-09-12T22:04:52.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:52.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475981+0000", 2024-09-12T22:04:52.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1590000000000004e-06 2024-09-12T22:04:52.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504359+0000", 2024-09-12T22:04:52.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028377711 2024-09-12T22:04:52.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504526+0000", 2024-09-12T22:04:52.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167023 2024-09-12T22:04:52.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504661+0000", 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135148 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.506563+0000", 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901778 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520770+0000", 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014206724 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520803+0000", 2024-09-12T22:04:52.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3083000000000002e-05 2024-09-12T22:04:52.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520852+0000", 2024-09-12T22:04:52.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9543999999999999e-05 2024-09-12T22:04:52.826 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.826 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.826 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.826 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117399 5.3 5:ce33c2c7:::benchmark_data_smithi043_32659_object117398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:52.826 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:52.826 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.253364784999999, 2024-09-12T22:04:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038176902999999998, 2024-09-12T22:04:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117399 2024-09-12T22:04:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:52.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480624+0000", 2024-09-12T22:04:52.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.322e-06 2024-09-12T22:04:52.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480670+0000", 2024-09-12T22:04:52.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6365000000000001e-05 2024-09-12T22:04:52.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480682+0000", 2024-09-12T22:04:52.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:04:52.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480689+0000", 2024-09-12T22:04:52.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:04:52.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480731+0000", 2024-09-12T22:04:52.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:04:52.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:52.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480738+0000", 2024-09-12T22:04:52.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:04:52.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513753+0000", 2024-09-12T22:04:52.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.033015125999999999 2024-09-12T22:04:52.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513935+0000", 2024-09-12T22:04:52.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018219500000000001 2024-09-12T22:04:52.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.514170+0000", 2024-09-12T22:04:52.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000234694 2024-09-12T22:04:52.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518462+0000", 2024-09-12T22:04:52.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004291563 2024-09-12T22:04:52.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518655+0000", 2024-09-12T22:04:52.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019362700000000001 2024-09-12T22:04:52.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518710+0000", 2024-09-12T22:04:52.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:04:52.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518799+0000", 2024-09-12T22:04:52.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9000999999999997e-05 2024-09-12T22:04:52.833 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.833 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.833 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.833 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117407 5.c 5:3c61c1b7:::benchmark_data_smithi043_32659_object117406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:52.833 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:52.833 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.220159271, 2024-09-12T22:04:52.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042860548999999998, 2024-09-12T22:04:52.833 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.833 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.833 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.833 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.833 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.834 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.834 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117407 2024-09-12T22:04:52.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.834 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:52.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:52.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513829+0000", 2024-09-12T22:04:52.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-12T22:04:52.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513900+0000", 2024-09-12T22:04:52.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1482000000000004e-05 2024-09-12T22:04:52.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513909+0000", 2024-09-12T22:04:52.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8370000000000003e-06 2024-09-12T22:04:52.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513917+0000", 2024-09-12T22:04:52.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:04:52.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513967+0000", 2024-09-12T22:04:52.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.007e-05 2024-09-12T22:04:52.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:52.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513975+0000", 2024-09-12T22:04:52.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5639999999999999e-06 2024-09-12T22:04:52.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542411+0000", 2024-09-12T22:04:52.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028436032999999999 2024-09-12T22:04:52.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542539+0000", 2024-09-12T22:04:52.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012777900000000001 2024-09-12T22:04:52.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542687+0000", 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148343 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548120+0000", 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054333580000000001 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556549+0000", 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084288309999999995 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556596+0000", 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6458999999999997e-05 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556688+0000", 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2676999999999994e-05 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:52.839 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.734355976, 2024-09-12T22:04:52.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:04:52.840 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.840 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.840 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.840 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:04:52.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.840 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:04:52.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:04:52.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:04:52.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:04:52.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:04:52.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:04:52.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:04:52.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:04:52.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:04:52.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:04:52.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:04:52.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:04:52.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:04:52.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:04:52.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:04:52.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:04:52.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:04:52.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:04:52.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:04:52.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:04:52.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.845 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.845 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.845 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:52.845 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.733877487999999, 2024-09-12T22:04:52.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:04:52.845 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:52.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:52.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:04:52.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:04:52.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:04:52.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:04:52.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:04:52.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:04:52.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:04:52.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:04:52.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:04:52.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:04:52.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:04:52.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:04:52.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:04:52.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:04:52.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:04:52.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:04:52.851 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.851 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.851 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.851 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.851 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:52.851 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.731382188, 2024-09-12T22:04:52.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:04:52.851 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.851 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.851 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.852 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.852 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:04:52.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.852 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:52.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:52.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:04:52.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:04:52.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:04:52.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:04:52.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:04:52.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:04:52.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:04:52.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:04:52.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:04:52.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:04:52.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:04:52.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:04:52.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:04:52.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:04:52.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:04:52.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:04:52.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:04:52.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:04:52.856 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.730301397, 2024-09-12T22:04:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:04:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.858 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:04:52.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.858 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:52.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:52.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:04:52.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:04:52.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:04:52.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:04:52.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:04:52.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:04:52.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:04:52.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:04:52.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:04:52.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:04:52.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:04:52.862 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.862 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.862 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.863 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:52.863 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:52.863 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.729065835, 2024-09-12T22:04:52.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:04:52.863 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:52.863 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:52.863 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:52.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:52.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:52.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:52.863 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:04:52.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.863 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:52.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:52.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:52.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:52.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:52.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:52.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:52.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:04:52.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:04:52.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:04:52.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:04:52.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:52.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:04:52.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:04:52.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:52.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:04:52.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:04:52.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:52.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:04:52.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:04:52.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:52.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:52.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:52.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:04:52.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:04:52.868 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.868 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.868 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.868 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:52.868 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:52.868 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:52.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:04:52.870 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:52.869+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:52.871 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:52.971 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:52.970+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:52.980 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:53.000 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:53.000 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:53.020 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:53.020 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:53.023 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:53.023 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:53.034 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:53.035 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:53.048 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:53.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~29s 2024-09-12T22:04:53.092 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:53.091+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:53.172 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:53.171+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:53.194 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 59 16 164794 164778 174.538 157.688 0.00430244 0.00572685 2024-09-12T22:04:53.212 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:53.212 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:53.226 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:53.273 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:53.271+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:53.374 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:53.373+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:53.431 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:53.431 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:53.447 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:53.490 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:53.489+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:53.575 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:53.574+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:53.598 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:53.598 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:53.611 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:53.677 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:53.675+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:53.777 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:53.776+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:53.802 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:53.802 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:53.814 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:53.878 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:53.877+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:53.963 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:53.963 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:53.977 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:54.018 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:54.017+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:54.079 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:54.078+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:54.142 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:54.142 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:54.155 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:54.181 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:54.179+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:54.194 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:2024-09-12T22:04:54.194288+0000 min lat: 0.00121163 max lat: 2.15917 avg lat: 0.0057386 2024-09-12T22:04:54.194 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T22:04:54.194 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 60 5 167235 167230 174.183 153.25 0.00814776 0.0057386 2024-09-12T22:04:54.279 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:54.279 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:54.281 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:54.280+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:54.288 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:54.382 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:54.381+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:54.398 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:54.399 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:54.408 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:54.458 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:04:54.482 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:54.481+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:54.518 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:54.518 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:54.527 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:54.584 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:54.583+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:54.673 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:54.673 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:54.681 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:54.725 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:54.724+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:54.785 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:54.784+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:54.792 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:54.792 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:54.801 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:54.886 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:54.885+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:54.911 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:54.911 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:54.920 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:55.004 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:55.003+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:55.024 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:04:55.070 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:55.071 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:55.080 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:55.121 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:55.120+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:55.132 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:55.149 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:55.149 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:55.167 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:55.167 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:55.170 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:55.170 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:55.189 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:55.188+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:55.194 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Total time run: 60.0082 2024-09-12T22:04:55.194 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Total writes made: 167235 2024-09-12T22:04:55.195 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Write size: 65536 2024-09-12T22:04:55.195 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Object size: 65536 2024-09-12T22:04:55.195 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Bandwidth (MB/sec): 174.179 2024-09-12T22:04:55.195 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Stddev Bandwidth: 60.5135 2024-09-12T22:04:55.195 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Max bandwidth (MB/sec): 393.312 2024-09-12T22:04:55.195 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Min bandwidth (MB/sec): 0 2024-09-12T22:04:55.195 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Average IOPS: 2786 2024-09-12T22:04:55.195 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Stddev IOPS: 968.216 2024-09-12T22:04:55.195 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Max IOPS: 6293 2024-09-12T22:04:55.195 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Min IOPS: 0 2024-09-12T22:04:55.195 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Average Latency(s): 0.00573867 2024-09-12T22:04:55.195 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Stddev Latency(s): 0.023058 2024-09-12T22:04:55.195 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Max latency(s): 2.15917 2024-09-12T22:04:55.195 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Min latency(s): 0.00121163 2024-09-12T22:04:55.200 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Cleaning up (deleting benchmark objects) 2024-09-12T22:04:55.251 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:55.251 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:55.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:55.251 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:55.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.251 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:55.251 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:55.251 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 50.621033959999998, 2024-09-12T22:04:55.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:55.252 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.252 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.252 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.252 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:55.252 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:55.252 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.252 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:55.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.252 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:55.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:55.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:55.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.254 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.254 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:55.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:55.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.254 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.254 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:55.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:55.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.254 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.254 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:55.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:55.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:55.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:55.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:55.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:55.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:55.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:55.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:55.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:55.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:55.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:55.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:55.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:55.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.257 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:55.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:55.257 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.257 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.257 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.257 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:55.258 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:55.258 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 50.615633019999997, 2024-09-12T22:04:55.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:55.258 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.258 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.258 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.258 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:55.258 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:55.258 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.258 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:55.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.259 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:55.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:55.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:55.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:55.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:55.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:55.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:55.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:55.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:55.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:55.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:55.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:55.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:55.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:55.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:55.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:55.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:55.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:55.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:55.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:55.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:55.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:55.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:55.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:55.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:55.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:55.264 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.264 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.264 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.264 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:55.264 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:55.264 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 50.614691753000002, 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:55.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:55.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:55.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:55.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:55.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:55.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:55.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:55.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:55.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:55.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:55.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:55.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:55.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:55.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:55.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:55.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:55.270 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.270 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.270 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.270 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:55.271 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:55.271 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 50.613693832999999, 2024-09-12T22:04:55.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:55.271 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.271 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.271 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.271 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:55.271 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:55.271 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.271 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:55.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.271 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:55.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:55.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:55.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:55.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:55.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:55.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:55.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:55.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:55.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:55.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:55.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:55.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:55.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:55.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:55.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:55.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:55.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:55.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:55.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:55.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:55.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:55.276 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.276 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.276 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.277 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:55.277 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:55.277 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.249945134000001, 2024-09-12T22:04:55.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:04:55.277 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.277 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.277 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.277 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:55.277 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:55.277 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.277 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:04:55.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.277 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:55.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:55.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:55.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:04:55.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:04:55.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:04:55.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:04:55.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:04:55.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:04:55.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:04:55.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:04:55.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:04:55.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:04:55.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:04:55.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:04:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:04:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:04:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:04:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:04:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:04:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:55.282 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:55.283 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.249311929000001, 2024-09-12T22:04:55.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:04:55.283 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.283 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.283 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.283 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:55.283 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:55.283 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.283 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:04:55.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.283 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:55.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:55.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:04:55.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:04:55.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:04:55.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:04:55.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:04:55.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:04:55.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:04:55.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:04:55.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:04:55.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:04:55.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:04:55.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:04:55.287 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.287 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.287 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.287 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:55.288 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:55.288 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.247492265999998, 2024-09-12T22:04:55.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:04:55.288 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.288 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.288 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.288 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:55.288 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:55.288 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.288 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:04:55.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.288 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:55.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:55.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:04:55.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:04:55.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:04:55.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:04:55.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:04:55.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:04:55.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:04:55.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:55.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:04:55.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:04:55.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:04:55.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:04:55.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:04:55.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:04:55.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.292 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.293 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:55.293 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:55.293 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.247324638999999, 2024-09-12T22:04:55.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:04:55.293 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.293 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.293 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:55.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:55.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.293 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:04:55.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.294 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:55.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:55.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:04:55.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:04:55.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:04:55.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:04:55.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:04:55.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:04:55.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:04:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:04:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:04:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:04:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:04:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:04:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.247183974999999, 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:55.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:55.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:04:55.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:04:55.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:04:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:04:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:04:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:04:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:04:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:04:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:04:55.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:04:55.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:04:55.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:04:55.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:04:55.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:04:55.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:04:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:04:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.246958452000001, 2024-09-12T22:04:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:04:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:55.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:04:55.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:04:55.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:04:55.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:04:55.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:04:55.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:04:55.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:04:55.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:04:55.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:04:55.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:04:55.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:04:55.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:04:55.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:55.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:04:55.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:04:55.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:04:55.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:04:55.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:04:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:04:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.246838747999998, 2024-09-12T22:04:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:04:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.308 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.308 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.308 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:55.308 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:55.308 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.308 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:04:55.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.308 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:55.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:55.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:04:55.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:04:55.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:04:55.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:04:55.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:04:55.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:04:55.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:04:55.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:55.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:04:55.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:04:55.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:04:55.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:04:55.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:55.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:04:55.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:04:55.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:04:55.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:04:55.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:04:55.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:04:55.313 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.313 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.313 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.313 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:04:55.313 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:55.313 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.246247466, 2024-09-12T22:04:55.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:04:55.313 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.313 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.313 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:55.313 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:04:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:04:55.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:04:55.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:04:55.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:04:55.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:04:55.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:04:55.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:04:55.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:04:55.317 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.317 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.317 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.317 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:04:55.317 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:55.317 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.246023898000001, 2024-09-12T22:04:55.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:04:55.317 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.317 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.317 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.317 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:55.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:55.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:55.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:04:55.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:04:55.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:04:55.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:04:55.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:04:55.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:04:55.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:04:55.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:04:55.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:04:55.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:04:55.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:04:55.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:04:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:04:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:04:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:04:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:55.321 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.245932416999999, 2024-09-12T22:04:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:04:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:04:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:55.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:55.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:04:55.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:04:55.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:04:55.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:04:55.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:04:55.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:04:55.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:04:55.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:04:55.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:04:55.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:04:55.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:04:55.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:04:55.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:55.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:04:55.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:04:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:04:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:04:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:04:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:04:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.245143613, 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:55.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:55.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:04:55.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:04:55.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:04:55.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:04:55.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:04:55.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:04:55.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:04:55.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:04:55.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.332 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:55.332 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:55.332 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.244879473000001, 2024-09-12T22:04:55.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:04:55.332 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.332 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.332 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.332 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:55.332 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:55.332 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.332 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:04:55.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.332 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:55.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:55.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:04:55.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:04:55.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:04:55.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:04:55.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:04:55.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:04:55.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:04:55.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:55.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:04:55.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.337 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:04:55.337 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:55.337 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.244374497999999, 2024-09-12T22:04:55.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:04:55.337 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.337 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.337 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.337 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:55.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:55.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:04:55.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:04:55.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:04:55.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:04:55.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:04:55.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:04:55.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:04:55.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:04:55.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:04:55.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:04:55.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:04:55.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:04:55.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:04:55.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:04:55.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:04:55.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:04:55.341 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.341 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.341 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.341 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:04:55.341 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:55.341 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.24324507, 2024-09-12T22:04:55.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:04:55.341 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.341 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.341 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.342 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:55.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:55.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:55.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:04:55.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:04:55.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:04:55.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:04:55.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:04:55.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:04:55.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:04:55.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:04:55.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:04:55.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:04:55.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:04:55.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:55.345 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.242490627999999, 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:55.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:04:55.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:04:55.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:04:55.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:04:55.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:04:55.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:04:55.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:04:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:04:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:04:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:04:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:04:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:04:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 16.241811525999999, 2024-09-12T22:04:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:04:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:04:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:04:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:04:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:04:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:55.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:04:55.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:04:55.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:55.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:04:55.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:04:55.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:55.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:55.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:55.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:04:55.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:04:55.355 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.355 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.356 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.356 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:55.356 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:55.356 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:55.357 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:55.356+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:55.358 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:55.444 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-09-12T22:04:55.459 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:55.456+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:55.505 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:55.505 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:55.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.505 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:168096 5.2 5:43df4db9:::benchmark_data_smithi043_32659_object858:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:55.505 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:55.501865+0000", 2024-09-12T22:04:55.505 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0021394650000000001, 2024-09-12T22:04:55.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021629140000000002, 2024-09-12T22:04:55.505 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.505 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.505 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:55.506 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.506 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.506 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.506 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 168096 2024-09-12T22:04:55.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.506 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.501865+0000", 2024-09-12T22:04:55.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.501865+0000", 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.501866+0000", 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9800000000000002e-07 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.501870+0000", 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8080000000000004e-06 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.501880+0000", 2024-09-12T22:04:55.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9110000000000005e-06 2024-09-12T22:04:55.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.501889+0000", 2024-09-12T22:04:55.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5019999999999992e-06 2024-09-12T22:04:55.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.501944+0000", 2024-09-12T22:04:55.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5476999999999998e-05 2024-09-12T22:04:55.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502119+0000", 2024-09-12T22:04:55.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017472899999999999 2024-09-12T22:04:55.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.504041+0000", 2024-09-12T22:04:55.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001921472 2024-09-12T22:04:55.509 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.509 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.509 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.509 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:168100 5.3 5:c798b16b:::benchmark_data_smithi043_32659_object862:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:55.509 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:55.502387+0000", 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001617027, 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017100730000000001, 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 168100 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502387+0000", 2024-09-12T22:04:55.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502387+0000", 2024-09-12T22:04:55.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502388+0000", 2024-09-12T22:04:55.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1999999999999998e-07 2024-09-12T22:04:55.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502392+0000", 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0450000000000002e-06 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502401+0000", 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8340000000000005e-06 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502408+0000", 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7009999999999999e-06 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502452+0000", 2024-09-12T22:04:55.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4753000000000003e-05 2024-09-12T22:04:55.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502594+0000", 2024-09-12T22:04:55.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014132899999999999 2024-09-12T22:04:55.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502698+0000", 2024-09-12T22:04:55.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000104442 2024-09-12T22:04:55.513 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.513 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.514 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:168103 5.5 5:aca1e742:::benchmark_data_smithi043_32659_object865:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:55.514 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:55.502871+0000", 2024-09-12T22:04:55.514 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001133621, 2024-09-12T22:04:55.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001272387, 2024-09-12T22:04:55.514 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.514 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.514 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:55.514 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.514 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.514 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.514 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 168103 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502871+0000", 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502871+0000", 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502871+0000", 2024-09-12T22:04:55.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9999999999999996e-07 2024-09-12T22:04:55.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502875+0000", 2024-09-12T22:04:55.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9210000000000002e-06 2024-09-12T22:04:55.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502883+0000", 2024-09-12T22:04:55.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0649999999999999e-06 2024-09-12T22:04:55.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502891+0000", 2024-09-12T22:04:55.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.994e-06 2024-09-12T22:04:55.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.502935+0000", 2024-09-12T22:04:55.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3990999999999999e-05 2024-09-12T22:04:55.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503097+0000", 2024-09-12T22:04:55.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161137 2024-09-12T22:04:55.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503220+0000", 2024-09-12T22:04:55.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012380400000000001 2024-09-12T22:04:55.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.518 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.518 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:168099 5.f e48/40 5:f532f38e:::benchmark_data_smithi043_32659_object861:head v 48'10528, mlcod=48'10525)", 2024-09-12T22:04:55.518 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:55.503676+0000", 2024-09-12T22:04:55.518 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00032792800000000001, 2024-09-12T22:04:55.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00051149300000000002, 2024-09-12T22:04:55.518 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.519 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.519 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:55.519 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503676+0000", 2024-09-12T22:04:55.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503676+0000", 2024-09-12T22:04:55.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503677+0000", 2024-09-12T22:04:55.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2300000000000002e-07 2024-09-12T22:04:55.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503683+0000", 2024-09-12T22:04:55.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0630000000000002e-06 2024-09-12T22:04:55.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503689+0000", 2024-09-12T22:04:55.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7889999999999997e-06 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503694+0000", 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3989999999999997e-06 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503746+0000", 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1656000000000001e-05 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503766+0000", 2024-09-12T22:04:55.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0049999999999999e-05 2024-09-12T22:04:55.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.522 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.522 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:168102 5.d e48/40 5:bc23953d:::benchmark_data_smithi043_32659_object864:head v 48'10416, mlcod=48'10414)", 2024-09-12T22:04:55.522 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:55.503703+0000", 2024-09-12T22:04:55.522 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00030139499999999998, 2024-09-12T22:04:55.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00051873800000000003, 2024-09-12T22:04:55.522 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.522 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.522 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:55.522 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503703+0000", 2024-09-12T22:04:55.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503703+0000", 2024-09-12T22:04:55.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503703+0000", 2024-09-12T22:04:55.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4900000000000002e-07 2024-09-12T22:04:55.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503706+0000", 2024-09-12T22:04:55.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4609999999999998e-06 2024-09-12T22:04:55.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503723+0000", 2024-09-12T22:04:55.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7442999999999999e-05 2024-09-12T22:04:55.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503728+0000", 2024-09-12T22:04:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5430000000000004e-06 2024-09-12T22:04:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503776+0000", 2024-09-12T22:04:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7982999999999998e-05 2024-09-12T22:04:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.503793+0000", 2024-09-12T22:04:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7958e-05 2024-09-12T22:04:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.526 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:168105 5.2 5.c7b27fe2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:55.526 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:55.504188+0000", 2024-09-12T22:04:55.526 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9998159, 2024-09-12T22:04:55.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4487000000000006e-05, 2024-09-12T22:04:55.526 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.526 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.526 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:55.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.526 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 168105 2024-09-12T22:04:55.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.527 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.504188+0000", 2024-09-12T22:04:55.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.504188+0000", 2024-09-12T22:04:55.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.504189+0000", 2024-09-12T22:04:55.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4300000000000002e-07 2024-09-12T22:04:55.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.504193+0000", 2024-09-12T22:04:55.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3200000000000001e-06 2024-09-12T22:04:55.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.504204+0000", 2024-09-12T22:04:55.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1097000000000001e-05 2024-09-12T22:04:55.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.504212+0000", 2024-09-12T22:04:55.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:04:55.529 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.529 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.529 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.529 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:168107 5.1 5.9d826641 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:55.529 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:55.504240+0000", 2024-09-12T22:04:55.529 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9997644, 2024-09-12T22:04:55.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5304999999999998e-05, 2024-09-12T22:04:55.529 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.529 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.530 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:55.530 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.530 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.530 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.530 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 168107 2024-09-12T22:04:55.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.530 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.504240+0000", 2024-09-12T22:04:55.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.504240+0000", 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.504240+0000", 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.37e-07 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.504243+0000", 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5639999999999999e-06 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.504250+0000", 2024-09-12T22:04:55.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6839999999999999e-06 2024-09-12T22:04:55.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:55.504255+0000", 2024-09-12T22:04:55.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-12T22:04:55.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.532 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.532 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:55.532 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 7 2024-09-12T22:04:55.532 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:55.534 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:55.578 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:55.577+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:55.659 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:55.657+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:55.681 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:55.681 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:55.681 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:55.682 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:55.682 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:55.695 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:55.779 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:55.778+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:55.861 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:55.859+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:55.885 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.248614934999999, 2024-09-12T22:04:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.47130881, 2024-09-12T22:04:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:04:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:04:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:04:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:04:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:04:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:04:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:04:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:04:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:04:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:04:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:04:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:04:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:04:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:04:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:04:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:04:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:04:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:04:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.471128879999998, 2024-09-12T22:04:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:04:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.899 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:04:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:04:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:04:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:04:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:04:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:04:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:04:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:04:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:04:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:04:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:04:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:04:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:04:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:04:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:04:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:04:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:04:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.471062439000001, 2024-09-12T22:04:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:04:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:04:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:04:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:04:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:04:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:04:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:04:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:04:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:04:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:04:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:04:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:04:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.471005995999999, 2024-09-12T22:04:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:04:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:04:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:04:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:04:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:04:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:04:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:04:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:04:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:04:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:04:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:04:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:04:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:04:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:04:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:04:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:04:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:04:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:04:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:04:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:04:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:04:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:04:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:04:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:04:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:04:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:04:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.470937536000001, 2024-09-12T22:04:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:04:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:04:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:04:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:04:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:04:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:04:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:04:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:04:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:04:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:04:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:04:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:04:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:04:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:04:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:04:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:04:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:04:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:04:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:04:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:04:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:04:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:04:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.470879800999999, 2024-09-12T22:04:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:04:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:04:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:04:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:04:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:04:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:04:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:04:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:04:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:04:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:04:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:04:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:04:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:04:55.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:04:55.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:04:55.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:04:55.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:04:55.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:04:55.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:04:55.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:04:55.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:04:55.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:04:55.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:04:55.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:55.929 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.470812109000001, 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:55.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:55.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:04:55.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:04:55.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:04:55.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:04:55.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:04:55.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:04:55.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:04:55.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:04:55.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:04:55.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:04:55.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:04:55.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:04:55.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:04:55.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:04:55.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:04:55.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:04:55.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:04:55.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:04:55.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:04:55.935 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.935 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.936 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:55.936 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:55.936 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.470757046999999, 2024-09-12T22:04:55.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:04:55.936 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.936 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.936 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.936 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.936 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.936 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.936 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:04:55.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.937 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:55.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:55.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:55.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:04:55.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:04:55.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:04:55.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:04:55.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:04:55.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:04:55.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:04:55.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:04:55.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:04:55.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:04:55.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:04:55.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:04:55.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:04:55.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:04:55.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:04:55.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:04:55.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:04:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:04:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:04:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:04:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.430109526999999, 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:55.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:04:55.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:04:55.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:04:55.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:04:55.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:04:55.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:04:55.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:04:55.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:04:55.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:04:55.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:04:55.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:04:55.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:04:55.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:04:55.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:04:55.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:04:55.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:04:55.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:04:55.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:04:55.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:04:55.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:04:55.948 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.948 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.949 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.949 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:55.949 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:55.949 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.427495798999999, 2024-09-12T22:04:55.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:04:55.949 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.949 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.949 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.949 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.949 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.949 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.949 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:04:55.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.950 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:55.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:55.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:04:55.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:04:55.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:04:55.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:04:55.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:04:55.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:04:55.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:04:55.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:04:55.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:04:55.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:04:55.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:55.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:55.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:04:55.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:04:55.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:04:55.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:04:55.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:04:55.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:04:55.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:04:55.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:04:55.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:04:55.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:04:55.955 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.955 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.955 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.955 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117396 5.1 5:83c565df:::benchmark_data_smithi043_32659_object117395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:55.955 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:55.955 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.427354676, 2024-09-12T22:04:55.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.090595995999999998, 2024-09-12T22:04:55.956 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.956 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.956 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.956 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117396 2024-09-12T22:04:55.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.956 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:55.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:55.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454559+0000", 2024-09-12T22:04:55.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:04:55.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454629+0000", 2024-09-12T22:04:55.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0036000000000005e-05 2024-09-12T22:04:55.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454641+0000", 2024-09-12T22:04:55.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2232000000000001e-05 2024-09-12T22:04:55.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454649+0000", 2024-09-12T22:04:55.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-12T22:04:55.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454697+0000", 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8028000000000002e-05 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454702+0000", 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540467+0000", 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085764217000000004 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540596+0000", 2024-09-12T22:04:55.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129787 2024-09-12T22:04:55.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540774+0000", 2024-09-12T22:04:55.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017746799999999999 2024-09-12T22:04:55.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544679+0000", 2024-09-12T22:04:55.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003904996 2024-09-12T22:04:55.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545009+0000", 2024-09-12T22:04:55.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033056600000000002 2024-09-12T22:04:55.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545067+0000", 2024-09-12T22:04:55.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7871999999999997e-05 2024-09-12T22:04:55.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545154+0000", 2024-09-12T22:04:55.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6701999999999998e-05 2024-09-12T22:04:55.961 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.962 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.962 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.962 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117398 5.6 5:6d151138:::benchmark_data_smithi043_32659_object117397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:55.962 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:55.962 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.406059505000002, 2024-09-12T22:04:55.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044999137000000002, 2024-09-12T22:04:55.962 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.962 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.962 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.962 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.962 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.962 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.963 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117398 2024-09-12T22:04:55.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.963 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:55.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:55.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475854+0000", 2024-09-12T22:04:55.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:04:55.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475914+0000", 2024-09-12T22:04:55.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9422999999999997e-05 2024-09-12T22:04:55.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475925+0000", 2024-09-12T22:04:55.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0881e-05 2024-09-12T22:04:55.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475930+0000", 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475974+0000", 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3810999999999998e-05 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475981+0000", 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1590000000000004e-06 2024-09-12T22:04:55.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504359+0000", 2024-09-12T22:04:55.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028377711 2024-09-12T22:04:55.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504526+0000", 2024-09-12T22:04:55.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167023 2024-09-12T22:04:55.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504661+0000", 2024-09-12T22:04:55.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135148 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.506563+0000", 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901778 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520770+0000", 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014206724 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520803+0000", 2024-09-12T22:04:55.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3083000000000002e-05 2024-09-12T22:04:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520852+0000", 2024-09-12T22:04:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9543999999999999e-05 2024-09-12T22:04:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117399 5.3 5:ce33c2c7:::benchmark_data_smithi043_32659_object117398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.401290511999999, 2024-09-12T22:04:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038176902999999998, 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117399 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:55.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480624+0000", 2024-09-12T22:04:55.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.322e-06 2024-09-12T22:04:55.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480670+0000", 2024-09-12T22:04:55.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6365000000000001e-05 2024-09-12T22:04:55.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480682+0000", 2024-09-12T22:04:55.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:04:55.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480689+0000", 2024-09-12T22:04:55.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:04:55.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480731+0000", 2024-09-12T22:04:55.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:04:55.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:55.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480738+0000", 2024-09-12T22:04:55.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:04:55.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513753+0000", 2024-09-12T22:04:55.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.033015125999999999 2024-09-12T22:04:55.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513935+0000", 2024-09-12T22:04:55.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018219500000000001 2024-09-12T22:04:55.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.514170+0000", 2024-09-12T22:04:55.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000234694 2024-09-12T22:04:55.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518462+0000", 2024-09-12T22:04:55.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004291563 2024-09-12T22:04:55.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518655+0000", 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019362700000000001 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518710+0000", 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518799+0000", 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9000999999999997e-05 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.974 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117407 5.c 5:3c61c1b7:::benchmark_data_smithi043_32659_object117406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.368084998, 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042860548999999998, 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117407 2024-09-12T22:04:55.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.976 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:55.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:55.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513829+0000", 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513900+0000", 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1482000000000004e-05 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513909+0000", 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8370000000000003e-06 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513917+0000", 2024-09-12T22:04:55.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:04:55.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513967+0000", 2024-09-12T22:04:55.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.007e-05 2024-09-12T22:04:55.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:55.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513975+0000", 2024-09-12T22:04:55.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5639999999999999e-06 2024-09-12T22:04:55.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542411+0000", 2024-09-12T22:04:55.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028436032999999999 2024-09-12T22:04:55.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542539+0000", 2024-09-12T22:04:55.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012777900000000001 2024-09-12T22:04:55.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542687+0000", 2024-09-12T22:04:55.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148343 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548120+0000", 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054333580000000001 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556549+0000", 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084288309999999995 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556596+0000", 2024-09-12T22:04:55.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6458999999999997e-05 2024-09-12T22:04:55.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556688+0000", 2024-09-12T22:04:55.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2676999999999994e-05 2024-09-12T22:04:55.981 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.981 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.981 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.981 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:55.981 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:55.981 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.882281703, 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:04:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:04:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:04:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:04:55.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:04:55.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:04:55.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:04:55.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:04:55.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:04:55.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:04:55.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:04:55.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:04:55.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:04:55.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:04:55.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:04:55.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:04:55.987 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.987 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.987 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.987 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:55.987 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:55.987 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.881803215000001, 2024-09-12T22:04:55.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:04:55.987 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.987 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.987 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.988 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.988 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.988 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.988 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:04:55.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.988 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:55.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:04:55.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:04:55.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:04:55.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:04:55.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:04:55.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:04:55.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:04:55.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:04:55.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:04:55.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:04:55.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:04:55.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:04:55.992 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.992 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.879307914999998, 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:04:55.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:04:55.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:04:55.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:55.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:04:55.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:04:55.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:55.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:04:55.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:04:55.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:55.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:55.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:04:55.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:04:55.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:55.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:04:55.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:04:55.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:55.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:04:55.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:04:55.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:55.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:04:55.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:04:55.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:55.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:04:55.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:04:55.998 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.998 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:55.998 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:55.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.998 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:55.999 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:55.999 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.878227123999999, 2024-09-12T22:04:55.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:04:55.999 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:55.999 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:55.999 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:55.999 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:55.999 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:55.999 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:55.999 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:04:55.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:55.999 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:55.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:55.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:56.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:56.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:56.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:56.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:56.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:56.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:04:56.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:56.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:04:56.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:04:56.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:56.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:04:56.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:04:56.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:04:56.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:04:56.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:04:56.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:56.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:04:56.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:04:56.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:56.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:04:56.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:04:56.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:56.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:04:56.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:04:56.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:56.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:04:56.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:04:56.004 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.004 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:56.004 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.004 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:56.004 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:56.004 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.876991562000001, 2024-09-12T22:04:56.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:56.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:56.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:56.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:04:56.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:56.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:56.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:04:56.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:04:56.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:56.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:04:56.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:04:56.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:56.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:04:56.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:04:56.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:56.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:04:56.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:04:56.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:04:56.010 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.010 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:56.010 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.010 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.010 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:56.010 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:56.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:56.012 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:56.010+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:56.112 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:56.111+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:56.174 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:56.174 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:56.174 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.174 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:170039 5.8 5:1124dc97:::benchmark_data_smithi043_32659_object2801:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.174 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.166913+0000", 2024-09-12T22:04:56.174 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0035598489999999999, 2024-09-12T22:04:56.174 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035833010000000001, 2024-09-12T22:04:56.174 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.174 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.175 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:56.175 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.175 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.175 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.175 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 170039 2024-09-12T22:04:56.175 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.175 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.175 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.175 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.175 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.166913+0000", 2024-09-12T22:04:56.175 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.176 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.176 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.176 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.166913+0000", 2024-09-12T22:04:56.176 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.176 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.176 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.176 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.166914+0000", 2024-09-12T22:04:56.176 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:04:56.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.177 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.177 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.166917+0000", 2024-09-12T22:04:56.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6629999999999999e-06 2024-09-12T22:04:56.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.177 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.177 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.166928+0000", 2024-09-12T22:04:56.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0365e-05 2024-09-12T22:04:56.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.166933+0000", 2024-09-12T22:04:56.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0100000000000003e-06 2024-09-12T22:04:56.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167033+0000", 2024-09-12T22:04:56.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000100257 2024-09-12T22:04:56.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167234+0000", 2024-09-12T22:04:56.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020103800000000001 2024-09-12T22:04:56.179 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.179 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.179 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.179 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:170037 5.5 e48/40 5:a2bd3493:::benchmark_data_smithi043_32659_object2799:head v 48'10632, mlcod=48'10628)", 2024-09-12T22:04:56.179 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.167138+0000", 2024-09-12T22:04:56.179 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0033351909999999999, 2024-09-12T22:04:56.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034302400000000002, 2024-09-12T22:04:56.180 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.180 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.180 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:56.180 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.180 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.180 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.180 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167138+0000", 2024-09-12T22:04:56.180 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.180 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.180 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.180 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167138+0000", 2024-09-12T22:04:56.180 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167138+0000", 2024-09-12T22:04:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2499999999999995e-07 2024-09-12T22:04:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167143+0000", 2024-09-12T22:04:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8790000000000002e-06 2024-09-12T22:04:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167151+0000", 2024-09-12T22:04:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6520000000000006e-06 2024-09-12T22:04:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167156+0000", 2024-09-12T22:04:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4140000000000002e-06 2024-09-12T22:04:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167196+0000", 2024-09-12T22:04:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0398999999999997e-05 2024-09-12T22:04:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167215+0000", 2024-09-12T22:04:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8688000000000001e-05 2024-09-12T22:04:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:170042 5.f 5:f56dc908:::benchmark_data_smithi043_32659_object2804:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.167282+0000", 2024-09-12T22:04:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.003190315, 2024-09-12T22:04:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033421739999999998, 2024-09-12T22:04:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 170042 2024-09-12T22:04:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167282+0000", 2024-09-12T22:04:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167282+0000", 2024-09-12T22:04:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167283+0000", 2024-09-12T22:04:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8599999999999998e-07 2024-09-12T22:04:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167288+0000", 2024-09-12T22:04:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3470000000000001e-06 2024-09-12T22:04:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167294+0000", 2024-09-12T22:04:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5239999999999997e-06 2024-09-12T22:04:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167298+0000", 2024-09-12T22:04:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:04:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167342+0000", 2024-09-12T22:04:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3418999999999999e-05 2024-09-12T22:04:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167493+0000", 2024-09-12T22:04:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015148700000000001 2024-09-12T22:04:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167614+0000", 2024-09-12T22:04:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000121004 2024-09-12T22:04:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:170043 5.f 5:f1ccb5b4:::benchmark_data_smithi043_32659_object2805:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.167316+0000", 2024-09-12T22:04:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00315687, 2024-09-12T22:04:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033824200000000001, 2024-09-12T22:04:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 170043 2024-09-12T22:04:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167316+0000", 2024-09-12T22:04:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167316+0000", 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167316+0000", 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9200000000000002e-07 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167318+0000", 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8330000000000001e-06 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167324+0000", 2024-09-12T22:04:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.336e-06 2024-09-12T22:04:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167329+0000", 2024-09-12T22:04:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.622e-06 2024-09-12T22:04:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169062+0000", 2024-09-12T22:04:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001733184 2024-09-12T22:04:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169195+0000", 2024-09-12T22:04:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013251800000000001 2024-09-12T22:04:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169295+0000", 2024-09-12T22:04:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010026099999999999 2024-09-12T22:04:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:170044 5.8 5:1fde6112:::benchmark_data_smithi043_32659_object2806:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.167338+0000", 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0031352939999999998, 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034337090000000001, 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 170044 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167338+0000", 2024-09-12T22:04:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167338+0000", 2024-09-12T22:04:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167338+0000", 2024-09-12T22:04:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:04:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167340+0000", 2024-09-12T22:04:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.945e-06 2024-09-12T22:04:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167347+0000", 2024-09-12T22:04:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0199999999999997e-06 2024-09-12T22:04:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167351+0000", 2024-09-12T22:04:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.07e-06 2024-09-12T22:04:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.168980+0000", 2024-09-12T22:04:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001629463 2024-09-12T22:04:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169137+0000", 2024-09-12T22:04:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015624000000000001 2024-09-12T22:04:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:170045 5.d 5:b454170b:::benchmark_data_smithi043_32659_object2807:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.167375+0000", 2024-09-12T22:04:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0030976340000000002, 2024-09-12T22:04:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034662550000000001, 2024-09-12T22:04:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 170045 2024-09-12T22:04:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167375+0000", 2024-09-12T22:04:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167375+0000", 2024-09-12T22:04:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167376+0000", 2024-09-12T22:04:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:04:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167378+0000", 2024-09-12T22:04:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.305e-06 2024-09-12T22:04:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167385+0000", 2024-09-12T22:04:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.63e-06 2024-09-12T22:04:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167388+0000", 2024-09-12T22:04:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3579999999999999e-06 2024-09-12T22:04:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167448+0000", 2024-09-12T22:04:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9799999999999997e-05 2024-09-12T22:04:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167615+0000", 2024-09-12T22:04:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016726299999999999 2024-09-12T22:04:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167722+0000", 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106487 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170724+0000", 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030021359999999999 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:170040 5.6 e48/40 5:67d5df14:::benchmark_data_smithi043_32659_object2802:head v 48'10568, mlcod=48'10565)", 2024-09-12T22:04:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.167548+0000", 2024-09-12T22:04:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0029244900000000001, 2024-09-12T22:04:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033714330000000001, 2024-09-12T22:04:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167548+0000", 2024-09-12T22:04:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167548+0000", 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167549+0000", 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7800000000000001e-07 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167559+0000", 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0525e-05 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167567+0000", 2024-09-12T22:04:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000007e-06 2024-09-12T22:04:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167573+0000", 2024-09-12T22:04:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6350000000000003e-06 2024-09-12T22:04:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167662+0000", 2024-09-12T22:04:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.967e-05 2024-09-12T22:04:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.167681+0000", 2024-09-12T22:04:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8182e-05 2024-09-12T22:04:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170895+0000", 2024-09-12T22:04:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032140419999999999 2024-09-12T22:04:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:170042 5.f e48/40 ondisk, result = 0)", 2024-09-12T22:04:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.169018+0000", 2024-09-12T22:04:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001455177, 2024-09-12T22:04:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019690720000000001, 2024-09-12T22:04:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169018+0000", 2024-09-12T22:04:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169018+0000", 2024-09-12T22:04:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169018+0000", 2024-09-12T22:04:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5799999999999999e-07 2024-09-12T22:04:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169022+0000", 2024-09-12T22:04:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8010000000000001e-06 2024-09-12T22:04:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169031+0000", 2024-09-12T22:04:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1810000000000007e-06 2024-09-12T22:04:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169038+0000", 2024-09-12T22:04:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3759999999999996e-06 2024-09-12T22:04:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170752+0000", 2024-09-12T22:04:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017145610000000001 2024-09-12T22:04:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170757+0000", 2024-09-12T22:04:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4139999999999996e-06 2024-09-12T22:04:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:170038 5.5 e48/40 5:a2274d29:::benchmark_data_smithi043_32659_object2800:head v 48'10633, mlcod=48'10630)", 2024-09-12T22:04:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.169147+0000", 2024-09-12T22:04:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0013260590000000001, 2024-09-12T22:04:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019016510000000001, 2024-09-12T22:04:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169147+0000", 2024-09-12T22:04:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169147+0000", 2024-09-12T22:04:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169147+0000", 2024-09-12T22:04:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7100000000000001e-07 2024-09-12T22:04:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169153+0000", 2024-09-12T22:04:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.677e-06 2024-09-12T22:04:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169162+0000", 2024-09-12T22:04:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5010000000000004e-06 2024-09-12T22:04:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169168+0000", 2024-09-12T22:04:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3960000000000003e-06 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169227+0000", 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8581e-05 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.169245+0000", 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8529000000000002e-05 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 48/48 lb 5:6723aff5:::benchmark_data_smithi043_32659_object61190:head)", 2024-09-12T22:04:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.170433+0000", 2024-09-12T22:04:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.9580999999999999e-05, 2024-09-12T22:04:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00067259000000000004, 2024-09-12T22:04:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170433+0000", 2024-09-12T22:04:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170433+0000", 2024-09-12T22:04:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170434+0000", 2024-09-12T22:04:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:04:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170441+0000", 2024-09-12T22:04:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:04:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170451+0000", 2024-09-12T22:04:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0030999999999999e-05 2024-09-12T22:04:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170459+0000", 2024-09-12T22:04:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999997e-06 2024-09-12T22:04:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:170052 5.f 5:f9198826:::benchmark_data_smithi043_32659_object2814:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.170438+0000", 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.5289e-05, 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00071724099999999997, 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 170052 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170438+0000", 2024-09-12T22:04:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170438+0000", 2024-09-12T22:04:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170438+0000", 2024-09-12T22:04:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8999999999999995e-07 2024-09-12T22:04:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170442+0000", 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9890000000000003e-06 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170452+0000", 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4080000000000004e-06 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170459+0000", 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:04:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171026+0000", 2024-09-12T22:04:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00056679199999999999 2024-09-12T22:04:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:170048 5.6 e48/40 5:631a7821:::benchmark_data_smithi043_32659_object2810:head v 48'10569, mlcod=48'10566)", 2024-09-12T22:04:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.170526+0000", 2024-09-12T22:04:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9999466, 2024-09-12T22:04:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00069086400000000002, 2024-09-12T22:04:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170526+0000", 2024-09-12T22:04:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170526+0000", 2024-09-12T22:04:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170527+0000", 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0600000000000001e-07 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170531+0000", 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2409999999999997e-06 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170538+0000", 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8419999999999999e-06 2024-09-12T22:04:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170543+0000", 2024-09-12T22:04:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.339e-06 2024-09-12T22:04:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171013+0000", 2024-09-12T22:04:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046941499999999999 2024-09-12T22:04:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171033+0000", 2024-09-12T22:04:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0134000000000001e-05 2024-09-12T22:04:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:170041 5.5 e48/40 5:a3378ba8:::benchmark_data_smithi043_32659_object2803:head v 48'10634, mlcod=48'10630)", 2024-09-12T22:04:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.170897+0000", 2024-09-12T22:04:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9995761, 2024-09-12T22:04:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00037945299999999997, 2024-09-12T22:04:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170897+0000", 2024-09-12T22:04:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170897+0000", 2024-09-12T22:04:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170897+0000", 2024-09-12T22:04:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:04:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170902+0000", 2024-09-12T22:04:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1479999999999997e-06 2024-09-12T22:04:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170913+0000", 2024-09-12T22:04:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.084e-05 2024-09-12T22:04:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170919+0000", 2024-09-12T22:04:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9460000000000003e-06 2024-09-12T22:04:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170958+0000", 2024-09-12T22:04:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9063000000000002e-05 2024-09-12T22:04:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170976+0000", 2024-09-12T22:04:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7629999999999999e-05 2024-09-12T22:04:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:170054 5.a 5:5e32f562:::benchmark_data_smithi043_32659_object2816:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.170990+0000", 2024-09-12T22:04:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9994826, 2024-09-12T22:04:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00035050000000000001, 2024-09-12T22:04:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 170054 2024-09-12T22:04:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170990+0000", 2024-09-12T22:04:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170990+0000", 2024-09-12T22:04:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170991+0000", 2024-09-12T22:04:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.09e-07 2024-09-12T22:04:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.170996+0000", 2024-09-12T22:04:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7060000000000003e-06 2024-09-12T22:04:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171005+0000", 2024-09-12T22:04:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1900000000000001e-06 2024-09-12T22:04:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171011+0000", 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4450000000000001e-06 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171064+0000", 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3244e-05 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171208+0000", 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014317400000000001 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:170053 5.c e48/40)", 2024-09-12T22:04:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.171311+0000", 2024-09-12T22:04:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9991617, 2024-09-12T22:04:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0925000000000001e-05, 2024-09-12T22:04:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171311+0000", 2024-09-12T22:04:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171311+0000", 2024-09-12T22:04:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171312+0000", 2024-09-12T22:04:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0399999999999996e-07 2024-09-12T22:04:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171317+0000", 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8930000000000004e-06 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171325+0000", 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.14e-06 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171331+0000", 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.263e-06 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:170043 5.f e48/40)", 2024-09-12T22:04:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.171351+0000", 2024-09-12T22:04:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9991221, 2024-09-12T22:04:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000102687, 2024-09-12T22:04:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171351+0000", 2024-09-12T22:04:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.236 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.236 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.236 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171351+0000", 2024-09-12T22:04:56.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.236 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.236 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.236 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.236 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171351+0000", 2024-09-12T22:04:56.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:04:56.236 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.236 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.236 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.236 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171353+0000", 2024-09-12T22:04:56.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.503e-06 2024-09-12T22:04:56.237 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.237 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.237 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.237 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171360+0000", 2024-09-12T22:04:56.237 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7839999999999998e-06 2024-09-12T22:04:56.237 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.237 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.237 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.237 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171365+0000", 2024-09-12T22:04:56.237 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9429999999999999e-06 2024-09-12T22:04:56.237 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.237 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.237 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:170055 5.a 5.30d72b3a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.171364+0000", 2024-09-12T22:04:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9991088, 2024-09-12T22:04:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000137195, 2024-09-12T22:04:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 170055 2024-09-12T22:04:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171364+0000", 2024-09-12T22:04:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171364+0000", 2024-09-12T22:04:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171365+0000", 2024-09-12T22:04:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:04:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171368+0000", 2024-09-12T22:04:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.811e-06 2024-09-12T22:04:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171377+0000", 2024-09-12T22:04:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1950000000000003e-06 2024-09-12T22:04:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171384+0000", 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3100000000000003e-06 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:170056 5.0 5:05bfa1f2:::benchmark_data_smithi043_32659_object2818:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:56.171395+0000", 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9990783, 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016234800000000001, 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:04:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 170056 2024-09-12T22:04:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171395+0000", 2024-09-12T22:04:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171395+0000", 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171395+0000", 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.15e-07 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171397+0000", 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.99e-06 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171404+0000", 2024-09-12T22:04:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.922e-06 2024-09-12T22:04:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171409+0000", 2024-09-12T22:04:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6070000000000001e-06 2024-09-12T22:04:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:56.171452+0000", 2024-09-12T22:04:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3028999999999997e-05 2024-09-12T22:04:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 18 2024-09-12T22:04:56.245 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:56.246 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:56.245+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:56.246 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:56.347 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:56.346+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:56.448 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:56.447+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:56.449 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:56.449 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:04:56.449 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:04:56.450 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:04:56.450 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:56.463 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:56.549 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:56.548+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:56.651 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:56.650+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:56.659 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:56.659 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:04:56.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:04:56.660 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:56.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.660 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:56.660 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:56.660 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 52.030673487999998, 2024-09-12T22:04:56.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:04:56.660 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.660 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.660 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.660 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.660 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.660 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:04:56.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:04:56.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:04:56.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:04:56.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:04:56.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:04:56.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.663 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.663 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:04:56.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:04:56.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.663 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.663 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:04:56.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:04:56.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.663 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.663 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:04:56.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:04:56.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:56.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:04:56.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:04:56.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:04:56.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:04:56.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:56.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:04:56.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.666 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:56.666 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:56.666 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 52.025272547999997, 2024-09-12T22:04:56.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:04:56.666 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.666 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.666 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.666 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.666 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.666 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.666 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:04:56.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.666 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:04:56.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:04:56.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:04:56.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:04:56.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:04:56.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:04:56.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:04:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:04:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:04:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:04:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:04:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:04:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:04:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:04:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:04:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 52.024331281000002, 2024-09-12T22:04:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:04:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:04:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:04:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:04:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:04:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:04:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:04:56.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:04:56.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:04:56.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:04:56.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:04:56.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:56.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:04:56.676 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:04:56.676 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.676 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.676 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.676 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:04:56.676 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:04:56.676 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.676 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.676 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.676 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:04:56.676 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:04:56.676 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.676 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.676 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.677 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:04:56.677 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:04:56.677 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.677 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.677 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.677 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.677 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.677 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:56.677 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:56.677 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 52.023333360999999, 2024-09-12T22:04:56.677 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:04:56.677 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.677 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.677 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.678 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.678 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.678 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.678 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:04:56.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.678 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:56.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:04:56.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:04:56.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:04:56.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:04:56.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:04:56.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:04:56.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:04:56.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:04:56.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:04:56.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:04:56.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:04:56.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:04:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:04:56.682 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.683 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.683 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.683 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.683 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:56.683 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:56.683 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.659584662, 2024-09-12T22:04:56.683 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:04:56.683 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.683 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.683 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.683 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.683 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.683 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.684 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:04:56.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.684 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:56.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:56.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:04:56.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:04:56.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:04:56.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:04:56.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:04:56.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:04:56.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:56.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:04:56.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:04:56.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:56.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:04:56.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:04:56.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:04:56.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.689 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:56.689 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:56.689 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.658951457000001, 2024-09-12T22:04:56.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:04:56.689 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.689 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.689 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.689 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.689 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.689 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.689 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:04:56.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.689 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:04:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:04:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:04:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:04:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:04:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:04:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:04:56.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:04:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:04:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:04:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:04:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.657131794000001, 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:04:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:04:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:04:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:56.698 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:56.699 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.656964167000002, 2024-09-12T22:04:56.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:04:56.699 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.699 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.699 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.699 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.699 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.699 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.699 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:04:56.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.699 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:56.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:04:56.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:04:56.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:04:56.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:04:56.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:04:56.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:04:56.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:04:56.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:04:56.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:04:56.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:04:56.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:04:56.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:04:56.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:04:56.703 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.703 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.703 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:04:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.656823502999998, 2024-09-12T22:04:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:04:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:04:56.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:04:56.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:04:56.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:04:56.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:04:56.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:04:56.707 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.656597980000001, 2024-09-12T22:04:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:04:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:04:56.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:04:56.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:04:56.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:04:56.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:04:56.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:04:56.712 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.713 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.713 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.713 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:56.713 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:56.713 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.656478276000001, 2024-09-12T22:04:56.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:04:56.713 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.713 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.713 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.713 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.713 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:04:56.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:04:56.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:04:56.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:04:56.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:04:56.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:04:56.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:04:56.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:04:56.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:04:56.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:04:56.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:04:56.718 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.718 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.718 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.655886993999999, 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:04:56.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:04:56.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:04:56.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:04:56.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:04:56.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:04:56.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:04:56.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:04:56.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:04:56.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:04:56.722 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.722 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.722 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.655663426, 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:04:56.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:04:56.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:04:56.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:04:56.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:04:56.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:04:56.726 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.726 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.655571944999998, 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:04:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.728 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:56.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:04:56.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:04:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:04:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:04:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:04:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:04:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:04:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:04:56.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:04:56.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:04:56.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:04:56.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:04:56.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:04:56.731 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.731 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.654783140999999, 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:04:56.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.733 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:56.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:04:56.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:04:56.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:04:56.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:04:56.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:04:56.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:04:56.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:04:56.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:04:56.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:04:56.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.736 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:04:56.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:04:56.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.736 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:04:56.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:04:56.736 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.736 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.654519001000001, 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:04:56.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.738 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:56.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:04:56.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:04:56.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:04:56.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:04:56.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:04:56.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:04:56.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:04:56.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.741 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.742 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:04:56.742 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:56.742 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.654014025999999, 2024-09-12T22:04:56.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:04:56.742 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.742 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.742 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.742 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:56.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:04:56.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:04:56.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:04:56.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:04:56.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:04:56.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:04:56.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:04:56.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:04:56.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:04:56.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:04:56.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:04:56.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:04:56.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.652884598, 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.746 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.747 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:56.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:56.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:04:56.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:04:56.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:04:56.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:04:56.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:04:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:04:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:04:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:04:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:04:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:04:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.750 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.652130155999998, 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.751 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:56.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:04:56.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:04:56.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:04:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:04:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:04:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:04:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:04:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:04:56.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:04:56.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:56.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:04:56.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:04:56.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:56.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:04:56.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:04:56.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:04:56.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:04:56.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:04:56.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:04:56.756 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.756 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.756 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.756 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:04:56.756 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.651451053999999, 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:04:56.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:04:56.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:04:56.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:56.761 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:56.762 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:56.761+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:56.762 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:56.863 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:56.861+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:56.911 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:172133 5.6 5:6ebd3398:::benchmark_data_smithi043_32659_object4895:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:56.905783+0000", 2024-09-12T22:04:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0040225729999999998, 2024-09-12T22:04:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040384410000000003, 2024-09-12T22:04:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 172133 2024-09-12T22:04:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905783+0000", 2024-09-12T22:04:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:56.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905783+0000", 2024-09-12T22:04:56.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:56.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905784+0000", 2024-09-12T22:04:56.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-12T22:04:56.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:56.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905789+0000", 2024-09-12T22:04:56.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:04:56.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:56.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905798+0000", 2024-09-12T22:04:56.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8859999999999993e-06 2024-09-12T22:04:56.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905805+0000", 2024-09-12T22:04:56.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2110000000000001e-06 2024-09-12T22:04:56.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:56.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.906082+0000", 2024-09-12T22:04:56.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027707799999999999 2024-09-12T22:04:56.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:56.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.906227+0000", 2024-09-12T22:04:56.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000145513 2024-09-12T22:04:56.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:56.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.906343+0000", 2024-09-12T22:04:56.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011558299999999999 2024-09-12T22:04:56.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:56.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.908755+0000", 2024-09-12T22:04:56.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024123600000000001 2024-09-12T22:04:56.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.916 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:56.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.917 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:172134 5.1 5:8a3a635f:::benchmark_data_smithi043_32659_object4896:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.917 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:56.905836+0000", 2024-09-12T22:04:56.917 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0039699540000000004, 2024-09-12T22:04:56.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040447269999999997, 2024-09-12T22:04:56.917 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:56.917 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:56.917 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:56.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:56.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:56.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.917 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 172134 2024-09-12T22:04:56.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.917 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:56.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:56.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905836+0000", 2024-09-12T22:04:56.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:56.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905836+0000", 2024-09-12T22:04:56.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:56.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905837+0000", 2024-09-12T22:04:56.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:04:56.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:56.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905840+0000", 2024-09-12T22:04:56.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9809999999999999e-06 2024-09-12T22:04:56.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:56.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905847+0000", 2024-09-12T22:04:56.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5050000000000001e-06 2024-09-12T22:04:56.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905855+0000", 2024-09-12T22:04:56.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4240000000000004e-06 2024-09-12T22:04:56.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:56.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905896+0000", 2024-09-12T22:04:56.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1159999999999999e-05 2024-09-12T22:04:56.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:56.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.906068+0000", 2024-09-12T22:04:56.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000172638 2024-09-12T22:04:56.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:56.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.906136+0000", 2024-09-12T22:04:56.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7210000000000002e-05 2024-09-12T22:04:56.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:56.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.908189+0000", 2024-09-12T22:04:56.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020536259999999998 2024-09-12T22:04:56.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.921 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:56.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.922 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:172135 5.c 5:3343d528:::benchmark_data_smithi043_32659_object4897:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.922 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:56.905871+0000", 2024-09-12T22:04:56.922 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0039349190000000003, 2024-09-12T22:04:56.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040536340000000004, 2024-09-12T22:04:56.922 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:56.922 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:56.922 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:56.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:56.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:56.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.922 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 172135 2024-09-12T22:04:56.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.923 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:56.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:56.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905871+0000", 2024-09-12T22:04:56.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:56.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905871+0000", 2024-09-12T22:04:56.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:56.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905871+0000", 2024-09-12T22:04:56.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4700000000000002e-07 2024-09-12T22:04:56.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:56.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905874+0000", 2024-09-12T22:04:56.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2790000000000001e-06 2024-09-12T22:04:56.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:56.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905880+0000", 2024-09-12T22:04:56.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3609999999999997e-06 2024-09-12T22:04:56.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905883+0000", 2024-09-12T22:04:56.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2040000000000002e-06 2024-09-12T22:04:56.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:56.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.906033+0000", 2024-09-12T22:04:56.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014976099999999999 2024-09-12T22:04:56.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:56.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.906193+0000", 2024-09-12T22:04:56.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016033900000000001 2024-09-12T22:04:56.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:56.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.906324+0000", 2024-09-12T22:04:56.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130963 2024-09-12T22:04:56.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:56.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.908438+0000", 2024-09-12T22:04:56.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021132759999999999 2024-09-12T22:04:56.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.926 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:56.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.927 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:172136 5.3 5:c2797e36:::benchmark_data_smithi043_32659_object4898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.927 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:56.905889+0000", 2024-09-12T22:04:56.927 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0039165700000000003, 2024-09-12T22:04:56.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040770520000000003, 2024-09-12T22:04:56.927 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:56.927 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:56.927 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:56.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:56.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:56.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.927 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 172136 2024-09-12T22:04:56.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.927 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:56.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:56.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905889+0000", 2024-09-12T22:04:56.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:56.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905889+0000", 2024-09-12T22:04:56.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:56.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905890+0000", 2024-09-12T22:04:56.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6600000000000003e-07 2024-09-12T22:04:56.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:56.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905891+0000", 2024-09-12T22:04:56.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.406e-06 2024-09-12T22:04:56.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:56.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905894+0000", 2024-09-12T22:04:56.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5190000000000001e-06 2024-09-12T22:04:56.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905897+0000", 2024-09-12T22:04:56.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.841e-06 2024-09-12T22:04:56.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:56.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905956+0000", 2024-09-12T22:04:56.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8653000000000002e-05 2024-09-12T22:04:56.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:56.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.906096+0000", 2024-09-12T22:04:56.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013996899999999999 2024-09-12T22:04:56.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:56.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.906213+0000", 2024-09-12T22:04:56.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116839 2024-09-12T22:04:56.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:56.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.909672+0000", 2024-09-12T22:04:56.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003458937 2024-09-12T22:04:56.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.931 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:56.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.931 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:172137 5.3 5:cc8c71cf:::benchmark_data_smithi043_32659_object4899:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.931 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:56.905947+0000", 2024-09-12T22:04:56.932 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0038593450000000001, 2024-09-12T22:04:56.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040599809999999998, 2024-09-12T22:04:56.932 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:56.932 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:56.932 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:56.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:56.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:56.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.932 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 172137 2024-09-12T22:04:56.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.932 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:56.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:56.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905947+0000", 2024-09-12T22:04:56.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:56.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905947+0000", 2024-09-12T22:04:56.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:56.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905947+0000", 2024-09-12T22:04:56.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-09-12T22:04:56.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:56.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905951+0000", 2024-09-12T22:04:56.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:04:56.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:56.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905959+0000", 2024-09-12T22:04:56.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3180000000000001e-06 2024-09-12T22:04:56.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905964+0000", 2024-09-12T22:04:56.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:04:56.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:56.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.907872+0000", 2024-09-12T22:04:56.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001907267 2024-09-12T22:04:56.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:56.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.908106+0000", 2024-09-12T22:04:56.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023442800000000001 2024-09-12T22:04:56.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:56.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.908233+0000", 2024-09-12T22:04:56.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012699 2024-09-12T22:04:56.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:56.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.909783+0000", 2024-09-12T22:04:56.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015502669999999999 2024-09-12T22:04:56.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.936 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:56.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.936 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:172143 5.1 5:8a230dbe:::benchmark_data_smithi043_32659_object4905:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.936 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:56.909807+0000", 2024-09-12T22:04:56.936 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999995, 2024-09-12T22:04:56.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024867800000000001, 2024-09-12T22:04:56.937 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:56.937 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:56.937 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:04:56.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:56.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:56.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.937 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 172143 2024-09-12T22:04:56.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.937 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:56.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:56.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.909807+0000", 2024-09-12T22:04:56.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.909807+0000", 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.909808+0000", 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.909812+0000", 2024-09-12T22:04:56.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3120000000000004e-06 2024-09-12T22:04:56.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:56.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.909820+0000", 2024-09-12T22:04:56.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.072e-06 2024-09-12T22:04:56.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.909825+0000", 2024-09-12T22:04:56.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.011e-06 2024-09-12T22:04:56.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:56.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.909867+0000", 2024-09-12T22:04:56.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1826999999999998e-05 2024-09-12T22:04:56.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:56.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.909977+0000", 2024-09-12T22:04:56.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110272 2024-09-12T22:04:56.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:56.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.910059+0000", 2024-09-12T22:04:56.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1841999999999993e-05 2024-09-12T22:04:56.940 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.940 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:172129 5.7 5:e29b0922:::benchmark_data_smithi043_32659_object4891:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:56.905373+0000", 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0044328989999999997, 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047229489999999997, 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 172129 2024-09-12T22:04:56.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.942 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:56.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:56.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905373+0000", 2024-09-12T22:04:56.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:56.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905373+0000", 2024-09-12T22:04:56.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:56.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:56.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905374+0000", 2024-09-12T22:04:56.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0160000000000001e-06 2024-09-12T22:04:56.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:56.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905379+0000", 2024-09-12T22:04:56.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.622e-06 2024-09-12T22:04:56.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:56.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905392+0000", 2024-09-12T22:04:56.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3016e-05 2024-09-12T22:04:56.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:56.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905401+0000", 2024-09-12T22:04:56.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0629999999999995e-06 2024-09-12T22:04:56.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:56.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905457+0000", 2024-09-12T22:04:56.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6533999999999998e-05 2024-09-12T22:04:56.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:56.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905627+0000", 2024-09-12T22:04:56.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017019100000000001 2024-09-12T22:04:56.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.905749+0000", 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121292 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:56.907830+0000", 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020811850000000002 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 7 2024-09-12T22:04:56.945 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:56.947 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:56.988 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:56.987+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:57.064 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:57.063+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:57.137 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:57.137 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:04:57.137 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:04:57.137 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:04:57.137 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:57.150 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:57.166 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:57.165+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:57.171 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:04:57.267 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:57.266+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:57.279 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:57.298 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:57.298 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:57.316 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:57.317 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:57.319 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:57.320 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:57.337 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:57.337 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:57.349 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:57.367 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:57.366+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:57.459 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:04:57.471 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:57.467+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:57.503 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:57.503 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:57.516 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:57.601 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:57.600+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:57.669 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:57.668+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:57.717 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:57.718 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:57.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:57.770 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:57.769+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:57.871 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:57.870+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:57.931 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:57.931 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:57.945 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:57.971 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:57.970+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:58.072 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:58.071+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:58.092 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:58.092 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:58.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:58.173 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:58.172+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:58.258 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:58.258 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:58.270 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:58.274 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:58.273+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:58.375 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:58.374+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:58.452 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-09-12T22:04:58.460 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:58.460 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:58.471 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:58.515 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:58.514+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:58.577 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:58.577+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:58.622 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:58.622 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:58.636 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:58.679 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:58.678+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:58.780 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:58.779+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:58.828 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:58.828 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:58.841 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:04:58.880 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2024-09-12T22:04:58.887 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:58.886+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:58.982 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:58.981+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:58.994 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:58.995 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:59.008 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:04:59.083 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:59.082+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:04:59.160 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:59.160 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:59.173 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:04:59.217 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:59.216+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:59.286 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:59.284+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:59.320 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:04:59.320 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:04:59.320 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:04:59.332 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:04:59.417 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:59.416+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:59.428 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:04:59.447 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:04:59.448 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:04:59.467 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:04:59.467 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:04:59.470 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:04:59.470 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:04:59.488 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:59.486+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:59.524 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:04:59.524 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:04:59.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:04:59.524 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:04:59.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.525 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:04:59.525 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:59.525 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.888071781000001, 2024-09-12T22:04:59.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:04:59.525 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.525 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.525 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.525 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.525 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.525 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.525 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:04:59.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.525 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:59.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:04:59.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:04:59.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:04:59.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:04:59.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:04:59.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:04:59.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:04:59.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:04:59.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:04:59.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:04:59.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:04:59.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:04:59.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:04:59.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:04:59.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:04:59.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:04:59.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:04:59.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:04:59.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:04:59.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:04:59.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:04:59.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:04:59.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:04:59.530 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.530 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.530 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.531 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:59.531 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:59.531 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.110765656000002, 2024-09-12T22:04:59.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:04:59.531 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.531 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.531 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:59.531 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.531 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.531 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.531 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:04:59.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.531 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:59.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:04:59.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:04:59.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:04:59.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:04:59.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:04:59.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:04:59.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:04:59.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:04:59.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:04:59.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:04:59.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:04:59.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:59.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:04:59.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:04:59.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:04:59.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:04:59.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:04:59.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:04:59.535 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.535 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.535 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.535 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:59.536 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:59.536 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.110585726, 2024-09-12T22:04:59.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:04:59.536 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.536 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.536 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:59.536 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.536 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.536 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.536 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:04:59.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.536 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:59.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:04:59.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:04:59.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:04:59.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:04:59.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:04:59.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:04:59.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:04:59.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:04:59.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:04:59.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:04:59.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:04:59.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:59.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:04:59.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:04:59.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:04:59.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:04:59.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:04:59.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:04:59.540 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.540 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.540 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.540 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:59.540 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:59.540 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.110519284999999, 2024-09-12T22:04:59.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:04:59.541 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.541 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.541 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:04:59.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.541 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:04:59.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.541 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:59.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:04:59.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:04:59.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:04:59.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:04:59.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:04:59.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:04:59.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:04:59.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:04:59.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:04:59.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:04:59.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:04:59.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:59.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:04:59.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:04:59.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:04:59.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:04:59.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:04:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:04:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.110462842, 2024-09-12T22:04:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:04:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.546 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.546 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.546 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:04:59.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.546 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:59.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:59.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:04:59.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:59.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:04:59.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:04:59.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:04:59.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:04:59.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:04:59.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:04:59.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:04:59.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:04:59.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:04:59.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:04:59.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:04:59.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:04:59.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:04:59.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:04:59.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:04:59.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:04:59.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:04:59.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:04:59.551 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.551 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.552 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.552 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:59.552 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:59.552 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.110394381999999, 2024-09-12T22:04:59.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:04:59.552 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.552 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.552 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.552 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.552 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.552 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.552 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:04:59.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.553 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:59.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:04:59.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:04:59.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:04:59.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:04:59.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:04:59.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:04:59.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:04:59.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:04:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:04:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:04:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:04:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:04:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:04:59.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:04:59.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:04:59.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:04:59.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:04:59.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:04:59.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:04:59.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:04:59.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:04:59.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:04:59.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:04:59.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:04:59.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:04:59.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:04:59.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:04:59.558 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.558 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.558 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.558 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:59.558 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:59.559 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.110336647, 2024-09-12T22:04:59.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:04:59.559 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.559 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.559 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.559 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.559 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.559 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.559 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:04:59.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.559 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:59.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:59.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:04:59.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:04:59.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:04:59.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:04:59.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:04:59.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:04:59.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:04:59.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:04:59.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:04:59.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:04:59.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:59.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:04:59.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:04:59.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:04:59.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:04:59.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:04:59.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:04:59.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:04:59.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:04:59.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:04:59.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:04:59.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:04:59.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:04:59.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:04:59.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:04:59.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:04:59.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:04:59.565 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.565 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.565 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.565 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:59.565 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:59.565 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.110268954999999, 2024-09-12T22:04:59.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:04:59.565 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.566 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.566 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.566 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.566 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.566 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.566 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:04:59.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.566 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:59.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:59.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:04:59.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:04:59.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:04:59.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:04:59.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:04:59.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:04:59.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:04:59.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:04:59.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:04:59.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:04:59.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:59.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:04:59.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:04:59.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:04:59.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:04:59.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:04:59.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:04:59.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:04:59.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:04:59.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:04:59.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:04:59.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:04:59.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:04:59.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:04:59.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:04:59.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:04:59.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:04:59.572 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.572 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.572 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.572 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:04:59.572 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:59.572 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.110213893000001, 2024-09-12T22:04:59.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:04:59.572 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.572 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.572 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.573 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.573 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.573 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:04:59.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.573 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:59.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:59.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:04:59.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:04:59.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:04:59.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:04:59.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:04:59.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:04:59.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:04:59.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:04:59.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:04:59.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:04:59.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:59.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:04:59.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:04:59.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:04:59.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:04:59.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:04:59.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:04:59.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:04:59.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:04:59.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:04:59.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:04:59.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:04:59.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:04:59.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:04:59.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:04:59.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:04:59.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:04:59.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.579 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.579 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:59.579 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:59.579 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.069566373000001, 2024-09-12T22:04:59.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:04:59.579 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.580 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.580 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.580 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:04:59.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.580 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:59.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:04:59.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:04:59.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:04:59.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:04:59.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:04:59.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:04:59.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:04:59.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:04:59.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:04:59.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:04:59.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:04:59.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:59.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:04:59.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:04:59.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:04:59.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:04:59.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:04:59.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:04:59.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:04:59.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:04:59.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:04:59.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:04:59.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:04:59.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:04:59.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:04:59.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:04:59.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:04:59.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.066952645000001, 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.587 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:04:59.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.587 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:59.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:04:59.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:04:59.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:04:59.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:04:59.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:04:59.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:04:59.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:59.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:04:59.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:04:59.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:04:59.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:04:59.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:04:59.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:04:59.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:04:59.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:04:59.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:04:59.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:04:59.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:04:59.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:04:59.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:04:59.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:04:59.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:04:59.592 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.592 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.592 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.592 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117396 5.1 5:83c565df:::benchmark_data_smithi043_32659_object117395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:59.592 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:59.593 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.066811521999998, 2024-09-12T22:04:59.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.090595995999999998, 2024-09-12T22:04:59.593 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.593 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.593 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.593 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.593 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.593 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.593 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117396 2024-09-12T22:04:59.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.593 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:59.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:04:59.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454559+0000", 2024-09-12T22:04:59.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:04:59.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454629+0000", 2024-09-12T22:04:59.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0036000000000005e-05 2024-09-12T22:04:59.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454641+0000", 2024-09-12T22:04:59.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2232000000000001e-05 2024-09-12T22:04:59.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454649+0000", 2024-09-12T22:04:59.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-12T22:04:59.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454697+0000", 2024-09-12T22:04:59.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8028000000000002e-05 2024-09-12T22:04:59.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:59.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454702+0000", 2024-09-12T22:04:59.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:04:59.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540467+0000", 2024-09-12T22:04:59.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085764217000000004 2024-09-12T22:04:59.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540596+0000", 2024-09-12T22:04:59.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129787 2024-09-12T22:04:59.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540774+0000", 2024-09-12T22:04:59.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017746799999999999 2024-09-12T22:04:59.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544679+0000", 2024-09-12T22:04:59.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003904996 2024-09-12T22:04:59.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545009+0000", 2024-09-12T22:04:59.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033056600000000002 2024-09-12T22:04:59.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545067+0000", 2024-09-12T22:04:59.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7871999999999997e-05 2024-09-12T22:04:59.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545154+0000", 2024-09-12T22:04:59.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6701999999999998e-05 2024-09-12T22:04:59.599 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.599 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.599 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.599 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117398 5.6 5:6d151138:::benchmark_data_smithi043_32659_object117397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:59.600 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:59.600 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.045516351, 2024-09-12T22:04:59.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044999137000000002, 2024-09-12T22:04:59.600 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.600 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.600 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.600 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117398 2024-09-12T22:04:59.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.600 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:59.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:04:59.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475854+0000", 2024-09-12T22:04:59.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:04:59.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475914+0000", 2024-09-12T22:04:59.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9422999999999997e-05 2024-09-12T22:04:59.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475925+0000", 2024-09-12T22:04:59.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0881e-05 2024-09-12T22:04:59.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475930+0000", 2024-09-12T22:04:59.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:04:59.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475974+0000", 2024-09-12T22:04:59.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3810999999999998e-05 2024-09-12T22:04:59.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:59.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475981+0000", 2024-09-12T22:04:59.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1590000000000004e-06 2024-09-12T22:04:59.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504359+0000", 2024-09-12T22:04:59.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028377711 2024-09-12T22:04:59.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504526+0000", 2024-09-12T22:04:59.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167023 2024-09-12T22:04:59.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504661+0000", 2024-09-12T22:04:59.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135148 2024-09-12T22:04:59.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.506563+0000", 2024-09-12T22:04:59.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901778 2024-09-12T22:04:59.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520770+0000", 2024-09-12T22:04:59.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014206724 2024-09-12T22:04:59.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520803+0000", 2024-09-12T22:04:59.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3083000000000002e-05 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520852+0000", 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9543999999999999e-05 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117399 5.3 5:ce33c2c7:::benchmark_data_smithi043_32659_object117398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.040747358000001, 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038176902999999998, 2024-09-12T22:04:59.606 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.607 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.607 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.607 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.607 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.607 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.607 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117399 2024-09-12T22:04:59.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.607 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:59.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:04:59.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480624+0000", 2024-09-12T22:04:59.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.322e-06 2024-09-12T22:04:59.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480670+0000", 2024-09-12T22:04:59.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6365000000000001e-05 2024-09-12T22:04:59.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480682+0000", 2024-09-12T22:04:59.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:04:59.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480689+0000", 2024-09-12T22:04:59.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:04:59.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480731+0000", 2024-09-12T22:04:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:04:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480738+0000", 2024-09-12T22:04:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:04:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513753+0000", 2024-09-12T22:04:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.033015125999999999 2024-09-12T22:04:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513935+0000", 2024-09-12T22:04:59.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018219500000000001 2024-09-12T22:04:59.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.514170+0000", 2024-09-12T22:04:59.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000234694 2024-09-12T22:04:59.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518462+0000", 2024-09-12T22:04:59.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004291563 2024-09-12T22:04:59.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518655+0000", 2024-09-12T22:04:59.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019362700000000001 2024-09-12T22:04:59.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518710+0000", 2024-09-12T22:04:59.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:04:59.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518799+0000", 2024-09-12T22:04:59.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9000999999999997e-05 2024-09-12T22:04:59.613 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.613 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.613 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.613 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117407 5.c 5:3c61c1b7:::benchmark_data_smithi043_32659_object117406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:04:59.613 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:59.613 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.007541843999999, 2024-09-12T22:04:59.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042860548999999998, 2024-09-12T22:04:59.613 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.613 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.613 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.613 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.613 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.614 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.614 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117407 2024-09-12T22:04:59.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.614 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:59.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:04:59.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513829+0000", 2024-09-12T22:04:59.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-12T22:04:59.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513900+0000", 2024-09-12T22:04:59.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1482000000000004e-05 2024-09-12T22:04:59.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513909+0000", 2024-09-12T22:04:59.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8370000000000003e-06 2024-09-12T22:04:59.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513917+0000", 2024-09-12T22:04:59.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:04:59.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513967+0000", 2024-09-12T22:04:59.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.007e-05 2024-09-12T22:04:59.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:04:59.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513975+0000", 2024-09-12T22:04:59.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5639999999999999e-06 2024-09-12T22:04:59.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542411+0000", 2024-09-12T22:04:59.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028436032999999999 2024-09-12T22:04:59.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542539+0000", 2024-09-12T22:04:59.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012777900000000001 2024-09-12T22:04:59.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542687+0000", 2024-09-12T22:04:59.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148343 2024-09-12T22:04:59.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548120+0000", 2024-09-12T22:04:59.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054333580000000001 2024-09-12T22:04:59.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556549+0000", 2024-09-12T22:04:59.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084288309999999995 2024-09-12T22:04:59.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556596+0000", 2024-09-12T22:04:59.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6458999999999997e-05 2024-09-12T22:04:59.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556688+0000", 2024-09-12T22:04:59.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2676999999999994e-05 2024-09-12T22:04:59.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.619 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.620 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:59.620 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:59.620 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.521738548999998, 2024-09-12T22:04:59.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:04:59.620 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.620 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.620 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.620 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:04:59.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.620 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:59.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:04:59.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:04:59.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:04:59.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:04:59.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:04:59.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:04:59.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:04:59.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:04:59.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:04:59.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:04:59.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:04:59.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:04:59.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:04:59.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:04:59.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:04:59.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:04:59.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:04:59.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:04:59.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:04:59.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:04:59.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:04:59.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:04:59.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:04:59.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.625 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.625 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:59.626 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:59.626 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.521260061, 2024-09-12T22:04:59.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:04:59.626 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.626 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.626 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.626 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.626 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.626 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.626 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:04:59.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.626 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:59.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:59.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:04:59.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:04:59.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:04:59.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:04:59.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:04:59.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:04:59.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:04:59.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:04:59.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:04:59.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:04:59.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:04:59.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:04:59.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:04:59.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:04:59.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:04:59.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:04:59.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:04:59.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:04:59.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:04:59.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:04:59.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:04:59.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:04:59.632 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.632 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.633 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.633 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:59.633 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:59.633 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.518764761, 2024-09-12T22:04:59.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:04:59.633 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.633 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.633 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.633 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.633 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.633 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.633 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:04:59.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:04:59.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:04:59.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:04:59.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:04:59.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:04:59.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:04:59.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:04:59.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:04:59.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:04:59.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:04:59.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:04:59.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:04:59.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:04:59.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:04:59.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:04:59.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:04:59.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:04:59.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:04:59.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:04:59.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:04:59.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:04:59.638 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.638 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.638 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.639 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:59.639 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:59.639 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.51768397, 2024-09-12T22:04:59.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:04:59.639 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.639 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.639 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.639 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.639 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.639 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.639 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:04:59.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.639 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:59.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:59.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:04:59.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:04:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:04:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:04:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:04:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:04:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:04:59.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:04:59.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:04:59.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:04:59.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:04:59.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:04:59.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:04:59.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:04:59.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:04:59.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:04:59.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:04:59.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:04:59.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:04:59.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:04:59.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:04:59.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:04:59.644 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.644 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.644 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.645 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:04:59.645 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:59.645 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.516448407999999, 2024-09-12T22:04:59.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:04:59.645 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:04:59.645 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:04:59.645 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:04:59.645 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:04:59.645 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:04:59.645 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.645 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:04:59.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.645 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:04:59.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:04:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:04:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:04:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:04:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:04:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:04:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:04:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:04:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:04:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:04:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:04:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:04:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:04:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:04:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:04:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:04:59.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:04:59.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:04:59.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:04:59.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:04:59.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:04:59.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:04:59.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:04:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:04:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:04:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:04:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:04:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:04:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:04:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:04:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:04:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:04:59.650 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:04:59.652 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:04:59.652 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:59.650+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:59.752 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:04:59.751+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:04:59.813 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:04:59.814 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:04:59.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.814 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:180289 5.1 e49/40 5:845b6434:::benchmark_data_smithi043_32659_object13051:head v 49'11200, mlcod=49'11195)", 2024-09-12T22:04:59.814 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.804706+0000", 2024-09-12T22:04:59.814 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0038871309999999998, 2024-09-12T22:04:59.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0039103940000000002, 2024-09-12T22:04:59.814 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.814 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.814 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:59.814 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804706+0000", 2024-09-12T22:04:59.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804706+0000", 2024-09-12T22:04:59.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804706+0000", 2024-09-12T22:04:59.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:04:59.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804711+0000", 2024-09-12T22:04:59.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3560000000000003e-06 2024-09-12T22:04:59.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.816 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804719+0000", 2024-09-12T22:04:59.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1070000000000005e-06 2024-09-12T22:04:59.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.816 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804725+0000", 2024-09-12T22:04:59.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3430000000000001e-06 2024-09-12T22:04:59.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:59.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806587+0000", 2024-09-12T22:04:59.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001861651 2024-09-12T22:04:59.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:59.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806604+0000", 2024-09-12T22:04:59.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7691999999999999e-05 2024-09-12T22:04:59.817 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.817 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.817 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.817 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180294 5.d 5:b696769f:::benchmark_data_smithi043_32659_object13056:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.818 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.804726+0000", 2024-09-12T22:04:59.818 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.003867152, 2024-09-12T22:04:59.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0039587379999999998, 2024-09-12T22:04:59.818 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.818 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.818 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:59.818 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.818 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.818 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.818 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180294 2024-09-12T22:04:59.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.818 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804726+0000", 2024-09-12T22:04:59.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804726+0000", 2024-09-12T22:04:59.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804727+0000", 2024-09-12T22:04:59.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4200000000000005e-07 2024-09-12T22:04:59.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804731+0000", 2024-09-12T22:04:59.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2939999999999999e-06 2024-09-12T22:04:59.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804741+0000", 2024-09-12T22:04:59.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0161e-05 2024-09-12T22:04:59.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804753+0000", 2024-09-12T22:04:59.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2189e-05 2024-09-12T22:04:59.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:59.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804802+0000", 2024-09-12T22:04:59.821 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8809e-05 2024-09-12T22:04:59.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:59.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804984+0000", 2024-09-12T22:04:59.821 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018151800000000001 2024-09-12T22:04:59.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:59.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.805086+0000", 2024-09-12T22:04:59.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000102963 2024-09-12T22:04:59.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:04:59.822 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.808639+0000", 2024-09-12T22:04:59.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035530219999999999 2024-09-12T22:04:59.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.822 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.808668+0000", 2024-09-12T22:04:59.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8969e-05 2024-09-12T22:04:59.822 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.822 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.822 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:180293 5.5 e49/40 5:ad355fb9:::benchmark_data_smithi043_32659_object13055:head v 49'11296, mlcod=49'11294)", 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.804999+0000", 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.003593639, 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037776390000000002, 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804999+0000", 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.804999+0000", 2024-09-12T22:04:59.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.805000+0000", 2024-09-12T22:04:59.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9500000000000003e-07 2024-09-12T22:04:59.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.805004+0000", 2024-09-12T22:04:59.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4490000000000001e-06 2024-09-12T22:04:59.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.825 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.825 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.805012+0000", 2024-09-12T22:04:59.825 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2009999999999999e-06 2024-09-12T22:04:59.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.825 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.825 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.805018+0000", 2024-09-12T22:04:59.825 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.626e-06 2024-09-12T22:04:59.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.825 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:59.825 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.805621+0000", 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00060329600000000002 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.805638+0000", 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6398000000000001e-05 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180296 5.f 5:f90e2d06:::benchmark_data_smithi043_32659_object13058:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.806364+0000", 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0022286540000000001, 2024-09-12T22:04:59.826 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024818010000000001, 2024-09-12T22:04:59.827 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.827 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.827 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:59.827 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.827 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.827 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.827 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180296 2024-09-12T22:04:59.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.827 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806364+0000", 2024-09-12T22:04:59.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806364+0000", 2024-09-12T22:04:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806365+0000", 2024-09-12T22:04:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.08e-06 2024-09-12T22:04:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806370+0000", 2024-09-12T22:04:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5889999999999996e-06 2024-09-12T22:04:59.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806388+0000", 2024-09-12T22:04:59.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8451999999999999e-05 2024-09-12T22:04:59.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806395+0000", 2024-09-12T22:04:59.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7340000000000002e-06 2024-09-12T22:04:59.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:59.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806482+0000", 2024-09-12T22:04:59.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.653e-05 2024-09-12T22:04:59.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.830 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:59.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806626+0000", 2024-09-12T22:04:59.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014465999999999999 2024-09-12T22:04:59.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.830 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:59.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806736+0000", 2024-09-12T22:04:59.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109288 2024-09-12T22:04:59.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.831 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:04:59.831 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.808610+0000", 2024-09-12T22:04:59.831 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018744009999999999 2024-09-12T22:04:59.831 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.831 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.831 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.831 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.831 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.831 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180297 5.e 5:7131e564:::benchmark_data_smithi043_32659_object13059:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.831 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.806464+0000", 2024-09-12T22:04:59.831 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0021293169999999999, 2024-09-12T22:04:59.831 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024638500000000001, 2024-09-12T22:04:59.831 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.831 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.832 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:59.832 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.832 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.832 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.832 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180297 2024-09-12T22:04:59.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.832 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.832 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.832 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806464+0000", 2024-09-12T22:04:59.832 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.832 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806464+0000", 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806464+0000", 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806467+0000", 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8339999999999999e-06 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806482+0000", 2024-09-12T22:04:59.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4817999999999999e-05 2024-09-12T22:04:59.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806489+0000", 2024-09-12T22:04:59.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2400000000000001e-06 2024-09-12T22:04:59.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:59.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.808201+0000", 2024-09-12T22:04:59.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001712084 2024-09-12T22:04:59.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.835 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:59.835 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.808361+0000", 2024-09-12T22:04:59.835 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016004100000000001 2024-09-12T22:04:59.835 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.835 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.835 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.835 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.835 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180299 5.a 5:5a0c6694:::benchmark_data_smithi043_32659_object13061:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.835 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.806667+0000", 2024-09-12T22:04:59.835 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0019257689999999999, 2024-09-12T22:04:59.835 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002328381, 2024-09-12T22:04:59.835 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.835 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.836 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:59.836 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.836 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.836 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.836 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180299 2024-09-12T22:04:59.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.836 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.836 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.836 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.836 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806667+0000", 2024-09-12T22:04:59.836 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.836 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.836 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806667+0000", 2024-09-12T22:04:59.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.837 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806668+0000", 2024-09-12T22:04:59.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3900000000000004e-07 2024-09-12T22:04:59.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.837 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806672+0000", 2024-09-12T22:04:59.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4569999999999998e-06 2024-09-12T22:04:59.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806682+0000", 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2750000000000001e-06 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806688+0000", 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2899999999999999e-06 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806745+0000", 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7136000000000003e-05 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.839 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:59.839 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806908+0000", 2024-09-12T22:04:59.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000162948 2024-09-12T22:04:59.839 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.839 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.839 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.839 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180300 5.d 5:bafcab58:::benchmark_data_smithi043_32659_object13062:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.839 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.806721+0000", 2024-09-12T22:04:59.839 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0018715719999999999, 2024-09-12T22:04:59.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023392259999999998, 2024-09-12T22:04:59.839 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.839 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.840 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:04:59.840 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.840 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.840 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.840 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180300 2024-09-12T22:04:59.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.840 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806721+0000", 2024-09-12T22:04:59.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806721+0000", 2024-09-12T22:04:59.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806722+0000", 2024-09-12T22:04:59.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9100000000000003e-07 2024-09-12T22:04:59.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806725+0000", 2024-09-12T22:04:59.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7310000000000002e-06 2024-09-12T22:04:59.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.842 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.842 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806742+0000", 2024-09-12T22:04:59.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7648000000000001e-05 2024-09-12T22:04:59.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.842 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.842 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806748+0000", 2024-09-12T22:04:59.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6230000000000002e-06 2024-09-12T22:04:59.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.842 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:59.842 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806810+0000", 2024-09-12T22:04:59.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1914000000000004e-05 2024-09-12T22:04:59.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807120+0000", 2024-09-12T22:04:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00030972699999999998 2024-09-12T22:04:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:04:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807281+0000", 2024-09-12T22:04:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000161068 2024-09-12T22:04:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.844 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180302 5.e 5.34bb69e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.844 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.806851+0000", 2024-09-12T22:04:59.844 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0017416949999999999, 2024-09-12T22:04:59.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022745420000000001, 2024-09-12T22:04:59.844 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.844 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.844 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:59.844 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.844 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.844 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.844 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180302 2024-09-12T22:04:59.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.844 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806851+0000", 2024-09-12T22:04:59.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806851+0000", 2024-09-12T22:04:59.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806852+0000", 2024-09-12T22:04:59.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9299999999999997e-07 2024-09-12T22:04:59.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.846 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806855+0000", 2024-09-12T22:04:59.846 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5559999999999999e-06 2024-09-12T22:04:59.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.846 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806863+0000", 2024-09-12T22:04:59.846 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6429999999999995e-06 2024-09-12T22:04:59.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.846 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806868+0000", 2024-09-12T22:04:59.846 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.383e-06 2024-09-12T22:04:59.847 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.847 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.847 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.847 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:180298 5.6 e49/40 5:69ea45e4:::benchmark_data_smithi043_32659_object13060:head v 49'11194, mlcod=49'11192)", 2024-09-12T22:04:59.847 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.807166+0000", 2024-09-12T22:04:59.847 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001427153, 2024-09-12T22:04:59.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020087600000000001, 2024-09-12T22:04:59.847 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.847 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.847 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:59.847 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807166+0000", 2024-09-12T22:04:59.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807166+0000", 2024-09-12T22:04:59.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807166+0000", 2024-09-12T22:04:59.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.68e-07 2024-09-12T22:04:59.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807171+0000", 2024-09-12T22:04:59.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.741e-06 2024-09-12T22:04:59.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807178+0000", 2024-09-12T22:04:59.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2899999999999997e-06 2024-09-12T22:04:59.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807184+0000", 2024-09-12T22:04:59.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4450000000000004e-06 2024-09-12T22:04:59.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.850 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:59.850 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807920+0000", 2024-09-12T22:04:59.850 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00073651399999999996 2024-09-12T22:04:59.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.850 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:59.850 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807938+0000", 2024-09-12T22:04:59.850 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8156e-05 2024-09-12T22:04:59.850 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.850 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.850 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180303 5.8 5:10319980:::benchmark_data_smithi043_32659_object13065:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.807222+0000", 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0013704990000000001, 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020053409999999999, 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180303 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807222+0000", 2024-09-12T22:04:59.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807222+0000", 2024-09-12T22:04:59.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807223+0000", 2024-09-12T22:04:59.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4199999999999995e-07 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807227+0000", 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8460000000000001e-06 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807236+0000", 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6060000000000003e-06 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807242+0000", 2024-09-12T22:04:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2160000000000003e-06 2024-09-12T22:04:59.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.854 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:59.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807476+0000", 2024-09-12T22:04:59.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00023472599999999999 2024-09-12T22:04:59.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.854 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:59.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.807605+0000", 2024-09-12T22:04:59.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012899799999999999 2024-09-12T22:04:59.854 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.854 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.854 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.855 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180304 5.4 5:238e42d8:::benchmark_data_smithi043_32659_object13066:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.855 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.808248+0000", 2024-09-12T22:04:59.855 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00034523099999999999, 2024-09-12T22:04:59.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001038869, 2024-09-12T22:04:59.855 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.855 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.855 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:59.855 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.855 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.855 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.855 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180304 2024-09-12T22:04:59.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.855 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.808248+0000", 2024-09-12T22:04:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.808248+0000", 2024-09-12T22:04:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.808248+0000", 2024-09-12T22:04:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:04:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.808253+0000", 2024-09-12T22:04:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3250000000000001e-06 2024-09-12T22:04:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.808264+0000", 2024-09-12T22:04:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1661999999999999e-05 2024-09-12T22:04:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.808271+0000", 2024-09-12T22:04:59.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4740000000000002e-06 2024-09-12T22:04:59.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.858 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.858 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:59.858 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.808648+0000", 2024-09-12T22:04:59.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00037680800000000001 2024-09-12T22:04:59.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.858 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.858 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:59.858 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.808828+0000", 2024-09-12T22:04:59.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018027399999999999 2024-09-12T22:04:59.858 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.858 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.858 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.859 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180305 5.4 5.ab364f34 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.859 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.809006+0000", 2024-09-12T22:04:59.859 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9995866, 2024-09-12T22:04:59.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033737300000000002, 2024-09-12T22:04:59.859 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.859 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.859 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:59.859 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.859 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.859 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.859 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180305 2024-09-12T22:04:59.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809006+0000", 2024-09-12T22:04:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809006+0000", 2024-09-12T22:04:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809007+0000", 2024-09-12T22:04:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0800000000000003e-07 2024-09-12T22:04:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809011+0000", 2024-09-12T22:04:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2390000000000004e-06 2024-09-12T22:04:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809021+0000", 2024-09-12T22:04:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0149999999999999e-05 2024-09-12T22:04:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809037+0000", 2024-09-12T22:04:59.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5129e-05 2024-09-12T22:04:59.862 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.862 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.862 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.862 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180306 5.b 5:d415a47d:::benchmark_data_smithi043_32659_object13068:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.862 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.809057+0000", 2024-09-12T22:04:59.862 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9995356, 2024-09-12T22:04:59.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033843000000000002, 2024-09-12T22:04:59.862 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.862 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.862 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:59.863 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.863 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.863 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.863 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180306 2024-09-12T22:04:59.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.863 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809057+0000", 2024-09-12T22:04:59.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809057+0000", 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809058+0000", 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3900000000000004e-07 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809061+0000", 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.892e-06 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809068+0000", 2024-09-12T22:04:59.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2529999999999998e-06 2024-09-12T22:04:59.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.865 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.865 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809073+0000", 2024-09-12T22:04:59.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4469999999999997e-06 2024-09-12T22:04:59.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.865 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:59.865 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809127+0000", 2024-09-12T22:04:59.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3600999999999997e-05 2024-09-12T22:04:59.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.865 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:59.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809280+0000", 2024-09-12T22:04:59.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015338799999999999 2024-09-12T22:04:59.866 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.866 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.866 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.866 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180307 5.4 5.5517454 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.866 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.809105+0000", 2024-09-12T22:04:59.866 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9994884, 2024-09-12T22:04:59.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00034775600000000001, 2024-09-12T22:04:59.866 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.866 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.866 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180307 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809105+0000", 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809105+0000", 2024-09-12T22:04:59.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809105+0000", 2024-09-12T22:04:59.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6000000000000003e-07 2024-09-12T22:04:59.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809109+0000", 2024-09-12T22:04:59.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4740000000000001e-06 2024-09-12T22:04:59.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809117+0000", 2024-09-12T22:04:59.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1990000000000006e-06 2024-09-12T22:04:59.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809123+0000", 2024-09-12T22:04:59.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0410000000000003e-06 2024-09-12T22:04:59.869 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.869 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.869 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.869 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDPGPush(5.6 49/40 [PushOp(5:68209abc:::benchmark_data_smithi043_32659_object99692:head, version: 36'6193, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:68209abc:::benchmark_data_smithi043_32659_object99692:head@36'6193, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T22:04:59.869 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.809282+0000", 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9993105, 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00024435, 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809282+0000", 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809282+0000", 2024-09-12T22:04:59.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.871 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.871 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809283+0000", 2024-09-12T22:04:59.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0999999999999999e-07 2024-09-12T22:04:59.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.871 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.871 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809327+0000", 2024-09-12T22:04:59.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3841000000000003e-05 2024-09-12T22:04:59.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.871 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.871 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809341+0000", 2024-09-12T22:04:59.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3968000000000001e-05 2024-09-12T22:04:59.872 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.872 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809351+0000", 2024-09-12T22:04:59.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0264e-05 2024-09-12T22:04:59.872 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.872 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.872 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.872 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.872 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 49/49 lb 5:681fb374:::benchmark_data_smithi043_32659_object26210:head)", 2024-09-12T22:04:59.872 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.809369+0000", 2024-09-12T22:04:59.873 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9992237, 2024-09-12T22:04:59.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019921300000000001, 2024-09-12T22:04:59.873 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.873 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.873 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:59.873 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809369+0000", 2024-09-12T22:04:59.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809369+0000", 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809369+0000", 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3799999999999999e-07 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809385+0000", 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5671e-05 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809394+0000", 2024-09-12T22:04:59.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0180000000000007e-06 2024-09-12T22:04:59.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809400+0000", 2024-09-12T22:04:59.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:04:59.875 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.875 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.875 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.875 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180309 5.b 5.75363ecb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.875 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.809388+0000", 2024-09-12T22:04:59.875 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9992051, 2024-09-12T22:04:59.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022299099999999999, 2024-09-12T22:04:59.876 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.876 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.876 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:59.876 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.876 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.876 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.876 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180309 2024-09-12T22:04:59.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.876 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809388+0000", 2024-09-12T22:04:59.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809388+0000", 2024-09-12T22:04:59.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809388+0000", 2024-09-12T22:04:59.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:04:59.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809392+0000", 2024-09-12T22:04:59.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5039999999999998e-06 2024-09-12T22:04:59.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809400+0000", 2024-09-12T22:04:59.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6499999999999996e-06 2024-09-12T22:04:59.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.879 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809405+0000", 2024-09-12T22:04:59.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4809999999999997e-06 2024-09-12T22:04:59.879 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.879 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.879 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.879 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:180301 5.6 e49/40 5:6842f64a:::benchmark_data_smithi043_32659_object13063:head v 49'11195, mlcod=49'11192)", 2024-09-12T22:04:59.879 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.809409+0000", 2024-09-12T22:04:59.879 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9991837, 2024-09-12T22:04:59.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000250592, 2024-09-12T22:04:59.880 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.880 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.880 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:59.880 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809409+0000", 2024-09-12T22:04:59.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809409+0000", 2024-09-12T22:04:59.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809409+0000", 2024-09-12T22:04:59.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.79e-07 2024-09-12T22:04:59.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809413+0000", 2024-09-12T22:04:59.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3469999999999999e-06 2024-09-12T22:04:59.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809419+0000", 2024-09-12T22:04:59.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8429999999999998e-06 2024-09-12T22:04:59.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809423+0000", 2024-09-12T22:04:59.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.437e-06 2024-09-12T22:04:59.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:59.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809570+0000", 2024-09-12T22:04:59.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014708399999999999 2024-09-12T22:04:59.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:59.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809582+0000", 2024-09-12T22:04:59.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2294e-05 2024-09-12T22:04:59.883 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.883 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.883 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.883 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180310 5.e 5.49185aae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.883 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.809416+0000", 2024-09-12T22:04:59.883 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9991765, 2024-09-12T22:04:59.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00029538299999999997, 2024-09-12T22:04:59.883 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.884 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.884 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:59.884 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.884 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.884 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.884 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180310 2024-09-12T22:04:59.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.884 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809416+0000", 2024-09-12T22:04:59.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809416+0000", 2024-09-12T22:04:59.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809417+0000", 2024-09-12T22:04:59.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:04:59.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809419+0000", 2024-09-12T22:04:59.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9910000000000001e-06 2024-09-12T22:04:59.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809424+0000", 2024-09-12T22:04:59.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6760000000000004e-06 2024-09-12T22:04:59.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809429+0000", 2024-09-12T22:04:59.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5920000000000002e-06 2024-09-12T22:04:59.886 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.886 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.886 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.887 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:180308 5.c e49/40)", 2024-09-12T22:04:59.887 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.809614+0000", 2024-09-12T22:04:59.887 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9989786, 2024-09-12T22:04:59.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014301299999999999, 2024-09-12T22:04:59.887 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.887 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.887 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:59.887 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809614+0000", 2024-09-12T22:04:59.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809614+0000", 2024-09-12T22:04:59.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809615+0000", 2024-09-12T22:04:59.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:04:59.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809619+0000", 2024-09-12T22:04:59.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1060000000000002e-06 2024-09-12T22:04:59.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809626+0000", 2024-09-12T22:04:59.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8110000000000003e-06 2024-09-12T22:04:59.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809632+0000", 2024-09-12T22:04:59.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0009999999999998e-06 2024-09-12T22:04:59.889 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.889 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.889 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180311 5.f 5.dee4ebbf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.809725+0000", 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9988675, 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3644000000000002e-05, 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180311 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809725+0000", 2024-09-12T22:04:59.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809725+0000", 2024-09-12T22:04:59.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809726+0000", 2024-09-12T22:04:59.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1399999999999996e-07 2024-09-12T22:04:59.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809730+0000", 2024-09-12T22:04:59.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2429999999999999e-06 2024-09-12T22:04:59.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809739+0000", 2024-09-12T22:04:59.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5189999999999992e-06 2024-09-12T22:04:59.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809745+0000", 2024-09-12T22:04:59.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0480000000000004e-06 2024-09-12T22:04:59.893 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.893 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.893 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.893 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180312 5.f 5.80a53cff (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.893 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.809766+0000", 2024-09-12T22:04:59.893 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.998827, 2024-09-12T22:04:59.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6408000000000003e-05, 2024-09-12T22:04:59.893 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.893 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.893 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:04:59.893 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180312 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809766+0000", 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809766+0000", 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809766+0000", 2024-09-12T22:04:59.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6599999999999996e-07 2024-09-12T22:04:59.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809770+0000", 2024-09-12T22:04:59.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2799999999999999e-06 2024-09-12T22:04:59.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809777+0000", 2024-09-12T22:04:59.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6499999999999996e-06 2024-09-12T22:04:59.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809783+0000", 2024-09-12T22:04:59.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4820000000000002e-06 2024-09-12T22:04:59.896 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.896 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.896 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.896 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180313 5.8 5:1952e6b2:::benchmark_data_smithi043_32659_object13075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.896 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.809801+0000", 2024-09-12T22:04:59.896 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9987917, 2024-09-12T22:04:59.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0001015, 2024-09-12T22:04:59.897 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.897 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.897 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:04:59.897 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.897 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.897 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.897 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180313 2024-09-12T22:04:59.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.897 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809801+0000", 2024-09-12T22:04:59.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809801+0000", 2024-09-12T22:04:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809802+0000", 2024-09-12T22:04:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:04:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809806+0000", 2024-09-12T22:04:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9319999999999998e-06 2024-09-12T22:04:59.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809814+0000", 2024-09-12T22:04:59.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9289999999999998e-06 2024-09-12T22:04:59.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809825+0000", 2024-09-12T22:04:59.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1029999999999999e-05 2024-09-12T22:04:59.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:59.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.809868+0000", 2024-09-12T22:04:59.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3331000000000002e-05 2024-09-12T22:04:59.900 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.900 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.900 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.900 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:180291 5.e 5:7fa55a8a:::benchmark_data_smithi043_32659_object13053:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:04:59.900 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:59.802965+0000", 2024-09-12T22:04:59.900 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0056273790000000001, 2024-09-12T22:04:59.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.006991176, 2024-09-12T22:04:59.901 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:04:59.901 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:04:59.901 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:04:59.901 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:04:59.901 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:04:59.901 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:04:59.901 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 180291 2024-09-12T22:04:59.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.901 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:04:59.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:04:59.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.802965+0000", 2024-09-12T22:04:59.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:04:59.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.802965+0000", 2024-09-12T22:04:59.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:04:59.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:04:59.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.802966+0000", 2024-09-12T22:04:59.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4099999999999997e-07 2024-09-12T22:04:59.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:04:59.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.802970+0000", 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.568e-06 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.802977+0000", 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.802981+0000", 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4340000000000002e-06 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:04:59.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806362+0000", 2024-09-12T22:04:59.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033806779999999998 2024-09-12T22:04:59.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:04:59.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:04:59.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:04:59.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:59.806544+0000", 2024-09-12T22:04:59.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018248799999999999 2024-09-12T22:04:59.904 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.904 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:04:59.904 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.904 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:04:59.904 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:04:59.904 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 24 2024-09-12T22:04:59.904 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:04:59.906 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:04:59.906 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:04:59.904+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:00.006 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:00.005+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:00.107 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:00.107 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:00.108 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:00.106+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:00.120 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:00.208 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:00.207+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:00.284 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:00.284 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:00.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:00.285 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:00.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.285 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:00.285 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:00.285 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 55.654637700000002, 2024-09-12T22:05:00.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:05:00.285 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.285 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.286 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.286 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:00.286 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:00.286 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.286 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:05:00.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.286 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:00.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:00.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:05:00.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:05:00.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:05:00.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:05:00.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:05:00.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:05:00.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:05:00.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:05:00.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:05:00.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:05:00.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:05:00.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:05:00.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:00.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:05:00.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:05:00.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:00.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:05:00.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:05:00.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:00.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:05:00.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:05:00.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:05:00.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:05:00.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:05:00.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:05:00.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.292 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.292 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:00.292 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:00.293 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 55.649236760000001, 2024-09-12T22:05:00.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:05:00.293 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.293 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.293 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:00.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:00.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.293 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:05:00.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.293 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:00.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:00.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:00.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:00.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:05:00.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:05:00.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:05:00.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:05:00.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:05:00.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:05:00.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:05:00.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:05:00.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:05:00.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:05:00.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:00.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:05:00.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:05:00.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:00.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:05:00.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:05:00.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:00.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:05:00.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:05:00.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:05:00.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:05:00.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:05:00.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:05:00.300 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.300 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.300 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.300 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:00.300 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:05:00.300 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 55.648295492999999, 2024-09-12T22:05:00.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:05:00.301 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.301 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.301 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.301 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:00.301 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:00.301 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.301 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:05:00.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.301 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:05:00.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:05:00.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:05:00.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:05:00.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:05:00.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:05:00.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:05:00.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:05:00.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:05:00.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:05:00.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:05:00.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:05:00.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:05:00.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:05:00.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:00.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:05:00.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:05:00.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:00.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:05:00.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:05:00.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:00.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:05:00.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:05:00.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:05:00.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:05:00.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:05:00.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:05:00.306 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.306 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.306 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.306 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:00.306 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:05:00.307 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 55.647297573000003, 2024-09-12T22:05:00.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:05:00.307 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.307 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.307 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.307 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:00.307 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:00.307 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.307 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:05:00.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.307 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:05:00.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:05:00.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:05:00.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:05:00.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:05:00.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:05:00.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:05:00.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:05:00.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:05:00.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:05:00.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:05:00.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:05:00.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:05:00.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:05:00.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:00.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:05:00.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:05:00.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:00.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:05:00.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:05:00.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:00.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:05:00.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:05:00.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:05:00.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:05:00.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:05:00.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:05:00.312 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.312 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.313 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.313 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:00.313 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:00.313 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.283548874000001, 2024-09-12T22:05:00.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:05:00.313 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.313 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.313 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.314 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:00.314 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:00.314 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.314 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:05:00.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.314 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:00.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:00.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:00.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:05:00.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:05:00.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:05:00.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:05:00.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:05:00.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:05:00.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:05:00.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:05:00.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:05:00.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:05:00.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:05:00.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:00.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:05:00.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:05:00.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:00.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:05:00.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:05:00.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:00.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:05:00.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:05:00.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:05:00.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:05:00.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:05:00.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:05:00.320 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.320 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.320 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.320 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:00.320 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:00.321 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.282915669000001, 2024-09-12T22:05:00.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:00.321 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.321 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.321 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.321 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:00.321 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:00.321 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.321 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:00.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.321 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:00.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:00.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:00.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:00.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:00.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:00.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:00.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:00.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:00.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:00.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:00.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:00.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:00.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:00.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:00.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:00.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:00.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:00.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:00.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:00.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:00.326 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.326 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.327 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.327 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:00.327 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:00.327 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.281096005999999, 2024-09-12T22:05:00.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:00.327 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.327 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.327 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.327 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:00.327 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:00.328 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.328 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:00.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.328 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:00.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:00.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:00.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:00.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:00.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:00.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:00.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:00.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:00.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:00.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:00.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:00.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:00.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:00.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:00.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:00.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:00.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:00.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:00.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:00.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:00.332 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.332 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.332 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.333 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:00.333 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:00.333 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.280928378999999, 2024-09-12T22:05:00.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:05:00.333 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.333 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.333 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.333 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:00.333 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:00.333 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.333 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:05:00.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.333 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:00.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:00.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:05:00.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:05:00.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:05:00.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:05:00.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:05:00.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:05:00.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:05:00.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:05:00.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:05:00.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:05:00.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:05:00.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:05:00.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:00.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:05:00.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:05:00.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:05:00.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:05:00.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:05:00.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:05:00.338 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.338 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.338 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.339 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:05:00.339 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:00.339 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.280787714999999, 2024-09-12T22:05:00.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:05:00.340 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.340 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.340 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.340 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:05:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:05:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:05:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:05:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:05:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:05:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:05:00.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:05:00.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:05:00.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:05:00.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:05:00.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:05:00.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:05:00.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:05:00.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:05:00.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:05:00.345 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.345 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.345 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.346 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:00.346 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:00.346 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.280562192000001, 2024-09-12T22:05:00.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:00.346 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.346 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.346 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.346 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:00.346 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:00.346 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.346 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:00.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.347 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:00.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:00.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:00.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:00.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:00.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:00.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:00.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:00.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:00.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:00.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:00.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:00.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:00.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:00.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:00.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:00.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:00.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:00.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:00.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:00.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:00.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.352 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.353 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:00.353 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:00.353 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.280442487999998, 2024-09-12T22:05:00.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:05:00.353 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.353 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.353 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.353 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:00.353 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:00.353 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.354 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:05:00.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.354 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:00.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:00.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:05:00.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:05:00.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:05:00.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:05:00.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:05:00.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:05:00.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:05:00.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:05:00.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:05:00.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:05:00.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:05:00.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:05:00.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:00.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:00.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:05:00.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:00.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:05:00.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:05:00.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:00.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:05:00.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:05:00.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:05:00.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:05:00.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:05:00.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:05:00.360 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.360 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.360 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.360 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:05:00.360 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:00.360 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.279851206, 2024-09-12T22:05:00.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:05:00.361 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.361 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.361 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:00.361 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:00.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:00.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:05:00.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:05:00.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:05:00.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:05:00.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:05:00.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:05:00.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:05:00.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:05:00.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:05:00.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:05:00.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.364 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:05:00.365 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:00.365 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.279627638000001, 2024-09-12T22:05:00.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:05:00.365 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.365 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.365 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.365 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:00.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:00.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:00.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:05:00.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:05:00.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:05:00.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:05:00.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:05:00.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:05:00.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:05:00.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:05:00.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:05:00.369 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.369 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.369 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.369 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:00.369 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:00.369 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.279536156999999, 2024-09-12T22:05:00.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:05:00.369 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.369 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.369 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.369 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:00.369 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:00.370 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.370 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:05:00.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.370 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:00.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:00.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:05:00.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:05:00.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:05:00.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:05:00.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:05:00.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:05:00.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:05:00.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:05:00.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:05:00.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:05:00.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:05:00.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:05:00.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:00.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:05:00.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:05:00.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:05:00.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:05:00.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:05:00.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:05:00.375 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.375 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.375 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.375 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:00.375 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:00.375 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.278747353, 2024-09-12T22:05:00.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:00.375 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.376 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.376 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.376 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:00.376 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:00.376 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.376 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:00.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.376 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:00.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:00.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:00.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:00.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:00.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:00.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:00.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:00.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:00.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:00.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:00.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:00.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:00.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:00.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:00.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:00.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:00.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:00.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:00.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:00.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:00.381 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.381 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.381 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.382 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:00.382 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:00.382 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.278483213000001, 2024-09-12T22:05:00.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:05:00.382 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.382 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.382 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.382 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:00.382 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:00.382 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.383 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:05:00.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.383 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:00.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:00.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:05:00.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:05:00.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:05:00.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:05:00.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:05:00.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:05:00.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:05:00.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:05:00.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:05:00.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:05:00.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:05:00.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:05:00.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:00.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:05:00.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:05:00.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:05:00.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:05:00.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:05:00.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:05:00.388 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.388 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.388 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.388 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:05:00.389 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:00.389 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.277978237999999, 2024-09-12T22:05:00.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:05:00.389 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.389 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.389 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.389 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:00.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:00.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:05:00.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:05:00.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:05:00.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:05:00.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:05:00.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:05:00.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:05:00.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:05:00.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:05:00.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:05:00.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:05:00.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:05:00.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:05:00.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:05:00.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:05:00.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:05:00.393 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.393 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.393 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.393 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:05:00.393 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:00.393 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.276848810000001, 2024-09-12T22:05:00.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:05:00.394 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.394 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.394 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.394 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:00.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:00.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:00.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:00.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:05:00.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:05:00.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:05:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:05:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:05:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:05:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:05:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:05:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:05:00.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:05:00.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:05:00.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:05:00.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:05:00.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:05:00.398 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.398 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.398 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.398 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:00.398 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:00.398 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.276094367999999, 2024-09-12T22:05:00.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:05:00.399 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.399 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.399 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.399 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:00.399 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:00.399 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.399 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:05:00.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.399 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:00.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:00.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:05:00.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:00.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:05:00.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:05:00.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:05:00.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:05:00.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:05:00.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:05:00.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:05:00.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:05:00.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:05:00.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:05:00.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:00.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:05:00.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:05:00.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:00.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:05:00.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:05:00.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:00.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:05:00.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:05:00.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:05:00.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:05:00.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:05:00.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:05:00.405 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.405 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.405 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.406 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:05:00.406 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:00.406 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.275415266, 2024-09-12T22:05:00.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:05:00.406 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:00.406 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:00.406 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:00.406 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:00.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:00.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:00.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:00.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:00.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:00.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:00.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:05:00.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:05:00.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:00.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:05:00.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:05:00.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:00.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:05:00.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:05:00.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:05:00.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:05:00.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:00.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:05:00.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:05:00.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:00.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:05:00.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:05:00.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:00.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:05:00.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:05:00.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:00.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:00.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:00.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:05:00.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:05:00.411 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.411 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.411 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.411 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:00.411 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:00.411 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:00.413 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:00.413 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:00.411+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:00.468 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:05:00.512 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:00.512+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:00.562 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:182508 5.6 5:647f39b2:::benchmark_data_smithi043_32659_object15270:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:05:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:00.558056+0000", 2024-09-12T22:05:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0032183350000000001, 2024-09-12T22:05:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003240887, 2024-09-12T22:05:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 182508 2024-09-12T22:05:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.558056+0000", 2024-09-12T22:05:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.558056+0000", 2024-09-12T22:05:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.558057+0000", 2024-09-12T22:05:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.066e-06 2024-09-12T22:05:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.558062+0000", 2024-09-12T22:05:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:05:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.558075+0000", 2024-09-12T22:05:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2853e-05 2024-09-12T22:05:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.558083+0000", 2024-09-12T22:05:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4460000000000001e-06 2024-09-12T22:05:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.558122+0000", 2024-09-12T22:05:00.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9062e-05 2024-09-12T22:05:00.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:00.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.558235+0000", 2024-09-12T22:05:00.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000112367 2024-09-12T22:05:00.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:00.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.558310+0000", 2024-09-12T22:05:00.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5681999999999998e-05 2024-09-12T22:05:00.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.567 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:00.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.568 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:182515 5.5 5:a3f1ed76:::benchmark_data_smithi043_32659_object15277:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:05:00.568 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:00.559595+0000", 2024-09-12T22:05:00.568 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0016797590000000001, 2024-09-12T22:05:00.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001778731, 2024-09-12T22:05:00.568 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:00.568 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:00.568 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:00.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:00.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:00.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.568 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 182515 2024-09-12T22:05:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559595+0000", 2024-09-12T22:05:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559595+0000", 2024-09-12T22:05:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559596+0000", 2024-09-12T22:05:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3099999999999996e-07 2024-09-12T22:05:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559599+0000", 2024-09-12T22:05:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6789999999999998e-06 2024-09-12T22:05:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559612+0000", 2024-09-12T22:05:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2556e-05 2024-09-12T22:05:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559621+0000", 2024-09-12T22:05:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9390000000000003e-06 2024-09-12T22:05:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559671+0000", 2024-09-12T22:05:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9804e-05 2024-09-12T22:05:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559854+0000", 2024-09-12T22:05:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183451 2024-09-12T22:05:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559966+0000", 2024-09-12T22:05:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011217099999999999 2024-09-12T22:05:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:182510 5.f e49/40 5:f902b6d0:::benchmark_data_smithi043_32659_object15272:head v 49'11446, mlcod=49'11444)", 2024-09-12T22:05:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:00.559733+0000", 2024-09-12T22:05:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001541331, 2024-09-12T22:05:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017073100000000001, 2024-09-12T22:05:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559733+0000", 2024-09-12T22:05:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559733+0000", 2024-09-12T22:05:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559734+0000", 2024-09-12T22:05:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:05:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559739+0000", 2024-09-12T22:05:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7450000000000003e-06 2024-09-12T22:05:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559749+0000", 2024-09-12T22:05:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0411000000000001e-05 2024-09-12T22:05:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559755+0000", 2024-09-12T22:05:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3010000000000003e-06 2024-09-12T22:05:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559796+0000", 2024-09-12T22:05:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1081999999999997e-05 2024-09-12T22:05:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559816+0000", 2024-09-12T22:05:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9760000000000001e-05 2024-09-12T22:05:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:182517 5.6 5:693cb2b3:::benchmark_data_smithi043_32659_object15279:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:05:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:00.559975+0000", 2024-09-12T22:05:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001299358, 2024-09-12T22:05:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015222650000000001, 2024-09-12T22:05:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 182517 2024-09-12T22:05:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559975+0000", 2024-09-12T22:05:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559975+0000", 2024-09-12T22:05:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559976+0000", 2024-09-12T22:05:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2099999999999995e-07 2024-09-12T22:05:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559980+0000", 2024-09-12T22:05:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:05:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559991+0000", 2024-09-12T22:05:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0917999999999999e-05 2024-09-12T22:05:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.559998+0000", 2024-09-12T22:05:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6420000000000001e-06 2024-09-12T22:05:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560057+0000", 2024-09-12T22:05:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.94e-05 2024-09-12T22:05:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560224+0000", 2024-09-12T22:05:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016700600000000001 2024-09-12T22:05:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560358+0000", 2024-09-12T22:05:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133857 2024-09-12T22:05:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:182514 5.d e49/40 5:bb734fea:::benchmark_data_smithi043_32659_object15276:head v 49'11360, mlcod=49'11358)", 2024-09-12T22:05:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:00.560095+0000", 2024-09-12T22:05:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0011801890000000001, 2024-09-12T22:05:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001473806, 2024-09-12T22:05:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560095+0000", 2024-09-12T22:05:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560095+0000", 2024-09-12T22:05:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560095+0000", 2024-09-12T22:05:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-07 2024-09-12T22:05:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560100+0000", 2024-09-12T22:05:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6940000000000003e-06 2024-09-12T22:05:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560109+0000", 2024-09-12T22:05:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7960000000000001e-06 2024-09-12T22:05:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560114+0000", 2024-09-12T22:05:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8119999999999996e-06 2024-09-12T22:05:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560155+0000", 2024-09-12T22:05:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0447000000000001e-05 2024-09-12T22:05:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560173+0000", 2024-09-12T22:05:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7969e-05 2024-09-12T22:05:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "MOSDPGPushReply(5.6 49/40 [PushReplyOp(5:685b2ba9:::benchmark_data_smithi043_32659_object80749:head)])", 2024-09-12T22:05:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:00.560306+0000", 2024-09-12T22:05:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000968785, 2024-09-12T22:05:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001321343, 2024-09-12T22:05:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560306+0000", 2024-09-12T22:05:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560306+0000", 2024-09-12T22:05:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560306+0000", 2024-09-12T22:05:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:05:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560311+0000", 2024-09-12T22:05:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2760000000000002e-06 2024-09-12T22:05:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560321+0000", 2024-09-12T22:05:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0171e-05 2024-09-12T22:05:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560328+0000", 2024-09-12T22:05:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2790000000000001e-06 2024-09-12T22:05:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:182493 5.6 e49/40)", 2024-09-12T22:05:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:00.560355+0000", 2024-09-12T22:05:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00091981500000000004, 2024-09-12T22:05:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001300881, 2024-09-12T22:05:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560355+0000", 2024-09-12T22:05:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560355+0000", 2024-09-12T22:05:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560355+0000", 2024-09-12T22:05:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3099999999999999e-07 2024-09-12T22:05:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560358+0000", 2024-09-12T22:05:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.633e-06 2024-09-12T22:05:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560367+0000", 2024-09-12T22:05:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9039999999999998e-06 2024-09-12T22:05:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560372+0000", 2024-09-12T22:05:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7250000000000002e-06 2024-09-12T22:05:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:182518 5.6 5.5f212176 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:05:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:00.560580+0000", 2024-09-12T22:05:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00069451799999999998, 2024-09-12T22:05:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001109072, 2024-09-12T22:05:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 182518 2024-09-12T22:05:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560580+0000", 2024-09-12T22:05:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560580+0000", 2024-09-12T22:05:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560581+0000", 2024-09-12T22:05:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.68e-07 2024-09-12T22:05:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560584+0000", 2024-09-12T22:05:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3270000000000001e-06 2024-09-12T22:05:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560596+0000", 2024-09-12T22:05:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2057e-05 2024-09-12T22:05:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.560604+0000", 2024-09-12T22:05:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2919999999999998e-06 2024-09-12T22:05:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:182512 5.f e49/40 5:ff9317e8:::benchmark_data_smithi043_32659_object15274:head v 49'11447, mlcod=49'11444)", 2024-09-12T22:05:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:00.561526+0000", 2024-09-12T22:05:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9997492, 2024-09-12T22:05:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019718000000000001, 2024-09-12T22:05:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.561526+0000", 2024-09-12T22:05:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.561526+0000", 2024-09-12T22:05:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.561526+0000", 2024-09-12T22:05:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4000000000000002e-07 2024-09-12T22:05:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.561531+0000", 2024-09-12T22:05:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:05:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.561537+0000", 2024-09-12T22:05:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2700000000000001e-06 2024-09-12T22:05:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.561542+0000", 2024-09-12T22:05:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4780000000000002e-06 2024-09-12T22:05:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.561581+0000", 2024-09-12T22:05:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9239999999999997e-05 2024-09-12T22:05:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.561601+0000", 2024-09-12T22:05:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9361999999999999e-05 2024-09-12T22:05:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:182493 5.6 5:61701055:::benchmark_data_smithi043_32659_object15255:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:05:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:00.553905+0000", 2024-09-12T22:05:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0073692749999999998, 2024-09-12T22:05:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078520120000000002, 2024-09-12T22:05:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 182493 2024-09-12T22:05:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.553905+0000", 2024-09-12T22:05:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.553905+0000", 2024-09-12T22:05:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.553906+0000", 2024-09-12T22:05:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7199999999999997e-07 2024-09-12T22:05:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.553911+0000", 2024-09-12T22:05:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7620000000000003e-06 2024-09-12T22:05:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.553923+0000", 2024-09-12T22:05:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1477e-05 2024-09-12T22:05:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.553931+0000", 2024-09-12T22:05:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3340000000000002e-06 2024-09-12T22:05:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.554904+0000", 2024-09-12T22:05:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00097262399999999995 2024-09-12T22:05:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.555077+0000", 2024-09-12T22:05:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017326900000000001 2024-09-12T22:05:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.555144+0000", 2024-09-12T22:05:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6909000000000006e-05 2024-09-12T22:05:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:00.557108+0000", 2024-09-12T22:05:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019642129999999998 2024-09-12T22:05:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 10 2024-09-12T22:05:00.612 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:00.614 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:00.614 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:00.612+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:00.714 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:00.713+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:00.803 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:00.803 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:00.816 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:00.816 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:00.814+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:00.917 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:00.916+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:01.006 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:01.006 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:01.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:01.006 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:01.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.006 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:01.006 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:05:01.007 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.369962313000002, 2024-09-12T22:05:01.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:05:01.007 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.007 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.007 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.007 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:05:01.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.007 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:05:01.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:05:01.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:05:01.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:05:01.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:05:01.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:05:01.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:05:01.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:05:01.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:05:01.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:05:01.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:05:01.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:05:01.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:05:01.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:05:01.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:05:01.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:05:01.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:05:01.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:05:01.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:05:01.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:05:01.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:05:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:05:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:05:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:05:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.592656187999999, 2024-09-12T22:05:01.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:01.014 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.014 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.014 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:01.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.014 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:01.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.014 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:01.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:01.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:01.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:01.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:01.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:01.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:01.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:01.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:01.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:01.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:01.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:01.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:01.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:01.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:01.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:01.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:01.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:01.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:01.018 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.018 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.018 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.018 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:01.019 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:01.019 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.592476258000001, 2024-09-12T22:05:01.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:01.019 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.019 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.019 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:01.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.020 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.020 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:01.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.020 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:01.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:01.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:01.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:01.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:01.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:01.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:01.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:01.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:01.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:01.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:01.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:01.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:01.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:01.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:01.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:01.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:01.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:01.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:01.024 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.024 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.024 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.024 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:01.024 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:01.025 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.592409817, 2024-09-12T22:05:01.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:01.025 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.025 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.025 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:01.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.025 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:01.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.025 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:01.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:01.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:01.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:01.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:01.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:01.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:01.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:01.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:01.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:01.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:01.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:01.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:01.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:01.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:01.029 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.029 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.029 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.030 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:01.030 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:01.030 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.592353373999998, 2024-09-12T22:05:01.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:01.030 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.030 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.030 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.030 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.030 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.030 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.030 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:01.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.030 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:01.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:01.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:01.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:01.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:01.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:01.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:01.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:01.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:01.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:01.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:01.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:01.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:01.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:01.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:01.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:01.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:01.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:01.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:01.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:01.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:01.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:01.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:01.036 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.036 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.036 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.036 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:01.036 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:01.036 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.592284914, 2024-09-12T22:05:01.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:01.037 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.037 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.037 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.037 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:01.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.037 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:01.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:01.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:01.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:01.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:01.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:01.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:01.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:01.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:01.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:01.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:01.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:01.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:01.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:01.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:01.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:01.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:01.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:01.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:01.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:01.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:01.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:01.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:01.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:01.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:01.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:01.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:01.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:01.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:01.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.043 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.043 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:01.043 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:01.044 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.592227178999998, 2024-09-12T22:05:01.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:01.044 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.044 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.044 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.044 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:01.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.044 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:01.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:01.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:01.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:01.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:01.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:01.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:01.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:01.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:01.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:01.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:01.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:01.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:01.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:01.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:01.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:01.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:01.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:01.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:01.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:01.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:01.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:01.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:01.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:01.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:01.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.050 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.050 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:01.050 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:01.050 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.592159487, 2024-09-12T22:05:01.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:01.050 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.050 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.051 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.051 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:01.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.051 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:01.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:01.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:01.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:01.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:01.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:01.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:01.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:01.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:01.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:01.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:01.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:01.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:01.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:01.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:01.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:01.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:01.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:01.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.057 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.057 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.057 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:01.057 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:01.057 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.592104424999999, 2024-09-12T22:05:01.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:01.057 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.057 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.057 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.058 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.058 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:01.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.058 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:01.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:01.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:01.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:01.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:01.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:01.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:01.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:01.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:01.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:01.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:01.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:01.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:01.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:01.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:01.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:01.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:01.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:01.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:01.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:01.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:01.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:01.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:01.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:01.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:01.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:01.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:01.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:01.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:01.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.064 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.064 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:01.064 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:01.064 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.551456904999998, 2024-09-12T22:05:01.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:01.064 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.064 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.064 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.065 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.065 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.065 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:01.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.065 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:01.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:01.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.548843176999998, 2024-09-12T22:05:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117396 5.1 5:83c565df:::benchmark_data_smithi043_32659_object117395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.548702054, 2024-09-12T22:05:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.090595995999999998, 2024-09-12T22:05:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117396 2024-09-12T22:05:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454559+0000", 2024-09-12T22:05:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:05:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454629+0000", 2024-09-12T22:05:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0036000000000005e-05 2024-09-12T22:05:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454641+0000", 2024-09-12T22:05:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2232000000000001e-05 2024-09-12T22:05:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454649+0000", 2024-09-12T22:05:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-12T22:05:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454697+0000", 2024-09-12T22:05:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8028000000000002e-05 2024-09-12T22:05:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454702+0000", 2024-09-12T22:05:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:05:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540467+0000", 2024-09-12T22:05:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085764217000000004 2024-09-12T22:05:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540596+0000", 2024-09-12T22:05:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129787 2024-09-12T22:05:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540774+0000", 2024-09-12T22:05:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017746799999999999 2024-09-12T22:05:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544679+0000", 2024-09-12T22:05:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003904996 2024-09-12T22:05:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545009+0000", 2024-09-12T22:05:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033056600000000002 2024-09-12T22:05:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545067+0000", 2024-09-12T22:05:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7871999999999997e-05 2024-09-12T22:05:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545154+0000", 2024-09-12T22:05:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6701999999999998e-05 2024-09-12T22:05:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117398 5.6 5:6d151138:::benchmark_data_smithi043_32659_object117397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:05:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.527406883000001, 2024-09-12T22:05:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044999137000000002, 2024-09-12T22:05:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117398 2024-09-12T22:05:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:05:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:05:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475854+0000", 2024-09-12T22:05:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:05:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475914+0000", 2024-09-12T22:05:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9422999999999997e-05 2024-09-12T22:05:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475925+0000", 2024-09-12T22:05:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0881e-05 2024-09-12T22:05:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475930+0000", 2024-09-12T22:05:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:05:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475974+0000", 2024-09-12T22:05:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3810999999999998e-05 2024-09-12T22:05:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475981+0000", 2024-09-12T22:05:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1590000000000004e-06 2024-09-12T22:05:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504359+0000", 2024-09-12T22:05:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028377711 2024-09-12T22:05:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504526+0000", 2024-09-12T22:05:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167023 2024-09-12T22:05:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504661+0000", 2024-09-12T22:05:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135148 2024-09-12T22:05:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.506563+0000", 2024-09-12T22:05:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901778 2024-09-12T22:05:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520770+0000", 2024-09-12T22:05:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014206724 2024-09-12T22:05:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520803+0000", 2024-09-12T22:05:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3083000000000002e-05 2024-09-12T22:05:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520852+0000", 2024-09-12T22:05:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9543999999999999e-05 2024-09-12T22:05:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117399 5.3 5:ce33c2c7:::benchmark_data_smithi043_32659_object117398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:05:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.522637889999999, 2024-09-12T22:05:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038176902999999998, 2024-09-12T22:05:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117399 2024-09-12T22:05:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:05:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:05:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480624+0000", 2024-09-12T22:05:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.322e-06 2024-09-12T22:05:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480670+0000", 2024-09-12T22:05:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6365000000000001e-05 2024-09-12T22:05:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480682+0000", 2024-09-12T22:05:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:05:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480689+0000", 2024-09-12T22:05:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:05:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480731+0000", 2024-09-12T22:05:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480738+0000", 2024-09-12T22:05:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:05:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513753+0000", 2024-09-12T22:05:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.033015125999999999 2024-09-12T22:05:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513935+0000", 2024-09-12T22:05:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018219500000000001 2024-09-12T22:05:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.514170+0000", 2024-09-12T22:05:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000234694 2024-09-12T22:05:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518462+0000", 2024-09-12T22:05:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004291563 2024-09-12T22:05:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518655+0000", 2024-09-12T22:05:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019362700000000001 2024-09-12T22:05:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518710+0000", 2024-09-12T22:05:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:05:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518799+0000", 2024-09-12T22:05:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9000999999999997e-05 2024-09-12T22:05:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117407 5.c 5:3c61c1b7:::benchmark_data_smithi043_32659_object117406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:05:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.489432376, 2024-09-12T22:05:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042860548999999998, 2024-09-12T22:05:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117407 2024-09-12T22:05:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:05:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:05:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513829+0000", 2024-09-12T22:05:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-12T22:05:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513900+0000", 2024-09-12T22:05:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1482000000000004e-05 2024-09-12T22:05:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513909+0000", 2024-09-12T22:05:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8370000000000003e-06 2024-09-12T22:05:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513917+0000", 2024-09-12T22:05:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:05:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513967+0000", 2024-09-12T22:05:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.007e-05 2024-09-12T22:05:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513975+0000", 2024-09-12T22:05:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5639999999999999e-06 2024-09-12T22:05:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542411+0000", 2024-09-12T22:05:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028436032999999999 2024-09-12T22:05:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542539+0000", 2024-09-12T22:05:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012777900000000001 2024-09-12T22:05:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542687+0000", 2024-09-12T22:05:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148343 2024-09-12T22:05:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548120+0000", 2024-09-12T22:05:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054333580000000001 2024-09-12T22:05:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556549+0000", 2024-09-12T22:05:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084288309999999995 2024-09-12T22:05:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556596+0000", 2024-09-12T22:05:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6458999999999997e-05 2024-09-12T22:05:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556688+0000", 2024-09-12T22:05:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2676999999999994e-05 2024-09-12T22:05:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.003629081, 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.003150593000001, 2024-09-12T22:05:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.000655293000001, 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.999574502000002, 2024-09-12T22:05:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.99833894, 2024-09-12T22:05:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:01.134 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:01.135 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:01.136 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:01.134+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:01.236 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:01.235+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:01.297 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:184606 5.6 e49/40 5:6dca15f0:::benchmark_data_smithi043_32659_object17368:head v 49'11446, mlcod=49'11444)", 2024-09-12T22:05:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:01.293105+0000", 2024-09-12T22:05:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0028741320000000002, 2024-09-12T22:05:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002896615, 2024-09-12T22:05:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293105+0000", 2024-09-12T22:05:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293105+0000", 2024-09-12T22:05:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293105+0000", 2024-09-12T22:05:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5499999999999998e-07 2024-09-12T22:05:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293109+0000", 2024-09-12T22:05:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5760000000000002e-06 2024-09-12T22:05:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293119+0000", 2024-09-12T22:05:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8810000000000008e-06 2024-09-12T22:05:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293132+0000", 2024-09-12T22:05:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3349e-05 2024-09-12T22:05:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293175+0000", 2024-09-12T22:05:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2892999999999997e-05 2024-09-12T22:05:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293195+0000", 2024-09-12T22:05:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0384999999999999e-05 2024-09-12T22:05:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:184612 5.d 5:b288a982:::benchmark_data_smithi043_32659_object17374:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:05:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:01.293135+0000", 2024-09-12T22:05:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0028437219999999999, 2024-09-12T22:05:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00293115, 2024-09-12T22:05:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 184612 2024-09-12T22:05:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293135+0000", 2024-09-12T22:05:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293135+0000", 2024-09-12T22:05:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293136+0000", 2024-09-12T22:05:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1299999999999999e-07 2024-09-12T22:05:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293140+0000", 2024-09-12T22:05:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8460000000000001e-06 2024-09-12T22:05:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293148+0000", 2024-09-12T22:05:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8439999999999998e-06 2024-09-12T22:05:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293154+0000", 2024-09-12T22:05:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2600000000000002e-06 2024-09-12T22:05:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.295355+0000", 2024-09-12T22:05:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022014769999999999 2024-09-12T22:05:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.295510+0000", 2024-09-12T22:05:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000154921 2024-09-12T22:05:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.295612+0000", 2024-09-12T22:05:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000102209 2024-09-12T22:05:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:184610 5.7 e49/40 5:e8dca89d:::benchmark_data_smithi043_32659_object17372:head v 49'11595, mlcod=49'11592)", 2024-09-12T22:05:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:01.293382+0000", 2024-09-12T22:05:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0025965530000000001, 2024-09-12T22:05:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027561790000000001, 2024-09-12T22:05:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293382+0000", 2024-09-12T22:05:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293382+0000", 2024-09-12T22:05:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293383+0000", 2024-09-12T22:05:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2200000000000004e-07 2024-09-12T22:05:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293387+0000", 2024-09-12T22:05:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4580000000000003e-06 2024-09-12T22:05:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293394+0000", 2024-09-12T22:05:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9859999999999997e-06 2024-09-12T22:05:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293399+0000", 2024-09-12T22:05:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0799999999999996e-06 2024-09-12T22:05:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.294947+0000", 2024-09-12T22:05:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001547465 2024-09-12T22:05:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.294968+0000", 2024-09-12T22:05:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0845000000000001e-05 2024-09-12T22:05:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:184611 5.5 e49/40 5:a05f9355:::benchmark_data_smithi043_32659_object17373:head v 49'11589, mlcod=49'11584)", 2024-09-12T22:05:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:01.293501+0000", 2024-09-12T22:05:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0024781059999999999, 2024-09-12T22:05:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026979539999999998, 2024-09-12T22:05:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293501+0000", 2024-09-12T22:05:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293501+0000", 2024-09-12T22:05:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293501+0000", 2024-09-12T22:05:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4000000000000002e-07 2024-09-12T22:05:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293506+0000", 2024-09-12T22:05:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:05:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293513+0000", 2024-09-12T22:05:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6159999999999996e-06 2024-09-12T22:05:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293519+0000", 2024-09-12T22:05:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:05:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.294153+0000", 2024-09-12T22:05:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00063398600000000001 2024-09-12T22:05:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.294169+0000", 2024-09-12T22:05:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6384000000000001e-05 2024-09-12T22:05:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:184613 5.4 5:2a2a8600:::benchmark_data_smithi043_32659_object17375:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:05:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:01.293650+0000", 2024-09-12T22:05:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0023286449999999998, 2024-09-12T22:05:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026143920000000001, 2024-09-12T22:05:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 184613 2024-09-12T22:05:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293650+0000", 2024-09-12T22:05:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293650+0000", 2024-09-12T22:05:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293651+0000", 2024-09-12T22:05:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.54e-07 2024-09-12T22:05:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293655+0000", 2024-09-12T22:05:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:05:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293665+0000", 2024-09-12T22:05:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9259999999999995e-06 2024-09-12T22:05:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293671+0000", 2024-09-12T22:05:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6039999999999998e-06 2024-09-12T22:05:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.294137+0000", 2024-09-12T22:05:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046595600000000001 2024-09-12T22:05:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.294280+0000", 2024-09-12T22:05:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000142449 2024-09-12T22:05:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.296167+0000", 2024-09-12T22:05:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001887634 2024-09-12T22:05:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.296272+0000", 2024-09-12T22:05:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104485 2024-09-12T22:05:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:184614 5.5 e49/40 5:ae609756:::benchmark_data_smithi043_32659_object17376:head v 49'11590, mlcod=49'11584)", 2024-09-12T22:05:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:01.295356+0000", 2024-09-12T22:05:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00062271199999999998, 2024-09-12T22:05:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00099811100000000009, 2024-09-12T22:05:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.295356+0000", 2024-09-12T22:05:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.295356+0000", 2024-09-12T22:05:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.295357+0000", 2024-09-12T22:05:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9299999999999998e-07 2024-09-12T22:05:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.295360+0000", 2024-09-12T22:05:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8210000000000003e-06 2024-09-12T22:05:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.295367+0000", 2024-09-12T22:05:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6309999999999997e-06 2024-09-12T22:05:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.295372+0000", 2024-09-12T22:05:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9529999999999998e-06 2024-09-12T22:05:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.295592+0000", 2024-09-12T22:05:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000219927 2024-09-12T22:05:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.295684+0000", 2024-09-12T22:05:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1914000000000001e-05 2024-09-12T22:05:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:184594 5.d 5:bba67b66:::benchmark_data_smithi043_32659_object17356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:05:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:01.286880+0000", 2024-09-12T22:05:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0090985059999999993, 2024-09-12T22:05:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0095456369999999992, 2024-09-12T22:05:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 184594 2024-09-12T22:05:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.286880+0000", 2024-09-12T22:05:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.286880+0000", 2024-09-12T22:05:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.286881+0000", 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6300000000000005e-07 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.286884+0000", 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3179999999999998e-06 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.286890+0000", 2024-09-12T22:05:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1539999999999999e-06 2024-09-12T22:05:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.286894+0000", 2024-09-12T22:05:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9439999999999998e-06 2024-09-12T22:05:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.288512+0000", 2024-09-12T22:05:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0016179300000000001 2024-09-12T22:05:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.288658+0000", 2024-09-12T22:05:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014634700000000001 2024-09-12T22:05:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.288755+0000", 2024-09-12T22:05:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6602999999999996e-05 2024-09-12T22:05:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.291685+0000", 2024-09-12T22:05:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0029296859999999999 2024-09-12T22:05:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:184616 5.1 e49/40 5:8a530560:::benchmark_data_smithi043_32659_object17378:head v 49'11469, mlcod=49'11467)", 2024-09-12T22:05:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:01.296409+0000", 2024-09-12T22:05:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9995699, 2024-09-12T22:05:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7733999999999996e-05, 2024-09-12T22:05:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.296409+0000", 2024-09-12T22:05:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.296409+0000", 2024-09-12T22:05:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.296410+0000", 2024-09-12T22:05:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:05:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.296419+0000", 2024-09-12T22:05:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1030000000000008e-06 2024-09-12T22:05:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.296427+0000", 2024-09-12T22:05:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0409999999999998e-06 2024-09-12T22:05:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.296433+0000", 2024-09-12T22:05:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8640000000000001e-06 2024-09-12T22:05:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.296476+0000", 2024-09-12T22:05:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3273999999999999e-05 2024-09-12T22:05:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.296496+0000", 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0072e-05 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:184596 5.f 5:fa291d87:::benchmark_data_smithi043_32659_object17358:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:01.288538+0000", 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0074408039999999996, 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0080187490000000004, 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 184596 2024-09-12T22:05:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.288538+0000", 2024-09-12T22:05:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.288538+0000", 2024-09-12T22:05:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.288538+0000", 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.288541+0000", 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4590000000000001e-06 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.288550+0000", 2024-09-12T22:05:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1400000000000006e-06 2024-09-12T22:05:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.288555+0000", 2024-09-12T22:05:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8679999999999998e-06 2024-09-12T22:05:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.291091+0000", 2024-09-12T22:05:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025360109999999999 2024-09-12T22:05:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.291240+0000", 2024-09-12T22:05:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000148703 2024-09-12T22:05:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.291337+0000", 2024-09-12T22:05:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7726000000000006e-05 2024-09-12T22:05:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293277+0000", 2024-09-12T22:05:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001939458 2024-09-12T22:05:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:184604 5.f 5:f4f80c4e:::benchmark_data_smithi043_32659_object17366:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:05:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:01.290014+0000", 2024-09-12T22:05:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.005965209, 2024-09-12T22:05:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0065846309999999996, 2024-09-12T22:05:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 184604 2024-09-12T22:05:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.290014+0000", 2024-09-12T22:05:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.290014+0000", 2024-09-12T22:05:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.290014+0000", 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8199999999999998e-07 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.290019+0000", 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0829999999999997e-06 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.290027+0000", 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6449999999999994e-06 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.290033+0000", 2024-09-12T22:05:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2020000000000001e-06 2024-09-12T22:05:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293343+0000", 2024-09-12T22:05:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033096129999999999 2024-09-12T22:05:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293593+0000", 2024-09-12T22:05:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00024987799999999998 2024-09-12T22:05:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293662+0000", 2024-09-12T22:05:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8979000000000005e-05 2024-09-12T22:05:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:184602 5.5 e49/40 5:aac2d22b:::benchmark_data_smithi043_32659_object17364:head v 49'11587, mlcod=49'11584)", 2024-09-12T22:05:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:01.290167+0000", 2024-09-12T22:05:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0058121300000000004, 2024-09-12T22:05:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00647761, 2024-09-12T22:05:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.290167+0000", 2024-09-12T22:05:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.290167+0000", 2024-09-12T22:05:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.290167+0000", 2024-09-12T22:05:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2099999999999996e-07 2024-09-12T22:05:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.290173+0000", 2024-09-12T22:05:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3689999999999998e-06 2024-09-12T22:05:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.290182+0000", 2024-09-12T22:05:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9879999999999993e-06 2024-09-12T22:05:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.290187+0000", 2024-09-12T22:05:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8560000000000003e-06 2024-09-12T22:05:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.291436+0000", 2024-09-12T22:05:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012480519999999999 2024-09-12T22:05:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.291453+0000", 2024-09-12T22:05:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7438000000000001e-05 2024-09-12T22:05:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:184603 5.5 e49/40 5:a8bc507a:::benchmark_data_smithi043_32659_object17365:head v 49'11588, mlcod=49'11584)", 2024-09-12T22:05:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:01.291740+0000", 2024-09-12T22:05:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0042384629999999996, 2024-09-12T22:05:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004961905, 2024-09-12T22:05:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.291740+0000", 2024-09-12T22:05:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.291740+0000", 2024-09-12T22:05:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.291741+0000", 2024-09-12T22:05:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0399999999999995e-07 2024-09-12T22:05:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.291746+0000", 2024-09-12T22:05:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:05:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.291756+0000", 2024-09-12T22:05:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4809999999999995e-06 2024-09-12T22:05:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.291761+0000", 2024-09-12T22:05:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:05:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293043+0000", 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00128185 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293062+0000", 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9029e-05 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:184609 5.f 5:f08e7d2e:::benchmark_data_smithi043_32659_object17371:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:05:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:01.292991+0000", 2024-09-12T22:05:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0029873299999999998, 2024-09-12T22:05:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037722060000000002, 2024-09-12T22:05:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 184609 2024-09-12T22:05:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.292991+0000", 2024-09-12T22:05:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.292991+0000", 2024-09-12T22:05:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.292992+0000", 2024-09-12T22:05:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:05:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.292995+0000", 2024-09-12T22:05:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7089999999999998e-06 2024-09-12T22:05:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293001+0000", 2024-09-12T22:05:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8419999999999999e-06 2024-09-12T22:05:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.293007+0000", 2024-09-12T22:05:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7060000000000001e-06 2024-09-12T22:05:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.294958+0000", 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019510949999999999 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.295093+0000", 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013484599999999999 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:01.295179+0000", 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5443000000000002e-05 2024-09-12T22:05:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.356 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:01.356 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.356 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:01.356 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:01.356 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 13 2024-09-12T22:05:01.356 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:01.357 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:01.356+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:01.358 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:01.455 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-09-12T22:05:01.458 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:01.457+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:01.471 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:05:01.521 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:01.521 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:01.521 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:01.521 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:01.522 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:01.535 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:01.559 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:01.558+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:01.599 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:01.599 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:01.618 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:01.618 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:01.621 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:01.621 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:01.660 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:01.658+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:01.735 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:01.735 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:01.749 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:01.760 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:01.760+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:01.862 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:01.860+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:01.897 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:01.897 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:01.909 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:01.962 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:01.961+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:02.063 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:02.062+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:02.095 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:02.096 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:02.107 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:02.164 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:02.163+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:02.253 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:02.253 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:02.265 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:02.264+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:02.266 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:02.365 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:02.364+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:02.425 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:02.425 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:02.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:02.481 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:02.480+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:02.568 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:02.567+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:02.591 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:02.591 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:02.604 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:02.669 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:02.668+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:02.770 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:02.768+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:02.804 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:02.804 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:02.817 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:02.870 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:02.869+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:02.969 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:02.970 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:02.970 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:02.969+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:02.982 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:03.072 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:03.070+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:03.170 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:03.170 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:03.172 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:03.171+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:03.183 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:03.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:03.272+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:03.367 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:03.367 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:03.374 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:03.373+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:03.379 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:03.470 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:05:03.475 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:03.474+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:03.544 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:03.544 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:03.559 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:03.575 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:03.574+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:03.622 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:05:03.677 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:03.676+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:03.732 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:03.750 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:03.751 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:03.764 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:03.765 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:03.769 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:03.770 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:03.773 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:03.773 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:03.777 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:03.776+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:03.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:03.878 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:03.877+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:03.979 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:03.977+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:03.984 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:03.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:03.984 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:03.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.984 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:03.984 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:03.984 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 59.354856421000001, 2024-09-12T22:05:03.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:05:03.984 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:03.984 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:03.984 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:03.985 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:03.985 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:03.985 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:03.985 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:05:03.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.985 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:03.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:03.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:03.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:03.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:03.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:03.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:03.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:03.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:05:03.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:05:03.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:03.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:05:03.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:05:03.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:03.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:05:03.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:05:03.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:03.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:05:03.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:05:03.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:03.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:05:03.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:05:03.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:03.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:05:03.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:05:03.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:03.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:05:03.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:05:03.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:03.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:05:03.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:05:03.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:03.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:05:03.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:05:03.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:03.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:05:03.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:05:03.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:03.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:05:03.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:05:03.990 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:03.990 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:03.990 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:03.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.990 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:03.990 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:03.990 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 59.349455481, 2024-09-12T22:05:03.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:05:03.991 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:03.991 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:03.991 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:03.991 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:03.991 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:03.991 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:03.991 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:05:03.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.991 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:03.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:03.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:03.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:03.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:03.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:03.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:03.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:03.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:03.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:03.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:05:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:05:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:05:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:05:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:05:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:05:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:03.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:05:03.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:05:03.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:03.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:05:03.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:05:03.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:03.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:05:03.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:05:03.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:03.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:05:03.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:05:03.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:03.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:05:03.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:05:03.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:03.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:05:03.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:05:03.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:03.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:05:03.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:05:03.996 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:03.996 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:03.996 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:03.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.996 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:03.996 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:05:03.996 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 59.348514213999998, 2024-09-12T22:05:03.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:03.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:05:03.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:03.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:03.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:05:03.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:05:03.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:03.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:05:03.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:05:03.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:03.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:05:03.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:05:03.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:03.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:05:03.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:05:03.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:03.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:03.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:03.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:05:03.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:05:04.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:05:04.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:05:04.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:04.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:05:04.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:05:04.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:05:04.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:05:04.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:04.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:05:04.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:05:04.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:05:04.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:05:04.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:05:04.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:05:04.002 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.002 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.002 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.002 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:04.002 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:05:04.002 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 59.347516294000002, 2024-09-12T22:05:04.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:05:04.002 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.002 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:05:04.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:05:04.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:05:04.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:05:04.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:05:04.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:05:04.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:05:04.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:05:04.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:05:04.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:05:04.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:05:04.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:05:04.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:05:04.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:04.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:05:04.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:05:04.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:05:04.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:05:04.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:04.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:05:04.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:05:04.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:05:04.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:05:04.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:05:04.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:05:04.008 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.008 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.008 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.008 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.008 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:04.008 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.983767595, 2024-09-12T22:05:04.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:05:04.008 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.008 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.008 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.008 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.009 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.009 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.009 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:05:04.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.009 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:04.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:04.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:05:04.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:05:04.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:05:04.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:05:04.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:05:04.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:05:04.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:05:04.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:05:04.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:04.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:05:04.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:05:04.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:05:04.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:05:04.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:04.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:05:04.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:05:04.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:05:04.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:05:04.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:05:04.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:05:04.014 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.014 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.014 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.014 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.014 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:04.014 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.98313439, 2024-09-12T22:05:04.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:04.014 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.014 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.014 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.014 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:04.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:04.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:04.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:04.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:04.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:04.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:04.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:04.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:04.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:04.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:04.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:04.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:04.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:04.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:04.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:04.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:04.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:04.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:04.019 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.019 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.019 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.019 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.019 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:04.019 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.981314727000001, 2024-09-12T22:05:04.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:04.019 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.019 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.019 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.020 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.020 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.020 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.020 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:04.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.020 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:04.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:04.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:04.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:04.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:04.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:04.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:04.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:04.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:04.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:04.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:04.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:04.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:04.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:04.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:04.024 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.024 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.024 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.024 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.024 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:04.024 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.981147100000001, 2024-09-12T22:05:04.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:05:04.024 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:05:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:05:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:05:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:05:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:05:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:05:04.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:05:04.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:05:04.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:05:04.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:05:04.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:05:04.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:05:04.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:05:04.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:04.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:05:04.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:05:04.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:05:04.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:05:04.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:05:04.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:05:04.029 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.029 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.029 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.029 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:05:04.029 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:04.030 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.981006436000001, 2024-09-12T22:05:04.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:05:04.030 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.030 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.030 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.030 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:04.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:04.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:05:04.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:05:04.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:05:04.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:05:04.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:05:04.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:05:04.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:05:04.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:05:04.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:05:04.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:05:04.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:05:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:05:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:05:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:05:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:05:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:05:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.034 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.034 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.034 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.034 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:04.034 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.980780913, 2024-09-12T22:05:04.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:04.034 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.034 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.034 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.034 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.034 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.034 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.035 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:04.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.035 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:04.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:04.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:04.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:04.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:04.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:04.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:04.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:04.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:04.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:04.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:04.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:04.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:04.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:04.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:04.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:04.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:04.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:04.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:04.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:04.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:04.039 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.039 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.039 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.039 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.039 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:04.039 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.980661209000001, 2024-09-12T22:05:04.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:05:04.039 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.039 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.039 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.039 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.040 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.040 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.040 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:05:04.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.040 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:04.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:04.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:05:04.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:05:04.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:05:04.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:05:04.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:05:04.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:05:04.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:05:04.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:05:04.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:05:04.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:05:04.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:05:04.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:05:04.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:04.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:04.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:05:04.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:05:04.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:05:04.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:04.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:05:04.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:05:04.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:05:04.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:05:04.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:05:04.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:05:04.045 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.045 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.045 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.045 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:05:04.045 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:04.045 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.980069926999999, 2024-09-12T22:05:04.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:05:04.045 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.045 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.045 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:04.046 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:04.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:04.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:05:04.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:05:04.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:05:04.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:05:04.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:05:04.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:05:04.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:05:04.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:05:04.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:05:04.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:05:04.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:05:04.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:05:04.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:05:04.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:05:04.049 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.049 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.049 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.049 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:05:04.049 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:04.049 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.979846359, 2024-09-12T22:05:04.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:05:04.050 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.050 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.050 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.050 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:04.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:04.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:04.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:05:04.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:05:04.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:05:04.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:05:04.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:05:04.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:05:04.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:05:04.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:05:04.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:05:04.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:05:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:05:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:05:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:05:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:05:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:05:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.054 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.054 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:04.054 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.979754878000001, 2024-09-12T22:05:04.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:05:04.054 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.054 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.054 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.054 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.054 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.054 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.054 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:05:04.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:05:04.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:05:04.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:05:04.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:05:04.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:05:04.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:05:04.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:05:04.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:05:04.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:05:04.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:05:04.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:05:04.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:04.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:05:04.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:05:04.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:05:04.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:05:04.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:05:04.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:05:04.059 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.059 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.059 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.059 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.059 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:04.059 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.978966073999999, 2024-09-12T22:05:04.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:04.059 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.059 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.059 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.059 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.060 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.060 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.060 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:04.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.060 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:04.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:04.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:04.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:04.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:04.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:04.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:04.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:04.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:04.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:04.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:04.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:04.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:04.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:04.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:04.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:04.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:04.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:04.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:04.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:04.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:04.064 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.064 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.064 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.064 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.064 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:04.064 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.978701934, 2024-09-12T22:05:04.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:05:04.065 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.065 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.065 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.065 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.065 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.065 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.065 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:05:04.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.065 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:04.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:04.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:05:04.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:05:04.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:05:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:05:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:05:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:05:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:05:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:05:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:05:04.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:05:04.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:05:04.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:05:04.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:04.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:05:04.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:05:04.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:05:04.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:05:04.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:05:04.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:05:04.069 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.069 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.069 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.069 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:05:04.070 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:04.070 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.978196959000002, 2024-09-12T22:05:04.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:05:04.070 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.070 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.070 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.070 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:04.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:04.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:05:04.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:05:04.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:05:04.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:05:04.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:05:04.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:05:04.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:05:04.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:05:04.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:05:04.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:05:04.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:05:04.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:05:04.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:05:04.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:05:04.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:05:04.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:05:04.074 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.074 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.074 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.074 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:05:04.074 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:04.074 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.977067530999999, 2024-09-12T22:05:04.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:05:04.074 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.074 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.074 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.075 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:04.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:04.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:04.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:04.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:05:04.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:05:04.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:05:04.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:05:04.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:05:04.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:05:04.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:05:04.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:05:04.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:05:04.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:05:04.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:05:04.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:05:04.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:05:04.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:05:04.078 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.078 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.078 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.078 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.976313089000001, 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:04.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:04.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:05:04.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:04.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:05:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:05:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:05:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:05:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:05:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:05:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:05:04.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:05:04.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:05:04.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:04.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:05:04.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:05:04.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:05:04.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:05:04.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:05:04.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:05:04.084 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.084 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.084 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.084 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:05:04.084 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:04.084 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 24.975633986999998, 2024-09-12T22:05:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:05:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:05:04.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:05:04.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:05:04.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:05:04.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:05:04.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:05:04.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.088 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.089 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.089 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:04.090 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:04.089+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:04.090 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:04.191 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:04.190+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:04.236 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:04.236 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:04.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.236 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:192772 5.c 5:30b93bfc:::benchmark_data_smithi043_32659_object25534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:05:04.236 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:04.227897+0000", 2024-09-12T22:05:04.236 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0065882040000000003, 2024-09-12T22:05:04.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0066156160000000004, 2024-09-12T22:05:04.236 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.237 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.237 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.237 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.237 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.237 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.237 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 192772 2024-09-12T22:05:04.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.237 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.227897+0000", 2024-09-12T22:05:04.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.227897+0000", 2024-09-12T22:05:04.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.227898+0000", 2024-09-12T22:05:04.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0100000000000004e-07 2024-09-12T22:05:04.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.227902+0000", 2024-09-12T22:05:04.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8430000000000003e-06 2024-09-12T22:05:04.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.227911+0000", 2024-09-12T22:05:04.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1030000000000008e-06 2024-09-12T22:05:04.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.227917+0000", 2024-09-12T22:05:04.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.494e-06 2024-09-12T22:05:04.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.230330+0000", 2024-09-12T22:05:04.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024123119999999998 2024-09-12T22:05:04.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.230515+0000", 2024-09-12T22:05:04.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018539300000000001 2024-09-12T22:05:04.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.230665+0000", 2024-09-12T22:05:04.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014938000000000001 2024-09-12T22:05:04.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.233365+0000", 2024-09-12T22:05:04.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002700409 2024-09-12T22:05:04.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234400+0000", 2024-09-12T22:05:04.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001034695 2024-09-12T22:05:04.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234480+0000", 2024-09-12T22:05:04.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0061000000000005e-05 2024-09-12T22:05:04.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.242 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.242 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:192774 5.3 5:caf471c1:::benchmark_data_smithi043_32659_object25536:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:05:04.242 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:04.228673+0000", 2024-09-12T22:05:04.242 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0058126769999999996, 2024-09-12T22:05:04.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059442460000000003, 2024-09-12T22:05:04.242 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.242 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.242 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:04.242 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.242 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.243 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.243 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 192774 2024-09-12T22:05:04.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.243 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.228673+0000", 2024-09-12T22:05:04.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.228673+0000", 2024-09-12T22:05:04.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.228674+0000", 2024-09-12T22:05:04.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:05:04.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.228679+0000", 2024-09-12T22:05:04.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8330000000000001e-06 2024-09-12T22:05:04.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.228690+0000", 2024-09-12T22:05:04.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1e-05 2024-09-12T22:05:04.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.228701+0000", 2024-09-12T22:05:04.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1598e-05 2024-09-12T22:05:04.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.230565+0000", 2024-09-12T22:05:04.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001863551 2024-09-12T22:05:04.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.230674+0000", 2024-09-12T22:05:04.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010979700000000001 2024-09-12T22:05:04.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.230755+0000", 2024-09-12T22:05:04.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0139e-05 2024-09-12T22:05:04.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.231864+0000", 2024-09-12T22:05:04.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011093190000000001 2024-09-12T22:05:04.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234610+0000", 2024-09-12T22:05:04.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027464329999999999 2024-09-12T22:05:04.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.247 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.247 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:192775 5.c 5:34cad2a2:::benchmark_data_smithi043_32659_object25537:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:05:04.247 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:04.229861+0000", 2024-09-12T22:05:04.247 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.004624632, 2024-09-12T22:05:04.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048487419999999996, 2024-09-12T22:05:04.248 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.248 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.248 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:04.248 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.248 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.248 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.248 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 192775 2024-09-12T22:05:04.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.248 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.229861+0000", 2024-09-12T22:05:04.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.229861+0000", 2024-09-12T22:05:04.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.229862+0000", 2024-09-12T22:05:04.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2399999999999997e-07 2024-09-12T22:05:04.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.229865+0000", 2024-09-12T22:05:04.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9400000000000004e-06 2024-09-12T22:05:04.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.229872+0000", 2024-09-12T22:05:04.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0299999999999996e-06 2024-09-12T22:05:04.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.229877+0000", 2024-09-12T22:05:04.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7500000000000003e-06 2024-09-12T22:05:04.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.232280+0000", 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002402562 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.232441+0000", 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161442 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.232535+0000", 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4067999999999995e-05 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.233573+0000", 2024-09-12T22:05:04.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001037236 2024-09-12T22:05:04.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234657+0000", 2024-09-12T22:05:04.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010841640000000001 2024-09-12T22:05:04.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234713+0000", 2024-09-12T22:05:04.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6654999999999999e-05 2024-09-12T22:05:04.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.253 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.253 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.253 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:192780 5.6 5:6424afe2:::benchmark_data_smithi043_32659_object25542:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:05:04.253 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:04.233797+0000", 2024-09-12T22:05:04.253 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00068797300000000004, 2024-09-12T22:05:04.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010084390000000001, 2024-09-12T22:05:04.253 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.253 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.253 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:04.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 192780 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.233797+0000", 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.233797+0000", 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.233798+0000", 2024-09-12T22:05:04.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7000000000000004e-07 2024-09-12T22:05:04.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.233802+0000", 2024-09-12T22:05:04.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9790000000000004e-06 2024-09-12T22:05:04.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.233811+0000", 2024-09-12T22:05:04.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9339999999999995e-06 2024-09-12T22:05:04.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.233818+0000", 2024-09-12T22:05:04.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9299999999999997e-06 2024-09-12T22:05:04.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.233862+0000", 2024-09-12T22:05:04.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4304999999999997e-05 2024-09-12T22:05:04.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.233974+0000", 2024-09-12T22:05:04.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000112014 2024-09-12T22:05:04.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234070+0000", 2024-09-12T22:05:04.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5161999999999995e-05 2024-09-12T22:05:04.257 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.257 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.257 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.257 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "MOSDPGPushReply(5.6 50/40 [PushReplyOp(5:698b760b:::benchmark_data_smithi043_32659_object30358:head)])", 2024-09-12T22:05:04.258 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:04.234035+0000", 2024-09-12T22:05:04.258 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00045042699999999999, 2024-09-12T22:05:04.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00082159799999999999, 2024-09-12T22:05:04.258 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.258 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.258 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:04.258 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234035+0000", 2024-09-12T22:05:04.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234035+0000", 2024-09-12T22:05:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234035+0000", 2024-09-12T22:05:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-07 2024-09-12T22:05:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234037+0000", 2024-09-12T22:05:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0949999999999998e-06 2024-09-12T22:05:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234041+0000", 2024-09-12T22:05:04.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0550000000000001e-06 2024-09-12T22:05:04.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234049+0000", 2024-09-12T22:05:04.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1380000000000007e-06 2024-09-12T22:05:04.260 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.260 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.260 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.261 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:192782 5.1 5:81b7b7ad:::benchmark_data_smithi043_32659_object25544:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:05:04.261 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:04.234201+0000", 2024-09-12T22:05:04.261 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00028415599999999998, 2024-09-12T22:05:04.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00068196999999999995, 2024-09-12T22:05:04.261 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.261 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.261 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:04.261 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.261 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.261 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.261 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 192782 2024-09-12T22:05:04.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.261 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234201+0000", 2024-09-12T22:05:04.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234201+0000", 2024-09-12T22:05:04.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234202+0000", 2024-09-12T22:05:04.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:05:04.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234206+0000", 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9670000000000003e-06 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234215+0000", 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5609999999999999e-06 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234221+0000", 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1210000000000003e-06 2024-09-12T22:05:04.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234271+0000", 2024-09-12T22:05:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0303000000000003e-05 2024-09-12T22:05:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234455+0000", 2024-09-12T22:05:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000184222 2024-09-12T22:05:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234581+0000", 2024-09-12T22:05:04.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012602699999999999 2024-09-12T22:05:04.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.265 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.265 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:192783 5.6 5.72ae9f06 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:05:04.265 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:04.234244+0000", 2024-09-12T22:05:04.265 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000241766, 2024-09-12T22:05:04.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00068072100000000002, 2024-09-12T22:05:04.265 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.265 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.265 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:04.265 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.266 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 192783 2024-09-12T22:05:04.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.266 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234244+0000", 2024-09-12T22:05:04.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234244+0000", 2024-09-12T22:05:04.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234244+0000", 2024-09-12T22:05:04.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8999999999999996e-07 2024-09-12T22:05:04.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234247+0000", 2024-09-12T22:05:04.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7350000000000001e-06 2024-09-12T22:05:04.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234254+0000", 2024-09-12T22:05:04.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6989999999999997e-06 2024-09-12T22:05:04.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234260+0000", 2024-09-12T22:05:04.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:05:04.268 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.268 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.268 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.268 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:192785 5.5 5:aee64aa6:::benchmark_data_smithi043_32659_object25547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:05:04.268 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:04.234268+0000", 2024-09-12T22:05:04.269 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000217763, 2024-09-12T22:05:04.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00068543900000000004, 2024-09-12T22:05:04.269 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.269 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.269 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:04.269 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.269 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.269 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.269 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 192785 2024-09-12T22:05:04.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.269 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234268+0000", 2024-09-12T22:05:04.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234268+0000", 2024-09-12T22:05:04.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234268+0000", 2024-09-12T22:05:04.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:05:04.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234270+0000", 2024-09-12T22:05:04.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.916e-06 2024-09-12T22:05:04.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234275+0000", 2024-09-12T22:05:04.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4890000000000003e-06 2024-09-12T22:05:04.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234280+0000", 2024-09-12T22:05:04.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6519999999999997e-06 2024-09-12T22:05:04.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234315+0000", 2024-09-12T22:05:04.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4788e-05 2024-09-12T22:05:04.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234462+0000", 2024-09-12T22:05:04.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000146608 2024-09-12T22:05:04.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234573+0000", 2024-09-12T22:05:04.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111319 2024-09-12T22:05:04.273 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.273 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.273 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.273 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:192787 5.7 5:e0f59cfb:::benchmark_data_smithi043_32659_object25549:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:05:04.273 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:04.234292+0000", 2024-09-12T22:05:04.273 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000193313, 2024-09-12T22:05:04.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00069850900000000004, 2024-09-12T22:05:04.273 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.273 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.273 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:04.273 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.273 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.274 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.274 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 192787 2024-09-12T22:05:04.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.274 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234292+0000", 2024-09-12T22:05:04.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234292+0000", 2024-09-12T22:05:04.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234293+0000", 2024-09-12T22:05:04.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6700000000000003e-07 2024-09-12T22:05:04.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234295+0000", 2024-09-12T22:05:04.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9700000000000002e-06 2024-09-12T22:05:04.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234300+0000", 2024-09-12T22:05:04.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8150000000000002e-06 2024-09-12T22:05:04.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234305+0000", 2024-09-12T22:05:04.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3540000000000002e-06 2024-09-12T22:05:04.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234414+0000", 2024-09-12T22:05:04.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010949 2024-09-12T22:05:04.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234574+0000", 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016003100000000001 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234694+0000", 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119252 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:192774 5.3 e50/40 ondisk, result = 0)", 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:04.234299+0000", 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000186171, 2024-09-12T22:05:04.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00072789600000000001, 2024-09-12T22:05:04.278 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.278 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.278 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:04.278 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234299+0000", 2024-09-12T22:05:04.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234299+0000", 2024-09-12T22:05:04.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234300+0000", 2024-09-12T22:05:04.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:05:04.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234304+0000", 2024-09-12T22:05:04.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7179999999999998e-06 2024-09-12T22:05:04.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234311+0000", 2024-09-12T22:05:04.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:05:04.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234317+0000", 2024-09-12T22:05:04.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9120000000000003e-06 2024-09-12T22:05:04.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234599+0000", 2024-09-12T22:05:04.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028190600000000001 2024-09-12T22:05:04.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234605+0000", 2024-09-12T22:05:04.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4849999999999997e-06 2024-09-12T22:05:04.281 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.281 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.281 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.281 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:192793 5.6 5.5b36c1e6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:05:04.281 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:04.234587+0000", 2024-09-12T22:05:04.281 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9998984, 2024-09-12T22:05:04.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00047745900000000001, 2024-09-12T22:05:04.281 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.281 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.281 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:04.281 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.282 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.282 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.282 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 192793 2024-09-12T22:05:04.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.282 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234587+0000", 2024-09-12T22:05:04.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234587+0000", 2024-09-12T22:05:04.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234588+0000", 2024-09-12T22:05:04.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.16e-07 2024-09-12T22:05:04.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234592+0000", 2024-09-12T22:05:04.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3669999999999999e-06 2024-09-12T22:05:04.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234601+0000", 2024-09-12T22:05:04.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5019999999999992e-06 2024-09-12T22:05:04.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234607+0000", 2024-09-12T22:05:04.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0170000000000002e-06 2024-09-12T22:05:04.284 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.284 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.284 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.284 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:192794 5.2 5:4c9f44a8:::benchmark_data_smithi043_32659_object25556:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:05:04.284 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:04.234761+0000", 2024-09-12T22:05:04.284 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9997244, 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033336999999999999, 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 192794 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234761+0000", 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234761+0000", 2024-09-12T22:05:04.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234762+0000", 2024-09-12T22:05:04.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:05:04.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234765+0000", 2024-09-12T22:05:04.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.737e-06 2024-09-12T22:05:04.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234773+0000", 2024-09-12T22:05:04.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7440000000000007e-06 2024-09-12T22:05:04.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234779+0000", 2024-09-12T22:05:04.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.716e-06 2024-09-12T22:05:04.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234823+0000", 2024-09-12T22:05:04.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4178999999999998e-05 2024-09-12T22:05:04.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:04.234965+0000", 2024-09-12T22:05:04.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014158000000000001 2024-09-12T22:05:04.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.288 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.288 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:04.288 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 12 2024-09-12T22:05:04.288 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:04.289 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:04.292 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:04.291+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:04.393 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:04.392+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:04.460 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-09-12T22:05:04.478 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:04.478 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:04.478 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:04.478 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:04.478 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:04.491 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:04.532 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:04.531+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:04.594 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:04.593+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:04.682 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:04.682 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:04.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:04.682 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:04.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.682 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:04.682 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:05:04.682 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.045302, 2024-09-12T22:05:04.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:05:04.682 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.683 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.683 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.683 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:05:04.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.683 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:05:04.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:05:04.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:05:04.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:05:04.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:05:04.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:05:04.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:05:04.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:05:04.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:05:04.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:05:04.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:05:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:05:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:05:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:05:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:05:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:05:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:05:04.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:05:04.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:05:04.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:05:04.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:05:04.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:05:04.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:05:04.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:05:04.688 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.688 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.688 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.688 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:04.688 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:04.688 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.267995875, 2024-09-12T22:05:04.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:04.689 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.689 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.689 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:04.689 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.689 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.689 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.689 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:04.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.689 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:04.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:04.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:04.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:04.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:04.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:04.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:04.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:04.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:04.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:04.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:04.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:04.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:04.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:04.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:04.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:04.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:04.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:04.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:04.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.693 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.693 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:04.693 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:04.693 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.267815944999999, 2024-09-12T22:05:04.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:04.694 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.694 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.694 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:04.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.694 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:04.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.694 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:04.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:04.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:04.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:04.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:04.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:04.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.267749504000001, 2024-09-12T22:05:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.699 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:04.699 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.699 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.699 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.699 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:04.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.699 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:04.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:04.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:04.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:04.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:04.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:04.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:04.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:04.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:04.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:04.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:04.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:04.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:04.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:04.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:04.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:04.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:04.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:04.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:04.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.703 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.703 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:04.703 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:04.703 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.267693060999999, 2024-09-12T22:05:04.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:04.703 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.703 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.704 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.704 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:04.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.704 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:04.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:04.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:04.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:04.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:04.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:04.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:04.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:04.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:04.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:04.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:04.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:04.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:04.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:04.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:04.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:04.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:04.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:04.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:04.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:04.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:04.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:04.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:04.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:04.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:04.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:04.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:04.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:04.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:04.709 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.710 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.710 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.710 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:04.710 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:04.710 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.267624601000001, 2024-09-12T22:05:04.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:04.710 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.710 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.710 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.710 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.711 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:04.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.711 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:04.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:04.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:04.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:04.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:04.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:04.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:04.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:04.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:04.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:04.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:04.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:04.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:04.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:04.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:04.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:04.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:04.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:04.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:04.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:04.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:04.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:04.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:04.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:04.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:04.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:04.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:04.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:04.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:04.717 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.717 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.717 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.717 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:04.717 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:04.717 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.267566865999999, 2024-09-12T22:05:04.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:04.717 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.717 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.717 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.718 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:04.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.718 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:04.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:04.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:04.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:04.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:04.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:04.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:04.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:04.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:04.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:04.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:04.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:04.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:04.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:04.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:04.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:04.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:04.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:04.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:04.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:04.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:04.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:04.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.724 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.724 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:04.724 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:04.724 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.267499174000001, 2024-09-12T22:05:04.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:04.724 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.724 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.724 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.725 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:04.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.725 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:04.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:04.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:04.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:04.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:04.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:04.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:04.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:04.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:04.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:04.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:04.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:04.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:04.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:04.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:04.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:04.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:04.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:04.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:04.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:04.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:04.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:04.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:04.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:04.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:04.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:04.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:04.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:04.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:04.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.734 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.734 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:04.735 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:04.735 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.267444112, 2024-09-12T22:05:04.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:04.735 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.735 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.735 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.735 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:04.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.735 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:04.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:04.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:04.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:04.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:04.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:04.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:04.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:04.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:04.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:04.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:04.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:04.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:04.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:04.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:04.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:04.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:04.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:04.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:04.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:04.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:04.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:04.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:04.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:04.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:04.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:04.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:04.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:04.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:04.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.741 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.741 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:04.741 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:04.741 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.226796591999999, 2024-09-12T22:05:04.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:04.741 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.742 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.742 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.742 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:04.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.742 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:04.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:04.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:04.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:04.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:04.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:04.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:04.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:04.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:04.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:04.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:04.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:04.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:04.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:04.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:04.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:04.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:04.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:04.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:04.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:04.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:04.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:04.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:04.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:04.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:04.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:04.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:04.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:04.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:04.748 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.748 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.748 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.748 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:04.748 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:04.748 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.224182863999999, 2024-09-12T22:05:04.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:04.748 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.748 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.749 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.749 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:04.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.749 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:04.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:04.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:04.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:04.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:04.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:04.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:04.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:04.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:04.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:04.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:04.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:04.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:04.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:04.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:04.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:04.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:04.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:04.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:04.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:04.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:04.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:04.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:04.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:04.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:04.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:04.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:04.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:04.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:04.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.755 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.755 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117396 5.1 5:83c565df:::benchmark_data_smithi043_32659_object117395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:04.755 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:04.755 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.224041741000001, 2024-09-12T22:05:04.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.090595995999999998, 2024-09-12T22:05:04.755 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.755 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.755 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.756 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117396 2024-09-12T22:05:04.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.756 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:04.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454559+0000", 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454629+0000", 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0036000000000005e-05 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454641+0000", 2024-09-12T22:05:04.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2232000000000001e-05 2024-09-12T22:05:04.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454649+0000", 2024-09-12T22:05:04.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-12T22:05:04.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454697+0000", 2024-09-12T22:05:04.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8028000000000002e-05 2024-09-12T22:05:04.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:04.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454702+0000", 2024-09-12T22:05:04.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:05:04.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540467+0000", 2024-09-12T22:05:04.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085764217000000004 2024-09-12T22:05:04.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540596+0000", 2024-09-12T22:05:04.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129787 2024-09-12T22:05:04.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540774+0000", 2024-09-12T22:05:04.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017746799999999999 2024-09-12T22:05:04.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544679+0000", 2024-09-12T22:05:04.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003904996 2024-09-12T22:05:04.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545009+0000", 2024-09-12T22:05:04.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033056600000000002 2024-09-12T22:05:04.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545067+0000", 2024-09-12T22:05:04.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7871999999999997e-05 2024-09-12T22:05:04.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545154+0000", 2024-09-12T22:05:04.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6701999999999998e-05 2024-09-12T22:05:04.761 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.761 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.761 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.762 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117398 5.6 5:6d151138:::benchmark_data_smithi043_32659_object117397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:04.762 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:05:04.762 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.202746569999999, 2024-09-12T22:05:04.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044999137000000002, 2024-09-12T22:05:04.762 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.762 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.762 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.762 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117398 2024-09-12T22:05:04.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.762 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:05:04.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:05:04.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475854+0000", 2024-09-12T22:05:04.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:05:04.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475914+0000", 2024-09-12T22:05:04.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9422999999999997e-05 2024-09-12T22:05:04.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475925+0000", 2024-09-12T22:05:04.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0881e-05 2024-09-12T22:05:04.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475930+0000", 2024-09-12T22:05:04.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:05:04.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475974+0000", 2024-09-12T22:05:04.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3810999999999998e-05 2024-09-12T22:05:04.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:04.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475981+0000", 2024-09-12T22:05:04.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1590000000000004e-06 2024-09-12T22:05:04.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504359+0000", 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028377711 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504526+0000", 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167023 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504661+0000", 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135148 2024-09-12T22:05:04.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.506563+0000", 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901778 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520770+0000", 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014206724 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520803+0000", 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3083000000000002e-05 2024-09-12T22:05:04.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520852+0000", 2024-09-12T22:05:04.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9543999999999999e-05 2024-09-12T22:05:04.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.768 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.768 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117399 5.3 5:ce33c2c7:::benchmark_data_smithi043_32659_object117398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:04.768 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:05:04.768 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.197977577, 2024-09-12T22:05:04.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038176902999999998, 2024-09-12T22:05:04.769 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.769 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.769 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.769 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117399 2024-09-12T22:05:04.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.769 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:05:04.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:05:04.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480624+0000", 2024-09-12T22:05:04.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.322e-06 2024-09-12T22:05:04.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480670+0000", 2024-09-12T22:05:04.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6365000000000001e-05 2024-09-12T22:05:04.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480682+0000", 2024-09-12T22:05:04.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:05:04.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480689+0000", 2024-09-12T22:05:04.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:05:04.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480731+0000", 2024-09-12T22:05:04.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:04.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:04.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480738+0000", 2024-09-12T22:05:04.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:05:04.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513753+0000", 2024-09-12T22:05:04.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.033015125999999999 2024-09-12T22:05:04.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513935+0000", 2024-09-12T22:05:04.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018219500000000001 2024-09-12T22:05:04.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.514170+0000", 2024-09-12T22:05:04.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000234694 2024-09-12T22:05:04.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518462+0000", 2024-09-12T22:05:04.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004291563 2024-09-12T22:05:04.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518655+0000", 2024-09-12T22:05:04.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019362700000000001 2024-09-12T22:05:04.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518710+0000", 2024-09-12T22:05:04.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:05:04.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518799+0000", 2024-09-12T22:05:04.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9000999999999997e-05 2024-09-12T22:05:04.775 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.775 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.775 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.775 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117407 5.c 5:3c61c1b7:::benchmark_data_smithi043_32659_object117406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:04.775 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:05:04.775 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.164772063000001, 2024-09-12T22:05:04.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042860548999999998, 2024-09-12T22:05:04.775 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.775 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.775 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.776 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.776 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.776 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117407 2024-09-12T22:05:04.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.776 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:05:04.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:05:04.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513829+0000", 2024-09-12T22:05:04.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-12T22:05:04.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513900+0000", 2024-09-12T22:05:04.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1482000000000004e-05 2024-09-12T22:05:04.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513909+0000", 2024-09-12T22:05:04.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8370000000000003e-06 2024-09-12T22:05:04.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513917+0000", 2024-09-12T22:05:04.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:05:04.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513967+0000", 2024-09-12T22:05:04.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.007e-05 2024-09-12T22:05:04.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:04.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513975+0000", 2024-09-12T22:05:04.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5639999999999999e-06 2024-09-12T22:05:04.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542411+0000", 2024-09-12T22:05:04.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028436032999999999 2024-09-12T22:05:04.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542539+0000", 2024-09-12T22:05:04.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012777900000000001 2024-09-12T22:05:04.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542687+0000", 2024-09-12T22:05:04.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148343 2024-09-12T22:05:04.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548120+0000", 2024-09-12T22:05:04.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054333580000000001 2024-09-12T22:05:04.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556549+0000", 2024-09-12T22:05:04.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084288309999999995 2024-09-12T22:05:04.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556596+0000", 2024-09-12T22:05:04.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6458999999999997e-05 2024-09-12T22:05:04.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556688+0000", 2024-09-12T22:05:04.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2676999999999994e-05 2024-09-12T22:05:04.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.781 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.782 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.782 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:04.782 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.678968768000001, 2024-09-12T22:05:04.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:04.782 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.782 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.782 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.782 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:04.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.783 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:04.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:04.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:04.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:04.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:04.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:04.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:04.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:04.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:04.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:04.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:04.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:04.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:04.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:04.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:04.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:04.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:04.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:04.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:04.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:04.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:04.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:04.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:04.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:04.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.787 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.788 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.788 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:04.788 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.678490279999998, 2024-09-12T22:05:04.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:04.788 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.788 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.788 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.788 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:04.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.789 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:04.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:04.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:04.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:04.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:04.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:04.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:04.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:04.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:04.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:04.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:04.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:04.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:04.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:04.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:04.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:04.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:04.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:04.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:04.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:04.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:04.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:04.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:04.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:04.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.793 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.794 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.794 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:04.794 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.675994979999999, 2024-09-12T22:05:04.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:04.794 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.794 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.794 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.794 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:04.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.794 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:04.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:04.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:04.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:04.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:04.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:04.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:04.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:04.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~41s 2024-09-12T22:05:04.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:04.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:04.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:04.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:04.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:04.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:04.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:04.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:04.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:04.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:04.801 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.801 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.801 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.801 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.801 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:04.802 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.674914188999999, 2024-09-12T22:05:04.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:04.802 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.802 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.802 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.802 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.802 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.802 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.802 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:04.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.802 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:04.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:04.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:04.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:04.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:04.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:04.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:04.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:04.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:04.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:04.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:04.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:04.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:04.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:04.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:04.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:04.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:04.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:04.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:04.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:04.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:04.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:04.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:04.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:04.807 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.807 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.807 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.807 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:04.807 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:04.808 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.673678627000001, 2024-09-12T22:05:04.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:04.808 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:04.808 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:04.808 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:04.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:04.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:04.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.808 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:04.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.808 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:04.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:04.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:04.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:04.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:04.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:04.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:04.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:04.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:04.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:04.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:04.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:04.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:04.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:04.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:04.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:04.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:04.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:04.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:04.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:04.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:04.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:04.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:04.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:04.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.813 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:04.813 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:04.813 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:04.814 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:04.814 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:04.796+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:04.898 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:04.897+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:04.965 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:04.965 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:04.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.966 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:194804 5.0 5:0285d863:::benchmark_data_smithi043_32659_object27566:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:04.966 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.961724+0000", 2024-09-12T22:05:04.966 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0015825819999999999, 2024-09-12T22:05:04.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001611786, 2024-09-12T22:05:04.966 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.966 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.966 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:04.966 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.966 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.966 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.966 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 194804 2024-09-12T22:05:04.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.966 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961724+0000", 2024-09-12T22:05:04.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961724+0000", 2024-09-12T22:05:04.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961725+0000", 2024-09-12T22:05:04.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1899999999999998e-07 2024-09-12T22:05:04.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961727+0000", 2024-09-12T22:05:04.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.295e-06 2024-09-12T22:05:04.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961734+0000", 2024-09-12T22:05:04.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0339999999999999e-06 2024-09-12T22:05:04.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961739+0000", 2024-09-12T22:05:04.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2599999999999996e-06 2024-09-12T22:05:04.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961804+0000", 2024-09-12T22:05:04.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4700000000000001e-05 2024-09-12T22:05:04.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961962+0000", 2024-09-12T22:05:04.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015827300000000001 2024-09-12T22:05:04.969 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.970 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.970 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.970 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:194805 5.0 5:0b3a7888:::benchmark_data_smithi043_32659_object27567:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:04.970 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.961760+0000", 2024-09-12T22:05:04.970 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001546621, 2024-09-12T22:05:04.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001652014, 2024-09-12T22:05:04.970 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.970 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.970 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:04.970 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.970 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.970 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.971 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 194805 2024-09-12T22:05:04.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.971 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961760+0000", 2024-09-12T22:05:04.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961760+0000", 2024-09-12T22:05:04.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961761+0000", 2024-09-12T22:05:04.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:05:04.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961764+0000", 2024-09-12T22:05:04.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.802e-06 2024-09-12T22:05:04.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961772+0000", 2024-09-12T22:05:04.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0409999999999998e-06 2024-09-12T22:05:04.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961777+0000", 2024-09-12T22:05:04.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:05:04.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.963333+0000", 2024-09-12T22:05:04.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001555638 2024-09-12T22:05:04.973 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.973 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.973 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.974 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:194802 5.7 e51/40 5:e7b8ed7c:::benchmark_data_smithi043_32659_object27564:head v 51'12234, mlcod=51'12230)", 2024-09-12T22:05:04.974 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.962961+0000", 2024-09-12T22:05:04.974 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00034550899999999997, 2024-09-12T22:05:04.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00050920700000000002, 2024-09-12T22:05:04.974 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.974 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.974 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:04.974 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.962961+0000", 2024-09-12T22:05:04.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.962961+0000", 2024-09-12T22:05:04.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.962962+0000", 2024-09-12T22:05:04.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0900000000000001e-07 2024-09-12T22:05:04.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.962966+0000", 2024-09-12T22:05:04.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5950000000000001e-06 2024-09-12T22:05:04.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.962974+0000", 2024-09-12T22:05:04.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6490000000000008e-06 2024-09-12T22:05:04.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.962979+0000", 2024-09-12T22:05:04.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1649999999999997e-06 2024-09-12T22:05:04.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.963166+0000", 2024-09-12T22:05:04.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018717199999999999 2024-09-12T22:05:04.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.963184+0000", 2024-09-12T22:05:04.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7791e-05 2024-09-12T22:05:04.977 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.977 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.977 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.977 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:194790 5.a 5:5b06ae07:::benchmark_data_smithi043_32659_object27552:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:04.977 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.957881+0000", 2024-09-12T22:05:04.978 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0054260879999999999, 2024-09-12T22:05:04.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056508490000000003, 2024-09-12T22:05:04.978 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.978 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.978 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:04.978 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.978 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.978 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.978 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 194790 2024-09-12T22:05:04.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.978 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.957881+0000", 2024-09-12T22:05:04.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.957881+0000", 2024-09-12T22:05:04.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.957882+0000", 2024-09-12T22:05:04.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5799999999999998e-07 2024-09-12T22:05:04.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.957885+0000", 2024-09-12T22:05:04.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7000000000000002e-06 2024-09-12T22:05:04.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.957895+0000", 2024-09-12T22:05:04.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2609999999999999e-06 2024-09-12T22:05:04.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.957901+0000", 2024-09-12T22:05:04.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.268e-06 2024-09-12T22:05:04.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.957945+0000", 2024-09-12T22:05:04.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4175000000000003e-05 2024-09-12T22:05:04.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958094+0000", 2024-09-12T22:05:04.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014892400000000001 2024-09-12T22:05:04.981 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.981 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.981 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.982 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:194792 5.e 5:766f53b4:::benchmark_data_smithi043_32659_object27554:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:04.982 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.957923+0000", 2024-09-12T22:05:04.982 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0053836960000000003, 2024-09-12T22:05:04.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056763079999999997, 2024-09-12T22:05:04.982 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.982 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.982 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:04.982 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.982 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.982 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.982 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 194792 2024-09-12T22:05:04.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.982 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.957923+0000", 2024-09-12T22:05:04.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.957923+0000", 2024-09-12T22:05:04.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.957924+0000", 2024-09-12T22:05:04.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2799999999999996e-07 2024-09-12T22:05:04.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.957926+0000", 2024-09-12T22:05:04.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3630000000000001e-06 2024-09-12T22:05:04.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.957933+0000", 2024-09-12T22:05:04.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6839999999999999e-06 2024-09-12T22:05:04.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.957938+0000", 2024-09-12T22:05:04.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8409999999999999e-06 2024-09-12T22:05:04.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958126+0000", 2024-09-12T22:05:04.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018849900000000001 2024-09-12T22:05:04.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958301+0000", 2024-09-12T22:05:04.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174976 2024-09-12T22:05:04.986 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.986 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.986 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.986 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:194793 5.0 5:0859021a:::benchmark_data_smithi043_32659_object27555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:04.986 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.958012+0000", 2024-09-12T22:05:04.986 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0052944719999999997, 2024-09-12T22:05:04.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056514319999999996, 2024-09-12T22:05:04.986 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.986 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.987 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:04.987 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.987 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.987 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.987 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 194793 2024-09-12T22:05:04.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.987 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958012+0000", 2024-09-12T22:05:04.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958012+0000", 2024-09-12T22:05:04.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958013+0000", 2024-09-12T22:05:04.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:04.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958016+0000", 2024-09-12T22:05:04.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7690000000000001e-06 2024-09-12T22:05:04.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958025+0000", 2024-09-12T22:05:04.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8099999999999992e-06 2024-09-12T22:05:04.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958034+0000", 2024-09-12T22:05:04.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7979999999999995e-06 2024-09-12T22:05:04.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958078+0000", 2024-09-12T22:05:04.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3486999999999999e-05 2024-09-12T22:05:04.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958270+0000", 2024-09-12T22:05:04.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019199399999999999 2024-09-12T22:05:04.990 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.990 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.990 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.990 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:194791 5.3 e51/40 5:ca865042:::benchmark_data_smithi043_32659_object27553:head v 51'12156, mlcod=51'12154)", 2024-09-12T22:05:04.990 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.958250+0000", 2024-09-12T22:05:04.990 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.005056924, 2024-09-12T22:05:04.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0054793760000000002, 2024-09-12T22:05:04.991 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.991 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.991 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:04.991 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958250+0000", 2024-09-12T22:05:04.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958250+0000", 2024-09-12T22:05:04.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958250+0000", 2024-09-12T22:05:04.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7899999999999999e-07 2024-09-12T22:05:04.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958254+0000", 2024-09-12T22:05:04.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1250000000000003e-06 2024-09-12T22:05:04.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958260+0000", 2024-09-12T22:05:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1660000000000002e-06 2024-09-12T22:05:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958263+0000", 2024-09-12T22:05:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5300000000000001e-06 2024-09-12T22:05:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958306+0000", 2024-09-12T22:05:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3157e-05 2024-09-12T22:05:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958319+0000", 2024-09-12T22:05:04.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2480000000000001e-05 2024-09-12T22:05:04.994 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.994 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.994 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.994 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:194795 5.a 5:558c8548:::benchmark_data_smithi043_32659_object27557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:04.994 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.958908+0000", 2024-09-12T22:05:04.994 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0043983809999999998, 2024-09-12T22:05:04.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0048807939999999999, 2024-09-12T22:05:04.994 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.995 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.995 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:04.995 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.995 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.995 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.995 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 194795 2024-09-12T22:05:04.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.995 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958908+0000", 2024-09-12T22:05:04.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:04.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958908+0000", 2024-09-12T22:05:04.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:04.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:04.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958909+0000", 2024-09-12T22:05:04.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3300000000000001e-07 2024-09-12T22:05:04.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:04.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958913+0000", 2024-09-12T22:05:04.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2180000000000001e-06 2024-09-12T22:05:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958924+0000", 2024-09-12T22:05:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0149999999999999e-05 2024-09-12T22:05:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.958931+0000", 2024-09-12T22:05:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7149999999999998e-06 2024-09-12T22:05:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959453+0000", 2024-09-12T22:05:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000521979 2024-09-12T22:05:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959559+0000", 2024-09-12T22:05:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010534799999999999 2024-09-12T22:05:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:194796 5.0 5:0798d5db:::benchmark_data_smithi043_32659_object27558:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.959079+0000", 2024-09-12T22:05:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0042277260000000002, 2024-09-12T22:05:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047762459999999996, 2024-09-12T22:05:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 194796 2024-09-12T22:05:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959079+0000", 2024-09-12T22:05:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959079+0000", 2024-09-12T22:05:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959080+0000", 2024-09-12T22:05:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9999999999999997e-07 2024-09-12T22:05:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959083+0000", 2024-09-12T22:05:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6179999999999999e-06 2024-09-12T22:05:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959102+0000", 2024-09-12T22:05:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.891e-05 2024-09-12T22:05:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959112+0000", 2024-09-12T22:05:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9639999999999998e-06 2024-09-12T22:05:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959750+0000", 2024-09-12T22:05:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00063773699999999998 2024-09-12T22:05:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959933+0000", 2024-09-12T22:05:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018304000000000001 2024-09-12T22:05:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:194794 5.5 e51/40 5:acd228e8:::benchmark_data_smithi043_32659_object27556:head v 51'12214, mlcod=51'12212)", 2024-09-12T22:05:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.959305+0000", 2024-09-12T22:05:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0040019590000000002, 2024-09-12T22:05:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046120170000000004, 2024-09-12T22:05:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959305+0000", 2024-09-12T22:05:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959305+0000", 2024-09-12T22:05:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959306+0000", 2024-09-12T22:05:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:05:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959310+0000", 2024-09-12T22:05:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5299999999999998e-06 2024-09-12T22:05:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959320+0000", 2024-09-12T22:05:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6879999999999994e-06 2024-09-12T22:05:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959325+0000", 2024-09-12T22:05:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5230000000000003e-06 2024-09-12T22:05:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959370+0000", 2024-09-12T22:05:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4543999999999999e-05 2024-09-12T22:05:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959387+0000", 2024-09-12T22:05:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7295e-05 2024-09-12T22:05:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:194797 5.7 e51/40 5:e9d9a491:::benchmark_data_smithi043_32659_object27559:head v 51'12232, mlcod=51'12230)", 2024-09-12T22:05:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.959888+0000", 2024-09-12T22:05:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0034190219999999999, 2024-09-12T22:05:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040825929999999998, 2024-09-12T22:05:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959888+0000", 2024-09-12T22:05:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959888+0000", 2024-09-12T22:05:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959888+0000", 2024-09-12T22:05:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6599999999999996e-07 2024-09-12T22:05:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959894+0000", 2024-09-12T22:05:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0579999999999997e-06 2024-09-12T22:05:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959902+0000", 2024-09-12T22:05:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8920000000000006e-06 2024-09-12T22:05:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959909+0000", 2024-09-12T22:05:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3629999999999999e-06 2024-09-12T22:05:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959964+0000", 2024-09-12T22:05:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5645e-05 2024-09-12T22:05:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.959977+0000", 2024-09-12T22:05:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2271e-05 2024-09-12T22:05:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:194799 5.1 e51/40 5:8a2c87fc:::benchmark_data_smithi043_32659_object27561:head v 51'12096, mlcod=51'12094)", 2024-09-12T22:05:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.960030+0000", 2024-09-12T22:05:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0032765810000000002, 2024-09-12T22:05:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0039937699999999998, 2024-09-12T22:05:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.960030+0000", 2024-09-12T22:05:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.960030+0000", 2024-09-12T22:05:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.960031+0000", 2024-09-12T22:05:05.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4000000000000002e-07 2024-09-12T22:05:05.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.960035+0000", 2024-09-12T22:05:05.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8929999999999998e-06 2024-09-12T22:05:05.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.960042+0000", 2024-09-12T22:05:05.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3679999999999996e-06 2024-09-12T22:05:05.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.960048+0000", 2024-09-12T22:05:05.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9190000000000004e-06 2024-09-12T22:05:05.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.960092+0000", 2024-09-12T22:05:05.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3603999999999998e-05 2024-09-12T22:05:05.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.960109+0000", 2024-09-12T22:05:05.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.734e-05 2024-09-12T22:05:05.014 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.014 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.014 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.014 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:194798 5.7 e51/40 5:e41e60cb:::benchmark_data_smithi043_32659_object27560:head v 51'12233, mlcod=51'12230)", 2024-09-12T22:05:05.014 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.961548+0000", 2024-09-12T22:05:05.014 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0017589579999999999, 2024-09-12T22:05:05.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002530774, 2024-09-12T22:05:05.014 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.015 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.015 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:05.015 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961548+0000", 2024-09-12T22:05:05.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961548+0000", 2024-09-12T22:05:05.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961549+0000", 2024-09-12T22:05:05.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6300000000000004e-07 2024-09-12T22:05:05.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961554+0000", 2024-09-12T22:05:05.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.677e-06 2024-09-12T22:05:05.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961567+0000", 2024-09-12T22:05:05.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2393e-05 2024-09-12T22:05:05.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961573+0000", 2024-09-12T22:05:05.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4239999999999998e-06 2024-09-12T22:05:05.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961614+0000", 2024-09-12T22:05:05.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0620000000000001e-05 2024-09-12T22:05:05.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961626+0000", 2024-09-12T22:05:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2342e-05 2024-09-12T22:05:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:194800 5.9 5:9f64a60c:::benchmark_data_smithi043_32659_object27562:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.961622+0000", 2024-09-12T22:05:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0016846470000000001, 2024-09-12T22:05:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025118559999999998, 2024-09-12T22:05:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 194800 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961622+0000", 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961622+0000", 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961623+0000", 2024-09-12T22:05:05.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.119e-06 2024-09-12T22:05:05.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961629+0000", 2024-09-12T22:05:05.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5260000000000001e-06 2024-09-12T22:05:05.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961643+0000", 2024-09-12T22:05:05.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4554e-05 2024-09-12T22:05:05.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961652+0000", 2024-09-12T22:05:05.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4260000000000003e-06 2024-09-12T22:05:05.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961687+0000", 2024-09-12T22:05:05.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4820000000000002e-05 2024-09-12T22:05:05.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961828+0000", 2024-09-12T22:05:05.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000141237 2024-09-12T22:05:05.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:05.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961936+0000", 2024-09-12T22:05:05.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000108242 2024-09-12T22:05:05.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:05.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.963762+0000", 2024-09-12T22:05:05.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00182595 2024-09-12T22:05:05.022 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.022 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.022 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.023 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:194801 5.4 5:2eb47fc6:::benchmark_data_smithi043_32659_object27563:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:05.023 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.961667+0000", 2024-09-12T22:05:05.023 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001639543, 2024-09-12T22:05:05.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025416689999999999, 2024-09-12T22:05:05.023 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.023 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.023 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:05.023 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.023 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.023 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.023 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 194801 2024-09-12T22:05:05.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.024 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961667+0000", 2024-09-12T22:05:05.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961667+0000", 2024-09-12T22:05:05.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961668+0000", 2024-09-12T22:05:05.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2300000000000001e-07 2024-09-12T22:05:05.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961671+0000", 2024-09-12T22:05:05.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7429999999999998e-06 2024-09-12T22:05:05.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961678+0000", 2024-09-12T22:05:05.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7300000000000005e-06 2024-09-12T22:05:05.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961684+0000", 2024-09-12T22:05:05.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9560000000000002e-06 2024-09-12T22:05:05.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961731+0000", 2024-09-12T22:05:05.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6406999999999998e-05 2024-09-12T22:05:05.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961889+0000", 2024-09-12T22:05:05.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015827300000000001 2024-09-12T22:05:05.026 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:194803 5.f 5:f97527a0:::benchmark_data_smithi043_32659_object27565:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:04.961699+0000", 2024-09-12T22:05:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0016076619999999999, 2024-09-12T22:05:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025704249999999999, 2024-09-12T22:05:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 194803 2024-09-12T22:05:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961699+0000", 2024-09-12T22:05:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961699+0000", 2024-09-12T22:05:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961700+0000", 2024-09-12T22:05:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1099999999999996e-07 2024-09-12T22:05:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961702+0000", 2024-09-12T22:05:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5009999999999999e-06 2024-09-12T22:05:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961709+0000", 2024-09-12T22:05:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0670000000000003e-06 2024-09-12T22:05:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961714+0000", 2024-09-12T22:05:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2140000000000004e-06 2024-09-12T22:05:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961754+0000", 2024-09-12T22:05:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9140000000000001e-05 2024-09-12T22:05:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.961904+0000", 2024-09-12T22:05:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015025800000000001 2024-09-12T22:05:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.962008+0000", 2024-09-12T22:05:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010442699999999999 2024-09-12T22:05:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:04.964004+0000", 2024-09-12T22:05:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019953779999999999 2024-09-12T22:05:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 16 2024-09-12T22:05:05.032 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:05.033 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:05.031+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:05.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:05.133 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:05.132+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:05.200 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:05.201 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:05.201 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:05.201 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:05.201 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:05.214 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:05.258 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:05.257+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:05.336 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:05.335+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:05.374 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:05.374 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:05.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:05.374 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:05.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.374 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:05.374 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:05.374 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 60.744384832000001, 2024-09-12T22:05:05.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:05:05.375 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.375 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.375 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.375 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.375 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.375 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.375 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:05:05.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.375 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:05.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:05.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:05:05.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:05:05.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:05:05.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:05:05.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:05:05.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:05:05.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:05:05.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:05:05.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:05:05.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:05:05.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:05:05.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:05:05.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:05.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:05:05.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:05:05.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:05.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:05:05.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:05:05.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:05.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:05:05.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:05:05.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:05:05.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:05:05.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:05:05.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:05:05.381 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.381 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.382 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.382 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:05.382 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:05.382 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 60.738983892, 2024-09-12T22:05:05.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:05:05.382 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.382 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.382 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.382 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.382 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.382 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.382 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:05:05.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:05:05.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:05:05.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:05:05.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:05:05.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:05:05.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:05.387 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 60.738042624999999, 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:05:05.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:05:05.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:05:05.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:05:05.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:05:05.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:05:05.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:05:05.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:05:05.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:05.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:05:05.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:05:05.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 60.737044705000002, 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.393 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.394 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.394 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.394 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:05:05.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.394 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:05:05.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:05:05.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:05:05.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:05:05.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:05:05.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:05:05.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:05:05.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:05:05.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:05:05.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:05:05.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:05.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:05:05.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:05:05.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:05.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:05:05.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:05:05.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:05.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:05:05.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:05:05.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:05:05.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:05:05.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:05:05.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:05:05.398 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.398 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.373296006, 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:05:05.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.400 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:05.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:05.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:05.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:05:05.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:05:05.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:05:05.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:05:05.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:05:05.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:05:05.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:05:05.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:05:05.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:05:05.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:05:05.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:05:05.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:05.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:05:05.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:05:05.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:05.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:05:05.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:05:05.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:05.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:05:05.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:05:05.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:05:05.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:05:05.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:05:05.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:05:05.404 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.404 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.404 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.405 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:05.405 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:05.405 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.372662801000001, 2024-09-12T22:05:05.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:05.405 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.405 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.405 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.405 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.405 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.405 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.405 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:05.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.405 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:05.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:05.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:05.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:05.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:05.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:05.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:05.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:05.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:05.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:05.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:05.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:05.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:05.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:05.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:05.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:05.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:05.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:05.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:05.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:05.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:05.409 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.409 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.410 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.410 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:05.410 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:05.410 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.370843138000001, 2024-09-12T22:05:05.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:05.410 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.410 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.410 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.410 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.410 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.410 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.410 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:05.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.411 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:05.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:05.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:05.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:05.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:05.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:05.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:05.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:05.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:05.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:05.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:05.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:05.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:05.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:05.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:05.414 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.415 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.415 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.415 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:05.415 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:05.415 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.370675511000002, 2024-09-12T22:05:05.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:05:05.415 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.415 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.415 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.415 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.415 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.415 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:05:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:05:05.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:05:05.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:05:05.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:05:05.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:05:05.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:05:05.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:05:05.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:05:05.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:05:05.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:05:05.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:05:05.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:05:05.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:05.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:05:05.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:05:05.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:05:05.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:05:05.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:05:05.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:05:05.420 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.420 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.420 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.420 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:05:05.420 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:05.420 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.370534846999998, 2024-09-12T22:05:05.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:05:05.420 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.420 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.420 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:05:05.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:05:05.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:05:05.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:05:05.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:05:05.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:05:05.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:05:05.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:05:05.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:05:05.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:05:05.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:05:05.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:05:05.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:05:05.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:05:05.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:05:05.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:05:05.424 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.424 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.424 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.424 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:05.425 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:05.425 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.370309324000001, 2024-09-12T22:05:05.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:05.425 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.425 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.425 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.425 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.425 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.425 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.425 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:05.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.425 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:05.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:05.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:05.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:05.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:05.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:05.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:05.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:05.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:05.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:05.429 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.429 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.429 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.429 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:05.429 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.370189620000001, 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:05.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:05:05.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:05:05.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:05:05.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:05:05.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.432 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:05:05.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:05:05.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.432 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:05:05.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:05:05.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:05.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:05:05.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:05:05.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:05.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:05:05.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:05:05.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:05:05.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:05:05.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:05:05.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:05:05.435 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.435 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.435 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.435 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:05:05.435 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:05.435 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.369598337999999, 2024-09-12T22:05:05.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:05:05.435 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.436 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.436 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:05.436 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:05.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:05.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:05:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:05:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:05:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:05:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:05:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:05:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:05:05.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:05:05.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:05:05.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:05:05.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.36937477, 2024-09-12T22:05:05.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:05.443 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:05.444 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.369283288999998, 2024-09-12T22:05:05.444 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:05:05.444 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.444 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.444 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.444 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.444 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.444 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.444 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:05:05.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.444 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.444 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.444 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:05.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.445 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.445 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:05.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.445 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.445 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:05:05.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:05:05.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.445 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.446 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:05:05.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:05:05.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.446 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:05:05.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:05:05.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.446 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:05:05.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:05:05.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:05:05.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:05:05.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:05:05.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:05:05.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:05.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:05:05.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:05:05.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:05:05.448 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:05:05.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:05:05.448 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:05:05.448 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.448 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.448 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.368494484999999, 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.449 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:05.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.450 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:05.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.450 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:05.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:05.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:05.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:05.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:05.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:05.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:05.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:05.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:05.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.453 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.453 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:05.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:05.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.453 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.453 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:05.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:05.453 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.453 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.453 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.368230345000001, 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:05:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:05:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:05:05.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:05:05.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:05:05.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:05:05.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:05.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:05:05.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:05:05.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.458 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.367725369999999, 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:05.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:05:05.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:05:05.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:05:05.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:05:05.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:05:05.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:05:05.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:05:05.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:05:05.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:05:05.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:05:05.462 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.462 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.366595942, 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:05.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:05:05.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:05:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:05:05.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.365841499999998, 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:05.467 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.468 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:05:05.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.468 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:05.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:05.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:05:05.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:05.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:05:05.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:05:05.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:05:05.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:05:05.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:05:05.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:05:05.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.472 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.365162397999999, 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:05.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:05.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:05.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:05.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:05:05.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:05:05.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:05.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:05:05.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:05:05.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:05.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:05:05.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:05:05.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:05.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:05:05.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:05:05.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:05.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:05.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:05.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:05:05.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:05:05.476 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.476 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.476 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.477 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:05.477 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:05.477 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:05.478 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:05.477+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:05.478 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:05.579 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:05.578+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:05.627 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:05.627 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:05.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.627 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:196630 5.3 5:c1bd4451:::benchmark_data_smithi043_32659_object29392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:05.628 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:05.622963+0000", 2024-09-12T22:05:05.628 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0032994159999999999, 2024-09-12T22:05:05.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003317356, 2024-09-12T22:05:05.628 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:05.628 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:05.628 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:05.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:05.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:05.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.628 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 196630 2024-09-12T22:05:05.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.628 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:05.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:05.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.622963+0000", 2024-09-12T22:05:05.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:05.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.622963+0000", 2024-09-12T22:05:05.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:05.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.622964+0000", 2024-09-12T22:05:05.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9000000000000005e-07 2024-09-12T22:05:05.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:05.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.622969+0000", 2024-09-12T22:05:05.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5879999999999999e-06 2024-09-12T22:05:05.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:05.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.622978+0000", 2024-09-12T22:05:05.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.901e-06 2024-09-12T22:05:05.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.622984+0000", 2024-09-12T22:05:05.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3389999999999998e-06 2024-09-12T22:05:05.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:05.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623034+0000", 2024-09-12T22:05:05.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9979999999999999e-05 2024-09-12T22:05:05.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:05.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623171+0000", 2024-09-12T22:05:05.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000136489 2024-09-12T22:05:05.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:05.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623269+0000", 2024-09-12T22:05:05.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8491000000000003e-05 2024-09-12T22:05:05.632 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.632 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:05.632 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.632 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:196631 5.7 5:e6b64d17:::benchmark_data_smithi043_32659_object29393:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:05.632 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:05.623017+0000", 2024-09-12T22:05:05.632 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0032460499999999999, 2024-09-12T22:05:05.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003309289, 2024-09-12T22:05:05.632 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:05.632 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:05.632 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:05.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:05.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:05.633 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.633 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 196631 2024-09-12T22:05:05.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.633 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:05.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:05.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623017+0000", 2024-09-12T22:05:05.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:05.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623017+0000", 2024-09-12T22:05:05.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:05.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623017+0000", 2024-09-12T22:05:05.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5000000000000002e-07 2024-09-12T22:05:05.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:05.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623021+0000", 2024-09-12T22:05:05.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.365e-06 2024-09-12T22:05:05.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:05.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623029+0000", 2024-09-12T22:05:05.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3990000000000004e-06 2024-09-12T22:05:05.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623035+0000", 2024-09-12T22:05:05.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2079999999999997e-06 2024-09-12T22:05:05.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:05.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623615+0000", 2024-09-12T22:05:05.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00057946400000000002 2024-09-12T22:05:05.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:05.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623783+0000", 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016774199999999999 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623896+0000", 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011341900000000001 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.625888+0000", 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001992448 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.637 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:196633 5.5 5:a6028753:::benchmark_data_smithi043_32659_object29395:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:05.637 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:05.623087+0000", 2024-09-12T22:05:05.637 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0031759069999999999, 2024-09-12T22:05:05.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032816270000000001, 2024-09-12T22:05:05.637 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:05.637 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:05.637 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:05.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:05.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:05.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.637 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 196633 2024-09-12T22:05:05.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.637 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:05.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:05.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623087+0000", 2024-09-12T22:05:05.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:05.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623087+0000", 2024-09-12T22:05:05.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:05.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623087+0000", 2024-09-12T22:05:05.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1100000000000001e-07 2024-09-12T22:05:05.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:05.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623089+0000", 2024-09-12T22:05:05.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9759999999999998e-06 2024-09-12T22:05:05.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:05.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623095+0000", 2024-09-12T22:05:05.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1149999999999999e-06 2024-09-12T22:05:05.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623101+0000", 2024-09-12T22:05:05.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5380000000000002e-06 2024-09-12T22:05:05.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:05.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623617+0000", 2024-09-12T22:05:05.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000516484 2024-09-12T22:05:05.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:05.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623778+0000", 2024-09-12T22:05:05.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016098499999999999 2024-09-12T22:05:05.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:05.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623896+0000", 2024-09-12T22:05:05.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117594 2024-09-12T22:05:05.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:05.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.625706+0000", 2024-09-12T22:05:05.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018103380000000001 2024-09-12T22:05:05.642 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.642 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:05.642 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.642 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:196634 5.3 5:ce7a5136:::benchmark_data_smithi043_32659_object29396:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:05.642 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:05.623116+0000", 2024-09-12T22:05:05.642 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.003147258, 2024-09-12T22:05:05.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003301357, 2024-09-12T22:05:05.642 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:05.642 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:05.643 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:05.643 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:05.643 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:05.643 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.643 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 196634 2024-09-12T22:05:05.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.643 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:05.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:05.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623116+0000", 2024-09-12T22:05:05.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:05.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623116+0000", 2024-09-12T22:05:05.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:05.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623116+0000", 2024-09-12T22:05:05.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:05:05.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:05.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623118+0000", 2024-09-12T22:05:05.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1129999999999999e-06 2024-09-12T22:05:05.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:05.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623125+0000", 2024-09-12T22:05:05.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6220000000000003e-06 2024-09-12T22:05:05.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623130+0000", 2024-09-12T22:05:05.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2299999999999999e-06 2024-09-12T22:05:05.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:05.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.624779+0000", 2024-09-12T22:05:05.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00164912 2024-09-12T22:05:05.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:05.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.624934+0000", 2024-09-12T22:05:05.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000155153 2024-09-12T22:05:05.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:05.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.625067+0000", 2024-09-12T22:05:05.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013231699999999999 2024-09-12T22:05:05.646 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.646 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:05.646 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.647 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:196639 5.c 5:339d7ab2:::benchmark_data_smithi043_32659_object29401:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:05.647 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:05.626189+0000", 2024-09-12T22:05:05.647 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.4277999999999996e-05, 2024-09-12T22:05:05.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027290399999999997, 2024-09-12T22:05:05.647 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:05.647 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:05.647 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:05.647 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:05.647 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:05.647 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.647 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 196639 2024-09-12T22:05:05.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.647 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:05.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:05.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626189+0000", 2024-09-12T22:05:05.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:05.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626189+0000", 2024-09-12T22:05:05.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:05.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626190+0000", 2024-09-12T22:05:05.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-12T22:05:05.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:05.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626195+0000", 2024-09-12T22:05:05.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-12T22:05:05.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:05.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626204+0000", 2024-09-12T22:05:05.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.166e-06 2024-09-12T22:05:05.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626210+0000", 2024-09-12T22:05:05.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.592e-06 2024-09-12T22:05:05.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:05.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626255+0000", 2024-09-12T22:05:05.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5435000000000001e-05 2024-09-12T22:05:05.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:05.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626366+0000", 2024-09-12T22:05:05.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111161 2024-09-12T22:05:05.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:05.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626434+0000", 2024-09-12T22:05:05.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8091999999999998e-05 2024-09-12T22:05:05.651 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.651 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:05.651 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.651 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:196637 5.9 e51/40)", 2024-09-12T22:05:05.651 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:05.626426+0000", 2024-09-12T22:05:05.651 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9998364, 2024-09-12T22:05:05.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4148999999999998e-05, 2024-09-12T22:05:05.652 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:05.652 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:05.652 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:05.652 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:05.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:05.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626426+0000", 2024-09-12T22:05:05.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:05.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626426+0000", 2024-09-12T22:05:05.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626427+0000", 2024-09-12T22:05:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2699999999999999e-07 2024-09-12T22:05:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626431+0000", 2024-09-12T22:05:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2050000000000004e-06 2024-09-12T22:05:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626438+0000", 2024-09-12T22:05:05.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4160000000000001e-06 2024-09-12T22:05:05.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626442+0000", 2024-09-12T22:05:05.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5240000000000002e-06 2024-09-12T22:05:05.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:05.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.626484+0000", 2024-09-12T22:05:05.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1628999999999997e-05 2024-09-12T22:05:05.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.654 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:05.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:196619 5.7 5:ef072f77:::benchmark_data_smithi043_32659_object29381:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:05.617180+0000", 2024-09-12T22:05:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0090828239999999998, 2024-09-12T22:05:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0093537240000000008, 2024-09-12T22:05:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 196619 2024-09-12T22:05:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.656 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:05.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:05.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.617180+0000", 2024-09-12T22:05:05.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:05.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.617180+0000", 2024-09-12T22:05:05.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:05.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.617181+0000", 2024-09-12T22:05:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:05:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.617184+0000", 2024-09-12T22:05:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4479999999999999e-06 2024-09-12T22:05:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.617197+0000", 2024-09-12T22:05:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.327e-05 2024-09-12T22:05:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.617203+0000", 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0410000000000003e-06 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.618194+0000", 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00099014999999999997 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.618366+0000", 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000172177 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:05.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.618492+0000", 2024-09-12T22:05:05.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000125718 2024-09-12T22:05:05.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:05.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.619937+0000", 2024-09-12T22:05:05.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0014452790000000001 2024-09-12T22:05:05.659 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.659 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:05.659 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.659 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:196627 5.3 5:cca5f77a:::benchmark_data_smithi043_32659_object29389:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:05.659 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:05.620412+0000", 2024-09-12T22:05:05.660 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0058510869999999996, 2024-09-12T22:05:05.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061710860000000001, 2024-09-12T22:05:05.660 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:05.660 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:05.660 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:05.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:05.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:05.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.660 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 196627 2024-09-12T22:05:05.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.660 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:05.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:05.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.620412+0000", 2024-09-12T22:05:05.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:05.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.620412+0000", 2024-09-12T22:05:05.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:05.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.620412+0000", 2024-09-12T22:05:05.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.72e-07 2024-09-12T22:05:05.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:05.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.620414+0000", 2024-09-12T22:05:05.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1260000000000001e-06 2024-09-12T22:05:05.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:05.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.620420+0000", 2024-09-12T22:05:05.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9329999999999998e-06 2024-09-12T22:05:05.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.620424+0000", 2024-09-12T22:05:05.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7469999999999999e-06 2024-09-12T22:05:05.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:05.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.620467+0000", 2024-09-12T22:05:05.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2784000000000002e-05 2024-09-12T22:05:05.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:05.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.620567+0000", 2024-09-12T22:05:05.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010068699999999999 2024-09-12T22:05:05.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:05.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.620635+0000", 2024-09-12T22:05:05.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7395000000000001e-05 2024-09-12T22:05:05.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:05.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.622358+0000", 2024-09-12T22:05:05.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001723004 2024-09-12T22:05:05.664 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.664 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:05.664 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.664 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:196629 5.1 5:8eb33030:::benchmark_data_smithi043_32659_object29391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:05:05.664 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:05.622757+0000", 2024-09-12T22:05:05.664 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0035058799999999998, 2024-09-12T22:05:05.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038679040000000001, 2024-09-12T22:05:05.665 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:05.665 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:05.665 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:05.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:05.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:05.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:05.665 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 196629 2024-09-12T22:05:05.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.665 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:05.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:05.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.622757+0000", 2024-09-12T22:05:05.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:05.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.622757+0000", 2024-09-12T22:05:05.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:05.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:05.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.622758+0000", 2024-09-12T22:05:05.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5000000000000001e-07 2024-09-12T22:05:05.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:05.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.622763+0000", 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8400000000000002e-06 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.622778+0000", 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5804999999999999e-05 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.622787+0000", 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:05.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.622840+0000", 2024-09-12T22:05:05.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2927000000000003e-05 2024-09-12T22:05:05.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:05.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623011+0000", 2024-09-12T22:05:05.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000170915 2024-09-12T22:05:05.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:05.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.623164+0000", 2024-09-12T22:05:05.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015323299999999999 2024-09-12T22:05:05.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:05.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:05.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:05.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:05.625563+0000", 2024-09-12T22:05:05.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023989889999999998 2024-09-12T22:05:05.669 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.669 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:05.669 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.669 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:05.669 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:05.669 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 9 2024-09-12T22:05:05.669 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:05.670 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:05.711 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:05.710+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:05.774 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:05:05.781 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:05.779+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:05.858 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:05.858 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:05.859 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:05.859 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:05.859 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:05.870 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:05.883 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:05.902 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:05.902 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:05.911 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:05.910+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:05.920 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:05.921 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:05.923 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:05.923 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:05.982 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:05.981+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:06.057 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:06.057 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:06.070 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:06.114 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:06.113+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:06.184 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:06.183+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:06.226 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:06.226 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:06.239 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:06.284 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:06.283+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:06.385 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:06.384+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:06.436 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:06.436 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:06.449 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:06.476 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:05:06.486 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:06.485+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:06.587 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:06.586+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:06.613 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:06.613 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:06.626 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:06.688 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:06.686+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:06.779 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:06.779 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:06.790 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:06.788+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:06.791 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:06.890 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:06.888+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:06.940 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:06.940 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:06.954 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:06.990 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:06.988+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:07.091 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:07.090+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:07.104 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:07.104 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:07.116 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:07.193 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:07.191+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:07.277 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:07.277 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:07.289 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:07.294 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:07.293+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:07.395 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:07.394+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-09-12T22:05:07.496 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:07.494+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:07.498 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:07.498 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:07.513 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:07.598 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:07.596+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:07.697 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:07.696+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:07.721 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:07.721 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:07.734 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:07.798 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:07.796+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:07.880 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:07.881 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:07.892 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:07.899 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:07.897+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:07.925 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:05:08.001 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:07.998+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:08.032 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:08.037 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:08.037 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:08.048 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:08.050 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:08.050 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:08.069 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:08.069 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:08.072 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:08.072 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:08.100 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:08.098+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:08.193 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:08.194 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:08.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:08.194 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:08.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.194 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:08.194 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:05:08.194 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.556996069999997, 2024-09-12T22:05:08.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:05:08.194 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.194 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.194 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.195 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.195 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.195 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.195 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:05:08.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.195 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:05:08.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:05:08.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:05:08.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:05:08.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:05:08.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:05:08.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:05:08.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:05:08.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:05:08.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:05:08.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:05:08.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:05:08.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:05:08.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:05:08.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:05:08.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:05:08.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:05:08.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:05:08.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:05:08.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:05:08.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:05:08.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:05:08.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:05:08.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:05:08.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.202 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.202 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:08.202 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:08.202 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.779689945000001, 2024-09-12T22:05:08.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:08.202 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.202 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.202 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:08.202 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.203 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:08.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.203 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:08.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:08.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:08.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:08.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:08.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:08.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:08.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:08.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:08.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:08.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:08.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:08.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:08.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:08.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:08.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:08.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:08.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:08.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:08.207 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.207 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.207 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.208 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:08.208 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:08.208 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.779510015, 2024-09-12T22:05:08.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:08.208 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.208 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.208 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:08.208 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.208 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.208 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.208 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:08.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.208 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:08.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:08.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:08.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:08.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:08.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:08.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:08.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:08.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:08.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:08.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:08.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:08.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:08.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:08.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:08.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:08.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:08.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:08.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:08.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.212 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.213 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:08.213 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:08.213 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.779443573999998, 2024-09-12T22:05:08.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:08.213 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.213 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.213 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:08.213 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.213 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.213 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.213 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:08.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.214 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:08.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:08.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:08.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:08.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:08.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:08.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:08.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:08.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:08.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:08.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:08.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:08.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.217 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.218 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:08.218 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:08.218 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.779387131, 2024-09-12T22:05:08.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:08.218 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.218 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.218 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.218 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:08.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.219 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:08.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:08.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:08.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:08.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:08.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:08.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:08.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:08.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:08.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:08.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:08.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:08.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:08.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:08.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:08.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:08.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:08.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:08.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:08.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:08.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:08.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:08.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:08.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:08.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:08.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:08.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:08.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:08.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:08.224 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.224 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.224 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.225 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:08.225 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:08.225 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.779318670999999, 2024-09-12T22:05:08.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:08.225 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.225 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.225 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.225 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.225 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.225 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.225 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:08.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.226 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:08.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:08.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:08.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:08.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:08.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:08.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:08.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:08.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:08.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:08.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:08.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:08.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:08.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:08.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:08.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:08.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:08.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:08.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:08.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:08.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:08.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:08.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:08.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:08.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:08.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:08.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:08.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:08.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:08.232 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.232 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.232 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.232 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:08.232 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:08.232 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.779260936, 2024-09-12T22:05:08.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:08.232 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.232 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.232 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.232 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.233 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.233 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.233 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:08.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.233 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:08.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:08.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:08.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:08.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:08.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:08.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:08.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:08.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:08.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:08.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:08.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:08.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:08.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:08.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:08.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:08.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:08.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:08.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:08.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:08.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:08.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:08.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:08.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:08.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.239 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.239 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:08.239 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:08.239 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.779193243999998, 2024-09-12T22:05:08.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:08.240 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.240 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.240 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.240 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:08.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.240 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:08.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:08.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:08.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:08.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:08.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:08.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:08.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:08.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:08.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:08.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:08.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:08.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:08.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:08.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:08.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:08.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:08.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:08.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:08.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:08.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:08.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:08.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:08.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:08.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:08.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.779138181999997, 2024-09-12T22:05:08.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:08.247 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.247 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.247 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.247 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:08.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.247 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:08.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:08.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:08.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:08.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:08.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:08.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:08.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:08.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:08.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:08.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:08.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:08.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:08.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:08.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:08.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:08.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:08.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:08.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:08.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:08.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:08.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:08.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:08.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:08.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:08.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:08.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:08.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:08.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:08.253 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.253 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.253 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.253 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:08.253 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:08.253 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.738490661999997, 2024-09-12T22:05:08.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:08.253 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.253 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.254 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.254 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.254 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.254 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.254 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:08.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.254 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:08.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:08.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:08.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:08.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:08.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:08.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:08.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:08.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:08.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:08.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:08.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:08.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:08.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:08.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:08.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:08.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:08.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:08.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:08.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:08.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:08.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:08.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:08.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:08.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:08.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:08.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:08.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:08.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:08.260 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.260 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.260 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.260 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:08.260 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:08.260 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.735876933999997, 2024-09-12T22:05:08.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:08.260 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.260 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.261 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.261 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.261 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.261 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.261 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:08.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.261 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:08.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:08.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:08.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:08.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:08.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:08.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:08.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:08.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:08.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:08.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:08.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:08.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:08.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:08.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:08.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:08.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:08.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:08.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:08.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:08.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:08.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:08.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:08.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:08.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:08.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:08.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:08.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:08.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:08.267 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.267 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.267 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.267 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117396 5.1 5:83c565df:::benchmark_data_smithi043_32659_object117395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:08.267 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:08.267 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.735735810999998, 2024-09-12T22:05:08.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.090595995999999998, 2024-09-12T22:05:08.267 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.267 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.267 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.268 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.268 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.268 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.268 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117396 2024-09-12T22:05:08.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.268 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:08.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:08.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454559+0000", 2024-09-12T22:05:08.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:05:08.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454629+0000", 2024-09-12T22:05:08.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0036000000000005e-05 2024-09-12T22:05:08.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454641+0000", 2024-09-12T22:05:08.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2232000000000001e-05 2024-09-12T22:05:08.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454649+0000", 2024-09-12T22:05:08.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-12T22:05:08.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454697+0000", 2024-09-12T22:05:08.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8028000000000002e-05 2024-09-12T22:05:08.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454702+0000", 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540467+0000", 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085764217000000004 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540596+0000", 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129787 2024-09-12T22:05:08.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540774+0000", 2024-09-12T22:05:08.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017746799999999999 2024-09-12T22:05:08.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544679+0000", 2024-09-12T22:05:08.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003904996 2024-09-12T22:05:08.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545009+0000", 2024-09-12T22:05:08.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033056600000000002 2024-09-12T22:05:08.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545067+0000", 2024-09-12T22:05:08.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7871999999999997e-05 2024-09-12T22:05:08.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545154+0000", 2024-09-12T22:05:08.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6701999999999998e-05 2024-09-12T22:05:08.273 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.273 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.274 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.274 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117398 5.6 5:6d151138:::benchmark_data_smithi043_32659_object117397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:08.274 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:05:08.274 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.714440639999999, 2024-09-12T22:05:08.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044999137000000002, 2024-09-12T22:05:08.274 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.274 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.274 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.274 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.274 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.274 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.274 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117398 2024-09-12T22:05:08.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.275 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:05:08.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:05:08.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475854+0000", 2024-09-12T22:05:08.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:05:08.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475914+0000", 2024-09-12T22:05:08.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9422999999999997e-05 2024-09-12T22:05:08.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475925+0000", 2024-09-12T22:05:08.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0881e-05 2024-09-12T22:05:08.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475930+0000", 2024-09-12T22:05:08.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:05:08.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475974+0000", 2024-09-12T22:05:08.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3810999999999998e-05 2024-09-12T22:05:08.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:08.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475981+0000", 2024-09-12T22:05:08.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1590000000000004e-06 2024-09-12T22:05:08.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504359+0000", 2024-09-12T22:05:08.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028377711 2024-09-12T22:05:08.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504526+0000", 2024-09-12T22:05:08.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167023 2024-09-12T22:05:08.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504661+0000", 2024-09-12T22:05:08.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135148 2024-09-12T22:05:08.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.506563+0000", 2024-09-12T22:05:08.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901778 2024-09-12T22:05:08.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520770+0000", 2024-09-12T22:05:08.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014206724 2024-09-12T22:05:08.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520803+0000", 2024-09-12T22:05:08.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3083000000000002e-05 2024-09-12T22:05:08.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520852+0000", 2024-09-12T22:05:08.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9543999999999999e-05 2024-09-12T22:05:08.282 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.282 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.282 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.282 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117399 5.3 5:ce33c2c7:::benchmark_data_smithi043_32659_object117398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:08.282 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:05:08.282 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.709671647, 2024-09-12T22:05:08.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038176902999999998, 2024-09-12T22:05:08.283 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.283 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.283 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.283 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.283 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.283 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.283 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117399 2024-09-12T22:05:08.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.283 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:05:08.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:05:08.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480624+0000", 2024-09-12T22:05:08.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.322e-06 2024-09-12T22:05:08.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480670+0000", 2024-09-12T22:05:08.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6365000000000001e-05 2024-09-12T22:05:08.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480682+0000", 2024-09-12T22:05:08.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:05:08.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480689+0000", 2024-09-12T22:05:08.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:05:08.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480731+0000", 2024-09-12T22:05:08.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:08.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:08.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480738+0000", 2024-09-12T22:05:08.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:05:08.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513753+0000", 2024-09-12T22:05:08.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.033015125999999999 2024-09-12T22:05:08.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513935+0000", 2024-09-12T22:05:08.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018219500000000001 2024-09-12T22:05:08.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.514170+0000", 2024-09-12T22:05:08.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000234694 2024-09-12T22:05:08.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518462+0000", 2024-09-12T22:05:08.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004291563 2024-09-12T22:05:08.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518655+0000", 2024-09-12T22:05:08.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019362700000000001 2024-09-12T22:05:08.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518710+0000", 2024-09-12T22:05:08.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:05:08.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518799+0000", 2024-09-12T22:05:08.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9000999999999997e-05 2024-09-12T22:05:08.290 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.290 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.290 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.290 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117407 5.c 5:3c61c1b7:::benchmark_data_smithi043_32659_object117406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:08.290 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:05:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.676466132999998, 2024-09-12T22:05:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042860548999999998, 2024-09-12T22:05:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117407 2024-09-12T22:05:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:05:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:05:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513829+0000", 2024-09-12T22:05:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-12T22:05:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513900+0000", 2024-09-12T22:05:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1482000000000004e-05 2024-09-12T22:05:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513909+0000", 2024-09-12T22:05:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8370000000000003e-06 2024-09-12T22:05:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513917+0000", 2024-09-12T22:05:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:05:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513967+0000", 2024-09-12T22:05:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.007e-05 2024-09-12T22:05:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513975+0000", 2024-09-12T22:05:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5639999999999999e-06 2024-09-12T22:05:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542411+0000", 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028436032999999999 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542539+0000", 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012777900000000001 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542687+0000", 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148343 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548120+0000", 2024-09-12T22:05:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054333580000000001 2024-09-12T22:05:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556549+0000", 2024-09-12T22:05:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084288309999999995 2024-09-12T22:05:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556596+0000", 2024-09-12T22:05:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6458999999999997e-05 2024-09-12T22:05:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556688+0000", 2024-09-12T22:05:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2676999999999994e-05 2024-09-12T22:05:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.190662838000001, 2024-09-12T22:05:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:08.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:08.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:08.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:08.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.303 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.303 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.303 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:08.304 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.190184349999999, 2024-09-12T22:05:08.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:08.304 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.304 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.304 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.304 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.304 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.304 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.304 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:08.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.304 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:08.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:08.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:08.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:08.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:08.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:08.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:08.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:08.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:08.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:08.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:08.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:08.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:08.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:08.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:08.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:08.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:08.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:08.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:08.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:08.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:08.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:08.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:08.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:08.310 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.310 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.310 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.310 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.310 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:08.311 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.187689049999999, 2024-09-12T22:05:08.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:08.311 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.311 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.311 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.311 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:08.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.311 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:08.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:08.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:08.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:08.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:08.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:08.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:08.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:08.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:08.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:08.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:08.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:08.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:08.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:08.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:08.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:08.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:08.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:08.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:08.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:08.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:08.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:08.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:08.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:08.316 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.316 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.316 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.317 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.317 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:08.317 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.186608259, 2024-09-12T22:05:08.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:08.317 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.317 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.317 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.317 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.317 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.317 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.317 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:08.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.317 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:08.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:08.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:08.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:08.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:08.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:08.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:08.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:08.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:08.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:08.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:08.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:08.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:08.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:08.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:08.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:08.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:08.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:08.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:08.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:08.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:08.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:08.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:08.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:08.322 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.322 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.322 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.323 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.323 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:08.323 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.185372696999998, 2024-09-12T22:05:08.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:08.323 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:08.323 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:08.323 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.323 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:08.323 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:08.323 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.323 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:08.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.323 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:08.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:08.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:08.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:08.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:08.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:08.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:08.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:08.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:08.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:08.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:08.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:08.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:08.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:08.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:08.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:08.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:08.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:08.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:08.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:08.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:08.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:08.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:08.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:08.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:08.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:08.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:08.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:08.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:08.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:08.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:08.328 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:08.329 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:08.330 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:08.330 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:08.328+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:08.431 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:08.430+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:08.491 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:08.491 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:08.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.491 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:204691 5.7 e52/40 5:ead71157:::benchmark_data_smithi043_32659_object37453:head v 52'12856, mlcod=52'12853)", 2024-09-12T22:05:08.491 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.486323+0000", 2024-09-12T22:05:08.491 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0026039169999999999, 2024-09-12T22:05:08.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026263139999999998, 2024-09-12T22:05:08.491 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.492 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.492 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:08.492 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486323+0000", 2024-09-12T22:05:08.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486323+0000", 2024-09-12T22:05:08.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486323+0000", 2024-09-12T22:05:08.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4600000000000005e-07 2024-09-12T22:05:08.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486331+0000", 2024-09-12T22:05:08.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7959999999999996e-06 2024-09-12T22:05:08.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486341+0000", 2024-09-12T22:05:08.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.04e-05 2024-09-12T22:05:08.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486348+0000", 2024-09-12T22:05:08.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6819999999999997e-06 2024-09-12T22:05:08.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486503+0000", 2024-09-12T22:05:08.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015502499999999999 2024-09-12T22:05:08.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486522+0000", 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9150000000000001e-05 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:204692 5.3 e52/40 5:c36273ea:::benchmark_data_smithi043_32659_object37454:head v 52'12739, mlcod=52'12737)", 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.486365+0000", 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002561579, 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002647281, 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486365+0000", 2024-09-12T22:05:08.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486365+0000", 2024-09-12T22:05:08.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486365+0000", 2024-09-12T22:05:08.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.46e-07 2024-09-12T22:05:08.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486369+0000", 2024-09-12T22:05:08.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6669999999999998e-06 2024-09-12T22:05:08.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486376+0000", 2024-09-12T22:05:08.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8800000000000002e-06 2024-09-12T22:05:08.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486397+0000", 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0863e-05 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487125+0000", 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00072876099999999997 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487143+0000", 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7334e-05 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.499 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:204690 5.c e52/40 5:379ed5eb:::benchmark_data_smithi043_32659_object37452:head v 52'12805, mlcod=52'12803)", 2024-09-12T22:05:08.499 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.486408+0000", 2024-09-12T22:05:08.499 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002518073, 2024-09-12T22:05:08.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026357300000000002, 2024-09-12T22:05:08.499 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.499 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.499 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:08.499 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486408+0000", 2024-09-12T22:05:08.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486408+0000", 2024-09-12T22:05:08.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486409+0000", 2024-09-12T22:05:08.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6699999999999999e-07 2024-09-12T22:05:08.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486414+0000", 2024-09-12T22:05:08.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8300000000000003e-06 2024-09-12T22:05:08.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486421+0000", 2024-09-12T22:05:08.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7989999999999994e-06 2024-09-12T22:05:08.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486427+0000", 2024-09-12T22:05:08.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5199999999999997e-06 2024-09-12T22:05:08.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486767+0000", 2024-09-12T22:05:08.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033972599999999999 2024-09-12T22:05:08.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486787+0000", 2024-09-12T22:05:08.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0188000000000001e-05 2024-09-12T22:05:08.502 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.502 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.502 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.502 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:204697 5.8 5:1c32a609:::benchmark_data_smithi043_32659_object37459:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:08.502 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.486696+0000", 2024-09-12T22:05:08.503 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0022308499999999999, 2024-09-12T22:05:08.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023821340000000002, 2024-09-12T22:05:08.503 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.503 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.503 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:08.503 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.503 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.503 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.503 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 204697 2024-09-12T22:05:08.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.503 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486696+0000", 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486696+0000", 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486697+0000", 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1800000000000004e-07 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486701+0000", 2024-09-12T22:05:08.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3640000000000001e-06 2024-09-12T22:05:08.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486711+0000", 2024-09-12T22:05:08.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7489999999999993e-06 2024-09-12T22:05:08.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486717+0000", 2024-09-12T22:05:08.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:08.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488104+0000", 2024-09-12T22:05:08.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001386239 2024-09-12T22:05:08.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488280+0000", 2024-09-12T22:05:08.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017599299999999999 2024-09-12T22:05:08.506 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.506 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.506 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.506 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 52/52 lb 5:6b04e331:::benchmark_data_smithi043_32659_object104131:head)", 2024-09-12T22:05:08.507 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.487278+0000", 2024-09-12T22:05:08.507 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001648369, 2024-09-12T22:05:08.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001844617, 2024-09-12T22:05:08.507 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.507 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.507 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:08.507 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487278+0000", 2024-09-12T22:05:08.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487278+0000", 2024-09-12T22:05:08.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487278+0000", 2024-09-12T22:05:08.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:05:08.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487285+0000", 2024-09-12T22:05:08.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7340000000000002e-06 2024-09-12T22:05:08.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.509 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487294+0000", 2024-09-12T22:05:08.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6230000000000003e-06 2024-09-12T22:05:08.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.509 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487300+0000", 2024-09-12T22:05:08.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2110000000000003e-06 2024-09-12T22:05:08.509 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.509 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.509 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.510 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:204699 5.b 5.b9c807b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:08.510 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.487364+0000", 2024-09-12T22:05:08.510 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0015619609999999999, 2024-09-12T22:05:08.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017833160000000001, 2024-09-12T22:05:08.510 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.510 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.510 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:08.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.511 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 204699 2024-09-12T22:05:08.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.511 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487364+0000", 2024-09-12T22:05:08.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487364+0000", 2024-09-12T22:05:08.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487366+0000", 2024-09-12T22:05:08.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.269e-06 2024-09-12T22:05:08.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487370+0000", 2024-09-12T22:05:08.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5399999999999997e-06 2024-09-12T22:05:08.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487381+0000", 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0869999999999999e-05 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487388+0000", 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0840000000000003e-06 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:204696 5.3 e52/40 5:cbd4a37e:::benchmark_data_smithi043_32659_object37458:head v 52'12740, mlcod=52'12737)", 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.487406+0000", 2024-09-12T22:05:08.513 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001520869, 2024-09-12T22:05:08.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001772364, 2024-09-12T22:05:08.514 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.514 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.514 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:08.514 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487406+0000", 2024-09-12T22:05:08.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487406+0000", 2024-09-12T22:05:08.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487406+0000", 2024-09-12T22:05:08.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5799999999999999e-07 2024-09-12T22:05:08.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487411+0000", 2024-09-12T22:05:08.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5739999999999997e-06 2024-09-12T22:05:08.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487418+0000", 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3359999999999997e-06 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487424+0000", 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488882+0000", 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014586429999999999 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488893+0000", 2024-09-12T22:05:08.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0688e-05 2024-09-12T22:05:08.517 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.517 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.517 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.517 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:204700 5.6 e52/40 5:62933ab5:::benchmark_data_smithi043_32659_object37462:head v 52'12669, mlcod=52'12667)", 2024-09-12T22:05:08.517 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.487805+0000", 2024-09-12T22:05:08.517 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0011215439999999999, 2024-09-12T22:05:08.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014025369999999999, 2024-09-12T22:05:08.517 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.517 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.517 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:08.517 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487805+0000", 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487805+0000", 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487805+0000", 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7199999999999999e-07 2024-09-12T22:05:08.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487811+0000", 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2660000000000001e-06 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487828+0000", 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7357e-05 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487835+0000", 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:08.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488063+0000", 2024-09-12T22:05:08.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022839 2024-09-12T22:05:08.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488082+0000", 2024-09-12T22:05:08.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9204000000000001e-05 2024-09-12T22:05:08.520 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.520 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.520 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.521 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:204698 5.3 e52/40)", 2024-09-12T22:05:08.521 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.488762+0000", 2024-09-12T22:05:08.521 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00016459100000000001, 2024-09-12T22:05:08.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00047500299999999999, 2024-09-12T22:05:08.521 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.521 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.521 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:08.521 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488762+0000", 2024-09-12T22:05:08.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488762+0000", 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488763+0000", 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9400000000000004e-07 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488768+0000", 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1950000000000002e-06 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488778+0000", 2024-09-12T22:05:08.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0202e-05 2024-09-12T22:05:08.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488784+0000", 2024-09-12T22:05:08.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6749999999999999e-06 2024-09-12T22:05:08.523 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.523 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.523 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.523 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:204701 5.4 5:22f90e4d:::benchmark_data_smithi043_32659_object37463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:08.524 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.488851+0000", 2024-09-12T22:05:08.524 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.5488999999999995e-05, 2024-09-12T22:05:08.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00041109300000000002, 2024-09-12T22:05:08.524 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.524 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.524 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:08.524 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.524 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.524 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.524 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 204701 2024-09-12T22:05:08.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.524 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488851+0000", 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488851+0000", 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488852+0000", 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.23e-07 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488857+0000", 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0989999999999998e-06 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488866+0000", 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6770000000000001e-06 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.488872+0000", 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2319999999999998e-06 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.489141+0000", 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00026947499999999998 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:204703 5.f 5:fb0616e8:::benchmark_data_smithi043_32659_object37465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.489066+0000", 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9998603, 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022831899999999999, 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:08.527 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.528 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.528 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.528 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 204703 2024-09-12T22:05:08.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.528 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.489066+0000", 2024-09-12T22:05:08.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.489066+0000", 2024-09-12T22:05:08.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.489067+0000", 2024-09-12T22:05:08.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0200000000000001e-07 2024-09-12T22:05:08.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.489071+0000", 2024-09-12T22:05:08.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.822e-06 2024-09-12T22:05:08.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.489081+0000", 2024-09-12T22:05:08.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9599999999999995e-06 2024-09-12T22:05:08.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.489087+0000", 2024-09-12T22:05:08.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5169999999999996e-06 2024-09-12T22:05:08.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.489136+0000", 2024-09-12T22:05:08.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8940000000000002e-05 2024-09-12T22:05:08.530 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.530 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.530 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:204702 5.c e52/40)", 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.489216+0000", 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9997101, 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000108948, 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.489216+0000", 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.489216+0000", 2024-09-12T22:05:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.489217+0000", 2024-09-12T22:05:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0900000000000001e-07 2024-09-12T22:05:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.489221+0000", 2024-09-12T22:05:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4939999999999997e-06 2024-09-12T22:05:08.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.489230+0000", 2024-09-12T22:05:08.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4870000000000002e-06 2024-09-12T22:05:08.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.489235+0000", 2024-09-12T22:05:08.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3539999999999999e-06 2024-09-12T22:05:08.533 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.533 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.533 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:204686 5.4 5:2f0dc37e:::benchmark_data_smithi043_32659_object37448:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.483774+0000", 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0051528980000000004, 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0055888730000000003, 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 204686 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.483774+0000", 2024-09-12T22:05:08.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.483774+0000", 2024-09-12T22:05:08.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.483774+0000", 2024-09-12T22:05:08.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4600000000000004e-07 2024-09-12T22:05:08.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.483778+0000", 2024-09-12T22:05:08.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1339999999999997e-06 2024-09-12T22:05:08.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.483787+0000", 2024-09-12T22:05:08.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6570000000000003e-06 2024-09-12T22:05:08.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.483794+0000", 2024-09-12T22:05:08.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5719999999999999e-06 2024-09-12T22:05:08.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485125+0000", 2024-09-12T22:05:08.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001331418 2024-09-12T22:05:08.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485345+0000", 2024-09-12T22:05:08.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022014699999999999 2024-09-12T22:05:08.537 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.537 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.537 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:204688 5.e 5:7f213a0b:::benchmark_data_smithi043_32659_object37450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.484209+0000", 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0047177340000000003, 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0052195540000000004, 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 204688 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.539 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.484209+0000", 2024-09-12T22:05:08.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.539 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.484209+0000", 2024-09-12T22:05:08.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.539 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.484209+0000", 2024-09-12T22:05:08.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6700000000000003e-07 2024-09-12T22:05:08.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.484213+0000", 2024-09-12T22:05:08.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:05:08.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.484221+0000", 2024-09-12T22:05:08.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4889999999999995e-06 2024-09-12T22:05:08.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.484227+0000", 2024-09-12T22:05:08.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1210000000000003e-06 2024-09-12T22:05:08.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485145+0000", 2024-09-12T22:05:08.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00091744700000000005 2024-09-12T22:05:08.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485496+0000", 2024-09-12T22:05:08.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000351023 2024-09-12T22:05:08.542 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.542 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.542 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.542 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:204693 5.b 5:da07c9ed:::benchmark_data_smithi043_32659_object37455:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:08.542 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.485661+0000", 2024-09-12T22:05:08.542 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.003265516, 2024-09-12T22:05:08.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038289259999999999, 2024-09-12T22:05:08.542 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.542 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.542 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:08.542 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.542 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 204693 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485661+0000", 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485661+0000", 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485662+0000", 2024-09-12T22:05:08.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3399999999999998e-07 2024-09-12T22:05:08.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485667+0000", 2024-09-12T22:05:08.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8579999999999999e-06 2024-09-12T22:05:08.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485676+0000", 2024-09-12T22:05:08.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6649999999999998e-06 2024-09-12T22:05:08.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485683+0000", 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0639999999999996e-06 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485755+0000", 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2076000000000006e-05 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485906+0000", 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015077299999999999 2024-09-12T22:05:08.545 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:204694 5.8 5:1626cd99:::benchmark_data_smithi043_32659_object37456:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.485703+0000", 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0032232570000000002, 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003851845, 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.546 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 204694 2024-09-12T22:05:08.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.547 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485703+0000", 2024-09-12T22:05:08.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485703+0000", 2024-09-12T22:05:08.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485704+0000", 2024-09-12T22:05:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485706+0000", 2024-09-12T22:05:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5790000000000002e-06 2024-09-12T22:05:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485713+0000", 2024-09-12T22:05:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7800000000000003e-06 2024-09-12T22:05:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485718+0000", 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3639999999999998e-06 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486327+0000", 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00060835700000000002 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.486572+0000", 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00024510299999999999 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.549 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.550 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.550 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:204695 5.e 5:7e61b64c:::benchmark_data_smithi043_32659_object37457:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:08.550 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:08.485890+0000", 2024-09-12T22:05:08.550 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0030366199999999999, 2024-09-12T22:05:08.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037345619999999999, 2024-09-12T22:05:08.550 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.550 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.550 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:08.550 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.550 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.550 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.550 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 204695 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485890+0000", 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485890+0000", 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.551 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485891+0000", 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4000000000000001e-07 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485895+0000", 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1810000000000003e-06 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485904+0000", 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8340000000000005e-06 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.485911+0000", 2024-09-12T22:05:08.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9260000000000003e-06 2024-09-12T22:05:08.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487113+0000", 2024-09-12T22:05:08.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001202177 2024-09-12T22:05:08.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:08.487249+0000", 2024-09-12T22:05:08.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013625599999999999 2024-09-12T22:05:08.553 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.553 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.553 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.554 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.554 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:08.554 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 17 2024-09-12T22:05:08.554 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:08.555 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:08.556 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:08.554+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:08.656 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:08.655+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:08.710 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:08.710 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:08.710 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:08.710 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:08.710 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:08.723 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:08.767 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:08.765+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:08.857 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:08.856+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:08.886 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:08.886 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:08.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:08.886 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:08.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.886 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:08.887 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:08.887 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 64.255425246000001, 2024-09-12T22:05:08.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:05:08.887 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.887 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.887 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.887 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.887 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.887 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.887 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:05:08.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.887 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:08.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:08.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:05:08.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:05:08.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:05:08.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:05:08.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:05:08.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:05:08.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:05:08.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:05:08.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:05:08.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:05:08.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:05:08.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:05:08.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:08.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:05:08.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:05:08.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:08.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:05:08.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:05:08.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:05:08.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:05:08.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:05:08.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:05:08.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:05:08.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:05:08.893 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.893 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.893 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.893 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:08.893 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:08.893 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 64.250024306, 2024-09-12T22:05:08.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:05:08.893 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.893 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.893 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.893 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:05:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:05:08.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:05:08.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:05:08.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:05:08.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:05:08.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:05:08.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:05:08.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:05:08.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:08.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:05:08.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:05:08.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:05:08.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:05:08.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:08.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:05:08.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:05:08.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:05:08.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:05:08.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:05:08.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:05:08.899 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.899 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.899 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.899 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44124 5.8 5:149c54f8:::benchmark_data_smithi043_32659_object44123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:08.899 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:05:08.899 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 64.249083038999999, 2024-09-12T22:05:08.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.084438409000000006, 2024-09-12T22:05:08.899 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.899 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.899 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.899 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.899 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.900 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.900 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44124 2024-09-12T22:05:08.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.900 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:05:08.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632638+0000", 2024-09-12T22:05:08.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632639+0000", 2024-09-12T22:05:08.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.09e-07 2024-09-12T22:05:08.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632714+0000", 2024-09-12T22:05:08.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5154000000000006e-05 2024-09-12T22:05:08.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632724+0000", 2024-09-12T22:05:08.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8870000000000004e-06 2024-09-12T22:05:08.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.632730+0000", 2024-09-12T22:05:08.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:05:08.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711862+0000", 2024-09-12T22:05:08.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.079131974999999993 2024-09-12T22:05:08.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711978+0000", 2024-09-12T22:05:08.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115179 2024-09-12T22:05:08.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:08.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.712094+0000", 2024-09-12T22:05:08.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116431 2024-09-12T22:05:08.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716868+0000", 2024-09-12T22:05:08.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047742740000000002 2024-09-12T22:05:08.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:08.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716964+0000", 2024-09-12T22:05:08.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:05:08.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717035+0000", 2024-09-12T22:05:08.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1528999999999999e-05 2024-09-12T22:05:08.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717076+0000", 2024-09-12T22:05:08.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1208000000000003e-05 2024-09-12T22:05:08.905 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.905 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.905 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.905 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44127 5.8 5:1ee28cc0:::benchmark_data_smithi043_32659_object44126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:08.905 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:05:08.905 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 64.248085118999995, 2024-09-12T22:05:08.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.083567728999999993, 2024-09-12T22:05:08.906 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.906 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.906 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.906 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.906 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.906 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.906 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44127 2024-09-12T22:05:08.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.906 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:05:08.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633636+0000", 2024-09-12T22:05:08.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633637+0000", 2024-09-12T22:05:08.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:05:08.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633740+0000", 2024-09-12T22:05:08.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010254 2024-09-12T22:05:08.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674371+0000", 2024-09-12T22:05:08.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.040631039000000001 2024-09-12T22:05:08.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674393+0000", 2024-09-12T22:05:08.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2623999999999999e-05 2024-09-12T22:05:08.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713674+0000", 2024-09-12T22:05:08.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039280645000000003 2024-09-12T22:05:08.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713763+0000", 2024-09-12T22:05:08.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9413000000000006e-05 2024-09-12T22:05:08.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:08.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.713854+0000", 2024-09-12T22:05:08.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0908000000000004e-05 2024-09-12T22:05:08.910 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.910 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.910 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.910 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717120+0000", 2024-09-12T22:05:08.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032659350000000002 2024-09-12T22:05:08.910 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.910 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.910 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:08.910 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717134+0000", 2024-09-12T22:05:08.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4270000000000001e-05 2024-09-12T22:05:08.910 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.910 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.911 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.911 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717167+0000", 2024-09-12T22:05:08.911 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2286999999999998e-05 2024-09-12T22:05:08.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.911 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.911 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.717204+0000", 2024-09-12T22:05:08.911 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7082000000000002e-05 2024-09-12T22:05:08.911 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.911 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.911 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.912 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.912 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:08.912 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.88433642, 2024-09-12T22:05:08.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:05:08.912 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.912 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.912 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.912 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.912 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.912 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.912 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:05:08.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.913 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:08.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:08.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:08.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:05:08.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:05:08.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:05:08.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:05:08.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:05:08.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:05:08.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:05:08.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.916 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.916 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:05:08.916 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:05:08.916 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.916 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.916 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:05:08.916 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:05:08.917 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.917 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.917 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:08.917 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:05:08.917 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:05:08.917 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:05:08.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:05:08.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:08.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:05:08.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:05:08.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:05:08.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:05:08.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:05:08.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:05:08.919 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.920 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.920 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.920 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.920 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:08.920 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.883703215000001, 2024-09-12T22:05:08.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:08.920 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.920 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.921 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.921 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.921 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.921 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.921 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:08.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.921 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.921 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.921 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:08.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:08.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.923 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.923 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.923 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:08.923 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:08.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.923 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.923 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.923 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:08.923 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:08.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.924 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:08.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:08.924 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.924 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:08.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:08.924 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:08.924 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:08.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:08.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:08.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:08.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:08.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:08.925 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.925 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.925 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.926 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.926 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:08.926 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.881883552000001, 2024-09-12T22:05:08.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:08.926 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.926 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.926 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.926 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.926 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.926 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.926 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:08.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.927 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:08.927 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:08.927 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:08.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:08.928 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.928 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.928 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.928 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:08.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:08.928 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.928 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.928 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.928 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:08.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:08.928 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.928 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:08.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:08.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:08.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:08.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:08.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:08.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:08.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:08.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:08.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:08.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:08.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:08.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:08.931 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.931 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.931 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.931 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.931 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:08.931 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.881715925000002, 2024-09-12T22:05:08.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:05:08.931 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.931 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.931 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.931 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.931 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.932 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.932 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:05:08.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.932 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.932 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:08.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.933 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:08.933 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.933 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:05:08.933 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:05:08.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:05:08.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:05:08.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.934 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:05:08.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:05:08.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.934 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:05:08.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:05:08.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:05:08.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:05:08.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:05:08.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:05:08.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:08.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:05:08.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:05:08.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:05:08.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:05:08.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:05:08.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:05:08.936 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.936 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.936 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.937 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:05:08.937 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:08.937 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.881575261000002, 2024-09-12T22:05:08.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:05:08.937 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.937 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.937 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.937 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:08.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:08.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:05:08.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:05:08.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:05:08.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:05:08.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.939 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:05:08.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:05:08.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.939 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:05:08.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:05:08.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:05:08.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:05:08.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:05:08.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:05:08.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.941 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:05:08.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:05:08.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.941 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:05:08.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:05:08.941 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.941 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.941 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.941 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.941 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.881349738000001, 2024-09-12T22:05:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:08.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:08.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:08.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:08.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:08.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:08.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:08.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:08.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:08.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:08.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:08.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:08.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:08.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:08.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:08.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:08.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:08.946 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.946 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.946 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.947 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.947 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:08.947 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.881230034000001, 2024-09-12T22:05:08.947 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:05:08.947 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.947 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.947 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.947 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.947 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.947 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.947 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:05:08.947 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.947 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.948 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.948 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:08.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.948 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.948 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:08.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.948 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:05:08.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:05:08.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:05:08.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:05:08.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:05:08.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:05:08.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:05:08.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:05:08.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:05:08.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:05:08.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:05:08.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:05:08.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:08.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:08.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:05:08.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:05:08.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:05:08.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:08.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:05:08.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:05:08.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:05:08.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:05:08.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:05:08.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:05:08.952 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.952 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.880638751999999, 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:08.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:08.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:05:08.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:05:08.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:05:08.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:05:08.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:05:08.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:05:08.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:05:08.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:05:08.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:05:08.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:05:08.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:05:08.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:05:08.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:05:08.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:05:08.957 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.957 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.957 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.957 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:05:08.957 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:08.957 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.880415184, 2024-09-12T22:05:08.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:05:08.957 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.957 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.957 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.958 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:08.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:08.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:08.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:05:08.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:05:08.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:05:08.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:05:08.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:05:08.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:05:08.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:05:08.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:05:08.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:05:08.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:05:08.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:05:08.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:05:08.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:05:08.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:05:08.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:05:08.961 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.961 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.961 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.962 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.962 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:08.962 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.880323702999998, 2024-09-12T22:05:08.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:05:08.962 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.962 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.962 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.962 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.962 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.962 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.962 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:05:08.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:05:08.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:05:08.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:05:08.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:05:08.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:05:08.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:05:08.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:05:08.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:05:08.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:05:08.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:05:08.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:05:08.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:05:08.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:08.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:05:08.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:05:08.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:05:08.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:05:08.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:05:08.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:05:08.966 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.966 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.879534898999999, 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.968 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:08.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:08.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:08.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:08.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:08.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:08.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:08.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:08.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:08.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:08.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:08.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:08.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:08.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:08.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:08.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.879270759000001, 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.972 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.973 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:05:08.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.973 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:08.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:08.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:05:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:05:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:05:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:05:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:05:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:05:08.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:05:08.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:05:08.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:05:08.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:05:08.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:05:08.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:05:08.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:08.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:05:08.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:05:08.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:05:08.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:05:08.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:05:08.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:05:08.977 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.977 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.977 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.977 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:05:08.977 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:08.977 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.878765783999999, 2024-09-12T22:05:08.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:05:08.978 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.978 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.978 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.978 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:08.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:08.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:05:08.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:05:08.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:05:08.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:05:08.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:05:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:05:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:05:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:05:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:05:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:05:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:05:08.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:05:08.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:05:08.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:05:08.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:05:08.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.877636356, 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:08.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:08.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:08.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:08.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:05:08.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:05:08.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:05:08.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:05:08.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:05:08.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:05:08.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:05:08.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:05:08.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:05:08.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:05:08.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:05:08.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:05:08.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:05:08.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:05:08.986 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.987 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.987 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.987 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:08.987 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:08.987 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.876881913999998, 2024-09-12T22:05:08.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:05:08.987 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.987 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.987 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.987 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:08.987 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:08.987 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:08.988 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:05:08.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.988 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:08.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:08.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:05:08.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:08.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:05:08.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:05:08.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:05:08.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:05:08.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:05:08.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:05:08.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:05:08.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:05:08.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:05:08.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:05:08.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:08.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:05:08.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:05:08.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:08.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:05:08.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:05:08.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:08.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:05:08.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:05:08.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:05:08.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:05:08.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:05:08.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:05:08.992 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.992 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.876202811999999, 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:08.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:08.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:08.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:08.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:08.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:05:08.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:05:08.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:08.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:05:08.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:05:08.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:08.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:05:08.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:05:08.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:08.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:05:08.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:05:08.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:08.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:05:08.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:05:08.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:08.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:05:08.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:05:08.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:08.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:05:08.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:05:08.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:08.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:08.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:08.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:05:08.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:05:08.997 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.997 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.997 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.997 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:08.997 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:08.997 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:08.999 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:08.996+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:08.999 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:09.099 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:09.098+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:09.145 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:09.145 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:09.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.146 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:206441 5.1 5:8f6565d9:::benchmark_data_smithi043_32659_object39203:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:09.146 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.139260+0000", 2024-09-12T22:05:09.146 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0048635010000000001, 2024-09-12T22:05:09.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048875000000000004, 2024-09-12T22:05:09.146 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.146 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.146 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:09.146 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.146 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.146 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.146 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 206441 2024-09-12T22:05:09.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.147 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139260+0000", 2024-09-12T22:05:09.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139260+0000", 2024-09-12T22:05:09.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139261+0000", 2024-09-12T22:05:09.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7599999999999997e-07 2024-09-12T22:05:09.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139264+0000", 2024-09-12T22:05:09.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.869e-06 2024-09-12T22:05:09.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139271+0000", 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1810000000000004e-06 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139276+0000", 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.468e-06 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139346+0000", 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9886000000000001e-05 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139512+0000", 2024-09-12T22:05:09.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000165382 2024-09-12T22:05:09.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139628+0000", 2024-09-12T22:05:09.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011647800000000001 2024-09-12T22:05:09.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142033+0000", 2024-09-12T22:05:09.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002404967 2024-09-12T22:05:09.150 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.150 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.150 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.151 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:206443 5.3 5:c0e4743f:::benchmark_data_smithi043_32659_object39205:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:09.151 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.139442+0000", 2024-09-12T22:05:09.151 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0046817680000000002, 2024-09-12T22:05:09.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047847020000000001, 2024-09-12T22:05:09.151 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.151 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.151 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:09.151 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.151 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.151 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.151 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 206443 2024-09-12T22:05:09.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.152 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139442+0000", 2024-09-12T22:05:09.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139442+0000", 2024-09-12T22:05:09.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139443+0000", 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0500000000000002e-07 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139447+0000", 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9890000000000003e-06 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139457+0000", 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0563e-05 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139464+0000", 2024-09-12T22:05:09.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.973e-06 2024-09-12T22:05:09.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139546+0000", 2024-09-12T22:05:09.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1629000000000001e-05 2024-09-12T22:05:09.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139811+0000", 2024-09-12T22:05:09.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026532500000000001 2024-09-12T22:05:09.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139955+0000", 2024-09-12T22:05:09.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014408499999999999 2024-09-12T22:05:09.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143365+0000", 2024-09-12T22:05:09.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034098840000000002 2024-09-12T22:05:09.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.155 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.156 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:206444 5.c 5:32ace054:::benchmark_data_smithi043_32659_object39206:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:09.156 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.139481+0000", 2024-09-12T22:05:09.156 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0046426330000000002, 2024-09-12T22:05:09.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048180890000000002, 2024-09-12T22:05:09.156 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.156 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.156 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:09.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.156 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 206444 2024-09-12T22:05:09.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.156 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139481+0000", 2024-09-12T22:05:09.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139481+0000", 2024-09-12T22:05:09.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139482+0000", 2024-09-12T22:05:09.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.51e-07 2024-09-12T22:05:09.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139484+0000", 2024-09-12T22:05:09.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4480000000000001e-06 2024-09-12T22:05:09.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139491+0000", 2024-09-12T22:05:09.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4460000000000004e-06 2024-09-12T22:05:09.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139498+0000", 2024-09-12T22:05:09.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0589999999999999e-06 2024-09-12T22:05:09.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139535+0000", 2024-09-12T22:05:09.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7486e-05 2024-09-12T22:05:09.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139714+0000", 2024-09-12T22:05:09.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000178808 2024-09-12T22:05:09.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139828+0000", 2024-09-12T22:05:09.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011398199999999999 2024-09-12T22:05:09.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142270+0000", 2024-09-12T22:05:09.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002441758 2024-09-12T22:05:09.160 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.160 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.160 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.161 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:206447 5.3 5:cdc04bc9:::benchmark_data_smithi043_32659_object39209:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:09.161 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.139590+0000", 2024-09-12T22:05:09.161 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0045341110000000004, 2024-09-12T22:05:09.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047803710000000003, 2024-09-12T22:05:09.161 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.161 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.161 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:09.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.162 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 206447 2024-09-12T22:05:09.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.162 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139590+0000", 2024-09-12T22:05:09.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139590+0000", 2024-09-12T22:05:09.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139590+0000", 2024-09-12T22:05:09.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8599999999999998e-07 2024-09-12T22:05:09.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139594+0000", 2024-09-12T22:05:09.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5030000000000002e-06 2024-09-12T22:05:09.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139602+0000", 2024-09-12T22:05:09.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:09.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.139608+0000", 2024-09-12T22:05:09.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4370000000000004e-06 2024-09-12T22:05:09.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.141743+0000", 2024-09-12T22:05:09.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021347710000000002 2024-09-12T22:05:09.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.141838+0000", 2024-09-12T22:05:09.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4388000000000005e-05 2024-09-12T22:05:09.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.141911+0000", 2024-09-12T22:05:09.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3919999999999997e-05 2024-09-12T22:05:09.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143625+0000", 2024-09-12T22:05:09.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001713832 2024-09-12T22:05:09.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.166 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.166 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:206451 5.5 5:a0d8a6ba:::benchmark_data_smithi043_32659_object39213:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:09.166 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.141965+0000", 2024-09-12T22:05:09.167 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0021588599999999999, 2024-09-12T22:05:09.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024782250000000001, 2024-09-12T22:05:09.167 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.167 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.167 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:09.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.167 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 206451 2024-09-12T22:05:09.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.167 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.141965+0000", 2024-09-12T22:05:09.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.141965+0000", 2024-09-12T22:05:09.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.141966+0000", 2024-09-12T22:05:09.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.44e-06 2024-09-12T22:05:09.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.141972+0000", 2024-09-12T22:05:09.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7509999999999997e-06 2024-09-12T22:05:09.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.141984+0000", 2024-09-12T22:05:09.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2475e-05 2024-09-12T22:05:09.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.141993+0000", 2024-09-12T22:05:09.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2539999999999992e-06 2024-09-12T22:05:09.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142057+0000", 2024-09-12T22:05:09.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3965000000000002e-05 2024-09-12T22:05:09.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142246+0000", 2024-09-12T22:05:09.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000188872 2024-09-12T22:05:09.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142360+0000", 2024-09-12T22:05:09.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114734 2024-09-12T22:05:09.171 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.171 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.171 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.171 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:206453 5.5 5:a8b93b94:::benchmark_data_smithi043_32659_object39215:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:09.171 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.142303+0000", 2024-09-12T22:05:09.171 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001820318, 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022113990000000002, 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 206453 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142303+0000", 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142303+0000", 2024-09-12T22:05:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142304+0000", 2024-09-12T22:05:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2600000000000001e-07 2024-09-12T22:05:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142309+0000", 2024-09-12T22:05:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6380000000000003e-06 2024-09-12T22:05:09.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142319+0000", 2024-09-12T22:05:09.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0396e-05 2024-09-12T22:05:09.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142326+0000", 2024-09-12T22:05:09.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1219999999999997e-06 2024-09-12T22:05:09.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.144228+0000", 2024-09-12T22:05:09.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901247 2024-09-12T22:05:09.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.144381+0000", 2024-09-12T22:05:09.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015364 2024-09-12T22:05:09.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.144491+0000", 2024-09-12T22:05:09.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010956299999999999 2024-09-12T22:05:09.175 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.175 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.176 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:206454 5.6 5:61149b51:::benchmark_data_smithi043_32659_object39216:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:09.176 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.142417+0000", 2024-09-12T22:05:09.176 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001706354, 2024-09-12T22:05:09.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002184559, 2024-09-12T22:05:09.176 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.176 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.176 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:09.176 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.176 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.176 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.177 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 206454 2024-09-12T22:05:09.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.177 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142417+0000", 2024-09-12T22:05:09.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142417+0000", 2024-09-12T22:05:09.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142418+0000", 2024-09-12T22:05:09.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2699999999999998e-07 2024-09-12T22:05:09.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142422+0000", 2024-09-12T22:05:09.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9029999999999997e-06 2024-09-12T22:05:09.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142437+0000", 2024-09-12T22:05:09.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4744e-05 2024-09-12T22:05:09.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142444+0000", 2024-09-12T22:05:09.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-06 2024-09-12T22:05:09.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142491+0000", 2024-09-12T22:05:09.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6553e-05 2024-09-12T22:05:09.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142652+0000", 2024-09-12T22:05:09.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016085399999999999 2024-09-12T22:05:09.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.142783+0000", 2024-09-12T22:05:09.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013082400000000001 2024-09-12T22:05:09.180 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.181 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.181 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.181 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:206457 5.1 5:8bb7b45b:::benchmark_data_smithi043_32659_object39219:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:09.181 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.143369+0000", 2024-09-12T22:05:09.181 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00075434299999999998, 2024-09-12T22:05:09.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0013125540000000001, 2024-09-12T22:05:09.181 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.181 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.181 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:09.181 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.181 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 206457 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143369+0000", 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143369+0000", 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143370+0000", 2024-09-12T22:05:09.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-12T22:05:09.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143374+0000", 2024-09-12T22:05:09.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2300000000000002e-06 2024-09-12T22:05:09.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143384+0000", 2024-09-12T22:05:09.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9000000000000001e-06 2024-09-12T22:05:09.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143391+0000", 2024-09-12T22:05:09.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9600000000000003e-06 2024-09-12T22:05:09.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143443+0000", 2024-09-12T22:05:09.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1752000000000002e-05 2024-09-12T22:05:09.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143609+0000", 2024-09-12T22:05:09.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016547999999999999 2024-09-12T22:05:09.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143734+0000", 2024-09-12T22:05:09.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012530700000000001 2024-09-12T22:05:09.185 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.185 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.186 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.186 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:206458 5.9 e52/40 5:99b38bee:::benchmark_data_smithi043_32659_object39220:head v 52'12991, mlcod=52'12988)", 2024-09-12T22:05:09.186 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.143800+0000", 2024-09-12T22:05:09.186 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00032380000000000001, 2024-09-12T22:05:09.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00094960400000000005, 2024-09-12T22:05:09.186 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.186 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.186 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:09.186 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143800+0000", 2024-09-12T22:05:09.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143800+0000", 2024-09-12T22:05:09.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143800+0000", 2024-09-12T22:05:09.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-09-12T22:05:09.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143805+0000", 2024-09-12T22:05:09.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1189999999999999e-06 2024-09-12T22:05:09.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143812+0000", 2024-09-12T22:05:09.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2660000000000004e-06 2024-09-12T22:05:09.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143816+0000", 2024-09-12T22:05:09.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4100000000000001e-06 2024-09-12T22:05:09.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143862+0000", 2024-09-12T22:05:09.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5454000000000002e-05 2024-09-12T22:05:09.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143887+0000", 2024-09-12T22:05:09.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5168999999999999e-05 2024-09-12T22:05:09.189 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.189 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.190 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.190 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:206459 5.d e52/40 5:bde6b852:::benchmark_data_smithi043_32659_object39221:head v 52'12810, mlcod=52'12808)", 2024-09-12T22:05:09.190 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.143937+0000", 2024-09-12T22:05:09.190 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000186763, 2024-09-12T22:05:09.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00085833800000000005, 2024-09-12T22:05:09.190 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.190 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.190 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:09.190 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143937+0000", 2024-09-12T22:05:09.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143937+0000", 2024-09-12T22:05:09.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143937+0000", 2024-09-12T22:05:09.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.41e-07 2024-09-12T22:05:09.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143939+0000", 2024-09-12T22:05:09.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1519999999999999e-06 2024-09-12T22:05:09.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143944+0000", 2024-09-12T22:05:09.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6e-06 2024-09-12T22:05:09.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.143947+0000", 2024-09-12T22:05:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2399999999999999e-06 2024-09-12T22:05:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.144182+0000", 2024-09-12T22:05:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023476500000000001 2024-09-12T22:05:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.144204+0000", 2024-09-12T22:05:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2059e-05 2024-09-12T22:05:09.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.194 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.194 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:206444 5.c e52/40)", 2024-09-12T22:05:09.194 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.144791+0000", 2024-09-12T22:05:09.194 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9993324, 2024-09-12T22:05:09.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9883000000000003e-05, 2024-09-12T22:05:09.194 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.194 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.194 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:09.194 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.144791+0000", 2024-09-12T22:05:09.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.144791+0000", 2024-09-12T22:05:09.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.144792+0000", 2024-09-12T22:05:09.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4700000000000001e-07 2024-09-12T22:05:09.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.144796+0000", 2024-09-12T22:05:09.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6029999999999998e-06 2024-09-12T22:05:09.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.144806+0000", 2024-09-12T22:05:09.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.009e-05 2024-09-12T22:05:09.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.144813+0000", 2024-09-12T22:05:09.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0950000000000001e-06 2024-09-12T22:05:09.197 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.197 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.197 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.197 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.197 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:09.197 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 11 2024-09-12T22:05:09.197 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:09.198 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:09.200 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:09.198+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:09.300 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:09.298+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:09.344 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:09.344 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:09.345 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:09.345 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:09.345 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:09.357 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:09.401 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:09.399+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:09.482 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:05:09.488 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:09.488 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:09.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:09.488 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:09.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.488 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:44125 5.9 5:9022696f:::benchmark_data_smithi043_32659_object44124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:09.488 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:05:09.489 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.852485717999997, 2024-09-12T22:05:09.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043366917999999997, 2024-09-12T22:05:09.489 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.489 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.489 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.489 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.489 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.489 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.489 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 44125 2024-09-12T22:05:09.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.489 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:05:09.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633298+0000", 2024-09-12T22:05:09.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633299+0000", 2024-09-12T22:05:09.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.031e-06 2024-09-12T22:05:09.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:05:09.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3220000000000002e-05 2024-09-12T22:05:09.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633372+0000", 2024-09-12T22:05:09.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:05:09.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633381+0000", 2024-09-12T22:05:09.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4640000000000006e-06 2024-09-12T22:05:09.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633442+0000", 2024-09-12T22:05:09.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1425000000000002e-05 2024-09-12T22:05:09.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633532+0000", 2024-09-12T22:05:09.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9766999999999996e-05 2024-09-12T22:05:09.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.633605+0000", 2024-09-12T22:05:09.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2595999999999994e-05 2024-09-12T22:05:09.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.635129+0000", 2024-09-12T22:05:09.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015243559999999999 2024-09-12T22:05:09.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676595+0000", 2024-09-12T22:05:09.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041465631000000003 2024-09-12T22:05:09.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676628+0000", 2024-09-12T22:05:09.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2999e-05 2024-09-12T22:05:09.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:04.676665+0000", 2024-09-12T22:05:09.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7194999999999999e-05 2024-09-12T22:05:09.494 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.494 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.494 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.495 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:09.495 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:09.495 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 36.075179593000001, 2024-09-12T22:05:09.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:09.495 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.495 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.495 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:09.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.495 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:09.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.496 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:09.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:09.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:09.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:09.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:09.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:09.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:09.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:09.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:09.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:09.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:09.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:09.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:09.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:09.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:09.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:09.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:09.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:09.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:09.500 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.500 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.500 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.500 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:09.500 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:09.500 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 36.074999663, 2024-09-12T22:05:09.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:09.501 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.501 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.501 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:09.501 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.501 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.501 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.501 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:09.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.501 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:09.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:09.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:09.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:09.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:09.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:09.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:09.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:09.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:09.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:09.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:09.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:09.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:09.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:09.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:09.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:09.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:09.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:09.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:09.506 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.506 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.506 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.506 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:09.506 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:09.507 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 36.074933221999999, 2024-09-12T22:05:09.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:09.507 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.507 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.507 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:09.507 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.507 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.507 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.507 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:09.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.507 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:09.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:09.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:09.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:09.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:09.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:09.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:09.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:09.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:09.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:09.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:09.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:09.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:09.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:09.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:09.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:09.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:09.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:09.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:09.511 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.511 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.511 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.512 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:09.512 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:09.512 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 36.074876779, 2024-09-12T22:05:09.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:09.512 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.512 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.512 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.512 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.512 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.512 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.512 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:09.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.513 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:09.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:09.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:09.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:09.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:09.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:09.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:09.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:09.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:09.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:09.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:09.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:09.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:09.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:09.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:09.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:09.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:09.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:09.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:09.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:09.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:09.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:09.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:09.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:09.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:09.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:09.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:09.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:09.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:09.519 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.519 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.519 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.519 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:09.520 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:09.520 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 36.074808318999999, 2024-09-12T22:05:09.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:09.520 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.520 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.520 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.520 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:09.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.520 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:09.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:09.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:09.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:09.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:09.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:09.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:09.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:09.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:09.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:09.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:09.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:09.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:09.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:09.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:09.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:09.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:09.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:09.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:09.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:09.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:09.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:09.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:09.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.527 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.527 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:09.527 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:09.527 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 36.074750584, 2024-09-12T22:05:09.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:09.527 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.527 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.527 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.528 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:09.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.528 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:09.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:09.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:09.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:09.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:09.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:09.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:09.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:09.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:09.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:09.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:09.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:09.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:09.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:09.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:09.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:09.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:09.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:09.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:09.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:09.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:09.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:09.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:09.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:09.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:09.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:09.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:09.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:09.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:09.533 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.533 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.533 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 36.074682891999998, 2024-09-12T22:05:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:09.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.535 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:09.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:09.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:09.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:09.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:09.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:09.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:09.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:09.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:09.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:09.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:09.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:09.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:09.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:09.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:09.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:09.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:09.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:09.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:09.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:09.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:09.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:09.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:09.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:09.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:09.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:09.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:09.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:09.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:09.540 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.540 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.541 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:09.541 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:09.541 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 36.074627829999997, 2024-09-12T22:05:09.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:09.541 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.541 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.541 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.541 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:09.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.542 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:09.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:09.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:09.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:09.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:09.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:09.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:09.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:09.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:09.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:09.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:09.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:09.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:09.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:09.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:09.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:09.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:09.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:09.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.033980309999997, 2024-09-12T22:05:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.031366581999997, 2024-09-12T22:05:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117396 5.1 5:83c565df:::benchmark_data_smithi043_32659_object117395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.031225458999998, 2024-09-12T22:05:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.090595995999999998, 2024-09-12T22:05:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117396 2024-09-12T22:05:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454559+0000", 2024-09-12T22:05:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:05:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454629+0000", 2024-09-12T22:05:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0036000000000005e-05 2024-09-12T22:05:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454641+0000", 2024-09-12T22:05:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2232000000000001e-05 2024-09-12T22:05:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454649+0000", 2024-09-12T22:05:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-12T22:05:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454697+0000", 2024-09-12T22:05:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8028000000000002e-05 2024-09-12T22:05:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:09.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454702+0000", 2024-09-12T22:05:09.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:05:09.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540467+0000", 2024-09-12T22:05:09.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085764217000000004 2024-09-12T22:05:09.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540596+0000", 2024-09-12T22:05:09.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129787 2024-09-12T22:05:09.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540774+0000", 2024-09-12T22:05:09.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017746799999999999 2024-09-12T22:05:09.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544679+0000", 2024-09-12T22:05:09.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003904996 2024-09-12T22:05:09.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545009+0000", 2024-09-12T22:05:09.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033056600000000002 2024-09-12T22:05:09.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545067+0000", 2024-09-12T22:05:09.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7871999999999997e-05 2024-09-12T22:05:09.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.545154+0000", 2024-09-12T22:05:09.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6701999999999998e-05 2024-09-12T22:05:09.955 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.956 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.956 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.956 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117398 5.6 5:6d151138:::benchmark_data_smithi043_32659_object117397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:09.956 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:05:09.956 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.009930288, 2024-09-12T22:05:09.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044999137000000002, 2024-09-12T22:05:09.956 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.956 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.956 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.957 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117398 2024-09-12T22:05:09.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.957 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:05:09.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475853+0000", 2024-09-12T22:05:09.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475854+0000", 2024-09-12T22:05:09.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:05:09.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475914+0000", 2024-09-12T22:05:09.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9422999999999997e-05 2024-09-12T22:05:09.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475925+0000", 2024-09-12T22:05:09.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0881e-05 2024-09-12T22:05:09.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475930+0000", 2024-09-12T22:05:09.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6069999999999998e-06 2024-09-12T22:05:09.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475974+0000", 2024-09-12T22:05:09.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3810999999999998e-05 2024-09-12T22:05:09.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:09.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.475981+0000", 2024-09-12T22:05:09.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1590000000000004e-06 2024-09-12T22:05:09.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504359+0000", 2024-09-12T22:05:09.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028377711 2024-09-12T22:05:09.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504526+0000", 2024-09-12T22:05:09.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167023 2024-09-12T22:05:09.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.504661+0000", 2024-09-12T22:05:09.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135148 2024-09-12T22:05:09.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.506563+0000", 2024-09-12T22:05:09.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001901778 2024-09-12T22:05:09.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520770+0000", 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014206724 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520803+0000", 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3083000000000002e-05 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.520852+0000", 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9543999999999999e-05 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.962 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.963 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117399 5.3 5:ce33c2c7:::benchmark_data_smithi043_32659_object117398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:09.963 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:05:09.963 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.005161295000001, 2024-09-12T22:05:09.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038176902999999998, 2024-09-12T22:05:09.963 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.963 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.963 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.963 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.963 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.963 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.963 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117399 2024-09-12T22:05:09.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.964 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:05:09.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480622+0000", 2024-09-12T22:05:09.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480624+0000", 2024-09-12T22:05:09.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.322e-06 2024-09-12T22:05:09.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480670+0000", 2024-09-12T22:05:09.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6365000000000001e-05 2024-09-12T22:05:09.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480682+0000", 2024-09-12T22:05:09.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:05:09.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480689+0000", 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480731+0000", 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.480738+0000", 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513753+0000", 2024-09-12T22:05:09.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.033015125999999999 2024-09-12T22:05:09.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513935+0000", 2024-09-12T22:05:09.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018219500000000001 2024-09-12T22:05:09.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.514170+0000", 2024-09-12T22:05:09.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000234694 2024-09-12T22:05:09.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518462+0000", 2024-09-12T22:05:09.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004291563 2024-09-12T22:05:09.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518655+0000", 2024-09-12T22:05:09.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019362700000000001 2024-09-12T22:05:09.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518710+0000", 2024-09-12T22:05:09.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:05:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518799+0000", 2024-09-12T22:05:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9000999999999997e-05 2024-09-12T22:05:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117407 5.c 5:3c61c1b7:::benchmark_data_smithi043_32659_object117406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:05:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.971955780999998, 2024-09-12T22:05:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042860548999999998, 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117407 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513828+0000", 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513829+0000", 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513900+0000", 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1482000000000004e-05 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513909+0000", 2024-09-12T22:05:09.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8370000000000003e-06 2024-09-12T22:05:09.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513917+0000", 2024-09-12T22:05:09.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:05:09.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513967+0000", 2024-09-12T22:05:09.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.007e-05 2024-09-12T22:05:09.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:09.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.513975+0000", 2024-09-12T22:05:09.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5639999999999999e-06 2024-09-12T22:05:09.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542411+0000", 2024-09-12T22:05:09.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.028436032999999999 2024-09-12T22:05:09.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542539+0000", 2024-09-12T22:05:09.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012777900000000001 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.542687+0000", 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148343 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548120+0000", 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054333580000000001 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556549+0000", 2024-09-12T22:05:09.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084288309999999995 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556596+0000", 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6458999999999997e-05 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.556688+0000", 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2676999999999994e-05 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.486152486000002, 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:09.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:09.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:09.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:09.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:09.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:09.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:09.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:09.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:09.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:09.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:09.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:09.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:09.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:09.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:09.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:09.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:09.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:09.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:09.982 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.983 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.983 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.983 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:09.983 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:09.983 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.485673997999999, 2024-09-12T22:05:09.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:09.983 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.983 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.983 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.984 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:09.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.984 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:09.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:09.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:09.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:09.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:09.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:09.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:09.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:09.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:09.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:09.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:09.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:09.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:09.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:09.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:09.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:09.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:09.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:09.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:09.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:09.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:09.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:09.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:09.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:09.989 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.989 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.989 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.989 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:09.989 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.483178698, 2024-09-12T22:05:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:09.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:09.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:09.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:09.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:09.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:09.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:09.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:09.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:09.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:09.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:09.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:09.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:09.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:09.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:09.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:09.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:09.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:09.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.482097907, 2024-09-12T22:05:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.480862344999998, 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:10.007 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:10.009 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:10.009 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:10.006+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:10.073 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:05:10.110 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:10.108+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:10.170 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:10.170 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:10.170 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.170 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:209085 5.b 5:d9ba6e71:::benchmark_data_smithi043_32659_object41847:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:10.170 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.162943+0000", 2024-09-12T22:05:10.170 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00499008, 2024-09-12T22:05:10.170 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0050087059999999999, 2024-09-12T22:05:10.171 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.171 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.171 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:10.171 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:10.171 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:10.171 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:10.171 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 209085 2024-09-12T22:05:10.171 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.171 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.171 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.171 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.171 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.162943+0000", 2024-09-12T22:05:10.171 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.171 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.172 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.172 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.172 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.162943+0000", 2024-09-12T22:05:10.172 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.172 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.172 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.172 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.172 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.162945+0000", 2024-09-12T22:05:10.172 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0860000000000001e-06 2024-09-12T22:05:10.172 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.173 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.173 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.173 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.162949+0000", 2024-09-12T22:05:10.173 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2880000000000003e-06 2024-09-12T22:05:10.173 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.173 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.173 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.173 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.162958+0000", 2024-09-12T22:05:10.173 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:10.173 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.173 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.174 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.174 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.162966+0000", 2024-09-12T22:05:10.174 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8939999999999993e-06 2024-09-12T22:05:10.174 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.174 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.174 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:10.174 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164615+0000", 2024-09-12T22:05:10.174 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0016494179999999999 2024-09-12T22:05:10.174 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.174 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.174 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:10.174 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164787+0000", 2024-09-12T22:05:10.174 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000171946 2024-09-12T22:05:10.175 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.175 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.175 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.175 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.175 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.175 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:209087 5.4 5:27d8fbbf:::benchmark_data_smithi043_32659_object41849:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:10.175 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.163205+0000", 2024-09-12T22:05:10.175 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0047282340000000004, 2024-09-12T22:05:10.175 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0048174000000000003, 2024-09-12T22:05:10.175 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.175 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.175 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:10.175 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:10.176 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:10.176 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:10.176 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 209087 2024-09-12T22:05:10.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.176 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.176 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.176 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.176 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.163205+0000", 2024-09-12T22:05:10.176 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.176 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.176 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.176 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.163205+0000", 2024-09-12T22:05:10.176 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.177 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.177 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.163206+0000", 2024-09-12T22:05:10.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8700000000000005e-07 2024-09-12T22:05:10.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.177 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.177 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.163210+0000", 2024-09-12T22:05:10.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8709999999999999e-06 2024-09-12T22:05:10.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.163219+0000", 2024-09-12T22:05:10.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.585e-06 2024-09-12T22:05:10.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.163226+0000", 2024-09-12T22:05:10.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9540000000000004e-06 2024-09-12T22:05:10.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.179 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:10.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164708+0000", 2024-09-12T22:05:10.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001481109 2024-09-12T22:05:10.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.179 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:10.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164965+0000", 2024-09-12T22:05:10.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025696699999999998 2024-09-12T22:05:10.179 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.179 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.179 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.180 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.180 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:209090 5.c e52/40 5:3c5ab4e9:::benchmark_data_smithi043_32659_object41852:head v 52'13082, mlcod=52'13079)", 2024-09-12T22:05:10.180 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.164054+0000", 2024-09-12T22:05:10.180 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0038797860000000001, 2024-09-12T22:05:10.180 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040096130000000004, 2024-09-12T22:05:10.180 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.180 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.180 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:10.180 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.181 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.181 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.181 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164054+0000", 2024-09-12T22:05:10.181 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.181 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.181 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.181 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164054+0000", 2024-09-12T22:05:10.181 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.181 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164054+0000", 2024-09-12T22:05:10.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.06e-07 2024-09-12T22:05:10.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164061+0000", 2024-09-12T22:05:10.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9419999999999998e-06 2024-09-12T22:05:10.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164070+0000", 2024-09-12T22:05:10.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3909999999999998e-06 2024-09-12T22:05:10.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.183 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.183 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.183 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164075+0000", 2024-09-12T22:05:10.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.451e-06 2024-09-12T22:05:10.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.183 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.183 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:10.183 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.165229+0000", 2024-09-12T22:05:10.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011538220000000001 2024-09-12T22:05:10.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:10.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.165253+0000", 2024-09-12T22:05:10.184 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3642000000000002e-05 2024-09-12T22:05:10.184 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.184 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.184 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.184 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:209089 5.7 e52/40 5:e9f35ee4:::benchmark_data_smithi043_32659_object41851:head v 52'13143, mlcod=52'13140)", 2024-09-12T22:05:10.185 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.164516+0000", 2024-09-12T22:05:10.185 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.003417827, 2024-09-12T22:05:10.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003578075, 2024-09-12T22:05:10.185 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.185 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.185 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:10.185 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164516+0000", 2024-09-12T22:05:10.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164516+0000", 2024-09-12T22:05:10.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164516+0000", 2024-09-12T22:05:10.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9200000000000001e-07 2024-09-12T22:05:10.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164521+0000", 2024-09-12T22:05:10.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3059999999999999e-06 2024-09-12T22:05:10.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164531+0000", 2024-09-12T22:05:10.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0519999999999999e-05 2024-09-12T22:05:10.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.188 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164536+0000", 2024-09-12T22:05:10.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2129999999999999e-06 2024-09-12T22:05:10.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.188 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:10.188 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164888+0000", 2024-09-12T22:05:10.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00035170900000000002 2024-09-12T22:05:10.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:10.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164900+0000", 2024-09-12T22:05:10.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2435e-05 2024-09-12T22:05:10.189 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.189 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.189 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.190 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:209091 5.7 e52/40 5:ec781333:::benchmark_data_smithi043_32659_object41853:head v 52'13144, mlcod=52'13140)", 2024-09-12T22:05:10.190 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.165546+0000", 2024-09-12T22:05:10.190 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0023876990000000001, 2024-09-12T22:05:10.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002578866, 2024-09-12T22:05:10.190 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.190 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.190 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:10.190 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.190 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.165546+0000", 2024-09-12T22:05:10.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.191 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.165546+0000", 2024-09-12T22:05:10.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.191 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.165546+0000", 2024-09-12T22:05:10.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5199999999999997e-07 2024-09-12T22:05:10.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.165551+0000", 2024-09-12T22:05:10.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.724e-06 2024-09-12T22:05:10.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.165557+0000", 2024-09-12T22:05:10.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1210000000000003e-06 2024-09-12T22:05:10.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.165561+0000", 2024-09-12T22:05:10.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9750000000000001e-06 2024-09-12T22:05:10.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:10.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166277+0000", 2024-09-12T22:05:10.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00071599399999999996 2024-09-12T22:05:10.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:10.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166290+0000", 2024-09-12T22:05:10.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2852e-05 2024-09-12T22:05:10.194 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.194 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.194 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.194 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:209094 5.e 5:722d4b9e:::benchmark_data_smithi043_32659_object41856:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:10.194 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.166254+0000", 2024-09-12T22:05:10.194 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001679179, 2024-09-12T22:05:10.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019031709999999999, 2024-09-12T22:05:10.195 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.195 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.195 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:10.195 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:10.195 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:10.195 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:10.195 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 209094 2024-09-12T22:05:10.195 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.195 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166254+0000", 2024-09-12T22:05:10.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166254+0000", 2024-09-12T22:05:10.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166255+0000", 2024-09-12T22:05:10.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:05:10.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166261+0000", 2024-09-12T22:05:10.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:05:10.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166269+0000", 2024-09-12T22:05:10.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0520000000000002e-06 2024-09-12T22:05:10.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166276+0000", 2024-09-12T22:05:10.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0040000000000002e-06 2024-09-12T22:05:10.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:10.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166337+0000", 2024-09-12T22:05:10.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0884000000000002e-05 2024-09-12T22:05:10.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:10.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166499+0000", 2024-09-12T22:05:10.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000162094 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:209096 5.e 5:7c3d524a:::benchmark_data_smithi043_32659_object41858:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.166319+0000", 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0016149039999999999, 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018724779999999999, 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:10.200 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 209096 2024-09-12T22:05:10.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.200 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.200 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.200 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166319+0000", 2024-09-12T22:05:10.200 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.200 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.200 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166319+0000", 2024-09-12T22:05:10.200 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166319+0000", 2024-09-12T22:05:10.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7299999999999995e-07 2024-09-12T22:05:10.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166322+0000", 2024-09-12T22:05:10.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1480000000000002e-06 2024-09-12T22:05:10.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166330+0000", 2024-09-12T22:05:10.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4220000000000003e-06 2024-09-12T22:05:10.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166335+0000", 2024-09-12T22:05:10.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5140000000000001e-06 2024-09-12T22:05:10.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:10.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.168114+0000", 2024-09-12T22:05:10.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001778274 2024-09-12T22:05:10.202 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.202 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.202 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.203 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.203 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:209092 5.1 e52/40 5:82be99ba:::benchmark_data_smithi043_32659_object41854:head v 52'12923, mlcod=52'12921)", 2024-09-12T22:05:10.203 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.166546+0000", 2024-09-12T22:05:10.203 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001387676, 2024-09-12T22:05:10.203 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0016760080000000001, 2024-09-12T22:05:10.203 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.203 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.203 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:10.203 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.203 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.203 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166546+0000", 2024-09-12T22:05:10.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.204 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.204 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166546+0000", 2024-09-12T22:05:10.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.204 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.204 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166549+0000", 2024-09-12T22:05:10.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5219999999999999e-06 2024-09-12T22:05:10.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166554+0000", 2024-09-12T22:05:10.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5190000000000003e-06 2024-09-12T22:05:10.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166564+0000", 2024-09-12T22:05:10.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0574000000000001e-05 2024-09-12T22:05:10.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166569+0000", 2024-09-12T22:05:10.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:05:10.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:10.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166604+0000", 2024-09-12T22:05:10.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4822e-05 2024-09-12T22:05:10.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:10.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166617+0000", 2024-09-12T22:05:10.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2788e-05 2024-09-12T22:05:10.207 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.207 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.207 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.207 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:209093 5.3 e52/40 5:c4e29870:::benchmark_data_smithi043_32659_object41855:head v 52'13040, mlcod=52'13038)", 2024-09-12T22:05:10.207 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.166585+0000", 2024-09-12T22:05:10.207 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0013481879999999999, 2024-09-12T22:05:10.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001668218, 2024-09-12T22:05:10.207 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.208 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.208 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:10.208 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166585+0000", 2024-09-12T22:05:10.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166585+0000", 2024-09-12T22:05:10.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166586+0000", 2024-09-12T22:05:10.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5199999999999998e-07 2024-09-12T22:05:10.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166588+0000", 2024-09-12T22:05:10.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8550000000000002e-06 2024-09-12T22:05:10.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.210 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166592+0000", 2024-09-12T22:05:10.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9570000000000004e-06 2024-09-12T22:05:10.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.210 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166595+0000", 2024-09-12T22:05:10.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7310000000000002e-06 2024-09-12T22:05:10.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:10.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166630+0000", 2024-09-12T22:05:10.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4959000000000002e-05 2024-09-12T22:05:10.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:10.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.166646+0000", 2024-09-12T22:05:10.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6211000000000001e-05 2024-09-12T22:05:10.211 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.211 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.212 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.212 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:209095 5.5 e52/40 5:aa8650b9:::benchmark_data_smithi043_32659_object41857:head v 52'13146, mlcod=52'13144)", 2024-09-12T22:05:10.212 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.167024+0000", 2024-09-12T22:05:10.212 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00090955300000000001, 2024-09-12T22:05:10.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001259589, 2024-09-12T22:05:10.212 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.212 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.212 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:10.212 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167024+0000", 2024-09-12T22:05:10.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167024+0000", 2024-09-12T22:05:10.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167025+0000", 2024-09-12T22:05:10.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8999999999999996e-07 2024-09-12T22:05:10.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167029+0000", 2024-09-12T22:05:10.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6890000000000003e-06 2024-09-12T22:05:10.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167038+0000", 2024-09-12T22:05:10.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.816e-06 2024-09-12T22:05:10.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167044+0000", 2024-09-12T22:05:10.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.947e-06 2024-09-12T22:05:10.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:10.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167095+0000", 2024-09-12T22:05:10.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0682e-05 2024-09-12T22:05:10.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:10.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167111+0000", 2024-09-12T22:05:10.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6066000000000002e-05 2024-09-12T22:05:10.216 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.216 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.216 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.216 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:209099 5.f 5:fa98cf1f:::benchmark_data_smithi043_32659_object41861:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:10.216 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.167335+0000", 2024-09-12T22:05:10.216 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000598743, 2024-09-12T22:05:10.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0009786459999999999, 2024-09-12T22:05:10.217 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.217 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.217 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:10.217 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:10.217 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:10.217 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:10.217 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 209099 2024-09-12T22:05:10.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.217 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.217 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167335+0000", 2024-09-12T22:05:10.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167335+0000", 2024-09-12T22:05:10.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167336+0000", 2024-09-12T22:05:10.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4900000000000004e-07 2024-09-12T22:05:10.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167340+0000", 2024-09-12T22:05:10.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6789999999999996e-06 2024-09-12T22:05:10.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167350+0000", 2024-09-12T22:05:10.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6730000000000004e-06 2024-09-12T22:05:10.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167357+0000", 2024-09-12T22:05:10.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.17e-06 2024-09-12T22:05:10.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:10.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167587+0000", 2024-09-12T22:05:10.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022987600000000001 2024-09-12T22:05:10.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:10.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167736+0000", 2024-09-12T22:05:10.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000148658 2024-09-12T22:05:10.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:10.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167855+0000", 2024-09-12T22:05:10.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118884 2024-09-12T22:05:10.221 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.221 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.221 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.221 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDPGPush(5.6 52/40 [PushOp(5:6b888b46:::benchmark_data_smithi043_32659_object136210:head, version: 43'8461, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:6b888b46:::benchmark_data_smithi043_32659_object136210:head@43'8461, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T22:05:10.221 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.167250+0000", 2024-09-12T22:05:10.221 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00068366499999999997, 2024-09-12T22:05:10.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011150089999999999, 2024-09-12T22:05:10.222 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.222 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.222 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:10.222 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167250+0000", 2024-09-12T22:05:10.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167250+0000", 2024-09-12T22:05:10.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167250+0000", 2024-09-12T22:05:10.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6400000000000002e-07 2024-09-12T22:05:10.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167352+0000", 2024-09-12T22:05:10.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000101673 2024-09-12T22:05:10.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.224 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.224 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167370+0000", 2024-09-12T22:05:10.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8173e-05 2024-09-12T22:05:10.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.224 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.224 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167384+0000", 2024-09-12T22:05:10.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3619e-05 2024-09-12T22:05:10.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:10.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.168101+0000", 2024-09-12T22:05:10.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000717002 2024-09-12T22:05:10.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:10.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.168114+0000", 2024-09-12T22:05:10.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2707999999999999e-05 2024-09-12T22:05:10.225 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.225 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.225 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.226 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 52/52 lb 5:6b886f11:::benchmark_data_smithi043_32659_object80227:head)", 2024-09-12T22:05:10.226 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.167401+0000", 2024-09-12T22:05:10.226 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00053270699999999999, 2024-09-12T22:05:10.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001011135, 2024-09-12T22:05:10.226 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.226 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.226 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:10.226 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167401+0000", 2024-09-12T22:05:10.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167401+0000", 2024-09-12T22:05:10.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167401+0000", 2024-09-12T22:05:10.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1899999999999998e-07 2024-09-12T22:05:10.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167407+0000", 2024-09-12T22:05:10.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.161e-06 2024-09-12T22:05:10.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167414+0000", 2024-09-12T22:05:10.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3330000000000002e-06 2024-09-12T22:05:10.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167419+0000", 2024-09-12T22:05:10.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.955e-06 2024-09-12T22:05:10.228 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:209101 5.0 5:093f8cdd:::benchmark_data_smithi043_32659_object41863:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.167975+0000", 2024-09-12T22:05:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9999585, 2024-09-12T22:05:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00048238600000000001, 2024-09-12T22:05:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 209101 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167975+0000", 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167975+0000", 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167976+0000", 2024-09-12T22:05:10.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0599999999999999e-07 2024-09-12T22:05:10.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.231 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167980+0000", 2024-09-12T22:05:10.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4850000000000003e-06 2024-09-12T22:05:10.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.231 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.167992+0000", 2024-09-12T22:05:10.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1654999999999999e-05 2024-09-12T22:05:10.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.168001+0000", 2024-09-12T22:05:10.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1439999999999992e-06 2024-09-12T22:05:10.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:10.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.168046+0000", 2024-09-12T22:05:10.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4876999999999997e-05 2024-09-12T22:05:10.232 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.232 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.232 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.232 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:209076 5.8 5:125744f5:::benchmark_data_smithi043_32659_object41838:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:10.233 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:10.159002+0000", 2024-09-12T22:05:10.233 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0089311649999999996, 2024-09-12T22:05:10.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0095159830000000004, 2024-09-12T22:05:10.233 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:10.233 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:10.233 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:10.233 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:10.233 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:10.233 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:10.233 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 209076 2024-09-12T22:05:10.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.233 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:10.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:10.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.159002+0000", 2024-09-12T22:05:10.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:10.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.159002+0000", 2024-09-12T22:05:10.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:10.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:10.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.159003+0000", 2024-09-12T22:05:10.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3300000000000001e-07 2024-09-12T22:05:10.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.159007+0000", 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2130000000000002e-06 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.159017+0000", 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7370000000000001e-06 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.159023+0000", 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2759999999999997e-06 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.163988+0000", 2024-09-12T22:05:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049648069999999999 2024-09-12T22:05:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:10.164140+0000", 2024-09-12T22:05:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015162800000000001 2024-09-12T22:05:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 15 2024-09-12T22:05:10.237 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:10.238 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:10.238 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:10.236+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:10.238 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:10.239 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:10.239 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:10.240 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:10.241 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:10.241 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:10.241 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:10.339 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:10.337+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:10.405 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:10.405 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:10.417 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:10.458 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:10.456+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:10.476 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-09-12T22:05:10.541 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:10.539+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:10.615 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:10.615 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:10.629 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:10.673 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:10.672+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:10.742 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:10.741+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:10.775 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:10.775 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:10.788 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:10.842 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~47s 2024-09-12T22:05:10.872 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:10.871+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:10.944 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:10.943+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:10.972 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:10.972 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:10.984 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:11.068 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:11.067+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:11.146 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:11.144+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:11.176 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:11.176 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:11.189 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:11.247 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:11.246+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:11.347 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:11.346+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:11.350 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:11.350 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:11.363 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:11.450 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:11.447+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:11.521 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:11.521 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:11.535 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:11.576 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:11.574+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:11.651 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:11.649+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:11.736 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:11.736 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:11.750 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:11.753 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:11.751+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:11.853 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:11.851+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:11.902 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:11.903 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:11.915 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:11.957 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:11.956+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:12.054 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:12.053+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:12.104 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:12.104 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:12.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:12.155 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:12.153+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:12.242 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:05:12.256 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:12.254+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:12.303 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:12.303 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:12.315 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:12.352 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:12.357 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:12.356+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:12.370 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:12.370 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:12.391 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:12.391 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:12.394 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:12.394 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:12.459 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:12.456+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:12.473 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:12.473 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:12.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.473 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:215505 5.d 5:b109f655:::benchmark_data_smithi043_32659_object48267:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:05:12.473 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.467400+0000", 2024-09-12T22:05:12.473 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0040227020000000004, 2024-09-12T22:05:12.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040455760000000004, 2024-09-12T22:05:12.473 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.473 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.473 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:12.473 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.474 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.474 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.474 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 215505 2024-09-12T22:05:12.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.474 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.467400+0000", 2024-09-12T22:05:12.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.467400+0000", 2024-09-12T22:05:12.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.467401+0000", 2024-09-12T22:05:12.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6200000000000006e-07 2024-09-12T22:05:12.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.467406+0000", 2024-09-12T22:05:12.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4469999999999999e-06 2024-09-12T22:05:12.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.467416+0000", 2024-09-12T22:05:12.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9869999999999994e-06 2024-09-12T22:05:12.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.467422+0000", 2024-09-12T22:05:12.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7340000000000002e-06 2024-09-12T22:05:12.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.467484+0000", 2024-09-12T22:05:12.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1533999999999997e-05 2024-09-12T22:05:12.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.468291+0000", 2024-09-12T22:05:12.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00080715599999999995 2024-09-12T22:05:12.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:12.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.468390+0000", 2024-09-12T22:05:12.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8947e-05 2024-09-12T22:05:12.477 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.477 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.477 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.477 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:215506 5.d 5:b74705e2:::benchmark_data_smithi043_32659_object48268:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.467582+0000", 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.003840647, 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003937276, 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 215506 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.467582+0000", 2024-09-12T22:05:12.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.467582+0000", 2024-09-12T22:05:12.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.467583+0000", 2024-09-12T22:05:12.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1100000000000005e-07 2024-09-12T22:05:12.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.467590+0000", 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1110000000000002e-06 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.467600+0000", 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6269999999999995e-06 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.467607+0000", 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0709999999999997e-06 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.481 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.481 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469878+0000", 2024-09-12T22:05:12.481 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002271323 2024-09-12T22:05:12.481 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.481 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.481 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.481 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.470031+0000", 2024-09-12T22:05:12.481 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000153215 2024-09-12T22:05:12.481 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.481 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.481 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:12.481 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.470137+0000", 2024-09-12T22:05:12.481 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105911 2024-09-12T22:05:12.482 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.482 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.482 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.482 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:215504 5.c e53/40 5:3ed255ac:::benchmark_data_smithi043_32659_object48266:head v 53'13490, mlcod=53'13487)", 2024-09-12T22:05:12.482 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.468106+0000", 2024-09-12T22:05:12.482 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0033164090000000002, 2024-09-12T22:05:12.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034848589999999999, 2024-09-12T22:05:12.482 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.482 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.482 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:12.482 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.468106+0000", 2024-09-12T22:05:12.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.468106+0000", 2024-09-12T22:05:12.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.468107+0000", 2024-09-12T22:05:12.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:05:12.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.468113+0000", 2024-09-12T22:05:12.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.224e-06 2024-09-12T22:05:12.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.468122+0000", 2024-09-12T22:05:12.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.49e-06 2024-09-12T22:05:12.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.468128+0000", 2024-09-12T22:05:12.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6659999999999996e-06 2024-09-12T22:05:12.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.468188+0000", 2024-09-12T22:05:12.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0442999999999997e-05 2024-09-12T22:05:12.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.468205+0000", 2024-09-12T22:05:12.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7319000000000001e-05 2024-09-12T22:05:12.486 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.486 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.486 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.486 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:215508 5.d 5:b7a8b14e:::benchmark_data_smithi043_32659_object48270:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:05:12.486 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.469284+0000", 2024-09-12T22:05:12.486 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0021390570000000002, 2024-09-12T22:05:12.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023660650000000001, 2024-09-12T22:05:12.486 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.486 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.487 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:12.487 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.487 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.487 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.487 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 215508 2024-09-12T22:05:12.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.487 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.487 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.487 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469284+0000", 2024-09-12T22:05:12.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.487 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469284+0000", 2024-09-12T22:05:12.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469284+0000", 2024-09-12T22:05:12.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6000000000000003e-07 2024-09-12T22:05:12.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469288+0000", 2024-09-12T22:05:12.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4300000000000002e-06 2024-09-12T22:05:12.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469299+0000", 2024-09-12T22:05:12.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1596999999999999e-05 2024-09-12T22:05:12.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469306+0000", 2024-09-12T22:05:12.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2029999999999997e-06 2024-09-12T22:05:12.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471397+0000", 2024-09-12T22:05:12.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002091257 2024-09-12T22:05:12.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471541+0000", 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000144506 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471633+0000", 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1815000000000001e-05 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.490 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:215509 5.8 5:1ddfd5c0:::benchmark_data_smithi043_32659_object48271:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:05:12.491 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.469316+0000", 2024-09-12T22:05:12.491 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002107013, 2024-09-12T22:05:12.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023797219999999999, 2024-09-12T22:05:12.491 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.491 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.491 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:12.491 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.491 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.491 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.491 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 215509 2024-09-12T22:05:12.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.492 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469316+0000", 2024-09-12T22:05:12.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469316+0000", 2024-09-12T22:05:12.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469316+0000", 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3999999999999997e-07 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469325+0000", 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8310000000000007e-06 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469331+0000", 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7699999999999998e-06 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469334+0000", 2024-09-12T22:05:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:05:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469382+0000", 2024-09-12T22:05:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7216999999999999e-05 2024-09-12T22:05:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469548+0000", 2024-09-12T22:05:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016611800000000001 2024-09-12T22:05:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.495 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.495 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.495 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:215510 5.9 5:9a4ad80d:::benchmark_data_smithi043_32659_object48272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:05:12.495 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.469348+0000", 2024-09-12T22:05:12.495 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002074743, 2024-09-12T22:05:12.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002386853, 2024-09-12T22:05:12.495 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.495 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.495 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:12.495 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.495 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.495 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.496 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 215510 2024-09-12T22:05:12.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.496 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469348+0000", 2024-09-12T22:05:12.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469348+0000", 2024-09-12T22:05:12.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469348+0000", 2024-09-12T22:05:12.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8000000000000002e-07 2024-09-12T22:05:12.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469350+0000", 2024-09-12T22:05:12.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.646e-06 2024-09-12T22:05:12.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469354+0000", 2024-09-12T22:05:12.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1359999999999999e-06 2024-09-12T22:05:12.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.498 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.498 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469357+0000", 2024-09-12T22:05:12.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.83e-06 2024-09-12T22:05:12.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469395+0000", 2024-09-12T22:05:12.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7966999999999997e-05 2024-09-12T22:05:12.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469512+0000", 2024-09-12T22:05:12.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116622 2024-09-12T22:05:12.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:12.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469572+0000", 2024-09-12T22:05:12.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0344999999999999e-05 2024-09-12T22:05:12.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:12.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471306+0000", 2024-09-12T22:05:12.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017339969999999999 2024-09-12T22:05:12.500 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.500 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.500 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.500 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:215511 5.3 e53/40 5:ca4f760c:::benchmark_data_smithi043_32659_object48273:head v 53'13434, mlcod=53'13431)", 2024-09-12T22:05:12.500 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.469669+0000", 2024-09-12T22:05:12.500 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0017534370000000001, 2024-09-12T22:05:12.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021093739999999998, 2024-09-12T22:05:12.500 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.501 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.501 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:12.501 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469669+0000", 2024-09-12T22:05:12.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469669+0000", 2024-09-12T22:05:12.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469670+0000", 2024-09-12T22:05:12.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.92e-07 2024-09-12T22:05:12.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469675+0000", 2024-09-12T22:05:12.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6079999999999998e-06 2024-09-12T22:05:12.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469684+0000", 2024-09-12T22:05:12.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5650000000000007e-06 2024-09-12T22:05:12.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469691+0000", 2024-09-12T22:05:12.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6470000000000001e-06 2024-09-12T22:05:12.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469740+0000", 2024-09-12T22:05:12.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8582999999999999e-05 2024-09-12T22:05:12.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469756+0000", 2024-09-12T22:05:12.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6725e-05 2024-09-12T22:05:12.504 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.504 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.504 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.504 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:215507 5.c e53/40 5:3a125a6a:::benchmark_data_smithi043_32659_object48269:head v 53'13491, mlcod=53'13487)", 2024-09-12T22:05:12.504 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.469716+0000", 2024-09-12T22:05:12.505 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001706808, 2024-09-12T22:05:12.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020950769999999999, 2024-09-12T22:05:12.505 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.505 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.505 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:12.505 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469716+0000", 2024-09-12T22:05:12.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469716+0000", 2024-09-12T22:05:12.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469716+0000", 2024-09-12T22:05:12.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7500000000000001e-07 2024-09-12T22:05:12.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469720+0000", 2024-09-12T22:05:12.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4939999999999999e-06 2024-09-12T22:05:12.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469728+0000", 2024-09-12T22:05:12.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8820000000000001e-06 2024-09-12T22:05:12.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.469733+0000", 2024-09-12T22:05:12.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7339999999999999e-06 2024-09-12T22:05:12.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.470020+0000", 2024-09-12T22:05:12.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000287397 2024-09-12T22:05:12.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.470037+0000", 2024-09-12T22:05:12.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6747000000000001e-05 2024-09-12T22:05:12.508 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.508 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.508 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.508 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:215512 5.e 5:754ced57:::benchmark_data_smithi043_32659_object48274:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:05:12.508 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.470494+0000", 2024-09-12T22:05:12.509 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00092843899999999998, 2024-09-12T22:05:12.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0013543680000000001, 2024-09-12T22:05:12.509 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.509 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.509 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:12.509 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.509 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.509 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.509 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 215512 2024-09-12T22:05:12.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.509 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.509 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.470494+0000", 2024-09-12T22:05:12.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.510 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.470494+0000", 2024-09-12T22:05:12.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.510 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.470495+0000", 2024-09-12T22:05:12.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9599999999999998e-07 2024-09-12T22:05:12.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.470500+0000", 2024-09-12T22:05:12.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2969999999999997e-06 2024-09-12T22:05:12.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.470510+0000", 2024-09-12T22:05:12.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0779e-05 2024-09-12T22:05:12.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.470519+0000", 2024-09-12T22:05:12.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3129999999999999e-06 2024-09-12T22:05:12.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.470645+0000", 2024-09-12T22:05:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000126756 2024-09-12T22:05:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.470779+0000", 2024-09-12T22:05:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013358099999999999 2024-09-12T22:05:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:215513 5.e 5.747bbb8e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.471083+0000", 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00034020699999999998, 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00079885299999999998, 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 215513 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471083+0000", 2024-09-12T22:05:12.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471083+0000", 2024-09-12T22:05:12.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471084+0000", 2024-09-12T22:05:12.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7199999999999997e-07 2024-09-12T22:05:12.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471090+0000", 2024-09-12T22:05:12.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8739999999999997e-06 2024-09-12T22:05:12.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471101+0000", 2024-09-12T22:05:12.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0214000000000001e-05 2024-09-12T22:05:12.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471108+0000", 2024-09-12T22:05:12.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0949999999999998e-06 2024-09-12T22:05:12.515 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.516 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.516 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.516 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:215514 5.b 5:dbdaf23c:::benchmark_data_smithi043_32659_object48276:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:05:12.516 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.471318+0000", 2024-09-12T22:05:12.516 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000105198, 2024-09-12T22:05:12.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00059178400000000004, 2024-09-12T22:05:12.516 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.516 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.516 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:12.516 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.516 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.516 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.517 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 215514 2024-09-12T22:05:12.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.517 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.517 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.517 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471318+0000", 2024-09-12T22:05:12.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.517 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.517 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471318+0000", 2024-09-12T22:05:12.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471318+0000", 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471323+0000", 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1389999999999997e-06 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471331+0000", 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1929999999999993e-06 2024-09-12T22:05:12.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471337+0000", 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3690000000000003e-06 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471404+0000", 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7352000000000002e-05 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471566+0000", 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000161235 2024-09-12T22:05:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.520 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.520 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.520 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:215515 5.b 5.10f17ab (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:05:12.520 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.471352+0000", 2024-09-12T22:05:12.520 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 7.1254000000000006e-05, 2024-09-12T22:05:12.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00058931800000000002, 2024-09-12T22:05:12.520 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.520 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.521 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:12.521 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.521 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.521 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.521 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 215515 2024-09-12T22:05:12.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.521 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471352+0000", 2024-09-12T22:05:12.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471352+0000", 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471352+0000", 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7300000000000001e-07 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471355+0000", 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5519999999999999e-06 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471361+0000", 2024-09-12T22:05:12.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4620000000000001e-06 2024-09-12T22:05:12.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471366+0000", 2024-09-12T22:05:12.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1959999999999999e-06 2024-09-12T22:05:12.523 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.523 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.523 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.523 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:215505 5.d e53/40)", 2024-09-12T22:05:12.523 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.471474+0000", 2024-09-12T22:05:12.524 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9999495, 2024-09-12T22:05:12.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00049401000000000002, 2024-09-12T22:05:12.524 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.524 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.524 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:12.524 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471474+0000", 2024-09-12T22:05:12.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471474+0000", 2024-09-12T22:05:12.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471474+0000", 2024-09-12T22:05:12.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9800000000000003e-07 2024-09-12T22:05:12.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471478+0000", 2024-09-12T22:05:12.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:05:12.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471485+0000", 2024-09-12T22:05:12.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.951e-06 2024-09-12T22:05:12.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471491+0000", 2024-09-12T22:05:12.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9479999999999996e-06 2024-09-12T22:05:12.526 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.526 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.526 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.526 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:215516 5.8 5:1b4062d7:::benchmark_data_smithi043_32659_object48278:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:05:12.527 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.471589+0000", 2024-09-12T22:05:12.527 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9998341, 2024-09-12T22:05:12.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00040411000000000001, 2024-09-12T22:05:12.527 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.527 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.527 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:12.527 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.527 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.527 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.527 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 215516 2024-09-12T22:05:12.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.527 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471589+0000", 2024-09-12T22:05:12.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471589+0000", 2024-09-12T22:05:12.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471590+0000", 2024-09-12T22:05:12.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:05:12.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471593+0000", 2024-09-12T22:05:12.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3629999999999998e-06 2024-09-12T22:05:12.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471602+0000", 2024-09-12T22:05:12.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2839999999999995e-06 2024-09-12T22:05:12.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471609+0000", 2024-09-12T22:05:12.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2190000000000001e-06 2024-09-12T22:05:12.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471654+0000", 2024-09-12T22:05:12.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5816999999999999e-05 2024-09-12T22:05:12.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471803+0000", 2024-09-12T22:05:12.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014825400000000001 2024-09-12T22:05:12.530 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.530 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.530 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.531 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:215517 5.f 5:fc0d92bc:::benchmark_data_smithi043_32659_object48279:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:05:12.531 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:12.471696+0000", 2024-09-12T22:05:12.531 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9997272, 2024-09-12T22:05:12.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033773499999999998, 2024-09-12T22:05:12.531 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.531 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.531 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:12.531 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.531 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.531 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.531 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 215517 2024-09-12T22:05:12.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.531 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471696+0000", 2024-09-12T22:05:12.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471696+0000", 2024-09-12T22:05:12.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471697+0000", 2024-09-12T22:05:12.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9999999999999996e-07 2024-09-12T22:05:12.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471700+0000", 2024-09-12T22:05:12.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1920000000000001e-06 2024-09-12T22:05:12.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471710+0000", 2024-09-12T22:05:12.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8910000000000007e-06 2024-09-12T22:05:12.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471715+0000", 2024-09-12T22:05:12.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8749999999999997e-06 2024-09-12T22:05:12.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:12.471761+0000", 2024-09-12T22:05:12.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5392999999999997e-05 2024-09-12T22:05:12.534 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.534 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.534 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.534 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.534 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:12.534 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 15 2024-09-12T22:05:12.534 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:12.535 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:05:12.536 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:12.559 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:12.558+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:12.660 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:12.658+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:12.734 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:12.734 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:12.734 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:12.734 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:12.734 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:12.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:12.789 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:12.787+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:12.862 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:12.861+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:12.948 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:12.948 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:12.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:12.948 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:12.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.948 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:12.948 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:12.948 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 68.319132389999993, 2024-09-12T22:05:12.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:05:12.949 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.949 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.949 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:12.949 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.949 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.949 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.949 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:05:12.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.949 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:12.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:12.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:05:12.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:05:12.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:05:12.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:05:12.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:05:12.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:05:12.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:05:12.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:05:12.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:05:12.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:05:12.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:05:12.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:05:12.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:12.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:05:12.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:05:12.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:12.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:05:12.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:05:12.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:12.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:05:12.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:05:12.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:12.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:05:12.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:05:12.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:12.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:05:12.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:05:12.954 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.955 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.955 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.955 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:12.955 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:12.955 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 68.313731450000006, 2024-09-12T22:05:12.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:05:12.955 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.955 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.955 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:12.955 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.956 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.956 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.956 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:05:12.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.956 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:12.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:12.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:12.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:12.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:05:12.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:05:12.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:05:12.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:05:12.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:05:12.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:05:12.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:05:12.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:05:12.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:05:12.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:05:12.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:12.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:05:12.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:05:12.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:12.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:05:12.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:05:12.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:12.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:05:12.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:05:12.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:12.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:05:12.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:05:12.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:12.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:05:12.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:05:12.961 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.961 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.961 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.961 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:12.961 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:12.961 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.948043564000002, 2024-09-12T22:05:12.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:05:12.962 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.962 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.962 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:12.962 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.962 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.962 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.962 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:05:12.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.962 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:12.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:12.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:12.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:05:12.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:05:12.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:05:12.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:05:12.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:05:12.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:05:12.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:05:12.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:05:12.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:05:12.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:05:12.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:05:12.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:12.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:05:12.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:05:12.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:12.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:05:12.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:05:12.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:12.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:05:12.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:05:12.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:12.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:05:12.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:05:12.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:12.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:05:12.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:05:12.968 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.968 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.968 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.968 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:12.968 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:12.968 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.947410359000003, 2024-09-12T22:05:12.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:12.968 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.968 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.968 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:12.968 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.968 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.969 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.969 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:12.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.969 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:12.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:12.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:12.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:12.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:12.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:12.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:12.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:12.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:12.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:12.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:12.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:12.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:12.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:12.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:12.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:12.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:12.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:12.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:12.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:12.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:12.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:12.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:12.974 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.974 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.974 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.974 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:12.974 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:12.974 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.945590695999996, 2024-09-12T22:05:12.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:12.974 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.974 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.974 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:12.975 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.975 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.975 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.975 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:12.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.975 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:12.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:12.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:12.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:12.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:12.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:12.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:12.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:12.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:12.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:12.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:12.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:12.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:12.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:12.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:12.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:12.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:12.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:12.979 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.979 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.979 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.979 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:12.979 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:12.980 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.945423069, 2024-09-12T22:05:12.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:05:12.980 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.980 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.980 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:12.980 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.980 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.980 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.980 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:05:12.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.980 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:12.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:12.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:05:12.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:05:12.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:05:12.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:05:12.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:05:12.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:05:12.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:05:12.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:05:12.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:05:12.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:05:12.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:05:12.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:05:12.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:12.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:05:12.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:05:12.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:12.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:05:12.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:05:12.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:12.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:05:12.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:05:12.984 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.984 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.985 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.985 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:05:12.985 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:12.985 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.945282405, 2024-09-12T22:05:12.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:05:12.985 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.985 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.985 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:12.985 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:12.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:12.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:05:12.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:05:12.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:05:12.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:05:12.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:05:12.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:05:12.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:05:12.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:05:12.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:05:12.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:05:12.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:05:12.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:05:12.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:12.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:05:12.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:05:12.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:12.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:05:12.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:05:12.989 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.989 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.989 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.990 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:12.990 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:12.990 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.945056882000003, 2024-09-12T22:05:12.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:12.990 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.990 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.990 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:12.990 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.990 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.990 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.990 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:12.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.990 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:12.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:12.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:12.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:12.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:12.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:12.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:12.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:12.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:12.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:12.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:12.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:12.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:12.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:12.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.995 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:12.995 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:12.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.995 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:12.995 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:12.995 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.944937178000004, 2024-09-12T22:05:12.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:05:12.995 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:12.995 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:12.995 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:12.995 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:12.995 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:12.995 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:12.996 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:05:12.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.996 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:12.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:12.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:12.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:12.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:12.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:12.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:12.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:05:12.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:05:12.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:12.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:05:12.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:05:12.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:12.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:05:12.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:05:12.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:12.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:05:12.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:05:12.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:12.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:05:12.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:05:12.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:12.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:05:12.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:05:12.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:12.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:12.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:05:12.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:12.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:05:12.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:05:12.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:12.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:12.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:12.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:05:13.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:05:13.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:13.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:05:13.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:05:13.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:13.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:05:13.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:05:13.000 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.000 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.001 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.001 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:05:13.001 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:13.001 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.944345896000002, 2024-09-12T22:05:13.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:05:13.001 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.001 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.001 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:13.001 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:13.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:13.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:05:13.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:05:13.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:05:13.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:05:13.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:05:13.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:05:13.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:05:13.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:13.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:05:13.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:05:13.005 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.005 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.005 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.005 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:05:13.005 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:13.005 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.944122327999999, 2024-09-12T22:05:13.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:05:13.005 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.005 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.005 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.006 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:13.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:13.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:13.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:05:13.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:05:13.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:05:13.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:05:13.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:05:13.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:05:13.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:05:13.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:05:13.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:05:13.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:05:13.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:05:13.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:13.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:05:13.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:05:13.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:13.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:05:13.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:05:13.009 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.009 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.009 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.944030847000001, 2024-09-12T22:05:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:05:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:05:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:13.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:13.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:05:13.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:05:13.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:05:13.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:05:13.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:05:13.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:05:13.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:05:13.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:05:13.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:05:13.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:05:13.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:05:13.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:05:13.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:13.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:05:13.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:05:13.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:13.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:05:13.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:05:13.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:13.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:05:13.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:05:13.014 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.015 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.015 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.015 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:13.015 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:13.015 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.943242042999998, 2024-09-12T22:05:13.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:13.015 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.015 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.015 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.015 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:13.015 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:13.015 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.016 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:13.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.016 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:13.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:13.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:13.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:13.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:13.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:13.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:13.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:13.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:13.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:13.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:13.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:13.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:13.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:13.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:13.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:13.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:13.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:13.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:13.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:13.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:13.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:13.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:13.020 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.020 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.020 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.020 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:13.020 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:13.021 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.942977902999999, 2024-09-12T22:05:13.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:05:13.021 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.021 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.021 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.021 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:13.021 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:13.021 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.021 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:05:13.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.021 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:05:13.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:05:13.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:05:13.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:05:13.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:05:13.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:05:13.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:05:13.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:05:13.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:05:13.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:05:13.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:13.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:05:13.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:05:13.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:13.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:05:13.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:05:13.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:13.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:05:13.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:05:13.025 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.025 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.025 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.026 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:05:13.026 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:13.026 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.942472928000001, 2024-09-12T22:05:13.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:05:13.026 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.026 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.026 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.026 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:13.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:13.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:05:13.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:05:13.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:05:13.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:05:13.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:05:13.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:05:13.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:05:13.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:05:13.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:05:13.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:05:13.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:05:13.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:05:13.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:13.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:05:13.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:05:13.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:13.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:05:13.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:05:13.030 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.030 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.030 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.030 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:05:13.030 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.941343500000002, 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:13.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:13.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:13.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:05:13.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:05:13.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:05:13.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:05:13.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:05:13.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:05:13.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:05:13.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:05:13.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:05:13.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:05:13.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:13.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:05:13.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:05:13.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:13.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:05:13.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:05:13.034 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.035 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.035 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.035 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:13.035 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:13.035 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.940589058, 2024-09-12T22:05:13.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:05:13.035 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.035 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.036 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.036 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:13.036 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:13.036 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.036 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:05:13.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.036 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:13.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:13.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:05:13.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:13.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:05:13.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:05:13.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:05:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:05:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:05:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:05:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:05:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:05:13.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:05:13.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:05:13.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:13.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:05:13.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:05:13.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:05:13.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:05:13.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:13.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:05:13.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:05:13.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:13.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:05:13.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:05:13.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:13.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:05:13.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:05:13.041 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.041 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.041 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.041 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:05:13.041 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:13.041 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 33.939909956000001, 2024-09-12T22:05:13.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:05:13.041 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.041 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:05:13.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:05:13.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:05:13.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:05:13.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:05:13.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:05:13.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:05:13.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:05:13.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:05:13.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:05:13.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:05:13.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:05:13.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.045 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:207316 5.d 5:b199774a:::benchmark_data_smithi043_32659_object40078:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.4974484349999999, 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095080382000000005, 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 207316 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:13.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:13.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447981+0000", 2024-09-12T22:05:13.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1999999999999998e-07 2024-09-12T22:05:13.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447985+0000", 2024-09-12T22:05:13.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1910000000000002e-06 2024-09-12T22:05:13.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447999+0000", 2024-09-12T22:05:13.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4185000000000001e-05 2024-09-12T22:05:13.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448006+0000", 2024-09-12T22:05:13.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8929999999999999e-06 2024-09-12T22:05:13.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448050+0000", 2024-09-12T22:05:13.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4406999999999997e-05 2024-09-12T22:05:13.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448236+0000", 2024-09-12T22:05:13.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018612899999999999 2024-09-12T22:05:13.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:13.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448357+0000", 2024-09-12T22:05:13.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000120303 2024-09-12T22:05:13.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:13.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450305+0000", 2024-09-12T22:05:13.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001947952 2024-09-12T22:05:13.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.542919+0000", 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092613928999999998 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.542971+0000", 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2083000000000003e-05 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.543060+0000", 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9489999999999999e-05 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.052 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:207325 5.9 5:98263198:::benchmark_data_smithi043_32659_object40087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:13.052 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:13.052 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.4952994629999998, 2024-09-12T22:05:13.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.089568523999999997, 2024-09-12T22:05:13.052 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.052 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.052 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.052 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:13.052 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:13.052 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.052 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 207325 2024-09-12T22:05:13.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.053 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:13.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:13.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:13.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3399999999999999e-07 2024-09-12T22:05:13.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450132+0000", 2024-09-12T22:05:13.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:05:13.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450139+0000", 2024-09-12T22:05:13.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6290000000000004e-06 2024-09-12T22:05:13.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450144+0000", 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3290000000000001e-06 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450205+0000", 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0504999999999998e-05 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450373+0000", 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000168314 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:13.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450485+0000", 2024-09-12T22:05:13.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011231299999999999 2024-09-12T22:05:13.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:13.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.452226+0000", 2024-09-12T22:05:13.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017412409999999999 2024-09-12T22:05:13.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539592+0000", 2024-09-12T22:05:13.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.087365211999999998 2024-09-12T22:05:13.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539633+0000", 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1165000000000003e-05 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539697+0000", 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4519999999999999e-05 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.057 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:13.059 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:13.057+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:13.059 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:13.159 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:13.158+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:13.208 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:13.208 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:13.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.208 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:217556 5.7 5:e2e4950e:::benchmark_data_smithi043_32659_object50318:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:05:13.209 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:13.207764+0000", 2024-09-12T22:05:13.209 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000215267, 2024-09-12T22:05:13.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023910500000000001, 2024-09-12T22:05:13.209 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.209 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.209 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:13.209 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.209 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.209 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.209 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 217556 2024-09-12T22:05:13.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.209 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:13.207764+0000", 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:13.207764+0000", 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:13.207765+0000", 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2399999999999997e-07 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:13.207769+0000", 2024-09-12T22:05:13.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9480000000000001e-06 2024-09-12T22:05:13.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:13.207779+0000", 2024-09-12T22:05:13.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0445000000000001e-05 2024-09-12T22:05:13.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:13.207801+0000", 2024-09-12T22:05:13.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1608999999999999e-05 2024-09-12T22:05:13.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:13.207874+0000", 2024-09-12T22:05:13.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3591999999999996e-05 2024-09-12T22:05:13.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.212 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.212 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:13.212 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 1 2024-09-12T22:05:13.212 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:13.220 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:13.262 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:13.261+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:13.361 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:13.360+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:13.403 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:13.404 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:13.404 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:13.404 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:13.404 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:13.416 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:13.483 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-09-12T22:05:13.501 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:13.500+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:13.563 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:13.562+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:13.604 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:13.604 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:13.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:13.604 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:13.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.604 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:13.605 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:13.605 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.190045943000001, 2024-09-12T22:05:13.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:13.605 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.605 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.605 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:13.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.605 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:13.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.605 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:13.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:13.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:13.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:13.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:13.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:13.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:13.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:13.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:13.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:13.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:13.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:13.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:13.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:13.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:13.609 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.609 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.609 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.609 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:13.609 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:13.609 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.189866013, 2024-09-12T22:05:13.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:13.610 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.610 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.610 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:13.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.610 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:13.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.610 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:13.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:13.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:13.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:13.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:13.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:13.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:13.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:13.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:13.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:13.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:13.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:13.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:13.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:13.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:13.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:13.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:13.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:13.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:13.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.614 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.189799571999998, 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:13.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:13.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:13.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:13.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:13.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:13.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:13.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:13.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:13.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:13.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:13.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.189743129, 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.619 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.620 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.620 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:13.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.620 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:13.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:13.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:13.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:13.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:13.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:13.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:13.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:13.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:13.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:13.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:13.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:13.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:13.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:13.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:13.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:13.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:13.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.626 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.627 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.627 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:13.627 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:13.627 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.189674668999999, 2024-09-12T22:05:13.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:13.627 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.627 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.627 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.627 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.627 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.627 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.627 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:13.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.628 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:13.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:13.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:13.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:13.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:13.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:13.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:13.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:13.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:13.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:13.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:13.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:13.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:13.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:13.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:13.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:13.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:13.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:13.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:13.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:13.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:13.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:13.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:13.633 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.633 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.633 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.634 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:13.634 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:13.634 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.189616934, 2024-09-12T22:05:13.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:13.634 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.634 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.634 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.635 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.635 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.635 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.635 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:13.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.635 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:13.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:13.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:13.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:13.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:13.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:13.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:13.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:13.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:13.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:13.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:13.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:13.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:13.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:13.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:13.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:13.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:13.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:13.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:13.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:13.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:13.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:13.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:13.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:13.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:13.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:13.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:13.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:13.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.189549241999998, 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.642 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:13.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.642 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:13.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:13.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:13.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:13.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:13.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:13.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:13.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:13.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:13.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:13.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:13.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:13.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:13.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:13.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:13.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:13.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:13.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:13.647 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.647 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.647 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.648 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:13.648 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:13.648 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.189494179999997, 2024-09-12T22:05:13.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:13.648 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.648 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.648 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.648 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:13.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.648 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:13.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:13.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:13.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:13.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:13.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:13.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:13.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:13.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:13.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:13.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:13.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:13.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:13.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:13.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:13.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:13.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:13.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:13.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:13.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:13.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:13.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:13.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:13.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.654 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.654 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:13.654 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:13.654 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.148846659999997, 2024-09-12T22:05:13.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:13.654 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.654 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.654 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.655 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:13.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.655 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:13.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:13.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:13.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:13.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:13.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:13.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:13.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:13.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:13.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:13.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:13.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:13.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:13.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:13.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:13.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:13.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:13.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:13.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:13.661 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.661 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.661 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.661 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:13.661 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:13.661 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.146232931999997, 2024-09-12T22:05:13.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:13.661 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.661 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.661 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.662 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.662 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.662 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.662 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:13.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.662 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:13.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:13.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:13.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:13.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:13.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:13.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:13.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:13.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:13.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:13.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:13.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:13.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:13.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:13.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:13.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:13.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:13.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:13.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:13.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:13.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:13.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:13.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:13.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:13.668 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.668 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.668 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.668 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:13.668 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:13.668 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.601018836000001, 2024-09-12T22:05:13.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:13.668 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.668 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.668 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:13.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:13.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:13.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:13.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:13.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:13.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:13.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:13.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:13.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:13.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:13.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:13.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:13.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:13.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:13.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:13.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:13.673 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.673 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.674 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.674 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:13.674 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:13.674 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.600540348000003, 2024-09-12T22:05:13.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:13.674 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.674 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.674 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.674 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:13.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:13.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:13.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:13.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:13.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:13.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:13.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:13.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:13.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:13.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.679 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.680 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:13.680 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:13.680 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.598045048000003, 2024-09-12T22:05:13.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:13.680 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.680 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.680 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.680 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:13.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.681 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:13.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:13.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:13.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:13.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:13.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:13.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:13.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:13.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:13.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:13.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:13.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:13.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:13.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:13.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:13.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:13.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:13.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:13.685 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.685 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.685 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.686 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:13.686 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:13.686 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.596964257000003, 2024-09-12T22:05:13.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:13.686 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.686 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.686 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.686 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.686 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.686 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:13.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:13.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:13.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:13.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:13.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:13.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:13.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:13.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:13.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:13.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:13.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:13.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:13.691 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.595728694999998, 2024-09-12T22:05:13.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:13.692 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.692 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.692 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.692 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:13.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.692 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:13.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:13.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:13.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:13.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:13.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:13.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:13.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:13.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:13.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:13.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:13.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:13.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:13.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:13.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:13.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:13.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:13.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:13.697 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.697 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.697 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.697 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:13.697 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:13.697 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.1549882069999997, 2024-09-12T22:05:13.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:13.697 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.698 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.698 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.698 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:13.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.698 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:13.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:13.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:13.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:13.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:13.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:13.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:13.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:13.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:13.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:13.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:13.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:13.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:13.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:13.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:13.702 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.702 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.702 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.702 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:13.702 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:13.702 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.15045778, 2024-09-12T22:05:13.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:13.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:13.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:13.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:13.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:13.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:13.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:13.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:13.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:13.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:13.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:13.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:13.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:13.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:13.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:13.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:13.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:13.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:13.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:13.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:13.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:13.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:13.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:13.708 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.708 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.708 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.708 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:13.708 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:13.708 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.1504337509999996, 2024-09-12T22:05:13.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:13.708 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:13.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:13.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:13.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:13.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:13.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:13.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:13.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:13.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:13.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:13.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:13.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:13.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:13.713 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.714 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.714 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.714 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:13.714 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:13.714 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.1502561020000002, 2024-09-12T22:05:13.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:13.714 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.714 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.714 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.714 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.714 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.714 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:13.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:13.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:13.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:13.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:13.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:13.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:13.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:13.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:13.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:13.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:13.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:13.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:13.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:13.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:13.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:13.719 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.719 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.719 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.720 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:13.720 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:13.720 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.1482375649999996, 2024-09-12T22:05:13.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:13.720 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:13.720 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:13.720 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:13.720 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:13.720 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:13.720 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.720 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:13.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.721 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:13.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:13.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:13.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:13.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:13.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:13.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:13.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:13.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:13.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:13.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:13.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:13.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:13.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:13.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:13.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:13.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:13.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:13.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:13.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:13.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:13.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:13.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:13.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:13.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:13.727 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.727 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.727 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:13.728 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:13.728 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:13.729 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:13.730 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:13.727+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:13.830 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:13.828+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:13.885 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:13.886 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:13.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.886 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:219398 5.9 5:999b9fd9:::benchmark_data_smithi043_32659_object52160:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:05:13.886 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:13.879698+0000", 2024-09-12T22:05:13.886 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0049416219999999997, 2024-09-12T22:05:13.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049594280000000001, 2024-09-12T22:05:13.886 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.886 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.886 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:13.886 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:13.886 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:13.886 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 219398 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.879698+0000", 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.879698+0000", 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.879699+0000", 2024-09-12T22:05:13.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7400000000000002e-07 2024-09-12T22:05:13.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.879702+0000", 2024-09-12T22:05:13.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3790000000000002e-06 2024-09-12T22:05:13.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.879712+0000", 2024-09-12T22:05:13.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2930000000000006e-06 2024-09-12T22:05:13.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.879718+0000", 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9390000000000002e-06 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.880241+0000", 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00052352400000000004 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.880423+0000", 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018233400000000001 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:13.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.880500+0000", 2024-09-12T22:05:13.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6817999999999995e-05 2024-09-12T22:05:13.890 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.890 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.890 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.890 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:219395 5.1 e54/40 5:88c41898:::benchmark_data_smithi043_32659_object52157:head v 54'13591, mlcod=54'13589)", 2024-09-12T22:05:13.890 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:13.880135+0000", 2024-09-12T22:05:13.890 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0045052030000000002, 2024-09-12T22:05:13.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045708459999999999, 2024-09-12T22:05:13.890 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.890 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.891 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:13.891 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.880135+0000", 2024-09-12T22:05:13.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.880135+0000", 2024-09-12T22:05:13.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.880135+0000", 2024-09-12T22:05:13.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:05:13.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.880141+0000", 2024-09-12T22:05:13.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5879999999999997e-06 2024-09-12T22:05:13.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.880150+0000", 2024-09-12T22:05:13.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5259999999999993e-06 2024-09-12T22:05:13.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.880156+0000", 2024-09-12T22:05:13.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6390000000000003e-06 2024-09-12T22:05:13.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.880615+0000", 2024-09-12T22:05:13.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00045890299999999998 2024-09-12T22:05:13.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.880632+0000", 2024-09-12T22:05:13.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6806000000000001e-05 2024-09-12T22:05:13.894 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.894 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.894 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.894 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:219397 5.1 e54/40 5:86308e6c:::benchmark_data_smithi043_32659_object52159:head v 54'13592, mlcod=54'13589)", 2024-09-12T22:05:13.894 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:13.881872+0000", 2024-09-12T22:05:13.894 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0027675989999999999, 2024-09-12T22:05:13.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028779529999999999, 2024-09-12T22:05:13.894 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.894 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.894 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:13.894 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.881872+0000", 2024-09-12T22:05:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.881872+0000", 2024-09-12T22:05:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.881873+0000", 2024-09-12T22:05:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4300000000000003e-07 2024-09-12T22:05:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.881878+0000", 2024-09-12T22:05:13.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2440000000000001e-06 2024-09-12T22:05:13.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.881887+0000", 2024-09-12T22:05:13.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5159999999999994e-06 2024-09-12T22:05:13.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.881894+0000", 2024-09-12T22:05:13.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8839999999999997e-06 2024-09-12T22:05:13.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883326+0000", 2024-09-12T22:05:13.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014329220000000001 2024-09-12T22:05:13.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883346+0000", 2024-09-12T22:05:13.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9211999999999998e-05 2024-09-12T22:05:13.897 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.897 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.897 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.898 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:219402 5.3 e54/40 5:c0c34ea6:::benchmark_data_smithi043_32659_object52164:head v 54'13655, mlcod=54'13653)", 2024-09-12T22:05:13.898 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:13.882314+0000", 2024-09-12T22:05:13.898 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002326098, 2024-09-12T22:05:13.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024952149999999998, 2024-09-12T22:05:13.898 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.898 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.898 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:13.898 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882314+0000", 2024-09-12T22:05:13.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882314+0000", 2024-09-12T22:05:13.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882314+0000", 2024-09-12T22:05:13.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7199999999999999e-07 2024-09-12T22:05:13.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882319+0000", 2024-09-12T22:05:13.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.724e-06 2024-09-12T22:05:13.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882328+0000", 2024-09-12T22:05:13.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:13.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882334+0000", 2024-09-12T22:05:13.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0939999999999996e-06 2024-09-12T22:05:13.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882379+0000", 2024-09-12T22:05:13.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5111999999999998e-05 2024-09-12T22:05:13.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882397+0000", 2024-09-12T22:05:13.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7703999999999999e-05 2024-09-12T22:05:13.901 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.901 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.901 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.901 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:219404 5.5 e54/40 5:af9e535c:::benchmark_data_smithi043_32659_object52166:head v 54'13786, mlcod=54'13784)", 2024-09-12T22:05:13.901 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:13.882423+0000", 2024-09-12T22:05:13.902 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0022170549999999999, 2024-09-12T22:05:13.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024281260000000001, 2024-09-12T22:05:13.902 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.902 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.902 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:13.902 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882423+0000", 2024-09-12T22:05:13.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882423+0000", 2024-09-12T22:05:13.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882423+0000", 2024-09-12T22:05:13.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4199999999999996e-07 2024-09-12T22:05:13.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882427+0000", 2024-09-12T22:05:13.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0180000000000003e-06 2024-09-12T22:05:13.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882435+0000", 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3200000000000002e-06 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882441+0000", 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.516e-06 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882488+0000", 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7191000000000003e-05 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.882505+0000", 2024-09-12T22:05:13.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6158999999999999e-05 2024-09-12T22:05:13.905 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.905 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.905 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.905 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:219407 5.d 5:b3281d9e:::benchmark_data_smithi043_32659_object52169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:05:13.905 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:13.883042+0000", 2024-09-12T22:05:13.905 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001597897, 2024-09-12T22:05:13.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018402760000000001, 2024-09-12T22:05:13.905 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.905 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.905 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:13.906 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:13.906 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:13.906 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.906 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 219407 2024-09-12T22:05:13.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.906 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883042+0000", 2024-09-12T22:05:13.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883042+0000", 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883043+0000", 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5099999999999999e-07 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883047+0000", 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0239999999999999e-06 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883054+0000", 2024-09-12T22:05:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3459999999999996e-06 2024-09-12T22:05:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883061+0000", 2024-09-12T22:05:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7320000000000001e-06 2024-09-12T22:05:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883108+0000", 2024-09-12T22:05:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6789000000000002e-05 2024-09-12T22:05:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883268+0000", 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000160686 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883369+0000", 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000101038 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:219409 5.e 5:7eee8b2b:::benchmark_data_smithi043_32659_object52171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:13.883641+0000", 2024-09-12T22:05:13.909 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0009986000000000001, 2024-09-12T22:05:13.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001279157, 2024-09-12T22:05:13.910 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.910 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.910 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:13.910 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:13.910 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:13.910 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.910 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 219409 2024-09-12T22:05:13.910 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.910 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.910 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.910 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.910 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883641+0000", 2024-09-12T22:05:13.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883641+0000", 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883642+0000", 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1299999999999999e-07 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883646+0000", 2024-09-12T22:05:13.911 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2749999999999997e-06 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883657+0000", 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0359e-05 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883664+0000", 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2119999999999997e-06 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883731+0000", 2024-09-12T22:05:13.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6839000000000002e-05 2024-09-12T22:05:13.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:13.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.883986+0000", 2024-09-12T22:05:13.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025486699999999998 2024-09-12T22:05:13.913 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.913 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.913 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.913 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:219399 5.1 e54/40)", 2024-09-12T22:05:13.913 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:13.884282+0000", 2024-09-12T22:05:13.913 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00035736299999999997, 2024-09-12T22:05:13.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00067101400000000005, 2024-09-12T22:05:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884282+0000", 2024-09-12T22:05:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884282+0000", 2024-09-12T22:05:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884283+0000", 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3300000000000001e-07 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884289+0000", 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884297+0000", 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.191e-06 2024-09-12T22:05:13.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884303+0000", 2024-09-12T22:05:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:05:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:219411 5.d 5:b9c79fab:::benchmark_data_smithi043_32659_object52173:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:05:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:13.884734+0000", 2024-09-12T22:05:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9999061, 2024-09-12T22:05:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000245999, 2024-09-12T22:05:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.917 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.917 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:13.917 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:13.917 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:13.917 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.917 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 219411 2024-09-12T22:05:13.917 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.917 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.917 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.917 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.917 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884734+0000", 2024-09-12T22:05:13.917 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884734+0000", 2024-09-12T22:05:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884734+0000", 2024-09-12T22:05:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2099999999999995e-07 2024-09-12T22:05:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884739+0000", 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5879999999999999e-06 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884750+0000", 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1214e-05 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884757+0000", 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2010000000000002e-06 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:13.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884930+0000", 2024-09-12T22:05:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017234100000000001 2024-09-12T22:05:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:219413 5.e 5.a0fe6fce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:05:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:13.884777+0000", 2024-09-12T22:05:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9998627, 2024-09-12T22:05:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00023231700000000001, 2024-09-12T22:05:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:13.921 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:13.921 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:13.921 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 219413 2024-09-12T22:05:13.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.921 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:13.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.921 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:13.921 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884777+0000", 2024-09-12T22:05:13.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.921 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:13.921 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884777+0000", 2024-09-12T22:05:13.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884778+0000", 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6599999999999996e-07 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884781+0000", 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6259999999999999e-06 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884788+0000", 2024-09-12T22:05:13.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5329999999999997e-06 2024-09-12T22:05:13.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:13.923 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:13.923 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:13.923 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:13.884794+0000", 2024-09-12T22:05:13.923 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.75e-06 2024-09-12T22:05:13.923 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.923 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:13.923 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.923 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:13.923 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:13.923 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 10 2024-09-12T22:05:13.923 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:13.924 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:13.967 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:13.965+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:14.032 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:14.030+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:14.118 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:14.119 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:14.119 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:14.119 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:14.119 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:14.133 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:14.134 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:14.132+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:14.234 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:14.232+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:14.330 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:14.330 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:14.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:14.331 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:14.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.331 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:14.331 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:14.331 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 69.701787065000005, 2024-09-12T22:05:14.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:05:14.331 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.331 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.331 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.331 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:14.331 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:14.331 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:14.331 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:05:14.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.332 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:14.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:14.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:05:14.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:05:14.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:05:14.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:05:14.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:05:14.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:05:14.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:05:14.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:05:14.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:05:14.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:05:14.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:05:14.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:05:14.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:14.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:05:14.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:05:14.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:14.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:05:14.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:05:14.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:14.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:05:14.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:05:14.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:05:14.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:05:14.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:05:14.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:05:14.339 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.339 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.340 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:14.340 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:14.340 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 69.696386125000004, 2024-09-12T22:05:14.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:05:14.340 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.340 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.340 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.340 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:14.340 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:14.340 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:14.341 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:05:14.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.341 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:14.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:14.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:14.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:14.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:05:14.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:05:14.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:05:14.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:05:14.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:05:14.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:05:14.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:05:14.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:05:14.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:05:14.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:05:14.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:14.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:05:14.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:05:14.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:14.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:05:14.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:05:14.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:14.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:05:14.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:05:14.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:05:14.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:05:14.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:05:14.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:05:14.346 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.346 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.346 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.347 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:14.347 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:14.347 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.330698239, 2024-09-12T22:05:14.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:05:14.347 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.347 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.347 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:14.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:14.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:14.347 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:05:14.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.348 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:14.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:14.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:14.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:05:14.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:05:14.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:05:14.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:05:14.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:05:14.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:05:14.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:05:14.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:05:14.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:05:14.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:05:14.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:05:14.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:14.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:05:14.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:05:14.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:14.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:05:14.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:05:14.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:14.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:05:14.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:05:14.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:05:14.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:05:14.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:05:14.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:05:14.353 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.353 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.353 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.353 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:14.353 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:14.353 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.330065034, 2024-09-12T22:05:14.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:14.353 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.353 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.353 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.353 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:14.354 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:14.354 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:14.354 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:14.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.354 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:14.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:14.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:14.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:14.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:14.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:14.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:14.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:14.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:14.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:14.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:14.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:14.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:14.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:14.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:14.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:14.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:14.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:14.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:14.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:14.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:14.359 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.359 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.359 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.359 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:14.359 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:14.359 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.328245371000001, 2024-09-12T22:05:14.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:14.360 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.360 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.360 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.360 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:14.360 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:14.360 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:14.360 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:14.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.360 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:14.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:14.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:14.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:14.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:14.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:14.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:14.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:14.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:14.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:14.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:14.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:14.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:14.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:14.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:14.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:14.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:14.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:14.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:14.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:14.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:14.365 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.365 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.365 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.365 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:14.365 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:14.365 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.328077743999998, 2024-09-12T22:05:14.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:05:14.365 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.365 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.365 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.366 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:14.366 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:14.366 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:14.366 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:05:14.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.366 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:14.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:14.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:05:14.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:05:14.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:05:14.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:05:14.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:05:14.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:05:14.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:05:14.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:05:14.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:05:14.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:05:14.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:05:14.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:05:14.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:14.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:05:14.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:05:14.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:05:14.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:05:14.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:05:14.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:05:14.370 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.370 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.370 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.370 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:05:14.370 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:14.370 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.327937079999998, 2024-09-12T22:05:14.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:05:14.370 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:05:14.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:05:14.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:05:14.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:05:14.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:05:14.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:05:14.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:05:14.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:05:14.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:05:14.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:05:14.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:05:14.374 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.374 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.374 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.375 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:14.375 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:14.375 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.327711557000001, 2024-09-12T22:05:14.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:14.375 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.375 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.375 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.375 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:14.375 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:14.375 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:14.375 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:14.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.375 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:14.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:14.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:14.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:14.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:14.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:14.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:14.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:14.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:14.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:14.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:14.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:14.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:14.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:14.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:14.379 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.379 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.380 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.380 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:14.380 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:14.380 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.327591853000001, 2024-09-12T22:05:14.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:05:14.380 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.380 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.380 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.380 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:14.380 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:14.380 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:14.381 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:05:14.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.381 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:14.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:14.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:05:14.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:05:14.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:05:14.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:05:14.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:05:14.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:05:14.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:05:14.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:05:14.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:05:14.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:05:14.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:05:14.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:05:14.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:14.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:14.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:05:14.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:14.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:05:14.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:05:14.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:14.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:05:14.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:05:14.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:05:14.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:05:14.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:05:14.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:05:14.386 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.386 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.386 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.386 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:05:14.386 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:14.386 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.327000570999999, 2024-09-12T22:05:14.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:05:14.386 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.386 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.386 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:14.386 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:14.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:14.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:05:14.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:05:14.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:05:14.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:05:14.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:05:14.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:05:14.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:05:14.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:05:14.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:05:14.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:05:14.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:05:14.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:05:14.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:05:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:05:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:05:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.326777002999997, 2024-09-12T22:05:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:05:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.391 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.391 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:14.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:14.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:14.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:05:14.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:05:14.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:05:14.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:05:14.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:05:14.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:05:14.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:05:14.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:05:14.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:05:14.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:05:14.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:05:14.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:05:14.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:05:14.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:05:14.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:05:14.394 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.394 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.394 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.395 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:14.395 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:14.395 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.326685521999998, 2024-09-12T22:05:14.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:05:14.395 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.395 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.395 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.395 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:14.395 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:14.395 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:14.395 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:05:14.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.396 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:14.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:14.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:05:14.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:05:14.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:05:14.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:05:14.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:05:14.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:05:14.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:05:14.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:05:14.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:05:14.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:05:14.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:05:14.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:05:14.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:14.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:05:14.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:05:14.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:05:14.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:05:14.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:05:14.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:05:14.400 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.400 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.400 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.400 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:14.400 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:14.400 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.325896718000003, 2024-09-12T22:05:14.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:14.400 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.400 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.401 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.401 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:14.401 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:14.401 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:14.401 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:14.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.401 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:14.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:14.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:14.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:14.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:14.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:14.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:14.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:14.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:14.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:14.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:14.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:14.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:14.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:14.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:14.405 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.405 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.405 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.405 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:14.405 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:14.405 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.325632577999997, 2024-09-12T22:05:14.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:05:14.406 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.406 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.406 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.406 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:14.406 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:14.406 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:14.406 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:05:14.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.406 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:14.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:14.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:05:14.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:05:14.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:05:14.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:05:14.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:05:14.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:05:14.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:05:14.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:05:14.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:05:14.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:05:14.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:05:14.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:05:14.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:14.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:05:14.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:05:14.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:05:14.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:05:14.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:05:14.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:05:14.410 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.410 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.410 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.411 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:05:14.411 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:14.411 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.325127602999999, 2024-09-12T22:05:14.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:05:14.411 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.411 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.411 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.411 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:14.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:14.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:05:14.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:05:14.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:05:14.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:05:14.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:05:14.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:05:14.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:05:14.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:05:14.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:05:14.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:05:14.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:05:14.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:05:14.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:05:14.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:05:14.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:05:14.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:05:14.415 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.415 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.415 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.415 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:05:14.415 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:14.415 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.323998175, 2024-09-12T22:05:14.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:05:14.415 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.415 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.416 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.416 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:14.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:14.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:05:14.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:05:14.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:05:14.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:05:14.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:05:14.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:05:14.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:05:14.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:05:14.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:05:14.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:05:14.419 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.419 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.419 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.420 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:14.420 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:14.420 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.323243732999998, 2024-09-12T22:05:14.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:05:14.420 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.420 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.420 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.420 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:14.420 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:14.420 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:14.420 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:05:14.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.421 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:14.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:14.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:05:14.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:14.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:05:14.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:05:14.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:05:14.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:05:14.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:05:14.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:05:14.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:05:14.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:05:14.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:05:14.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:05:14.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:14.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:05:14.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:05:14.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:14.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:05:14.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:05:14.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:14.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:05:14.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:05:14.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:05:14.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:05:14.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:05:14.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:05:14.425 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.425 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.425 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.426 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:05:14.426 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:14.426 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.322564630999999, 2024-09-12T22:05:14.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:05:14.426 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.426 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.426 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.426 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:14.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:14.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:05:14.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:05:14.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:05:14.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:05:14.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:05:14.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:05:14.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:05:14.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:05:14.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:05:14.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:05:14.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:05:14.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:05:14.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:05:14.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:05:14.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:05:14.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:05:14.430 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.430 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.430 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.430 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:207316 5.d 5:b199774a:::benchmark_data_smithi043_32659_object40078:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:14.430 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:14.430 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.8801031100000003, 2024-09-12T22:05:14.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095080382000000005, 2024-09-12T22:05:14.430 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.430 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 207316 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:14.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.432 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447981+0000", 2024-09-12T22:05:14.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1999999999999998e-07 2024-09-12T22:05:14.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.432 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447985+0000", 2024-09-12T22:05:14.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1910000000000002e-06 2024-09-12T22:05:14.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.433 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.433 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447999+0000", 2024-09-12T22:05:14.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4185000000000001e-05 2024-09-12T22:05:14.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.433 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.433 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448006+0000", 2024-09-12T22:05:14.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8929999999999999e-06 2024-09-12T22:05:14.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.433 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.433 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448050+0000", 2024-09-12T22:05:14.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4406999999999997e-05 2024-09-12T22:05:14.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448236+0000", 2024-09-12T22:05:14.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018612899999999999 2024-09-12T22:05:14.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:14.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448357+0000", 2024-09-12T22:05:14.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000120303 2024-09-12T22:05:14.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:14.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450305+0000", 2024-09-12T22:05:14.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001947952 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.542919+0000", 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092613928999999998 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.542971+0000", 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2083000000000003e-05 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.543060+0000", 2024-09-12T22:05:14.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9489999999999999e-05 2024-09-12T22:05:14.436 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.436 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.436 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.436 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:207325 5.9 5:98263198:::benchmark_data_smithi043_32659_object40087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:14.436 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:14.436 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.8779541379999998, 2024-09-12T22:05:14.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.089568523999999997, 2024-09-12T22:05:14.436 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:14.436 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:14.436 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:14.436 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:14.437 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:14.437 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:14.437 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 207325 2024-09-12T22:05:14.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.437 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:14.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:14.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:14.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:14.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:14.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3399999999999999e-07 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450132+0000", 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450139+0000", 2024-09-12T22:05:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6290000000000004e-06 2024-09-12T22:05:14.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.439 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:14.439 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450144+0000", 2024-09-12T22:05:14.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3290000000000001e-06 2024-09-12T22:05:14.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.439 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:14.439 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450205+0000", 2024-09-12T22:05:14.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0504999999999998e-05 2024-09-12T22:05:14.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.439 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:14.439 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450373+0000", 2024-09-12T22:05:14.440 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000168314 2024-09-12T22:05:14.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:14.440 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450485+0000", 2024-09-12T22:05:14.440 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011231299999999999 2024-09-12T22:05:14.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.452226+0000", 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017412409999999999 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539592+0000", 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.087365211999999998 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539633+0000", 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1165000000000003e-05 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:14.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:14.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539697+0000", 2024-09-12T22:05:14.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4519999999999999e-05 2024-09-12T22:05:14.442 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.442 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.442 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.442 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:14.442 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:14.442 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:14.443 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:05:14.444 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:14.442+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:14.445 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:14.544 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:14.542+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:14.555 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:14.573 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:14.574 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:14.593 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:14.593 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:14.596 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:14.596 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:14.596 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:14.597 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:14.609 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:14.652 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:14.651+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:14.746 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:14.744+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:14.754 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:14.754 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:14.767 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:14.861 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:14.860+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:14.948 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:14.947+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:14.964 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:14.964 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:14.977 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:15.049 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:15.047+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:15.136 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:15.136 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:15.153 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:15.154 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:15.152+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:15.254 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:15.253+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:15.355 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:15.356 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:15.356 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:15.354+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:15.368 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:15.457 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:15.454+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:15.497 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:05:15.522 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:15.522 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:15.535 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:15.576 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:15.574+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:15.658 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:15.656+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:15.682 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:15.682 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:15.696 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:15.758 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:15.757+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:15.846 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:15.846 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:15.857 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:15.859 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:15.857+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:15.960 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:15.958+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:16.044 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:16.044 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:16.056 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:16.102 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:16.099+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:16.162 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:16.160+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:16.218 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:16.218 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:16.232 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:16.263 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:16.261+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:16.364 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:16.362+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:16.430 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:16.431 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:16.443 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:16.465 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:16.463+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:16.489 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-09-12T22:05:16.565 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:16.563+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:16.597 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:05:16.638 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:16.638 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:16.646 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~53s 2024-09-12T22:05:16.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:16.695 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:16.694+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:16.706 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:16.724 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:16.725 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:16.744 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:16.745 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:16.747 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:16.748 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:16.766 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:16.765+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:16.799 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:16.799 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:16.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.799 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:227491 5.5 5:a2d738f1:::benchmark_data_smithi043_32659_object60253:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:16.799 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:16.794283+0000", 2024-09-12T22:05:16.799 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0026474010000000002, 2024-09-12T22:05:16.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026656179999999998, 2024-09-12T22:05:16.799 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:16.799 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:16.799 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:16.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:16.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:16.800 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:16.800 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 227491 2024-09-12T22:05:16.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.800 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:16.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:16.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.794283+0000", 2024-09-12T22:05:16.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:16.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.794283+0000", 2024-09-12T22:05:16.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:16.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.794284+0000", 2024-09-12T22:05:16.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5000000000000001e-07 2024-09-12T22:05:16.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:16.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.794289+0000", 2024-09-12T22:05:16.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5349999999999998e-06 2024-09-12T22:05:16.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:16.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.794301+0000", 2024-09-12T22:05:16.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1532000000000001e-05 2024-09-12T22:05:16.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:16.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.794309+0000", 2024-09-12T22:05:16.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0269999999999995e-06 2024-09-12T22:05:16.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:16.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.794362+0000", 2024-09-12T22:05:16.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3711999999999997e-05 2024-09-12T22:05:16.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:16.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.794540+0000", 2024-09-12T22:05:16.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0001775 2024-09-12T22:05:16.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:16.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.794668+0000", 2024-09-12T22:05:16.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012857400000000001 2024-09-12T22:05:16.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:16.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796528+0000", 2024-09-12T22:05:16.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018599109999999999 2024-09-12T22:05:16.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.804 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:16.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.804 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:227494 5.6 5:6b11c225:::benchmark_data_smithi043_32659_object60256:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:16.804 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:16.796273+0000", 2024-09-12T22:05:16.804 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000657955, 2024-09-12T22:05:16.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00072413700000000002, 2024-09-12T22:05:16.804 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:16.804 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:16.804 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:16.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:16.805 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:16.805 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:16.805 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 227494 2024-09-12T22:05:16.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.805 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:16.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:16.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796273+0000", 2024-09-12T22:05:16.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:16.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796273+0000", 2024-09-12T22:05:16.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:16.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796274+0000", 2024-09-12T22:05:16.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:05:16.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:16.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796277+0000", 2024-09-12T22:05:16.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7500000000000001e-06 2024-09-12T22:05:16.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:16.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796286+0000", 2024-09-12T22:05:16.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3340000000000002e-06 2024-09-12T22:05:16.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:16.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796290+0000", 2024-09-12T22:05:16.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6319999999999999e-06 2024-09-12T22:05:16.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:16.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796327+0000", 2024-09-12T22:05:16.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6337000000000001e-05 2024-09-12T22:05:16.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:16.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796423+0000", 2024-09-12T22:05:16.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6821e-05 2024-09-12T22:05:16.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:16.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796506+0000", 2024-09-12T22:05:16.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2910000000000004e-05 2024-09-12T22:05:16.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.808 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:16.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.809 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:227474 5.c e55/40 ondisk, result = 0)", 2024-09-12T22:05:16.809 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:16.796949+0000", 2024-09-12T22:05:16.809 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999814, 2024-09-12T22:05:16.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010328900000000001, 2024-09-12T22:05:16.809 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:16.809 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:16.809 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:16.809 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:16.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:16.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796949+0000", 2024-09-12T22:05:16.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:16.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796949+0000", 2024-09-12T22:05:16.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:16.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796950+0000", 2024-09-12T22:05:16.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0500000000000003e-07 2024-09-12T22:05:16.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:16.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796954+0000", 2024-09-12T22:05:16.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8419999999999998e-06 2024-09-12T22:05:16.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:16.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796964+0000", 2024-09-12T22:05:16.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0285000000000001e-05 2024-09-12T22:05:16.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:16.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796970+0000", 2024-09-12T22:05:16.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7790000000000001e-06 2024-09-12T22:05:16.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:16.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797014+0000", 2024-09-12T22:05:16.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3900000000000003e-05 2024-09-12T22:05:16.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:16.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797022+0000", 2024-09-12T22:05:16.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8110000000000003e-06 2024-09-12T22:05:16.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.812 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:16.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.813 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:227479 5.7 e55/40 ondisk, result = 0)", 2024-09-12T22:05:16.813 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:16.796985+0000", 2024-09-12T22:05:16.813 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999461, 2024-09-12T22:05:16.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8615000000000004e-05, 2024-09-12T22:05:16.813 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:16.813 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:16.813 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:16.813 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:16.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:16.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796985+0000", 2024-09-12T22:05:16.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:16.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796985+0000", 2024-09-12T22:05:16.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:16.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796985+0000", 2024-09-12T22:05:16.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1399999999999998e-07 2024-09-12T22:05:16.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:16.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796987+0000", 2024-09-12T22:05:16.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.956e-06 2024-09-12T22:05:16.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:16.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796993+0000", 2024-09-12T22:05:16.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5119999999999999e-06 2024-09-12T22:05:16.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:16.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.796997+0000", 2024-09-12T22:05:16.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-12T22:05:16.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:16.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797032+0000", 2024-09-12T22:05:16.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5552000000000001e-05 2024-09-12T22:05:16.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:16.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797043+0000", 2024-09-12T22:05:16.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0198e-05 2024-09-12T22:05:16.816 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.816 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:16.816 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.817 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:227481 5.1 e55/40)", 2024-09-12T22:05:16.817 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:16.797061+0000", 2024-09-12T22:05:16.817 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9998693, 2024-09-12T22:05:16.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3835000000000001e-05, 2024-09-12T22:05:16.817 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:16.817 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:16.817 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:16.817 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:16.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:16.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797061+0000", 2024-09-12T22:05:16.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:16.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797061+0000", 2024-09-12T22:05:16.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:16.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797062+0000", 2024-09-12T22:05:16.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.27e-07 2024-09-12T22:05:16.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:16.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797064+0000", 2024-09-12T22:05:16.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.633e-06 2024-09-12T22:05:16.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:16.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797071+0000", 2024-09-12T22:05:16.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7270000000000001e-06 2024-09-12T22:05:16.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:16.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797075+0000", 2024-09-12T22:05:16.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.352e-06 2024-09-12T22:05:16.819 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.819 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:16.819 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.820 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:227484 5.c e55/40)", 2024-09-12T22:05:16.820 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:16.797086+0000", 2024-09-12T22:05:16.820 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9998455, 2024-09-12T22:05:16.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4078000000000004e-05, 2024-09-12T22:05:16.820 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:16.820 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:16.820 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:16.820 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:16.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:16.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797086+0000", 2024-09-12T22:05:16.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:16.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797086+0000", 2024-09-12T22:05:16.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:16.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797086+0000", 2024-09-12T22:05:16.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.04e-07 2024-09-12T22:05:16.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:16.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797087+0000", 2024-09-12T22:05:16.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.581e-06 2024-09-12T22:05:16.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:16.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797092+0000", 2024-09-12T22:05:16.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1059999999999999e-06 2024-09-12T22:05:16.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:16.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797122+0000", 2024-09-12T22:05:16.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9646e-05 2024-09-12T22:05:16.822 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.822 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:16.823 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.823 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:227474 5.c 5:3653c845:::benchmark_data_smithi043_32659_object60236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:16.823 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:16.788809+0000", 2024-09-12T22:05:16.823 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0081213889999999997, 2024-09-12T22:05:16.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0084121170000000002, 2024-09-12T22:05:16.823 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:16.823 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:16.823 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:16.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:16.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:16.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:16.824 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 227474 2024-09-12T22:05:16.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.824 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:16.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:16.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.788809+0000", 2024-09-12T22:05:16.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:16.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.788809+0000", 2024-09-12T22:05:16.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:16.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.788810+0000", 2024-09-12T22:05:16.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9700000000000005e-07 2024-09-12T22:05:16.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:16.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.788814+0000", 2024-09-12T22:05:16.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0629999999999999e-06 2024-09-12T22:05:16.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:16.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.788824+0000", 2024-09-12T22:05:16.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2110000000000004e-06 2024-09-12T22:05:16.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:16.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.788832+0000", 2024-09-12T22:05:16.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9480000000000008e-06 2024-09-12T22:05:16.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:16.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.788887+0000", 2024-09-12T22:05:16.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5381999999999999e-05 2024-09-12T22:05:16.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:16.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.789038+0000", 2024-09-12T22:05:16.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000151006 2024-09-12T22:05:16.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:16.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.789169+0000", 2024-09-12T22:05:16.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131345 2024-09-12T22:05:16.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:16.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791258+0000", 2024-09-12T22:05:16.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020886020000000002 2024-09-12T22:05:16.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:16.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797028+0000", 2024-09-12T22:05:16.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.005769639 2024-09-12T22:05:16.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:16.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797097+0000", 2024-09-12T22:05:16.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9265999999999997e-05 2024-09-12T22:05:16.828 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.828 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:16.828 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.828 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:227481 5.1 5:8c7d8cdf:::benchmark_data_smithi043_32659_object60243:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:16.829 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:16.791360+0000", 2024-09-12T22:05:16.829 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0055712189999999997, 2024-09-12T22:05:16.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059562950000000003, 2024-09-12T22:05:16.829 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:16.829 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:16.829 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:16.829 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:16.829 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:16.829 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:16.829 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 227481 2024-09-12T22:05:16.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.829 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:16.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791360+0000", 2024-09-12T22:05:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791360+0000", 2024-09-12T22:05:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791361+0000", 2024-09-12T22:05:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099e-06 2024-09-12T22:05:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791366+0000", 2024-09-12T22:05:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6799999999999998e-06 2024-09-12T22:05:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791378+0000", 2024-09-12T22:05:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.199e-05 2024-09-12T22:05:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791386+0000", 2024-09-12T22:05:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7039999999999994e-06 2024-09-12T22:05:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791439+0000", 2024-09-12T22:05:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2441999999999997e-05 2024-09-12T22:05:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791595+0000", 2024-09-12T22:05:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015653299999999999 2024-09-12T22:05:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791718+0000", 2024-09-12T22:05:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122564 2024-09-12T22:05:16.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:16.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.794636+0000", 2024-09-12T22:05:16.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029185529999999999 2024-09-12T22:05:16.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:16.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797180+0000", 2024-09-12T22:05:16.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0025439439999999998 2024-09-12T22:05:16.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:16.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797238+0000", 2024-09-12T22:05:16.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7367999999999997e-05 2024-09-12T22:05:16.834 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.834 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:16.834 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.834 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:227482 5.1 5:8dc9edd1:::benchmark_data_smithi043_32659_object60244:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:16.834 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:16.791403+0000", 2024-09-12T22:05:16.834 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0055274390000000003, 2024-09-12T22:05:16.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059852519999999999, 2024-09-12T22:05:16.834 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:16.834 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:16.834 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:16.835 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:16.835 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:16.835 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:16.835 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 227482 2024-09-12T22:05:16.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.835 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:16.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:16.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791403+0000", 2024-09-12T22:05:16.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:16.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791403+0000", 2024-09-12T22:05:16.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:16.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791404+0000", 2024-09-12T22:05:16.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4799999999999998e-07 2024-09-12T22:05:16.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:16.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791407+0000", 2024-09-12T22:05:16.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7949999999999999e-06 2024-09-12T22:05:16.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:16.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791415+0000", 2024-09-12T22:05:16.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3639999999999999e-06 2024-09-12T22:05:16.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:16.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791421+0000", 2024-09-12T22:05:16.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-12T22:05:16.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:16.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.793309+0000", 2024-09-12T22:05:16.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018880209999999999 2024-09-12T22:05:16.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:16.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.793466+0000", 2024-09-12T22:05:16.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015717899999999999 2024-09-12T22:05:16.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:16.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.793544+0000", 2024-09-12T22:05:16.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7712000000000004e-05 2024-09-12T22:05:16.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:16.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.794841+0000", 2024-09-12T22:05:16.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012970659999999999 2024-09-12T22:05:16.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.839 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:16.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.839 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:227484 5.c 5:3a5319c8:::benchmark_data_smithi043_32659_object60246:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:16.839 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:16.791440+0000", 2024-09-12T22:05:16.839 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0054906620000000003, 2024-09-12T22:05:16.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.006013076, 2024-09-12T22:05:16.839 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:16.839 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:16.839 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:16.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:16.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:16.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:16.840 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 227484 2024-09-12T22:05:16.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.840 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:16.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:16.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791440+0000", 2024-09-12T22:05:16.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:16.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791440+0000", 2024-09-12T22:05:16.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:16.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:16.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791441+0000", 2024-09-12T22:05:16.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.82e-07 2024-09-12T22:05:16.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:16.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791444+0000", 2024-09-12T22:05:16.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8310000000000001e-06 2024-09-12T22:05:16.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791458+0000", 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4419999999999999e-05 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791464+0000", 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0179999999999998e-06 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791539+0000", 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5103000000000002e-05 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:16.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791646+0000", 2024-09-12T22:05:16.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010658399999999999 2024-09-12T22:05:16.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:16.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.791714+0000", 2024-09-12T22:05:16.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.792e-05 2024-09-12T22:05:16.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:16.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.793389+0000", 2024-09-12T22:05:16.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001675197 2024-09-12T22:05:16.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:16.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797344+0000", 2024-09-12T22:05:16.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039548140000000001 2024-09-12T22:05:16.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:16.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797374+0000", 2024-09-12T22:05:16.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0490000000000001e-05 2024-09-12T22:05:16.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:16.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:16.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:16.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:16.797453+0000", 2024-09-12T22:05:16.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9116999999999995e-05 2024-09-12T22:05:16.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.845 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:16.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:16.845 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:16.845 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 10 2024-09-12T22:05:16.845 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:16.846 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:16.867 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:16.865+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:16.968 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:16.967+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:17.032 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:17.033 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:17.046 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:17.087 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:17.086+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:17.170 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:17.169+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:17.233 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.819405637000003, 2024-09-12T22:05:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.819225707000001, 2024-09-12T22:05:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.819159266, 2024-09-12T22:05:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.819102823000001, 2024-09-12T22:05:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.819034363, 2024-09-12T22:05:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:17.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:17.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:17.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:17.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:17.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:17.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:17.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:17.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:17.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:17.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:17.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:17.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:17.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:17.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:17.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:17.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:17.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:17.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:17.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:17.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:17.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:17.267 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.267 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.267 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.267 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:17.267 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:17.268 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.818976628000001, 2024-09-12T22:05:17.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:17.268 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.268 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.268 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.268 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.268 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.268 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.268 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:17.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.268 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:17.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:17.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:17.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:17.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:17.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:17.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:17.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:17.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:17.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:17.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:17.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:17.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:17.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:17.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:17.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:17.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:17.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:17.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:17.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:17.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:17.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:17.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:17.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:17.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:17.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:17.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:17.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:17.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:17.275 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.275 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.275 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.276 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:17.276 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:17.276 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.818908936, 2024-09-12T22:05:17.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:17.276 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.276 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.276 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.276 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.276 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:17.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:17.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:17.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:17.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:17.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:17.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:17.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:17.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:17.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:17.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:17.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:17.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:17.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:17.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:17.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:17.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:17.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:17.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:17.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:17.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:17.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:17.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:17.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:17.283 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.283 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.283 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.284 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:17.284 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:17.284 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.818853873999998, 2024-09-12T22:05:17.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:17.284 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.284 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.284 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.284 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.284 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.284 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.284 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:17.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.285 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:17.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:17.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:17.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:17.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:17.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:17.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:17.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:17.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:17.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:17.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:17.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:17.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:17.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:17.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:17.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:17.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:17.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:17.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:17.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:17.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:17.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:17.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:17.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:17.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:17.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:17.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:17.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:17.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:17.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.291 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.292 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:17.292 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:17.292 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.778206353999998, 2024-09-12T22:05:17.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:17.292 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.292 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.292 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.292 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:17.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.293 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:17.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:17.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:17.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:17.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:17.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:17.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:17.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:17.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:17.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:17.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:17.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:17.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:17.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:17.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:17.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:17.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:17.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:17.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:17.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:17.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:17.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:17.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:17.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:17.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:17.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:17.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:17.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:17.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:17.299 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.299 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.299 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.300 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:17.300 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:17.300 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.775592625999998, 2024-09-12T22:05:17.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:17.300 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.300 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.300 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.300 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.300 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.300 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.300 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:17.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.301 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:17.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:17.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:17.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:17.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:17.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:17.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:17.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:17.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:17.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:17.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:17.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:17.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:17.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:17.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:17.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:17.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:17.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:17.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:17.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:17.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:17.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:17.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:17.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:17.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:17.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:17.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:17.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:17.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:17.307 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.307 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.307 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.307 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:17.307 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:17.307 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 38.230378530000003, 2024-09-12T22:05:17.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:17.307 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.308 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.308 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.308 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:17.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.308 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:17.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:17.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:17.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:17.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:17.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:17.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:17.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:17.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:17.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:17.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:17.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:17.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:17.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:17.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:17.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:17.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:17.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:17.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:17.314 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.314 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.314 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.314 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:17.314 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:17.314 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 38.229900041999997, 2024-09-12T22:05:17.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:17.314 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.314 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.314 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.315 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.315 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.315 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.315 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:17.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.315 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:17.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:17.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:17.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:17.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:17.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:17.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:17.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:17.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:17.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:17.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:17.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:17.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:17.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:17.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:17.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:17.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:17.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:17.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:17.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:17.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:17.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:17.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:17.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:17.321 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.321 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.321 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.321 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:17.321 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:17.321 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 38.227404741999997, 2024-09-12T22:05:17.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:17.321 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.321 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.321 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.322 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.322 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.322 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.322 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:17.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.322 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:17.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:17.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:17.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:17.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:17.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:17.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:17.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:17.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:17.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:17.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:17.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:17.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:17.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:17.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:17.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:17.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:17.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:17.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:17.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:17.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:17.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:17.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:17.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:17.328 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.328 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.328 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.328 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:17.328 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:17.328 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 38.226323950999998, 2024-09-12T22:05:17.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:17.329 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.329 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.329 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.329 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:17.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.329 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:17.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:17.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:17.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:17.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:17.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:17.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:17.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:17.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:17.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:17.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:17.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:17.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:17.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:17.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:17.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:17.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:17.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:17.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:17.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:17.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:17.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:17.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:17.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:17.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.335 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.335 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:17.335 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:17.335 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 38.225088389, 2024-09-12T22:05:17.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:17.336 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.336 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.336 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.336 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:17.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.336 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:17.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:17.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:17.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:17.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:17.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:17.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:17.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:17.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:17.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:17.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:17.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:17.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:17.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:17.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:17.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:17.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:17.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:17.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:17.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:17.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:17.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:17.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:17.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:17.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.342 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.342 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:17.342 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:17.342 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.7843479010000003, 2024-09-12T22:05:17.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:17.343 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.343 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.343 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.343 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:17.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.343 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:17.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:17.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:17.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:17.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:17.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:17.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:17.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:17.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:17.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:17.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:17.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:17.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:17.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:17.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:17.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:17.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:17.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:17.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:17.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:17.348 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.348 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.348 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.348 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:17.348 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:17.348 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.7798174739999997, 2024-09-12T22:05:17.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:17.349 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.349 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.349 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.349 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.349 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.349 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.349 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:17.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.349 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:17.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:17.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:17.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:17.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:17.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:17.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:17.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:17.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:17.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:17.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:17.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:17.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:17.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:17.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:17.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:17.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:17.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:17.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:17.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:17.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:17.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:17.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:17.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:17.355 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.355 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.355 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.355 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:17.355 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:17.355 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.7797934450000001, 2024-09-12T22:05:17.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:17.356 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.356 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.356 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.356 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.356 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.356 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.356 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:17.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.356 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:17.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:17.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:17.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:17.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:17.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:17.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:17.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:17.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:17.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:17.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:17.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:17.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:17.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:17.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:17.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:17.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:17.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:17.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:17.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:17.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:17.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:17.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:17.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:17.362 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.362 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.362 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.362 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:17.362 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:17.362 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.7796157959999999, 2024-09-12T22:05:17.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:17.363 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.363 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.363 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.363 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.363 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.363 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.363 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:17.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.363 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:17.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:17.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:17.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:17.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:17.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:17.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:17.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:17.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:17.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:17.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:17.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:17.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:17.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:17.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:17.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:17.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:17.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.369 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.369 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:17.369 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:17.369 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.7775972590000002, 2024-09-12T22:05:17.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:17.370 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:17.370 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:17.370 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:17.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:17.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.370 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:17.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.370 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:17.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:17.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:17.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:17.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:17.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:17.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:17.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:17.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:17.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:17.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:17.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:17.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:17.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:17.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:17.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:17.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:17.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:17.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:17.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:17.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:17.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:17.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:17.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:17.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:17.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:17.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:17.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:17.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:17.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:17.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:17.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:17.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:17.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:17.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:17.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:17.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:17.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:17.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:17.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:17.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.377 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:17.377 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:17.377 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:17.379 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:17.379 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:17.377+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:17.480 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:17.478+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:17.534 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:17.534 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:17.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.534 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:229540 5.3 e55/40 5:c4cf8c0c:::benchmark_data_smithi043_32659_object62302:head v 55'14252, mlcod=55'14249)", 2024-09-12T22:05:17.534 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.524969+0000", 2024-09-12T22:05:17.534 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0062054550000000003, 2024-09-12T22:05:17.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0062270119999999997, 2024-09-12T22:05:17.534 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.534 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.534 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:17.535 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.524969+0000", 2024-09-12T22:05:17.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.524969+0000", 2024-09-12T22:05:17.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.524969+0000", 2024-09-12T22:05:17.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9700000000000003e-07 2024-09-12T22:05:17.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.524972+0000", 2024-09-12T22:05:17.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7030000000000002e-06 2024-09-12T22:05:17.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.524977+0000", 2024-09-12T22:05:17.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7810000000000002e-06 2024-09-12T22:05:17.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.524981+0000", 2024-09-12T22:05:17.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8879999999999999e-06 2024-09-12T22:05:17.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:17.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.526982+0000", 2024-09-12T22:05:17.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020004889999999998 2024-09-12T22:05:17.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:17.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.527000+0000", 2024-09-12T22:05:17.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8800999999999998e-05 2024-09-12T22:05:17.537 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:229546 5.b 5.5e7a572b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.525808+0000", 2024-09-12T22:05:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0053660870000000003, 2024-09-12T22:05:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0054469200000000001, 2024-09-12T22:05:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.539 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 229546 2024-09-12T22:05:17.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.539 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.539 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.525808+0000", 2024-09-12T22:05:17.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.539 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.525808+0000", 2024-09-12T22:05:17.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.525809+0000", 2024-09-12T22:05:17.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8899999999999998e-07 2024-09-12T22:05:17.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.525814+0000", 2024-09-12T22:05:17.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1880000000000001e-06 2024-09-12T22:05:17.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.525828+0000", 2024-09-12T22:05:17.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3895e-05 2024-09-12T22:05:17.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.525834+0000", 2024-09-12T22:05:17.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1279999999999996e-06 2024-09-12T22:05:17.541 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.541 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.541 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.541 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:229550 5.4 5:288bdb7d:::benchmark_data_smithi043_32659_object62312:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:17.541 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.526656+0000", 2024-09-12T22:05:17.541 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0045181259999999999, 2024-09-12T22:05:17.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046567589999999999, 2024-09-12T22:05:17.541 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.542 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.542 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:17.542 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:17.542 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:17.542 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.542 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 229550 2024-09-12T22:05:17.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.542 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.526656+0000", 2024-09-12T22:05:17.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.526656+0000", 2024-09-12T22:05:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.526657+0000", 2024-09-12T22:05:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2799999999999995e-07 2024-09-12T22:05:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.526659+0000", 2024-09-12T22:05:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7879999999999998e-06 2024-09-12T22:05:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.526667+0000", 2024-09-12T22:05:17.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1899999999999998e-06 2024-09-12T22:05:17.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.526672+0000", 2024-09-12T22:05:17.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2970000000000003e-06 2024-09-12T22:05:17.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:17.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.526738+0000", 2024-09-12T22:05:17.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5936e-05 2024-09-12T22:05:17.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:17.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.528569+0000", 2024-09-12T22:05:17.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018308319999999999 2024-09-12T22:05:17.545 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.545 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.545 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:229545 5.3 e55/40 5:c4b79547:::benchmark_data_smithi043_32659_object62307:head v 55'14253, mlcod=55'14249)", 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.526789+0000", 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0043853490000000002, 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045876809999999997, 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.526789+0000", 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.546 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.526789+0000", 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.526789+0000", 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4799999999999998e-07 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.526795+0000", 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.526916+0000", 2024-09-12T22:05:17.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000120327 2024-09-12T22:05:17.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.526924+0000", 2024-09-12T22:05:17.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0569999999999993e-06 2024-09-12T22:05:17.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:17.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530880+0000", 2024-09-12T22:05:17.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0039558900000000001 2024-09-12T22:05:17.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530899+0000", 2024-09-12T22:05:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9470000000000002e-05 2024-09-12T22:05:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:229528 5.b 5:de3cdd2c:::benchmark_data_smithi043_32659_object62290:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.520104+0000", 2024-09-12T22:05:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.011070025000000001, 2024-09-12T22:05:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011336916000000001, 2024-09-12T22:05:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 229528 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.520104+0000", 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.551 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.520104+0000", 2024-09-12T22:05:17.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.551 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.520105+0000", 2024-09-12T22:05:17.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8599999999999998e-07 2024-09-12T22:05:17.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.520108+0000", 2024-09-12T22:05:17.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5439999999999999e-06 2024-09-12T22:05:17.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.520117+0000", 2024-09-12T22:05:17.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8459999999999997e-06 2024-09-12T22:05:17.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.520125+0000", 2024-09-12T22:05:17.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6190000000000002e-06 2024-09-12T22:05:17.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:17.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.521461+0000", 2024-09-12T22:05:17.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001336435 2024-09-12T22:05:17.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:17.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.521569+0000", 2024-09-12T22:05:17.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000108328 2024-09-12T22:05:17.553 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.553 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.553 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:229553 5.a 5:5f884818:::benchmark_data_smithi043_32659_object62315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.527427+0000", 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0037472579999999998, 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040809119999999999, 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 229553 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.527427+0000", 2024-09-12T22:05:17.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.527427+0000", 2024-09-12T22:05:17.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.556 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.527427+0000", 2024-09-12T22:05:17.556 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999997e-07 2024-09-12T22:05:17.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.556 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.527430+0000", 2024-09-12T22:05:17.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.43e-06 2024-09-12T22:05:17.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.557 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.527438+0000", 2024-09-12T22:05:17.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7630000000000006e-06 2024-09-12T22:05:17.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.527444+0000", 2024-09-12T22:05:17.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2610000000000001e-06 2024-09-12T22:05:17.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:17.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.527484+0000", 2024-09-12T22:05:17.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.019e-05 2024-09-12T22:05:17.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.527629+0000", 2024-09-12T22:05:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014509700000000001 2024-09-12T22:05:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.531384+0000", 2024-09-12T22:05:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037546989999999998 2024-09-12T22:05:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.531436+0000", 2024-09-12T22:05:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2009999999999998e-05 2024-09-12T22:05:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.560 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:17.560 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.531514+0000", 2024-09-12T22:05:17.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8306999999999994e-05 2024-09-12T22:05:17.560 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.560 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.560 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.560 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:229547 5.3 e55/40)", 2024-09-12T22:05:17.560 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.528705+0000", 2024-09-12T22:05:17.560 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0024691940000000001, 2024-09-12T22:05:17.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028814539999999999, 2024-09-12T22:05:17.560 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.561 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.561 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:17.561 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.528705+0000", 2024-09-12T22:05:17.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.528705+0000", 2024-09-12T22:05:17.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.528706+0000", 2024-09-12T22:05:17.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8400000000000003e-07 2024-09-12T22:05:17.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.528710+0000", 2024-09-12T22:05:17.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2230000000000001e-06 2024-09-12T22:05:17.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.528718+0000", 2024-09-12T22:05:17.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4999999999999999e-06 2024-09-12T22:05:17.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.563 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.563 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.528724+0000", 2024-09-12T22:05:17.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6969999999999998e-06 2024-09-12T22:05:17.563 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.563 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.563 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.563 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:229556 5.a 5:58926c34:::benchmark_data_smithi043_32659_object62318:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:17.563 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.529630+0000", 2024-09-12T22:05:17.563 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001544213, 2024-09-12T22:05:17.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002004512, 2024-09-12T22:05:17.564 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.564 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.564 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:17.564 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:17.564 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:17.564 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.564 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 229556 2024-09-12T22:05:17.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.564 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529630+0000", 2024-09-12T22:05:17.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529630+0000", 2024-09-12T22:05:17.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529630+0000", 2024-09-12T22:05:17.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1900000000000002e-07 2024-09-12T22:05:17.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529635+0000", 2024-09-12T22:05:17.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7269999999999998e-06 2024-09-12T22:05:17.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529641+0000", 2024-09-12T22:05:17.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1179999999999997e-06 2024-09-12T22:05:17.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529646+0000", 2024-09-12T22:05:17.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.425e-06 2024-09-12T22:05:17.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.567 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:17.567 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529696+0000", 2024-09-12T22:05:17.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9793000000000003e-05 2024-09-12T22:05:17.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.567 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:17.567 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529880+0000", 2024-09-12T22:05:17.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000184148 2024-09-12T22:05:17.567 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.567 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.567 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.568 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:229558 5.e 5:78ec615c:::benchmark_data_smithi043_32659_object62320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:17.568 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.529779+0000", 2024-09-12T22:05:17.568 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0013946329999999999, 2024-09-12T22:05:17.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001933155, 2024-09-12T22:05:17.568 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.568 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.568 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:17.568 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:17.568 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:17.568 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.568 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 229558 2024-09-12T22:05:17.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.568 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529779+0000", 2024-09-12T22:05:17.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529779+0000", 2024-09-12T22:05:17.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529780+0000", 2024-09-12T22:05:17.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3399999999999999e-07 2024-09-12T22:05:17.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.570 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.570 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529786+0000", 2024-09-12T22:05:17.570 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7649999999999999e-06 2024-09-12T22:05:17.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.570 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.570 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529794+0000", 2024-09-12T22:05:17.570 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8390000000000007e-06 2024-09-12T22:05:17.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.570 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.570 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529799+0000", 2024-09-12T22:05:17.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9139999999999996e-06 2024-09-12T22:05:17.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:17.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529920+0000", 2024-09-12T22:05:17.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000120945 2024-09-12T22:05:17.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:17.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530247+0000", 2024-09-12T22:05:17.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00032625900000000002 2024-09-12T22:05:17.571 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.571 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.571 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.572 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:229559 5.a 5:577002ce:::benchmark_data_smithi043_32659_object62321:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:17.572 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.529938+0000", 2024-09-12T22:05:17.572 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001235838, 2024-09-12T22:05:17.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001839617, 2024-09-12T22:05:17.572 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.572 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.572 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:17.572 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:17.572 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:17.572 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.572 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 229559 2024-09-12T22:05:17.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.573 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529938+0000", 2024-09-12T22:05:17.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529938+0000", 2024-09-12T22:05:17.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529939+0000", 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4199999999999996e-07 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529942+0000", 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1300000000000001e-06 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529947+0000", 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7990000000000001e-06 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529950+0000", 2024-09-12T22:05:17.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6289999999999999e-06 2024-09-12T22:05:17.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.575 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:17.575 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.531631+0000", 2024-09-12T22:05:17.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0016803880000000001 2024-09-12T22:05:17.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.575 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:17.575 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.531782+0000", 2024-09-12T22:05:17.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000151741 2024-09-12T22:05:17.575 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.575 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.575 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.576 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:229560 5.d 5:bac190af:::benchmark_data_smithi043_32659_object62322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:17.576 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.529960+0000", 2024-09-12T22:05:17.576 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001213708, 2024-09-12T22:05:17.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018866829999999999, 2024-09-12T22:05:17.576 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.576 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.576 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:17.576 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:17.576 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:17.576 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.576 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 229560 2024-09-12T22:05:17.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529960+0000", 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529960+0000", 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529961+0000", 2024-09-12T22:05:17.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:05:17.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529962+0000", 2024-09-12T22:05:17.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7630000000000001e-06 2024-09-12T22:05:17.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529966+0000", 2024-09-12T22:05:17.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9169999999999999e-06 2024-09-12T22:05:17.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.529969+0000", 2024-09-12T22:05:17.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8380000000000002e-06 2024-09-12T22:05:17.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:17.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530004+0000", 2024-09-12T22:05:17.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5222999999999998e-05 2024-09-12T22:05:17.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:17.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530158+0000", 2024-09-12T22:05:17.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015360499999999999 2024-09-12T22:05:17.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:17.580 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530263+0000", 2024-09-12T22:05:17.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105154 2024-09-12T22:05:17.580 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.580 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.580 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.580 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.580 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:229561 5.9 5:9a653607:::benchmark_data_smithi043_32659_object62323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:17.580 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.530064+0000", 2024-09-12T22:05:17.580 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001109856, 2024-09-12T22:05:17.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001853363, 2024-09-12T22:05:17.581 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.581 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.581 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:17.581 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:17.581 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:17.581 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.581 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 229561 2024-09-12T22:05:17.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.581 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.581 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.581 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530064+0000", 2024-09-12T22:05:17.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530064+0000", 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530065+0000", 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0599999999999999e-07 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530069+0000", 2024-09-12T22:05:17.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7060000000000002e-06 2024-09-12T22:05:17.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530077+0000", 2024-09-12T22:05:17.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9100000000000005e-06 2024-09-12T22:05:17.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530082+0000", 2024-09-12T22:05:17.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5539999999999997e-06 2024-09-12T22:05:17.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:17.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530124+0000", 2024-09-12T22:05:17.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2200000000000003e-05 2024-09-12T22:05:17.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:17.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530286+0000", 2024-09-12T22:05:17.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016174200000000001 2024-09-12T22:05:17.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:17.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530390+0000", 2024-09-12T22:05:17.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104317 2024-09-12T22:05:17.584 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.584 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.585 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.585 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.585 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.585 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:229555 5.c e55/40 5:3c718e12:::benchmark_data_smithi043_32659_object62317:head v 55'14400, mlcod=55'14398)", 2024-09-12T22:05:17.585 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.530230+0000", 2024-09-12T22:05:17.585 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00094444199999999998, 2024-09-12T22:05:17.585 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001760595, 2024-09-12T22:05:17.585 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.585 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.585 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:17.586 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530230+0000", 2024-09-12T22:05:17.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530230+0000", 2024-09-12T22:05:17.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530230+0000", 2024-09-12T22:05:17.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2399999999999997e-07 2024-09-12T22:05:17.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530236+0000", 2024-09-12T22:05:17.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.446e-06 2024-09-12T22:05:17.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530244+0000", 2024-09-12T22:05:17.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1799999999999996e-06 2024-09-12T22:05:17.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530250+0000", 2024-09-12T22:05:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.071e-06 2024-09-12T22:05:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530381+0000", 2024-09-12T22:05:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013096200000000001 2024-09-12T22:05:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.530400+0000", 2024-09-12T22:05:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8734000000000001e-05 2024-09-12T22:05:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.589 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.589 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.589 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:229539 5.b 5:df39fb24:::benchmark_data_smithi043_32659_object62301:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:17.589 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.523081+0000", 2024-09-12T22:05:17.589 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0080928920000000008, 2024-09-12T22:05:17.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0089684510000000005, 2024-09-12T22:05:17.589 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.589 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.589 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:17.589 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:17.589 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:17.589 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.589 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 229539 2024-09-12T22:05:17.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.590 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.590 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523081+0000", 2024-09-12T22:05:17.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.590 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523081+0000", 2024-09-12T22:05:17.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523082+0000", 2024-09-12T22:05:17.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1399999999999997e-07 2024-09-12T22:05:17.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523084+0000", 2024-09-12T22:05:17.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4849999999999999e-06 2024-09-12T22:05:17.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523091+0000", 2024-09-12T22:05:17.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5030000000000002e-06 2024-09-12T22:05:17.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.592 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.592 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523096+0000", 2024-09-12T22:05:17.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1959999999999999e-06 2024-09-12T22:05:17.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.592 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:17.592 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523178+0000", 2024-09-12T22:05:17.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1761000000000005e-05 2024-09-12T22:05:17.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.592 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:17.592 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523348+0000", 2024-09-12T22:05:17.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017022599999999999 2024-09-12T22:05:17.592 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.593 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.593 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.593 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:229562 5.d 5:b9423546:::benchmark_data_smithi043_32659_object62324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:17.593 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.531816+0000", 2024-09-12T22:05:17.593 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9993577, 2024-09-12T22:05:17.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00030275400000000002, 2024-09-12T22:05:17.593 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.593 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.593 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:17.593 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:17.593 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:17.593 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:17.594 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 229562 2024-09-12T22:05:17.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.594 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.594 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.594 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.531816+0000", 2024-09-12T22:05:17.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.594 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.594 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.531816+0000", 2024-09-12T22:05:17.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.531817+0000", 2024-09-12T22:05:17.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.155e-06 2024-09-12T22:05:17.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.531828+0000", 2024-09-12T22:05:17.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0186e-05 2024-09-12T22:05:17.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.531837+0000", 2024-09-12T22:05:17.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1209999999999996e-06 2024-09-12T22:05:17.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.531843+0000", 2024-09-12T22:05:17.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3949999999999998e-06 2024-09-12T22:05:17.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:17.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.531956+0000", 2024-09-12T22:05:17.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000113167 2024-09-12T22:05:17.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:17.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.532099+0000", 2024-09-12T22:05:17.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014306400000000001 2024-09-12T22:05:17.597 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.597 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.597 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.597 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.597 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.597 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:229531 5.3 e55/40 5:c9a3cd22:::benchmark_data_smithi043_32659_object62293:head v 55'14251, mlcod=55'14249)", 2024-09-12T22:05:17.597 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:17.523461+0000", 2024-09-12T22:05:17.597 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0077134730000000002, 2024-09-12T22:05:17.597 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0087238929999999999, 2024-09-12T22:05:17.597 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:17.597 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:17.597 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:17.597 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:17.597 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523461+0000", 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523461+0000", 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523461+0000", 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523466+0000", 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6260000000000003e-06 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523545+0000", 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9167999999999998e-05 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523559+0000", 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3833e-05 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523597+0000", 2024-09-12T22:05:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8050000000000003e-05 2024-09-12T22:05:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:17.523615+0000", 2024-09-12T22:05:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7929000000000001e-05 2024-09-12T22:05:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 16 2024-09-12T22:05:17.601 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:17.602 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:17.602 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:17.600+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:17.703 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:17.701+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:17.796 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:17.796 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:17.796 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:17.796 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:17.796 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:17.803 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:17.802+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:17.809 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:17.903 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:17.901+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:18.004 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:18.003+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:18.005 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:18.005 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:18.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:18.005 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:18.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.006 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:18.006 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:18.006 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 73.375550208000007, 2024-09-12T22:05:18.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:05:18.006 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.006 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.006 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.006 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:18.006 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:18.006 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.006 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:05:18.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.006 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:18.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:18.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:05:18.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:05:18.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:05:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:05:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:05:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:05:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:05:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:05:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:05:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:05:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:05:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:05:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:05:18.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:05:18.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:18.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:05:18.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:05:18.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:05:18.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:05:18.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:05:18.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:05:18.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:05:18.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:05:18.011 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.011 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.011 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.011 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:18.012 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:18.012 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 73.370149268000006, 2024-09-12T22:05:18.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:05:18.012 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.012 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.012 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.012 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:18.012 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:18.012 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.012 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:05:18.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.012 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:18.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:18.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:18.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:18.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:05:18.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:05:18.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:05:18.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:05:18.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:05:18.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:05:18.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:05:18.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:05:18.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:05:18.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:18.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:05:18.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:05:18.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:05:18.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:05:18.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:05:18.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:05:18.017 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.017 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.017 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.020 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.020 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:18.020 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.004461382000002, 2024-09-12T22:05:18.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:18.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:18.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:05:18.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:05:18.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:05:18.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:05:18.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:05:18.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:05:18.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:05:18.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:05:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:05:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:05:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:05:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:05:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:05:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:05:18.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:05:18.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:18.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:05:18.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:05:18.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:05:18.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:05:18.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:05:18.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:05:18.026 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.026 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.026 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.026 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.026 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:18.026 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.003828177000003, 2024-09-12T22:05:18.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:18.027 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.027 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.027 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.027 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:18.027 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:18.027 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.027 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:18.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.027 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:18.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:18.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:18.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:18.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:18.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:18.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:18.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:18.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:18.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:18.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:18.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:18.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:18.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:18.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:18.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:18.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:18.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:18.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:18.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:18.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:18.032 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.032 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.032 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.032 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.032 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:18.032 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.002008514000003, 2024-09-12T22:05:18.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:18.032 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.032 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.032 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.032 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:18.033 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:18.033 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.033 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:18.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.033 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:18.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:18.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:18.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:18.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:18.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:18.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.001840887, 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.037 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:18.038 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:18.038 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.038 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:05:18.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.038 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:18.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:18.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:05:18.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:05:18.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:05:18.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:05:18.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:05:18.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:05:18.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:05:18.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:05:18.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:05:18.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:05:18.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:05:18.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:05:18.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:18.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:05:18.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:05:18.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:05:18.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.001700223, 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:05:18.042 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.043 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.043 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.043 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:18.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:18.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:05:18.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:05:18.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:05:18.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:05:18.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:05:18.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:05:18.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:05:18.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:05:18.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:05:18.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:05:18.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:05:18.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:05:18.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:05:18.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:05:18.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:05:18.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:05:18.046 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.046 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.047 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.047 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.047 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:18.047 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.001474700000003, 2024-09-12T22:05:18.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:18.047 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.047 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.047 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.047 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:18.047 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:18.047 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.047 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:18.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.048 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:18.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:18.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:18.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:18.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:18.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:18.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:18.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:18.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:18.052 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.052 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.052 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.052 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.052 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:18.052 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.001354996000003, 2024-09-12T22:05:18.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:05:18.052 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.052 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.052 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.052 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:18.053 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:18.053 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.053 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:05:18.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.053 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:18.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:18.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:05:18.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:05:18.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:05:18.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:05:18.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:05:18.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:05:18.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:05:18.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:05:18.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:05:18.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:05:18.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:05:18.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:18.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:05:18.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:05:18.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:05:18.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:05:18.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:05:18.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:05:18.058 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.058 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.058 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.058 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:05:18.058 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:18.058 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.000763714000001, 2024-09-12T22:05:18.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:05:18.058 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.058 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.058 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:18.058 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:18.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:18.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:05:18.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:05:18.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:05:18.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:05:18.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:05:18.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:05:18.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:05:18.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:05:18.062 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.062 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.062 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.062 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:05:18.062 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:18.062 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.000540145999999, 2024-09-12T22:05:18.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:05:18.062 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:18.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:05:18.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:05:18.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:05:18.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:05:18.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:05:18.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:05:18.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:05:18.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:05:18.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:05:18.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:05:18.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:05:18.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:05:18.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:05:18.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:05:18.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:05:18.066 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.066 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.066 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.000448665, 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:18.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:18.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:05:18.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:05:18.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:05:18.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:05:18.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:05:18.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:05:18.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:05:18.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:05:18.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:05:18.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:05:18.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:05:18.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:05:18.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:05:18.071 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.071 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.071 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.072 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.072 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:18.072 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.999659860999998, 2024-09-12T22:05:18.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:18.072 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.072 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.072 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.072 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:18.072 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:18.072 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.072 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:18.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.073 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:18.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:18.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:18.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:18.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:18.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:18.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:18.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:18.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:18.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:18.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:18.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:18.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:18.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:18.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:18.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:18.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:18.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:18.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:18.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:18.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:18.077 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.077 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.077 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.077 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.077 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:18.077 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.999395720999999, 2024-09-12T22:05:18.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:05:18.077 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.077 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.077 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.077 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:18.078 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:18.078 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.078 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:05:18.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.078 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:18.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:18.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:05:18.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:05:18.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:05:18.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:05:18.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:05:18.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:05:18.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:05:18.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:05:18.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:05:18.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:05:18.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:05:18.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:05:18.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:18.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:05:18.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:05:18.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:05:18.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:05:18.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:05:18.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:05:18.082 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.082 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.082 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.082 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:05:18.082 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:18.082 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.998890746000001, 2024-09-12T22:05:18.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:05:18.083 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.083 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.083 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.083 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:18.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:18.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:05:18.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:05:18.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:05:18.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:05:18.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:05:18.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:05:18.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:05:18.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:05:18.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:05:18.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:05:18.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.087 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:05:18.087 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:18.087 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.997761318000002, 2024-09-12T22:05:18.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:05:18.087 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.087 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.087 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.087 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:18.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:18.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:18.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:18.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:05:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:05:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:05:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:05:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:05:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:05:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:05:18.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:05:18.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:05:18.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:05:18.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:05:18.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:05:18.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:05:18.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:05:18.091 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.091 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.091 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.091 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.091 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:18.091 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.997006876, 2024-09-12T22:05:18.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:05:18.091 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.091 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.092 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.092 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:18.092 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:18.092 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.092 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:05:18.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.092 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:18.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:18.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:05:18.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:18.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:05:18.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:05:18.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:05:18.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:05:18.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:05:18.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:05:18.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:05:18.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:05:18.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:05:18.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:05:18.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:18.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:05:18.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:05:18.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:05:18.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:05:18.097 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.097 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.097 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.097 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:05:18.097 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:18.097 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.996327774000001, 2024-09-12T22:05:18.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:05:18.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:05:18.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:05:18.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:05:18.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:05:18.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:05:18.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:05:18.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:05:18.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:05:18.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:05:18.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.102 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:207316 5.d 5:b199774a:::benchmark_data_smithi043_32659_object40078:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:18.102 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:18.102 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.5538662530000007, 2024-09-12T22:05:18.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095080382000000005, 2024-09-12T22:05:18.102 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.102 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.102 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.102 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:18.102 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:18.102 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.102 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 207316 2024-09-12T22:05:18.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.102 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:18.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:18.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447981+0000", 2024-09-12T22:05:18.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1999999999999998e-07 2024-09-12T22:05:18.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447985+0000", 2024-09-12T22:05:18.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1910000000000002e-06 2024-09-12T22:05:18.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447999+0000", 2024-09-12T22:05:18.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4185000000000001e-05 2024-09-12T22:05:18.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448006+0000", 2024-09-12T22:05:18.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8929999999999999e-06 2024-09-12T22:05:18.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448050+0000", 2024-09-12T22:05:18.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4406999999999997e-05 2024-09-12T22:05:18.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448236+0000", 2024-09-12T22:05:18.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018612899999999999 2024-09-12T22:05:18.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:18.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448357+0000", 2024-09-12T22:05:18.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000120303 2024-09-12T22:05:18.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:18.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450305+0000", 2024-09-12T22:05:18.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001947952 2024-09-12T22:05:18.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.542919+0000", 2024-09-12T22:05:18.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092613928999999998 2024-09-12T22:05:18.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.542971+0000", 2024-09-12T22:05:18.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2083000000000003e-05 2024-09-12T22:05:18.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.543060+0000", 2024-09-12T22:05:18.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9489999999999999e-05 2024-09-12T22:05:18.107 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.107 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.107 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.108 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:207325 5.9 5:98263198:::benchmark_data_smithi043_32659_object40087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:18.108 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:18.108 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.5517172810000002, 2024-09-12T22:05:18.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.089568523999999997, 2024-09-12T22:05:18.108 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:18.108 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:18.108 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.108 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:18.108 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:18.108 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.108 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 207325 2024-09-12T22:05:18.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.108 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:18.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:18.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:18.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:18.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:18.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:18.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:18.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:18.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3399999999999999e-07 2024-09-12T22:05:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450132+0000", 2024-09-12T22:05:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:05:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450139+0000", 2024-09-12T22:05:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6290000000000004e-06 2024-09-12T22:05:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450144+0000", 2024-09-12T22:05:18.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3290000000000001e-06 2024-09-12T22:05:18.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:18.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450205+0000", 2024-09-12T22:05:18.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0504999999999998e-05 2024-09-12T22:05:18.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:18.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450373+0000", 2024-09-12T22:05:18.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000168314 2024-09-12T22:05:18.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:18.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450485+0000", 2024-09-12T22:05:18.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011231299999999999 2024-09-12T22:05:18.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:18.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.452226+0000", 2024-09-12T22:05:18.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017412409999999999 2024-09-12T22:05:18.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539592+0000", 2024-09-12T22:05:18.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.087365211999999998 2024-09-12T22:05:18.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:18.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539633+0000", 2024-09-12T22:05:18.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1165000000000003e-05 2024-09-12T22:05:18.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:18.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:18.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:18.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539697+0000", 2024-09-12T22:05:18.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4519999999999999e-05 2024-09-12T22:05:18.113 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.113 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.113 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.113 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:18.113 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:18.113 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:18.115 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:18.113+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:18.115 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:18.216 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:18.214+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:18.266 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:231567 5.6 5:6403524f:::benchmark_data_smithi043_32659_object64329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:18.257653+0000", 2024-09-12T22:05:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0069249130000000004, 2024-09-12T22:05:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069418930000000002, 2024-09-12T22:05:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 231567 2024-09-12T22:05:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.257653+0000", 2024-09-12T22:05:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.257653+0000", 2024-09-12T22:05:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.257653+0000", 2024-09-12T22:05:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2200000000000003e-07 2024-09-12T22:05:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.257658+0000", 2024-09-12T22:05:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7269999999999998e-06 2024-09-12T22:05:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.257667+0000", 2024-09-12T22:05:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999995e-06 2024-09-12T22:05:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.257673+0000", 2024-09-12T22:05:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-09-12T22:05:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.260561+0000", 2024-09-12T22:05:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0028875340000000002 2024-09-12T22:05:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.260716+0000", 2024-09-12T22:05:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015541400000000001 2024-09-12T22:05:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.260840+0000", 2024-09-12T22:05:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012354799999999999 2024-09-12T22:05:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262665+0000", 2024-09-12T22:05:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018255809999999999 2024-09-12T22:05:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:231573 5.9 e55/40 5:955cf719:::benchmark_data_smithi043_32659_object64335:head v 55'14532, mlcod=55'14528)", 2024-09-12T22:05:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:18.262380+0000", 2024-09-12T22:05:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0021971930000000001, 2024-09-12T22:05:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022641200000000001, 2024-09-12T22:05:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262380+0000", 2024-09-12T22:05:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262380+0000", 2024-09-12T22:05:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262381+0000", 2024-09-12T22:05:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0399999999999996e-07 2024-09-12T22:05:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262387+0000", 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6690000000000003e-06 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262395+0000", 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0909999999999993e-06 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262399+0000", 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0210000000000001e-06 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262448+0000", 2024-09-12T22:05:18.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9196999999999997e-05 2024-09-12T22:05:18.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262461+0000", 2024-09-12T22:05:18.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2923e-05 2024-09-12T22:05:18.274 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.274 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.274 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.275 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:231578 5.3 5:c8b5fab3:::benchmark_data_smithi043_32659_object64340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:18.275 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:18.262432+0000", 2024-09-12T22:05:18.275 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0021456800000000001, 2024-09-12T22:05:18.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002245815, 2024-09-12T22:05:18.275 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.275 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.275 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:18.275 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.275 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.275 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.275 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 231578 2024-09-12T22:05:18.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.275 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262432+0000", 2024-09-12T22:05:18.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262432+0000", 2024-09-12T22:05:18.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262433+0000", 2024-09-12T22:05:18.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9500000000000001e-07 2024-09-12T22:05:18.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262437+0000", 2024-09-12T22:05:18.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:05:18.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262446+0000", 2024-09-12T22:05:18.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6030000000000005e-06 2024-09-12T22:05:18.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262452+0000", 2024-09-12T22:05:18.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5189999999999998e-06 2024-09-12T22:05:18.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262504+0000", 2024-09-12T22:05:18.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1919000000000002e-05 2024-09-12T22:05:18.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262688+0000", 2024-09-12T22:05:18.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018431900000000001 2024-09-12T22:05:18.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262775+0000", 2024-09-12T22:05:18.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6930999999999998e-05 2024-09-12T22:05:18.279 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.279 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.279 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.279 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:231579 5.1 5:82c1f13d:::benchmark_data_smithi043_32659_object64341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:18.279 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:18.263030+0000", 2024-09-12T22:05:18.279 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001547407, 2024-09-12T22:05:18.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001685544, 2024-09-12T22:05:18.279 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.280 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.280 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:18.280 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.280 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.280 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.280 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 231579 2024-09-12T22:05:18.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.280 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263030+0000", 2024-09-12T22:05:18.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263030+0000", 2024-09-12T22:05:18.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263031+0000", 2024-09-12T22:05:18.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0800000000000003e-07 2024-09-12T22:05:18.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263035+0000", 2024-09-12T22:05:18.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3649999999999997e-06 2024-09-12T22:05:18.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263050+0000", 2024-09-12T22:05:18.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4995e-05 2024-09-12T22:05:18.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263057+0000", 2024-09-12T22:05:18.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0219999999999999e-06 2024-09-12T22:05:18.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263107+0000", 2024-09-12T22:05:18.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9317999999999998e-05 2024-09-12T22:05:18.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263266+0000", 2024-09-12T22:05:18.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000159612 2024-09-12T22:05:18.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263404+0000", 2024-09-12T22:05:18.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013783400000000001 2024-09-12T22:05:18.283 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.283 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.283 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.284 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:231582 5.6 5:6d648e80:::benchmark_data_smithi043_32659_object64344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:18.284 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:18.263763+0000", 2024-09-12T22:05:18.284 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00081437100000000004, 2024-09-12T22:05:18.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00099096899999999996, 2024-09-12T22:05:18.284 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.284 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.284 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:18.284 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.284 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.284 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.284 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 231582 2024-09-12T22:05:18.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.285 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263763+0000", 2024-09-12T22:05:18.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263763+0000", 2024-09-12T22:05:18.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263764+0000", 2024-09-12T22:05:18.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4300000000000002e-07 2024-09-12T22:05:18.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263768+0000", 2024-09-12T22:05:18.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9530000000000001e-06 2024-09-12T22:05:18.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263776+0000", 2024-09-12T22:05:18.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5930000000000006e-06 2024-09-12T22:05:18.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263781+0000", 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.057e-06 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263822+0000", 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0683999999999999e-05 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263940+0000", 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118027 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264070+0000", 2024-09-12T22:05:18.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013027899999999999 2024-09-12T22:05:18.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.288 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.288 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:231583 5.1 5.7fb0b301 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:18.288 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:18.263793+0000", 2024-09-12T22:05:18.288 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00078435199999999999, 2024-09-12T22:05:18.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010128069999999999, 2024-09-12T22:05:18.288 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.288 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 231583 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263793+0000", 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263793+0000", 2024-09-12T22:05:18.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263793+0000", 2024-09-12T22:05:18.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0199999999999998e-07 2024-09-12T22:05:18.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263795+0000", 2024-09-12T22:05:18.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.694e-06 2024-09-12T22:05:18.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263799+0000", 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0099999999999997e-06 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263803+0000", 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6559999999999998e-06 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:231584 5.5 5:ad430469:::benchmark_data_smithi043_32659_object64346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:18.263808+0000", 2024-09-12T22:05:18.291 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00076918600000000005, 2024-09-12T22:05:18.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010419590000000001, 2024-09-12T22:05:18.292 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.292 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.292 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:18.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.292 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 231584 2024-09-12T22:05:18.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.292 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263808+0000", 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263808+0000", 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263809+0000", 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.27e-07 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263810+0000", 2024-09-12T22:05:18.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7579999999999999e-06 2024-09-12T22:05:18.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263816+0000", 2024-09-12T22:05:18.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0750000000000003e-06 2024-09-12T22:05:18.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263822+0000", 2024-09-12T22:05:18.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-12T22:05:18.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263864+0000", 2024-09-12T22:05:18.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2249000000000002e-05 2024-09-12T22:05:18.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264022+0000", 2024-09-12T22:05:18.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000158009 2024-09-12T22:05:18.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264141+0000", 2024-09-12T22:05:18.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011896399999999999 2024-09-12T22:05:18.295 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.295 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.296 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:231585 5.2 5:4399e7e5:::benchmark_data_smithi043_32659_object64347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:18.296 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:18.263831+0000", 2024-09-12T22:05:18.296 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00074615700000000001, 2024-09-12T22:05:18.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010743580000000001, 2024-09-12T22:05:18.296 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.296 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.296 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:18.296 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.296 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.296 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.296 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 231585 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263831+0000", 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263831+0000", 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263832+0000", 2024-09-12T22:05:18.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3799999999999998e-07 2024-09-12T22:05:18.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263833+0000", 2024-09-12T22:05:18.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.561e-06 2024-09-12T22:05:18.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263837+0000", 2024-09-12T22:05:18.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8700000000000002e-06 2024-09-12T22:05:18.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263840+0000", 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6970000000000002e-06 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263870+0000", 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0261999999999999e-05 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.263966+0000", 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6366999999999994e-05 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.299 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:231561 5.6 e55/40)", 2024-09-12T22:05:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:18.264341+0000", 2024-09-12T22:05:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000236429, 2024-09-12T22:05:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00059722200000000001, 2024-09-12T22:05:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264341+0000", 2024-09-12T22:05:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264341+0000", 2024-09-12T22:05:18.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264342+0000", 2024-09-12T22:05:18.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8400000000000004e-07 2024-09-12T22:05:18.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264345+0000", 2024-09-12T22:05:18.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5609999999999999e-06 2024-09-12T22:05:18.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264355+0000", 2024-09-12T22:05:18.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0147e-05 2024-09-12T22:05:18.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264361+0000", 2024-09-12T22:05:18.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9070000000000004e-06 2024-09-12T22:05:18.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.302 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:231567 5.6 e55/40)", 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:18.264378+0000", 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00019943900000000001, 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00058306000000000005, 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264378+0000", 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264378+0000", 2024-09-12T22:05:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264378+0000", 2024-09-12T22:05:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.22e-07 2024-09-12T22:05:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264380+0000", 2024-09-12T22:05:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9929999999999998e-06 2024-09-12T22:05:18.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264387+0000", 2024-09-12T22:05:18.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.793e-06 2024-09-12T22:05:18.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264391+0000", 2024-09-12T22:05:18.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.861e-06 2024-09-12T22:05:18.305 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.305 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.305 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "MOSDPGPushReply(5.6 55/40 [PushReplyOp(5:6e912aff:::benchmark_data_smithi043_32659_object104107:head)])", 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:18.264414+0000", 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000163215, 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00057078599999999999, 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264414+0000", 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264414+0000", 2024-09-12T22:05:18.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264414+0000", 2024-09-12T22:05:18.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4999999999999999e-07 2024-09-12T22:05:18.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264417+0000", 2024-09-12T22:05:18.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.745e-06 2024-09-12T22:05:18.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264424+0000", 2024-09-12T22:05:18.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1230000000000002e-06 2024-09-12T22:05:18.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.264429+0000", 2024-09-12T22:05:18.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.057e-06 2024-09-12T22:05:18.308 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.308 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.308 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.309 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:231561 5.6 5:6d1624c9:::benchmark_data_smithi043_32659_object64323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:05:18.309 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:18.257413+0000", 2024-09-12T22:05:18.309 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0071646000000000001, 2024-09-12T22:05:18.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0075983860000000004, 2024-09-12T22:05:18.309 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.309 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.309 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:18.309 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.309 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.309 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.309 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 231561 2024-09-12T22:05:18.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.257413+0000", 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.257413+0000", 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.257414+0000", 2024-09-12T22:05:18.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.540000000000001e-07 2024-09-12T22:05:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.257419+0000", 2024-09-12T22:05:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1399999999999999e-06 2024-09-12T22:05:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.257428+0000", 2024-09-12T22:05:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7199999999999995e-06 2024-09-12T22:05:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.257435+0000", 2024-09-12T22:05:18.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0210000000000002e-06 2024-09-12T22:05:18.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.258018+0000", 2024-09-12T22:05:18.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00058343499999999999 2024-09-12T22:05:18.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.258179+0000", 2024-09-12T22:05:18.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016048200000000001 2024-09-12T22:05:18.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.258321+0000", 2024-09-12T22:05:18.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014237399999999999 2024-09-12T22:05:18.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:18.262201+0000", 2024-09-12T22:05:18.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038800570000000001 2024-09-12T22:05:18.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.313 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.313 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:18.313 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 12 2024-09-12T22:05:18.313 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:18.314 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:18.355 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:18.354+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:18.418 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:18.417+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:18.499 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:18.499 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:18.504 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:05:18.512 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:18.553 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:18.552+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:18.620 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:18.619+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:18.708 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:18.708 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:18.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:18.708 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:18.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.708 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:18.708 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:18.708 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.294086776999997, 2024-09-12T22:05:18.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:18.708 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.708 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.709 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:18.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.709 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:18.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.709 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:18.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:18.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:18.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:18.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:18.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:18.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:18.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:18.712 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.713 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.713 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.713 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:18.713 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:18.713 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.293906847000002, 2024-09-12T22:05:18.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:18.713 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.713 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.713 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:18.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:18.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:18.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:18.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:18.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:18.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:18.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:18.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:18.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:18.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:18.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:18.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:18.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:18.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:18.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:18.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:18.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:18.717 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.717 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.717 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.293840406000001, 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:18.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:18.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:18.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:18.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:18.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:18.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:18.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:18.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:18.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:18.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:18.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:18.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:18.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:18.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:18.722 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.722 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.722 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.722 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:18.722 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:18.722 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.293783963000003, 2024-09-12T22:05:18.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:18.723 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.723 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.723 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.723 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:18.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.723 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:18.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:18.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:18.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:18.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:18.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:18.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:18.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:18.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:18.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:18.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:18.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:18.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:18.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:18.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:18.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:18.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:18.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:18.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:18.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:18.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:18.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:18.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:18.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:18.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.729 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.729 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:18.729 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:18.729 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.293715503000001, 2024-09-12T22:05:18.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:18.729 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.729 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.729 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.729 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.729 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.729 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.730 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:18.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.730 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:18.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:18.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:18.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:18.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:18.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:18.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:18.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:18.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:18.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:18.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:18.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:18.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:18.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:18.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:18.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:18.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:18.735 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.735 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.735 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.735 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:18.735 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:18.736 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.293657768000003, 2024-09-12T22:05:18.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:18.736 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.736 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.736 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.736 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.736 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.736 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.736 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:18.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.736 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:18.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:18.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:18.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:18.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:18.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:18.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:18.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:18.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:18.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:18.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:18.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:18.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:18.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:18.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:18.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:18.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:18.742 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.742 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.742 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.742 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:18.742 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:18.742 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.293590076000001, 2024-09-12T22:05:18.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:18.742 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.742 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.742 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.743 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:18.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.743 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:18.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:18.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:18.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:18.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:18.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:18.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:18.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:18.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:18.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:18.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:18.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:18.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:18.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:18.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:18.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:18.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:18.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:18.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:18.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:18.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:18.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:18.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:18.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:18.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:18.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:18.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:18.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:18.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:18.748 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.748 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.748 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.293535014, 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.749 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:18.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:18.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:18.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:18.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:18.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:18.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:18.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:18.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:18.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:18.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:18.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:18.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:18.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:18.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:18.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:18.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:18.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:18.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:18.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:18.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:18.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:18.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:18.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:18.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.755 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.755 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:18.755 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:18.755 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.252887493999999, 2024-09-12T22:05:18.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:18.755 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.756 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.756 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.756 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:18.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.756 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:18.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:18.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:18.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:18.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:18.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:18.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:18.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:18.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:18.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:18.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:18.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:18.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:18.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:18.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:18.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:18.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:18.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:18.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:18.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:18.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:18.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:18.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:18.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.762 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.762 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:18.762 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:18.762 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.250273765999999, 2024-09-12T22:05:18.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:18.762 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.762 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.762 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.762 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:18.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.763 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:18.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:18.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:18.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:18.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:18.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:18.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:18.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:18.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:18.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:18.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:18.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:18.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:18.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:18.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:18.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:18.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:18.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:18.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:18.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:18.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:18.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:18.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:18.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.768 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.768 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.768 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:18.768 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.705059669999997, 2024-09-12T22:05:18.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:18.769 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.769 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.769 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.769 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:18.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.769 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:18.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:18.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:18.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:18.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:18.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:18.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:18.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:18.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:18.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:18.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:18.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:18.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:18.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:18.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:18.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:18.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:18.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:18.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.774 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.774 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.774 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:18.774 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.704581181999998, 2024-09-12T22:05:18.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:18.774 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.774 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.775 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.775 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:18.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.775 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:18.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:18.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:18.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:18.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:18.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:18.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:18.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:18.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:18.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:18.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:18.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:18.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:18.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:18.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:18.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:18.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:18.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:18.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.780 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.780 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.780 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:18.780 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.702085881999999, 2024-09-12T22:05:18.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:18.780 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.781 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.781 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.781 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:18.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.781 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:18.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:18.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:18.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:18.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:18.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:18.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:18.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:18.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:18.785 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.786 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.786 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.786 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:18.786 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.701005090999999, 2024-09-12T22:05:18.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:18.786 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.786 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.786 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.786 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.786 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.786 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.787 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:18.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.787 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:18.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:18.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:18.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:18.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:18.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:18.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:18.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:18.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:18.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:18.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:18.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:18.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:18.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:18.791 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.791 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.791 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.792 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:18.792 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:18.792 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.699769529000001, 2024-09-12T22:05:18.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:18.792 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.792 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.792 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.792 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:18.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.792 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:18.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:18.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:18.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:18.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:18.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:18.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:18.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:18.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:18.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:18.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:18.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:18.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:18.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:18.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:18.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:18.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:18.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:18.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:18.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:18.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:18.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.797 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.2590290409999998, 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.798 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:18.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:18.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:18.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:18.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:18.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:18.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:18.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:18.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:18.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:18.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:18.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:18.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:18.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:18.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:18.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:18.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:18.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:18.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:18.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:18.802 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.802 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.2544986139999992, 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.804 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:18.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:18.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:18.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:18.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:18.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:18.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:18.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:18.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:18.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:18.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:18.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:18.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.808 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.809 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:18.809 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:18.809 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.2544745850000005, 2024-09-12T22:05:18.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:18.809 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.809 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.809 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.809 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:18.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.809 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:18.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:18.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:18.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:18.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:18.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:18.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:18.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:18.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:18.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:18.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:18.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:18.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:18.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:18.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:18.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.2542969359999994, 2024-09-12T22:05:18.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:18.815 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.815 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.815 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.815 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.815 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.815 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.815 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:18.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.815 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:18.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:18.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:18.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:18.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:18.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:18.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:18.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:18.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:18.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:18.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:18.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:18.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:18.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:18.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:18.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:18.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:18.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:18.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.820 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.820 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:18.820 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:18.820 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.2522783989999997, 2024-09-12T22:05:18.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:18.820 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:18.820 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:18.820 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:18.821 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:18.821 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:18.821 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:18.821 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:18.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.821 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:18.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:18.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:18.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:18.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:18.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:18.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:18.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:18.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:18.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:18.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:18.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:18.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:18.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:18.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:18.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:18.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:18.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:18.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:18.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:18.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:18.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:18.825 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.826 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.826 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.826 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:18.826 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:18.826 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:18.826 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:05:18.828 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:18.828 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:18.826+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:18.927 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:18.926+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:18.935 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:18.953 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:18.953 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:18.974 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:18.975 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:18.977 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:18.978 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:18.989 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:18.990 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:19.003 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:19.046 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:19.045+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:19.132 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:19.129+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:19.205 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:19.205 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:19.217 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:19.259 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:19.257+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:19.333 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:19.331+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:19.418 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:19.419 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:19.433 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:19.474 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:19.473+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:19.492 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-09-12T22:05:19.535 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:19.534+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:19.580 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:19.580 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:19.594 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:19.637 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:19.635+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:19.737 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:19.736+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:19.782 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:19.783 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:19.795 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:19.839 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:19.837+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:19.939 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:19.938+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:19.981 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:19.981 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:19.992 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:20.040 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:20.039+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:20.141 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:20.140+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:20.150 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:20.150 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:20.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:20.242 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:20.241+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:20.343 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:20.341+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:20.365 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:20.365 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:20.378 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:20.464 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:20.463+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:20.545 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:20.544+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:20.576 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:20.577 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:20.589 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:20.645 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:20.644+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:20.731 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:20.731 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:20.743 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:20.746 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:20.746+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:20.847 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:20.846+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:20.885 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:20.885 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:20.897 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:20.948 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:20.947+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:20.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:05:21.045 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:21.045 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:21.048 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:21.047+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:21.057 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:21.087 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:21.105 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:21.105 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:21.128 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:21.129 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:21.131 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:21.131 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:21.149 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:21.148+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:21.210 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:239732 5.e 5:79483025:::benchmark_data_smithi043_32659_object72494:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.205814+0000", 2024-09-12T22:05:21.210 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002338297, 2024-09-12T22:05:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023617970000000001, 2024-09-12T22:05:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 239732 2024-09-12T22:05:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205814+0000", 2024-09-12T22:05:21.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205814+0000", 2024-09-12T22:05:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205814+0000", 2024-09-12T22:05:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2e-07 2024-09-12T22:05:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205816+0000", 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8980000000000001e-06 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205825+0000", 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3510000000000008e-06 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205831+0000", 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.049e-06 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205864+0000", 2024-09-12T22:05:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2972000000000002e-05 2024-09-12T22:05:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205993+0000", 2024-09-12T22:05:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000128682 2024-09-12T22:05:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:239733 5.0 5:0ce392f5:::benchmark_data_smithi043_32659_object72495:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.205841+0000", 2024-09-12T22:05:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002310767, 2024-09-12T22:05:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023994110000000002, 2024-09-12T22:05:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 239733 2024-09-12T22:05:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205841+0000", 2024-09-12T22:05:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205841+0000", 2024-09-12T22:05:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205842+0000", 2024-09-12T22:05:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4200000000000001e-07 2024-09-12T22:05:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205849+0000", 2024-09-12T22:05:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5599999999999996e-06 2024-09-12T22:05:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205856+0000", 2024-09-12T22:05:21.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8290000000000002e-06 2024-09-12T22:05:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205861+0000", 2024-09-12T22:05:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5589999999999999e-06 2024-09-12T22:05:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207761+0000", 2024-09-12T22:05:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019000169999999999 2024-09-12T22:05:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207892+0000", 2024-09-12T22:05:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000131438 2024-09-12T22:05:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:239734 5.8 5:1c94a38c:::benchmark_data_smithi043_32659_object72496:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.219 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.205869+0000", 2024-09-12T22:05:21.220 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0022828280000000002, 2024-09-12T22:05:21.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024099450000000001, 2024-09-12T22:05:21.220 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.220 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.220 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:21.220 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.220 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.220 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 239734 2024-09-12T22:05:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205869+0000", 2024-09-12T22:05:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205869+0000", 2024-09-12T22:05:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205869+0000", 2024-09-12T22:05:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2e-07 2024-09-12T22:05:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205871+0000", 2024-09-12T22:05:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.812e-06 2024-09-12T22:05:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205877+0000", 2024-09-12T22:05:21.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7030000000000003e-06 2024-09-12T22:05:21.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205881+0000", 2024-09-12T22:05:21.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0069999999999999e-06 2024-09-12T22:05:21.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207518+0000", 2024-09-12T22:05:21.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001636806 2024-09-12T22:05:21.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207671+0000", 2024-09-12T22:05:21.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015321000000000001 2024-09-12T22:05:21.224 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.224 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.224 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.224 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:239735 5.d 5:b9257f3d:::benchmark_data_smithi043_32659_object72497:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.224 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.205890+0000", 2024-09-12T22:05:21.224 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0022616989999999998, 2024-09-12T22:05:21.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024250470000000001, 2024-09-12T22:05:21.224 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.224 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.225 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:21.225 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.225 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.225 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.225 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 239735 2024-09-12T22:05:21.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.225 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205890+0000", 2024-09-12T22:05:21.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205890+0000", 2024-09-12T22:05:21.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205891+0000", 2024-09-12T22:05:21.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6599999999999996e-07 2024-09-12T22:05:21.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205893+0000", 2024-09-12T22:05:21.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.08e-06 2024-09-12T22:05:21.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205899+0000", 2024-09-12T22:05:21.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9599999999999997e-06 2024-09-12T22:05:21.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205903+0000", 2024-09-12T22:05:21.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5079999999999999e-06 2024-09-12T22:05:21.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205957+0000", 2024-09-12T22:05:21.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3678999999999999e-05 2024-09-12T22:05:21.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206128+0000", 2024-09-12T22:05:21.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017136699999999999 2024-09-12T22:05:21.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:21.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206293+0000", 2024-09-12T22:05:21.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016432600000000001 2024-09-12T22:05:21.228 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.229 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.229 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.229 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:239736 5.9 5:9b61b249:::benchmark_data_smithi043_32659_object72498:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.229 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.206041+0000", 2024-09-12T22:05:21.229 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0021110009999999999, 2024-09-12T22:05:21.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023144519999999998, 2024-09-12T22:05:21.229 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.229 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.229 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:21.229 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.230 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.230 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.230 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 239736 2024-09-12T22:05:21.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.230 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206041+0000", 2024-09-12T22:05:21.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206041+0000", 2024-09-12T22:05:21.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.231 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206042+0000", 2024-09-12T22:05:21.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9100000000000003e-07 2024-09-12T22:05:21.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206045+0000", 2024-09-12T22:05:21.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7400000000000002e-06 2024-09-12T22:05:21.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206053+0000", 2024-09-12T22:05:21.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8220000000000007e-06 2024-09-12T22:05:21.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206060+0000", 2024-09-12T22:05:21.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:21.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206111+0000", 2024-09-12T22:05:21.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1020999999999998e-05 2024-09-12T22:05:21.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206245+0000", 2024-09-12T22:05:21.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000134299 2024-09-12T22:05:21.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:21.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206344+0000", 2024-09-12T22:05:21.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9369000000000004e-05 2024-09-12T22:05:21.236 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.236 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.236 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.236 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.236 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.236 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:239727 5.7 e56/40 5:e383934a:::benchmark_data_smithi043_32659_object72489:head v 56'15060, mlcod=56'15058)", 2024-09-12T22:05:21.236 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.206309+0000", 2024-09-12T22:05:21.237 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0018425189999999999, 2024-09-12T22:05:21.237 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002088056, 2024-09-12T22:05:21.237 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.237 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.237 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:21.237 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.237 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.238 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206309+0000", 2024-09-12T22:05:21.238 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.238 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206309+0000", 2024-09-12T22:05:21.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.239 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206310+0000", 2024-09-12T22:05:21.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.08e-07 2024-09-12T22:05:21.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.239 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206314+0000", 2024-09-12T22:05:21.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0169999999999998e-06 2024-09-12T22:05:21.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206321+0000", 2024-09-12T22:05:21.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.289e-06 2024-09-12T22:05:21.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206326+0000", 2024-09-12T22:05:21.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0189999999999997e-06 2024-09-12T22:05:21.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206444+0000", 2024-09-12T22:05:21.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118015 2024-09-12T22:05:21.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206464+0000", 2024-09-12T22:05:21.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9754000000000001e-05 2024-09-12T22:05:21.241 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.241 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.241 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.241 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:239730 5.5 e56/40 5:a6cd72c4:::benchmark_data_smithi043_32659_object72492:head v 56'15087, mlcod=56'15085)", 2024-09-12T22:05:21.242 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.207471+0000", 2024-09-12T22:05:21.242 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00068089699999999997, 2024-09-12T22:05:21.242 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00098452400000000008, 2024-09-12T22:05:21.242 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.242 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.242 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:21.242 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.242 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.242 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207471+0000", 2024-09-12T22:05:21.242 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207471+0000", 2024-09-12T22:05:21.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.243 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207472+0000", 2024-09-12T22:05:21.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:21.243 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207478+0000", 2024-09-12T22:05:21.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2110000000000003e-06 2024-09-12T22:05:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207486+0000", 2024-09-12T22:05:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207492+0000", 2024-09-12T22:05:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6500000000000001e-06 2024-09-12T22:05:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.245 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207586+0000", 2024-09-12T22:05:21.245 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3795999999999994e-05 2024-09-12T22:05:21.245 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.245 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.245 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.245 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207603+0000", 2024-09-12T22:05:21.245 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7544e-05 2024-09-12T22:05:21.245 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.245 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.245 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.245 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.245 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.245 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:239731 5.6 e56/40 5:656c2598:::benchmark_data_smithi043_32659_object72493:head v 56'14832, mlcod=56'14830)", 2024-09-12T22:05:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.207514+0000", 2024-09-12T22:05:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00063796999999999997, 2024-09-12T22:05:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0010005089999999999, 2024-09-12T22:05:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207514+0000", 2024-09-12T22:05:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207514+0000", 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207514+0000", 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6399999999999998e-07 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207518+0000", 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3450000000000002e-06 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.248 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.248 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207524+0000", 2024-09-12T22:05:21.248 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1099999999999999e-06 2024-09-12T22:05:21.248 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.248 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.248 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.248 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.207528+0000", 2024-09-12T22:05:21.248 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.622e-06 2024-09-12T22:05:21.248 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.248 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.248 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.248 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208068+0000", 2024-09-12T22:05:21.248 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00053962900000000002 2024-09-12T22:05:21.248 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.249 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.249 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.249 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208086+0000", 2024-09-12T22:05:21.249 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7895999999999999e-05 2024-09-12T22:05:21.249 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.249 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.249 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.249 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.249 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.249 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:239738 5.d 5:b1c8e08c:::benchmark_data_smithi043_32659_object72500:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.249 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.208358+0000", 2024-09-12T22:05:21.249 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.999794, 2024-09-12T22:05:21.250 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00021773499999999999, 2024-09-12T22:05:21.250 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.250 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.250 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:21.250 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.250 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.250 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.250 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 239738 2024-09-12T22:05:21.250 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.250 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.250 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.250 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.250 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208358+0000", 2024-09-12T22:05:21.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208358+0000", 2024-09-12T22:05:21.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208359+0000", 2024-09-12T22:05:21.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4499999999999996e-07 2024-09-12T22:05:21.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208363+0000", 2024-09-12T22:05:21.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:21.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208370+0000", 2024-09-12T22:05:21.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0079999999999996e-06 2024-09-12T22:05:21.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208375+0000", 2024-09-12T22:05:21.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6739999999999996e-06 2024-09-12T22:05:21.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208418+0000", 2024-09-12T22:05:21.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2895999999999997e-05 2024-09-12T22:05:21.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208585+0000", 2024-09-12T22:05:21.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000166902 2024-09-12T22:05:21.253 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.253 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.253 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:239739 5.0 5.b0f4b120 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.208387+0000", 2024-09-12T22:05:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9997654, 2024-09-12T22:05:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000255071, 2024-09-12T22:05:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 239739 2024-09-12T22:05:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208387+0000", 2024-09-12T22:05:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208387+0000", 2024-09-12T22:05:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208387+0000", 2024-09-12T22:05:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:05:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208388+0000", 2024-09-12T22:05:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.418e-06 2024-09-12T22:05:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208392+0000", 2024-09-12T22:05:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7060000000000002e-06 2024-09-12T22:05:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.208395+0000", 2024-09-12T22:05:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0120000000000001e-06 2024-09-12T22:05:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:239723 5.0 5:06a2f19a:::benchmark_data_smithi043_32659_object72485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.202321+0000", 2024-09-12T22:05:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0058305630000000004, 2024-09-12T22:05:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0063760609999999997, 2024-09-12T22:05:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 239723 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.202321+0000", 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.202321+0000", 2024-09-12T22:05:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.202322+0000", 2024-09-12T22:05:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3799999999999997e-07 2024-09-12T22:05:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.202324+0000", 2024-09-12T22:05:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0669999999999999e-06 2024-09-12T22:05:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.202330+0000", 2024-09-12T22:05:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5350000000000001e-06 2024-09-12T22:05:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.202336+0000", 2024-09-12T22:05:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0730000000000004e-06 2024-09-12T22:05:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.202375+0000", 2024-09-12T22:05:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9443999999999997e-05 2024-09-12T22:05:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.202532+0000", 2024-09-12T22:05:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000157097 2024-09-12T22:05:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:239724 5.3 e56/40 5:c856ede5:::benchmark_data_smithi043_32659_object72486:head v 56'14874, mlcod=56'14871)", 2024-09-12T22:05:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.203431+0000", 2024-09-12T22:05:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0047205880000000004, 2024-09-12T22:05:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0053312740000000004, 2024-09-12T22:05:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203431+0000", 2024-09-12T22:05:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203431+0000", 2024-09-12T22:05:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203432+0000", 2024-09-12T22:05:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.68e-07 2024-09-12T22:05:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203437+0000", 2024-09-12T22:05:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.865e-06 2024-09-12T22:05:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203444+0000", 2024-09-12T22:05:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3749999999999997e-06 2024-09-12T22:05:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203449+0000", 2024-09-12T22:05:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1540000000000001e-06 2024-09-12T22:05:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203653+0000", 2024-09-12T22:05:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020342799999999999 2024-09-12T22:05:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203672+0000", 2024-09-12T22:05:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9244000000000001e-05 2024-09-12T22:05:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:239726 5.8 5:133a3ca9:::benchmark_data_smithi043_32659_object72488:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.203742+0000", 2024-09-12T22:05:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0044096689999999997, 2024-09-12T22:05:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0050850110000000004, 2024-09-12T22:05:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 239726 2024-09-12T22:05:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203742+0000", 2024-09-12T22:05:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203742+0000", 2024-09-12T22:05:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203743+0000", 2024-09-12T22:05:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:05:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203747+0000", 2024-09-12T22:05:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0690000000000003e-06 2024-09-12T22:05:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203755+0000", 2024-09-12T22:05:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3289999999999994e-06 2024-09-12T22:05:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203763+0000", 2024-09-12T22:05:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3660000000000003e-06 2024-09-12T22:05:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203806+0000", 2024-09-12T22:05:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2994999999999997e-05 2024-09-12T22:05:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.203955+0000", 2024-09-12T22:05:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014975599999999999 2024-09-12T22:05:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:239728 5.a 5:5fc7fa42:::benchmark_data_smithi043_32659_object72490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.205759+0000", 2024-09-12T22:05:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0023929630000000001, 2024-09-12T22:05:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003129728, 2024-09-12T22:05:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 239728 2024-09-12T22:05:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205759+0000", 2024-09-12T22:05:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205759+0000", 2024-09-12T22:05:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205760+0000", 2024-09-12T22:05:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6599999999999996e-07 2024-09-12T22:05:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205763+0000", 2024-09-12T22:05:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4419999999999998e-06 2024-09-12T22:05:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205771+0000", 2024-09-12T22:05:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7379999999999994e-06 2024-09-12T22:05:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205776+0000", 2024-09-12T22:05:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9010000000000002e-06 2024-09-12T22:05:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205824+0000", 2024-09-12T22:05:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8699000000000002e-05 2024-09-12T22:05:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205963+0000", 2024-09-12T22:05:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013876200000000001 2024-09-12T22:05:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:239729 5.0 5:0b984324:::benchmark_data_smithi043_32659_object72491:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.205790+0000", 2024-09-12T22:05:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0023620859999999998, 2024-09-12T22:05:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031616209999999999, 2024-09-12T22:05:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 239729 2024-09-12T22:05:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205790+0000", 2024-09-12T22:05:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205790+0000", 2024-09-12T22:05:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205790+0000", 2024-09-12T22:05:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.75e-07 2024-09-12T22:05:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205792+0000", 2024-09-12T22:05:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1100000000000001e-06 2024-09-12T22:05:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205799+0000", 2024-09-12T22:05:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3040000000000001e-06 2024-09-12T22:05:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205804+0000", 2024-09-12T22:05:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2009999999999998e-06 2024-09-12T22:05:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.205849+0000", 2024-09-12T22:05:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4660999999999998e-05 2024-09-12T22:05:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.206004+0000", 2024-09-12T22:05:21.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015542999999999999 2024-09-12T22:05:21.279 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.279 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.279 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.279 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.279 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:21.279 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 15 2024-09-12T22:05:21.279 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:21.281 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:21.281 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:21.279+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:21.382 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:21.380+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:21.479 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:21.479 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:21.479 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:21.479 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:21.479 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:21.482 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:21.481+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:21.494 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:21.506 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:05:21.583 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:21.582+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:21.685 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:21.683+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:21.695 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:21.695 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 77.065942426999996, 2024-09-12T22:05:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:05:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.696 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:05:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:21.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:05:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:05:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:05:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:05:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:05:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:05:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:05:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:05:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:05:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:05:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:05:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:05:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:05:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:05:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:05:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:05:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:05:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:05:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:05:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:05:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:05:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:05:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 77.060541486999995, 2024-09-12T22:05:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:05:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.709 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:05:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:05:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:05:21.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:05:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:05:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:05:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:05:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:05:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:05:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:05:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:05:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.713 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:05:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:05:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:05:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:05:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:21.715 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.694853600999998, 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:21.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:05:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:05:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:05:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:05:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:05:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:05:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:05:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:05:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:05:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:05:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:05:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:05:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:05:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.694220395999999, 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.721 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:21.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.692400732999999, 2024-09-12T22:05:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.726 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:21.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:21.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.692233106000003, 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.731 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:05:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:21.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:05:21.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:05:21.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:05:21.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:05:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:05:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.692092442000003, 2024-09-12T22:05:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:05:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:05:21.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:05:21.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:05:21.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:05:21.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:05:21.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:05:21.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:05:21.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:05:21.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:05:21.740 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.740 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.740 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.740 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:21.740 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:21.740 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.691866918999999, 2024-09-12T22:05:21.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:21.740 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:21.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:21.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:21.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:21.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:21.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:21.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:21.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:21.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:21.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:21.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:21.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:21.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:21.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.691747214999999, 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.745 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.746 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.746 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.746 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.746 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.746 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:05:21.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.747 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:21.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:21.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:05:21.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:05:21.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:05:21.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:05:21.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:05:21.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:05:21.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:05:21.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:21.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:21.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:05:21.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:21.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:05:21.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:05:21.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:21.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.752 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:05:21.752 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:21.752 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.691155932999997, 2024-09-12T22:05:21.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:05:21.752 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.752 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.752 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:21.752 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:21.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:05:21.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:05:21.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.755 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:05:21.756 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:21.756 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.690932365000002, 2024-09-12T22:05:21.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:05:21.756 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.756 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.756 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.756 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:21.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:21.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:21.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:05:21.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:05:21.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:05:21.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:05:21.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:05:21.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:05:21.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:05:21.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:05:21.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:05:21.759 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.760 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.760 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.760 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:21.760 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:21.760 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.690840883999996, 2024-09-12T22:05:21.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:05:21.760 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.760 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.760 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.760 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.760 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.760 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.761 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:05:21.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.761 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:21.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:21.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:05:21.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:05:21.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:05:21.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:05:21.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:05:21.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:05:21.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:05:21.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:21.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:05:21.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:05:21.764 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:05:21.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:05:21.764 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:05:21.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:05:21.765 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.765 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.765 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.765 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.765 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:21.765 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:21.765 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.690052080000001, 2024-09-12T22:05:21.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:21.765 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.765 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.765 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.765 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.765 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.766 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.766 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:21.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.766 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:21.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:21.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:21.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:21.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:21.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:21.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:21.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:21.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:21.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:21.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:21.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:21.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:21.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:21.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:21.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:21.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:21.770 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.770 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.770 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.770 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:21.770 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:21.770 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.689787940000002, 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:21.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:05:21.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:05:21.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:05:21.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:05:21.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:05:21.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:05:21.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:21.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:05:21.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:05:21.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:05:21.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:05:21.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:05:21.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:05:21.775 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.775 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.775 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.775 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:05:21.775 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:21.776 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.689282964999997, 2024-09-12T22:05:21.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:05:21.776 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.776 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.776 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.776 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.776 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.776 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:21.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:21.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:05:21.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:05:21.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:05:21.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:05:21.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:05:21.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:05:21.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:05:21.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:05:21.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:05:21.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:05:21.780 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.780 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.780 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.780 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:05:21.780 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:21.780 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.688153536999998, 2024-09-12T22:05:21.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:05:21.780 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.780 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:05:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:05:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:05:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:05:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.687399095000004, 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:05:21.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:05:21.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:05:21.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:05:21.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:05:21.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:05:21.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:05:21.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:05:21.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:21.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:05:21.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:05:21.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:05:21.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:05:21.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:05:21.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:05:21.790 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.790 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.790 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.790 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:05:21.790 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:21.790 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.686719992999997, 2024-09-12T22:05:21.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:05:21.790 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.790 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.790 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.790 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:05:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:05:21.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:05:21.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:05:21.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:05:21.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:05:21.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:05:21.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:05:21.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:05:21.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:05:21.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:05:21.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:05:21.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:207316 5.d 5:b199774a:::benchmark_data_smithi043_32659_object40078:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:21.794 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.244258472, 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095080382000000005, 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 207316 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:21.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447981+0000", 2024-09-12T22:05:21.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1999999999999998e-07 2024-09-12T22:05:21.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447985+0000", 2024-09-12T22:05:21.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1910000000000002e-06 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447999+0000", 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4185000000000001e-05 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448006+0000", 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8929999999999999e-06 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448050+0000", 2024-09-12T22:05:21.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4406999999999997e-05 2024-09-12T22:05:21.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448236+0000", 2024-09-12T22:05:21.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018612899999999999 2024-09-12T22:05:21.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:21.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448357+0000", 2024-09-12T22:05:21.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000120303 2024-09-12T22:05:21.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:21.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450305+0000", 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001947952 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.542919+0000", 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092613928999999998 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.542971+0000", 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2083000000000003e-05 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.543060+0000", 2024-09-12T22:05:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9489999999999999e-05 2024-09-12T22:05:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:207325 5.9 5:98263198:::benchmark_data_smithi043_32659_object40087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.2421095, 2024-09-12T22:05:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.089568523999999997, 2024-09-12T22:05:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 207325 2024-09-12T22:05:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3399999999999999e-07 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450132+0000", 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450139+0000", 2024-09-12T22:05:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6290000000000004e-06 2024-09-12T22:05:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450144+0000", 2024-09-12T22:05:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3290000000000001e-06 2024-09-12T22:05:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450205+0000", 2024-09-12T22:05:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0504999999999998e-05 2024-09-12T22:05:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450373+0000", 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000168314 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450485+0000", 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011231299999999999 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.452226+0000", 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017412409999999999 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539592+0000", 2024-09-12T22:05:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.087365211999999998 2024-09-12T22:05:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539633+0000", 2024-09-12T22:05:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1165000000000003e-05 2024-09-12T22:05:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539697+0000", 2024-09-12T22:05:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4519999999999999e-05 2024-09-12T22:05:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:21.806 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:21.807 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:21.806+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:21.807 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:21.908 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:21.907+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:21.953 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:241723 5.3 5:cf97cccb:::benchmark_data_smithi043_32659_object74485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:21.949246+0000", 2024-09-12T22:05:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0029725229999999999, 2024-09-12T22:05:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029955279999999999, 2024-09-12T22:05:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 241723 2024-09-12T22:05:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949246+0000", 2024-09-12T22:05:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949246+0000", 2024-09-12T22:05:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949246+0000", 2024-09-12T22:05:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:05:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949251+0000", 2024-09-12T22:05:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0289999999999999e-06 2024-09-12T22:05:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949257+0000", 2024-09-12T22:05:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9859999999999999e-06 2024-09-12T22:05:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949263+0000", 2024-09-12T22:05:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7499999999999997e-06 2024-09-12T22:05:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949310+0000", 2024-09-12T22:05:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6555999999999999e-05 2024-09-12T22:05:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949429+0000", 2024-09-12T22:05:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118947 2024-09-12T22:05:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949525+0000", 2024-09-12T22:05:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6398999999999996e-05 2024-09-12T22:05:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.951559+0000", 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002033736 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:241724 5.c 5:3fed6269:::benchmark_data_smithi043_32659_object74486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:21.949902+0000", 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0023159930000000001, 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023974280000000001, 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 241724 2024-09-12T22:05:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949902+0000", 2024-09-12T22:05:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949902+0000", 2024-09-12T22:05:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949903+0000", 2024-09-12T22:05:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0399999999999995e-07 2024-09-12T22:05:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949907+0000", 2024-09-12T22:05:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.126e-06 2024-09-12T22:05:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949916+0000", 2024-09-12T22:05:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2939999999999994e-06 2024-09-12T22:05:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949924+0000", 2024-09-12T22:05:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3919999999999997e-06 2024-09-12T22:05:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949969+0000", 2024-09-12T22:05:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5037999999999998e-05 2024-09-12T22:05:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950136+0000", 2024-09-12T22:05:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016761200000000001 2024-09-12T22:05:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950259+0000", 2024-09-12T22:05:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122197 2024-09-12T22:05:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952182+0000", 2024-09-12T22:05:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001923007 2024-09-12T22:05:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:241725 5.5 5:a2c1e78e:::benchmark_data_smithi043_32659_object74487:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:21.950766+0000", 2024-09-12T22:05:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0014523229999999999, 2024-09-12T22:05:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001613511, 2024-09-12T22:05:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 241725 2024-09-12T22:05:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950766+0000", 2024-09-12T22:05:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950766+0000", 2024-09-12T22:05:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950767+0000", 2024-09-12T22:05:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0299999999999997e-07 2024-09-12T22:05:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950772+0000", 2024-09-12T22:05:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2689999999999999e-06 2024-09-12T22:05:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950784+0000", 2024-09-12T22:05:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1902999999999999e-05 2024-09-12T22:05:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950792+0000", 2024-09-12T22:05:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5750000000000003e-06 2024-09-12T22:05:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950840+0000", 2024-09-12T22:05:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.833e-05 2024-09-12T22:05:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950986+0000", 2024-09-12T22:05:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014646 2024-09-12T22:05:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.951105+0000", 2024-09-12T22:05:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118539 2024-09-12T22:05:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:241718 5.f e56/40 5:fe70d311:::benchmark_data_smithi043_32659_object74480:head v 56'15151, mlcod=56'15147)", 2024-09-12T22:05:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:21.950937+0000", 2024-09-12T22:05:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0012814949999999999, 2024-09-12T22:05:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015164410000000001, 2024-09-12T22:05:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950937+0000", 2024-09-12T22:05:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950937+0000", 2024-09-12T22:05:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950937+0000", 2024-09-12T22:05:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:05:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950942+0000", 2024-09-12T22:05:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4889999999999997e-06 2024-09-12T22:05:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950949+0000", 2024-09-12T22:05:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6369999999999999e-06 2024-09-12T22:05:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950955+0000", 2024-09-12T22:05:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4330000000000003e-06 2024-09-12T22:05:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950996+0000", 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0973999999999998e-05 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.951013+0000", 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7241e-05 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:241726 5.7 5:ee78d1ff:::benchmark_data_smithi043_32659_object74488:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:21.950980+0000", 2024-09-12T22:05:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001238304, 2024-09-12T22:05:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001536146, 2024-09-12T22:05:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 241726 2024-09-12T22:05:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950980+0000", 2024-09-12T22:05:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950980+0000", 2024-09-12T22:05:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950981+0000", 2024-09-12T22:05:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5999999999999991e-07 2024-09-12T22:05:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950986+0000", 2024-09-12T22:05:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6530000000000002e-06 2024-09-12T22:05:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.950995+0000", 2024-09-12T22:05:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4509999999999998e-06 2024-09-12T22:05:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.951002+0000", 2024-09-12T22:05:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8970000000000002e-06 2024-09-12T22:05:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.951222+0000", 2024-09-12T22:05:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022026399999999999 2024-09-12T22:05:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.951396+0000", 2024-09-12T22:05:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017345699999999999 2024-09-12T22:05:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.951524+0000", 2024-09-12T22:05:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000128312 2024-09-12T22:05:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "MOSDPGPushReply(5.3 56/40 [PushReplyOp(5:c023783d:::benchmark_data_smithi043_32659_object93887:head)])", 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:21.952259+0000", 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999599, 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031581300000000002, 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952259+0000", 2024-09-12T22:05:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952259+0000", 2024-09-12T22:05:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952259+0000", 2024-09-12T22:05:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-09-12T22:05:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952264+0000", 2024-09-12T22:05:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6949999999999999e-06 2024-09-12T22:05:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952275+0000", 2024-09-12T22:05:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1338999999999999e-05 2024-09-12T22:05:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952283+0000", 2024-09-12T22:05:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2300000000000008e-06 2024-09-12T22:05:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952335+0000", 2024-09-12T22:05:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1984000000000002e-05 2024-09-12T22:05:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952574+0000", 2024-09-12T22:05:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023893499999999999 2024-09-12T22:05:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:241728 5.3 5:cff8fd91:::benchmark_data_smithi043_32659_object74490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:21.952426+0000", 2024-09-12T22:05:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9997926, 2024-09-12T22:05:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021733399999999999, 2024-09-12T22:05:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 241728 2024-09-12T22:05:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952426+0000", 2024-09-12T22:05:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952426+0000", 2024-09-12T22:05:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952426+0000", 2024-09-12T22:05:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0500000000000002e-07 2024-09-12T22:05:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952431+0000", 2024-09-12T22:05:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7040000000000002e-06 2024-09-12T22:05:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952441+0000", 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6180000000000001e-06 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952447+0000", 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3439999999999997e-06 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.952599+0000", 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015235699999999999 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.991 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:241710 5.7 5:eedae643:::benchmark_data_smithi043_32659_object74472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.991 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:21.944757+0000", 2024-09-12T22:05:21.991 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0074609780000000001, 2024-09-12T22:05:21.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079224489999999998, 2024-09-12T22:05:21.991 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:21.991 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:21.991 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:21.991 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:21.991 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:21.991 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.991 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 241710 2024-09-12T22:05:21.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.991 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:21.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:21.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.944757+0000", 2024-09-12T22:05:21.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:21.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.944757+0000", 2024-09-12T22:05:21.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.944758+0000", 2024-09-12T22:05:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-12T22:05:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.944762+0000", 2024-09-12T22:05:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2529999999999998e-06 2024-09-12T22:05:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.944772+0000", 2024-09-12T22:05:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3770000000000002e-06 2024-09-12T22:05:21.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.944778+0000", 2024-09-12T22:05:21.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5490000000000003e-06 2024-09-12T22:05:21.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:21.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.945827+0000", 2024-09-12T22:05:21.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001048818 2024-09-12T22:05:21.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:21.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.946000+0000", 2024-09-12T22:05:21.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017296499999999999 2024-09-12T22:05:21.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:21.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.946116+0000", 2024-09-12T22:05:21.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116239 2024-09-12T22:05:21.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:21.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949036+0000", 2024-09-12T22:05:21.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029198039999999998 2024-09-12T22:05:21.996 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.996 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:21.996 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:21.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.996 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:241717 5.c 5:37ab70ff:::benchmark_data_smithi043_32659_object74479:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:05:21.996 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:21.947287+0000", 2024-09-12T22:05:21.996 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0049315840000000001, 2024-09-12T22:05:21.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.005433574, 2024-09-12T22:05:21.996 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:21.996 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:21.996 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:21.996 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:21.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:21.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:21.997 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 241717 2024-09-12T22:05:21.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.997 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:21.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:21.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.947287+0000", 2024-09-12T22:05:21.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:21.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.947287+0000", 2024-09-12T22:05:21.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:21.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:21.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.947287+0000", 2024-09-12T22:05:21.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:05:21.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:21.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.947290+0000", 2024-09-12T22:05:21.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7259999999999998e-06 2024-09-12T22:05:21.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:21.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.947295+0000", 2024-09-12T22:05:21.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2429999999999996e-06 2024-09-12T22:05:21.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:21.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:21.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:21.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.947299+0000", 2024-09-12T22:05:21.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0879999999999997e-06 2024-09-12T22:05:21.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.947343+0000", 2024-09-12T22:05:22.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3383000000000001e-05 2024-09-12T22:05:22.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.947455+0000", 2024-09-12T22:05:22.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011233199999999999 2024-09-12T22:05:22.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.947570+0000", 2024-09-12T22:05:22.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011448200000000001 2024-09-12T22:05:22.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:21.949535+0000", 2024-09-12T22:05:22.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019658779999999999 2024-09-12T22:05:22.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.001 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.001 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:22.001 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 9 2024-09-12T22:05:22.001 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:22.003 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-09-12T22:05:22.003 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:22.009 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:22.008+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:22.111 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:22.110+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:22.125 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:22.126 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:22.135 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:22.211 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:22.211+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:22.257 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.843984466999999, 2024-09-12T22:05:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:22.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:22.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:22.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:22.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:22.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:22.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:22.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:22.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:22.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:22.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.263 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:22.263 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:22.263 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.843804536999997, 2024-09-12T22:05:22.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:22.263 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.263 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.263 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:22.263 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.263 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.263 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.263 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:22.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.264 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:22.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:22.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:22.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:22.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:22.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:22.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:22.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:22.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:22.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:22.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:22.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:22.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:22.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:22.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:22.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:22.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:22.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:22.267 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.267 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.267 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.268 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:22.268 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:22.268 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.843738096000003, 2024-09-12T22:05:22.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:22.268 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.268 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.268 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:22.268 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.268 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.268 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.268 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:22.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.269 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:22.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:22.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:22.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:22.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:22.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:22.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:22.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:22.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:22.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:22.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:22.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:22.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:22.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:22.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:22.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:22.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:22.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:22.273 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.273 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.273 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.273 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:22.273 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:22.274 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.843681652999997, 2024-09-12T22:05:22.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:22.274 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.274 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.274 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.274 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.274 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.274 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.274 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:22.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.274 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:22.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:22.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:22.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:22.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:22.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:22.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:22.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:22.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:22.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:22.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:22.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:22.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:22.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:22.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:22.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:22.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:22.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:22.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:22.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:22.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:22.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:22.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:22.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:22.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:22.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:22.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:22.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:22.281 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.281 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.281 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.281 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:22.281 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:22.282 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.843613193000003, 2024-09-12T22:05:22.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:22.282 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.282 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.282 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.282 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.282 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.282 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.282 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:22.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.282 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:22.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:22.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:22.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:22.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:22.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:22.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:22.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:22.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:22.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:22.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:22.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:22.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:22.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:22.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:22.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:22.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:22.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:22.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:22.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:22.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:22.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:22.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:22.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.288 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.843555457999997, 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.289 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:22.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:22.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:22.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:22.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:22.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:22.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:22.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:22.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:22.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:22.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:22.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:22.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:22.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:22.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:22.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:22.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:22.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:22.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:22.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:22.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:22.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:22.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:22.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:22.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:22.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:22.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:22.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:22.295 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.295 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.295 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.296 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:22.296 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:22.296 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.843487766000003, 2024-09-12T22:05:22.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:22.296 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.296 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.296 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.296 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.296 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.296 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.296 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:22.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.297 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:22.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:22.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:22.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:22.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:22.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:22.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:22.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:22.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:22.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:22.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:22.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:22.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:22.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:22.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:22.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:22.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:22.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:22.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:22.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:22.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:22.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:22.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:22.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.303 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.304 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:22.304 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:22.304 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.843432704000001, 2024-09-12T22:05:22.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:22.304 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.304 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.304 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.304 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.304 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.304 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.304 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:22.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.305 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:22.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:22.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:22.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:22.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:22.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:22.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:22.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:22.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:22.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:22.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:22.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:22.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:22.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:22.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:22.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:22.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:22.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:22.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:22.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:22.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:22.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:22.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:22.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:22.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:22.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:22.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:22.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:22.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.315 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.315 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:22.315 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:22.315 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.802785184000001, 2024-09-12T22:05:22.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:22.315 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:22.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:22.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:22.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:22.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:22.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:22.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:22.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:22.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:22.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:22.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:22.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:22.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:22.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:22.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:22.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:22.321 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.321 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.321 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.322 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:22.322 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:22.322 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.800171456000001, 2024-09-12T22:05:22.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:22.322 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.322 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.322 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.322 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.322 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.322 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.322 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:22.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.323 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:22.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:22.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:22.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:22.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:22.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:22.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:22.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:22.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:22.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:22.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:22.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:22.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:22.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:22.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:22.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:22.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:22.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:22.328 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.328 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.328 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.328 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.328 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:22.329 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.254957359999999, 2024-09-12T22:05:22.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:22.329 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.329 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.329 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.329 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:22.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.329 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:22.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:22.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:22.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:22.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:22.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:22.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:22.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:22.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:22.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:22.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:22.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:22.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:22.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:22.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:22.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:22.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:22.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:22.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:22.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:22.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:22.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:22.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:22.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:22.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.335 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.335 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.335 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:22.335 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.254478872, 2024-09-12T22:05:22.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:22.336 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.336 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.336 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.336 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:22.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.336 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:22.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:22.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:22.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:22.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:22.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:22.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:22.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:22.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:22.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:22.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:22.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:22.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:22.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:22.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:22.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:22.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:22.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:22.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:22.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:22.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:22.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:22.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:22.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:22.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.342 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.342 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.342 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:22.343 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.251983572, 2024-09-12T22:05:22.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:22.343 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.343 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.343 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.343 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:22.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.343 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:22.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:22.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:22.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:22.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:22.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:22.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:22.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:22.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:22.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:22.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:22.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:22.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:22.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:22.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:22.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:22.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:22.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:22.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:22.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:22.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:22.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:22.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.250902781000001, 2024-09-12T22:05:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:22.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:22.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:22.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:22.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:22.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:22.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:22.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:22.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:22.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:22.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:22.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:22.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.355 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.355 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.355 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.355 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:22.355 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.249667219000003, 2024-09-12T22:05:22.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:22.355 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.355 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.356 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:22.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.356 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:22.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:22.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:22.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:22.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:22.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:22.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:22.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:22.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:22.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:22.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:22.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:22.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:22.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:22.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:22.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:22.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:22.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:22.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:22.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:22.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:22.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:22.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:22.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:22.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.361 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.361 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:22.361 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:22.361 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.808926731, 2024-09-12T22:05:22.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:22.362 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.362 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.362 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.362 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:22.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.362 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:22.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:22.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:22.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:22.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:22.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:22.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:22.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:22.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:22.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:22.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:22.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:22.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:22.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:22.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:22.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:22.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:22.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:22.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:22.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:22.367 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.367 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.367 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.367 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:22.368 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:22.368 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.804396304000001, 2024-09-12T22:05:22.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:22.368 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.368 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.368 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.368 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.368 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.368 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.368 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:22.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.369 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:22.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:22.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:22.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:22.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:22.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:22.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:22.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:22.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:22.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:22.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:22.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:22.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:22.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:22.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:22.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:22.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:22.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:22.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:22.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:22.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:22.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:22.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:22.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:22.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.374 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.375 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:22.375 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:22.375 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.804372275, 2024-09-12T22:05:22.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:22.375 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.375 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.375 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.376 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:22.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.376 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:22.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:22.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:22.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:22.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:22.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:22.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:22.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:22.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:22.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:22.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:22.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:22.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:22.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:22.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:22.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:22.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:22.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:22.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.381 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.381 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:22.381 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:22.381 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.804194625999999, 2024-09-12T22:05:22.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:22.381 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.381 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.381 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.382 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:22.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.382 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:22.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:22.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:22.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:22.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:22.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:22.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:22.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:22.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:22.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:22.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:22.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:22.386 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.387 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.387 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:22.387 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:22.387 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.802176089, 2024-09-12T22:05:22.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:22.387 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:22.387 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:22.387 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.387 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:22.387 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:22.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.388 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:22.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.388 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:22.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:22.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:22.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:22.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:22.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:22.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:22.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:22.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:22.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:22.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:22.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:22.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:22.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:22.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:22.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:22.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:22.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:22.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:22.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:22.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:22.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:22.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:22.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:22.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:22.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:22.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:22.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:22.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:22.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:22.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:22.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:22.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:22.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:22.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:22.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:22.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:22.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:22.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:22.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.394 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.394 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.394 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:22.394 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:22.394 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:22.396 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:22.396 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:22.395+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:22.496 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:22.495+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:22.510 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:22.510 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:22.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.511 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241940 5.6 5.dbae7d06 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.511 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:22.511 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.45495199600000003, 2024-09-12T22:05:22.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.45496725900000001, 2024-09-12T22:05:22.511 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.511 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.511 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.511 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.511 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.511 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.512 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241940 2024-09-12T22:05:22.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.512 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:22.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:22.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:22.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4700000000000002e-07 2024-09-12T22:05:22.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053907+0000", 2024-09-12T22:05:22.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.796e-06 2024-09-12T22:05:22.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053912+0000", 2024-09-12T22:05:22.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.622e-06 2024-09-12T22:05:22.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053915+0000", 2024-09-12T22:05:22.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3009999999999998e-06 2024-09-12T22:05:22.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053952+0000", 2024-09-12T22:05:22.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6668000000000002e-05 2024-09-12T22:05:22.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053957+0000", 2024-09-12T22:05:22.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5849999999999999e-06 2024-09-12T22:05:22.515 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.515 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.515 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.516 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5.bbe4afa6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.516 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:22.516 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.53070370099999997, 2024-09-12T22:05:22.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.530759592, 2024-09-12T22:05:22.516 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.516 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.516 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.517 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.517 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.517 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.517 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:05:22.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.517 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.517 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.517 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:22.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:22.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:05:22.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:05:22.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:05:22.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:05:22.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:05:22.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:05:22.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:05:22.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:05:22.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:05:22.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:05:22.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:05:22.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:05:22.521 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.521 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.521 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.521 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5.4e2f26d6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.521 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:22.521 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.54254406099999997, 2024-09-12T22:05:22.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.54263383799999998, 2024-09-12T22:05:22.521 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.522 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.522 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.522 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.522 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.522 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.522 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:05:22.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.522 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:22.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:22.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:22.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:05:22.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:05:22.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:05:22.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:05:22.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:05:22.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:05:22.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:05:22.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:05:22.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:05:22.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:05:22.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:22.526 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.526 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.526 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.526 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241974 5.6 5.4f5b39d6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.526 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:22.526 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.42387273800000003, 2024-09-12T22:05:22.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.42399546500000002, 2024-09-12T22:05:22.526 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.526 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.527 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.527 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.527 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.527 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.527 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241974 2024-09-12T22:05:22.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.527 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:22.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:22.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084985+0000", 2024-09-12T22:05:22.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4600000000000004e-07 2024-09-12T22:05:22.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084989+0000", 2024-09-12T22:05:22.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9349999999999996e-06 2024-09-12T22:05:22.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084999+0000", 2024-09-12T22:05:22.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0043e-05 2024-09-12T22:05:22.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085004+0000", 2024-09-12T22:05:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1619999999999999e-06 2024-09-12T22:05:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085041+0000", 2024-09-12T22:05:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7469999999999999e-05 2024-09-12T22:05:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085048+0000", 2024-09-12T22:05:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:05:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.531 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.531 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241896 5.6 5.c49b1f76 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.531 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:22.531 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.47711357399999998, 2024-09-12T22:05:22.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.47726941299999998, 2024-09-12T22:05:22.531 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.531 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.531 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.531 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.531 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.531 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241896 2024-09-12T22:05:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031744+0000", 2024-09-12T22:05:22.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8100000000000001e-07 2024-09-12T22:05:22.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031749+0000", 2024-09-12T22:05:22.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.437e-06 2024-09-12T22:05:22.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031757+0000", 2024-09-12T22:05:22.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6999999999999997e-06 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031765+0000", 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6709999999999999e-06 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031809+0000", 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3970000000000001e-05 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031817+0000", 2024-09-12T22:05:22.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6580000000000002e-06 2024-09-12T22:05:22.535 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.535 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.535 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.535 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5.6e846b46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.535 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:22.535 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.53953179699999998, 2024-09-12T22:05:22.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.53972066500000004, 2024-09-12T22:05:22.535 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.535 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.535 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.536 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.536 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.536 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.536 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:05:22.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.536 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:22.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:22.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:05:22.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:05:22.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:05:22.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:22.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:05:22.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:05:22.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:05:22.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:05:22.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.539 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:05:22.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:05:22.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.539 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:05:22.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:05:22.539 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.539 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.540 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.540 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241966 5.6 5.108f1ca6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.540 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:22.540 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.437206347, 2024-09-12T22:05:22.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.43742754099999998, 2024-09-12T22:05:22.540 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.540 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.540 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.540 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.541 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.541 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.541 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241966 2024-09-12T22:05:22.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.541 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:22.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:22.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071651+0000", 2024-09-12T22:05:22.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:05:22.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071656+0000", 2024-09-12T22:05:22.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7929999999999997e-06 2024-09-12T22:05:22.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071669+0000", 2024-09-12T22:05:22.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2692e-05 2024-09-12T22:05:22.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071676+0000", 2024-09-12T22:05:22.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:05:22.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071716+0000", 2024-09-12T22:05:22.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9817999999999997e-05 2024-09-12T22:05:22.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071721+0000", 2024-09-12T22:05:22.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.057e-06 2024-09-12T22:05:22.545 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.545 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.545 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.545 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241967 5.6 5.a6b4b436 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.545 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:22.545 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.437158243, 2024-09-12T22:05:22.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.43741334799999998, 2024-09-12T22:05:22.545 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.545 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.545 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.545 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.545 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.546 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.546 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241967 2024-09-12T22:05:22.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.546 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.546 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.546 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:22.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.546 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.546 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:22.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:22.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:22.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071702+0000", 2024-09-12T22:05:22.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6929999999999999e-06 2024-09-12T22:05:22.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071709+0000", 2024-09-12T22:05:22.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2470000000000002e-06 2024-09-12T22:05:22.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071715+0000", 2024-09-12T22:05:22.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7370000000000003e-06 2024-09-12T22:05:22.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071737+0000", 2024-09-12T22:05:22.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1976000000000001e-05 2024-09-12T22:05:22.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071740+0000", 2024-09-12T22:05:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1760000000000002e-06 2024-09-12T22:05:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5.273b7726 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.551 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:22.551 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.53854530700000003, 2024-09-12T22:05:22.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.53884846600000003, 2024-09-12T22:05:22.551 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.551 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.551 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.551 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.551 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.552 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.552 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:05:22.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.552 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:22.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:22.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:05:22.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:22.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:05:22.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:05:22.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:05:22.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:22.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:05:22.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:05:22.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:05:22.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:05:22.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:05:22.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:22.555 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.556 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.556 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.556 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241968 5.6 5.31ebedc6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.556 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:22.556 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.43713238599999998, 2024-09-12T22:05:22.556 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.43746660799999998, 2024-09-12T22:05:22.556 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.556 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.556 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.556 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.556 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.556 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241968 2024-09-12T22:05:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071725+0000", 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5600000000000001e-07 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071727+0000", 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.232e-06 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071733+0000", 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2750000000000001e-06 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.559 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071738+0000", 2024-09-12T22:05:22.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9289999999999997e-06 2024-09-12T22:05:22.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.559 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071769+0000", 2024-09-12T22:05:22.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0746e-05 2024-09-12T22:05:22.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.559 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071774+0000", 2024-09-12T22:05:22.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8099999999999997e-06 2024-09-12T22:05:22.559 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.560 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.560 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.560 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5.1b312816 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.560 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:22.560 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.51480303999999999, 2024-09-12T22:05:22.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.51517925399999998, 2024-09-12T22:05:22.560 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.560 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.560 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.560 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.560 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.560 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.561 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:05:22.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.561 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:22.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:22.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:05:22.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:05:22.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:05:22.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:05:22.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:05:22.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:05:22.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.563 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.563 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:05:22.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:05:22.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.563 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.563 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:05:22.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:05:22.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:05:22.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:22.564 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.564 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.564 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.564 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241935 5.6 5.1b7d4706 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.564 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:22.564 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.45802394899999999, 2024-09-12T22:05:22.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.458459267, 2024-09-12T22:05:22.564 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.564 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.565 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.565 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.565 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.565 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.565 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241935 2024-09-12T22:05:22.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.565 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:22.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:22.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050834+0000", 2024-09-12T22:05:22.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2500000000000004e-07 2024-09-12T22:05:22.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.567 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.567 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050838+0000", 2024-09-12T22:05:22.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7029999999999997e-06 2024-09-12T22:05:22.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.567 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.567 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050853+0000", 2024-09-12T22:05:22.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4545000000000001e-05 2024-09-12T22:05:22.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.567 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050859+0000", 2024-09-12T22:05:22.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:05:22.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050902+0000", 2024-09-12T22:05:22.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3455999999999999e-05 2024-09-12T22:05:22.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050909+0000", 2024-09-12T22:05:22.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6950000000000003e-06 2024-09-12T22:05:22.569 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.569 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.569 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.569 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5.68f08b36 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.569 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:22.569 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.52272881599999999, 2024-09-12T22:05:22.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.52321376100000005, 2024-09-12T22:05:22.570 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.570 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.570 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.570 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.570 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.570 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.570 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:05:22.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.570 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.570 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:22.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:22.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.572 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:05:22.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:05:22.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.572 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.572 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:05:22.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:05:22.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.572 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:05:22.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:05:22.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:05:22.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:05:22.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:05:22.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:05:22.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:05:22.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:05:22.574 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.574 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.574 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.574 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5.9b3d9bf6 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.574 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:22.575 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.54457678600000003, 2024-09-12T22:05:22.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.54512296699999996, 2024-09-12T22:05:22.575 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.575 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.575 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.575 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.575 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.575 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.575 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:05:22.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.575 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:22.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:22.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:05:22.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:05:22.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:05:22.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:05:22.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:05:22.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:05:22.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:05:22.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:05:22.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:05:22.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:05:22.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:05:22.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:05:22.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:05:22.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:05:22.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:05:22.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.580 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.580 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:05:22.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:05:22.580 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.580 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.580 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.580 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.580 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5.20a1b206 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.580 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:22.581 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.53345867300000005, 2024-09-12T22:05:22.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.534081586, 2024-09-12T22:05:22.581 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.581 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.581 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.581 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.581 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.581 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.581 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:05:22.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.581 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:22.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:22.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:05:22.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:05:22.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:05:22.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:05:22.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:05:22.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:05:22.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:05:22.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:05:22.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:05:22.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:05:22.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:05:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:05:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5.292c3b96 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.51330675800000003, 2024-09-12T22:05:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.51399284899999997, 2024-09-12T22:05:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:05:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:05:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:05:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:05:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:05:22.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:05:22.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:22.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:05:22.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:05:22.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.589 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:22.589 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:05:22.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:05:22.589 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.589 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.589 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.589 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.589 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:22.589 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 16 2024-09-12T22:05:22.589 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:22.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:22.596 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~59s 2024-09-12T22:05:22.632 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:22.631+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:22.698 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:22.698+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:22.742 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:22.742 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:22.742 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:22.742 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:22.742 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:22.752 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:22.799 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:22.798+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:22.863 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:22.864 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:22.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:22.864 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:22.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.864 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44107 5.0 5:06657486:::benchmark_data_smithi043_32659_object44106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:22.864 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:22.864 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 78.235015230000002, 2024-09-12T22:05:22.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085485273000000001, 2024-09-12T22:05:22.864 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.864 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.864 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.864 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.864 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.865 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.865 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44107 2024-09-12T22:05:22.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.865 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.865 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.865 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:22.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.865 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.865 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626296+0000", 2024-09-12T22:05:22.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626297+0000", 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626447+0000", 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000150075 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626456+0000", 2024-09-12T22:05:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2869999999999993e-06 2024-09-12T22:05:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.626463+0000", 2024-09-12T22:05:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3539999999999996e-06 2024-09-12T22:05:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.630985+0000", 2024-09-12T22:05:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045221050000000002 2024-09-12T22:05:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631052+0000", 2024-09-12T22:05:22.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.711e-05 2024-09-12T22:05:22.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:22.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631126+0000", 2024-09-12T22:05:22.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3708999999999995e-05 2024-09-12T22:05:22.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:22.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676356+0000", 2024-09-12T22:05:22.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.045230232000000002 2024-09-12T22:05:22.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676550+0000", 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000194608 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.676625+0000", 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4177999999999994e-05 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711781+0000", 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.035156605 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.869 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.870 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.870 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:44121 5.8 5:1b60ef7b:::benchmark_data_smithi043_32659_object44120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T22:05:22.870 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:22.870 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 78.229614290000001, 2024-09-12T22:05:22.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.085259048000000004, 2024-09-12T22:05:22.870 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.870 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.871 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.871 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.871 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.871 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.871 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 44121 2024-09-12T22:05:22.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.871 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.871 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.871 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:22.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.871 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.872 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:22.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.872 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.872 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631697+0000", 2024-09-12T22:05:22.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:22.872 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.872 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631764+0000", 2024-09-12T22:05:22.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6971000000000006e-05 2024-09-12T22:05:22.872 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631770+0000", 2024-09-12T22:05:22.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7420000000000003e-06 2024-09-12T22:05:22.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.631774+0000", 2024-09-12T22:05:22.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:05:22.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633352+0000", 2024-09-12T22:05:22.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015776200000000001 2024-09-12T22:05:22.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.633470+0000", 2024-09-12T22:05:22.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118421 2024-09-12T22:05:22.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 0", 2024-09-12T22:05:22.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.674698+0000", 2024-09-12T22:05:22.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.041228055 2024-09-12T22:05:22.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.711833+0000", 2024-09-12T22:05:22.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037134882000000001 2024-09-12T22:05:22.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:22.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716883+0000", 2024-09-12T22:05:22.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005050372 2024-09-12T22:05:22.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716916+0000", 2024-09-12T22:05:22.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2697999999999998e-05 2024-09-12T22:05:22.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:04.716956+0000", 2024-09-12T22:05:22.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9771999999999998e-05 2024-09-12T22:05:22.876 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.876 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.876 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.876 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128878 5.9 5:95760d8d:::benchmark_data_smithi043_32659_object128877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.876 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:22.876 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.863926403999997, 2024-09-12T22:05:22.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099006944, 2024-09-12T22:05:22.876 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.877 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.877 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.877 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.877 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.877 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.877 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128878 2024-09-12T22:05:22.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.877 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:22.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:22.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997385+0000", 2024-09-12T22:05:22.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:05:22.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997529+0000", 2024-09-12T22:05:22.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014373700000000001 2024-09-12T22:05:22.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997538+0000", 2024-09-12T22:05:22.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:05:22.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.997552+0000", 2024-09-12T22:05:22.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3617e-05 2024-09-12T22:05:22.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001606+0000", 2024-09-12T22:05:22.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040544320000000002 2024-09-12T22:05:22.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001722+0000", 2024-09-12T22:05:22.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011595900000000001 2024-09-12T22:05:22.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:22.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001855+0000", 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013319100000000001 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003905+0000", 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020499910000000001 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004367+0000", 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00046182900000000003 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004410+0000", 2024-09-12T22:05:22.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3223000000000003e-05 2024-09-12T22:05:22.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096392+0000", 2024-09-12T22:05:22.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091981141000000002 2024-09-12T22:05:22.884 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.884 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.884 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.884 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.884 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:22.885 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.863293198999997, 2024-09-12T22:05:22.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:22.885 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.885 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.885 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.885 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.885 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.885 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.885 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:22.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.885 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:22.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:22.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:22.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:22.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:22.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:22.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:22.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:22.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:22.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:22.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:22.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:22.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:22.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:22.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:22.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:22.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:22.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:22.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:22.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:22.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:22.890 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.890 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.890 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.890 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.890 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:22.890 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.861473535999998, 2024-09-12T22:05:22.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:22.891 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.891 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.891 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.891 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.891 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.891 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.891 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:22.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.891 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:22.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:22.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:22.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:22.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:22.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:22.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:22.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:22.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:22.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:22.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:22.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:22.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:22.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:22.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:22.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:22.896 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.896 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.896 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.896 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128882 5.4 5:21af7b6c:::benchmark_data_smithi043_32659_object128881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.896 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:22.896 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.861305909000002, 2024-09-12T22:05:22.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096661230000000001, 2024-09-12T22:05:22.896 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.896 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.896 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.896 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.897 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.897 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.897 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128882 2024-09-12T22:05:22.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.897 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:22.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000005+0000", 2024-09-12T22:05:22.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000006+0000", 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000089+0000", 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3257999999999995e-05 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000098+0000", 2024-09-12T22:05:22.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1609999999999992e-06 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000105+0000", 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000180+0000", 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5475999999999994e-05 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000296+0000", 2024-09-12T22:05:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116082 2024-09-12T22:05:22.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:22.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096549+0000", 2024-09-12T22:05:22.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096252989999999997 2024-09-12T22:05:22.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096595+0000", 2024-09-12T22:05:22.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5905000000000002e-05 2024-09-12T22:05:22.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096666+0000", 2024-09-12T22:05:22.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1347999999999995e-05 2024-09-12T22:05:22.901 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.901 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.901 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.901 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128881 5.c e42/40 5:377bf234:::benchmark_data_smithi043_32659_object128880:head v 42'8005, mlcod=42'8003)", 2024-09-12T22:05:22.901 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:22.901 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.861165245000002, 2024-09-12T22:05:22.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096393217000000003, 2024-09-12T22:05:22.901 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.901 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.902 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.902 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:22.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000146+0000", 2024-09-12T22:05:22.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000147+0000", 2024-09-12T22:05:22.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8299999999999996e-07 2024-09-12T22:05:22.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000162+0000", 2024-09-12T22:05:22.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4938e-05 2024-09-12T22:05:22.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000169+0000", 2024-09-12T22:05:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.401e-06 2024-09-12T22:05:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000174+0000", 2024-09-12T22:05:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.288e-06 2024-09-12T22:05:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000221+0000", 2024-09-12T22:05:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6972999999999999e-05 2024-09-12T22:05:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000238+0000", 2024-09-12T22:05:22.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7065999999999999e-05 2024-09-12T22:05:22.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096495+0000", 2024-09-12T22:05:22.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096256605999999995 2024-09-12T22:05:22.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096539+0000", 2024-09-12T22:05:22.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4162000000000002e-05 2024-09-12T22:05:22.905 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.905 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.860939721999998, 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:22.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.907 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:22.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:22.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:22.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:22.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:22.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:22.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:22.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:22.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:22.910 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:22.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:22.910 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.910 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.910 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.910 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:22.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:22.910 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.910 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.910 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.910 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:22.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:22.910 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.910 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128886 5.d 5:bbd01d11:::benchmark_data_smithi043_32659_object128885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.860820017999998, 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095976436999999998, 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128886 2024-09-12T22:05:22.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.912 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:22.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000491+0000", 2024-09-12T22:05:22.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000492+0000", 2024-09-12T22:05:22.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:05:22.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000519+0000", 2024-09-12T22:05:22.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7781e-05 2024-09-12T22:05:22.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000527+0000", 2024-09-12T22:05:22.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1040000000000001e-06 2024-09-12T22:05:22.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000532+0000", 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1240000000000004e-06 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001311+0000", 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077974999999999995 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001421+0000", 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011000100000000001 2024-09-12T22:05:22.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:22.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:22.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076596900000000002 2024-09-12T22:05:22.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004327+0000", 2024-09-12T22:05:22.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021401290000000002 2024-09-12T22:05:22.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:22.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004384+0000", 2024-09-12T22:05:22.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6181000000000003e-05 2024-09-12T22:05:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004432+0000", 2024-09-12T22:05:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8157e-05 2024-09-12T22:05:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096468+0000", 2024-09-12T22:05:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092035681999999994 2024-09-12T22:05:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.6 e 42/42 lb 5:6197513c:::benchmark_data_smithi043_32659_object98745:head)", 2024-09-12T22:05:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.860228736000003, 2024-09-12T22:05:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095402735000000002, 2024-09-12T22:05:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001082+0000", 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001083+0000", 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001090+0000", 2024-09-12T22:05:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3699999999999997e-06 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001099+0000", 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.234e-06 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001106+0000", 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1530000000000002e-06 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096371+0000", 2024-09-12T22:05:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095265353999999997 2024-09-12T22:05:22.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.920 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.920 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096389+0000", 2024-09-12T22:05:22.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8459000000000001e-05 2024-09-12T22:05:22.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.920 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.920 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096485+0000", 2024-09-12T22:05:22.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5715000000000001e-05 2024-09-12T22:05:22.920 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.920 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128885 5.6 e42/40 5:68317e68:::benchmark_data_smithi043_32659_object128884:head v 42'7988, mlcod=42'7986)", 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.860005168000001, 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097736137000000001, 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:22.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.924 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:22.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001306+0000", 2024-09-12T22:05:22.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:05:22.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001310+0000", 2024-09-12T22:05:22.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1230000000000002e-06 2024-09-12T22:05:22.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001318+0000", 2024-09-12T22:05:22.927 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:05:22.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.928 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.928 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001323+0000", 2024-09-12T22:05:22.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5689999999999998e-06 2024-09-12T22:05:22.928 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.928 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.928 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001653+0000", 2024-09-12T22:05:22.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033078300000000002 2024-09-12T22:05:22.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001671+0000", 2024-09-12T22:05:22.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7966999999999999e-05 2024-09-12T22:05:22.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098998+0000", 2024-09-12T22:05:22.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097327102999999998 2024-09-12T22:05:22.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.931 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099042+0000", 2024-09-12T22:05:22.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3622999999999999e-05 2024-09-12T22:05:22.931 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.931 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.931 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.932 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128887 5.8 5:157564c6:::benchmark_data_smithi043_32659_object128886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.932 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:22.932 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.859913687000002, 2024-09-12T22:05:22.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098115799000000004, 2024-09-12T22:05:22.932 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.932 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.932 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.932 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.932 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.932 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.933 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128887 2024-09-12T22:05:22.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.933 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.933 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:22.933 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001397+0000", 2024-09-12T22:05:22.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.934 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001403+0000", 2024-09-12T22:05:22.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:05:22.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.934 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001492+0000", 2024-09-12T22:05:22.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8332999999999996e-05 2024-09-12T22:05:22.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001514+0000", 2024-09-12T22:05:22.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155e-05 2024-09-12T22:05:22.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001521+0000", 2024-09-12T22:05:22.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2869999999999999e-06 2024-09-12T22:05:22.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003092+0000", 2024-09-12T22:05:22.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001570926 2024-09-12T22:05:22.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003200+0000", 2024-09-12T22:05:22.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010764000000000001 2024-09-12T22:05:22.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:22.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099388+0000", 2024-09-12T22:05:22.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096188953999999993 2024-09-12T22:05:22.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099437+0000", 2024-09-12T22:05:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8560999999999998e-05 2024-09-12T22:05:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099513+0000", 2024-09-12T22:05:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6182999999999999e-05 2024-09-12T22:05:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.859124883, 2024-09-12T22:05:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.939 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.939 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.939 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.939 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.939 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:22.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.940 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:22.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.941 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:22.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:22.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:22.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:22.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:22.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:22.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:22.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:22.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:22.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:22.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:22.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:22.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:22.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:22.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:22.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:22.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:22.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:22.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.947 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.947 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:22.947 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:22.947 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.947 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.947 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.948 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128889 5.b 5:dfee4b2a:::benchmark_data_smithi043_32659_object128888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.948 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:22.948 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.858860743000001, 2024-09-12T22:05:22.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098009796999999996, 2024-09-12T22:05:22.948 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.949 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.949 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.949 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.949 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.949 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.949 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128889 2024-09-12T22:05:22.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.949 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:22.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002450+0000", 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002451+0000", 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8199999999999999e-07 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002537+0000", 2024-09-12T22:05:22.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6324999999999998e-05 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002546+0000", 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.704e-06 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002554+0000", 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002621+0000", 2024-09-12T22:05:22.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6872000000000006e-05 2024-09-12T22:05:22.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002746+0000", 2024-09-12T22:05:22.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125604 2024-09-12T22:05:22.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:22.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100340+0000", 2024-09-12T22:05:22.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097593665999999996 2024-09-12T22:05:22.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100395+0000", 2024-09-12T22:05:22.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4799999999999997e-05 2024-09-12T22:05:22.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100460+0000", 2024-09-12T22:05:22.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5369000000000004e-05 2024-09-12T22:05:22.953 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.953 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.953 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.953 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128890 5.c e42/40 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head v 42'8006, mlcod=42'8003)", 2024-09-12T22:05:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.858355768000003, 2024-09-12T22:05:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096856719999999993, 2024-09-12T22:05:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002955+0000", 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002956+0000", 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002961+0000", 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2449999999999998e-06 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002970+0000", 2024-09-12T22:05:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4800000000000001e-06 2024-09-12T22:05:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002976+0000", 2024-09-12T22:05:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:05:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003068+0000", 2024-09-12T22:05:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1791000000000003e-05 2024-09-12T22:05:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003085+0000", 2024-09-12T22:05:22.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7708999999999999e-05 2024-09-12T22:05:22.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099760+0000", 2024-09-12T22:05:22.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.096674866999999998 2024-09-12T22:05:22.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099812+0000", 2024-09-12T22:05:22.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1780000000000002e-05 2024-09-12T22:05:22.958 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.958 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.958 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.958 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128891 5.6 e42/40 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head v 42'7989, mlcod=42'7986)", 2024-09-12T22:05:22.958 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:22.958 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.857226339999997, 2024-09-12T22:05:22.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095731964000000003, 2024-09-12T22:05:22.958 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.958 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.958 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.958 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004085+0000", 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004091+0000", 2024-09-12T22:05:22.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:05:22.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004098+0000", 2024-09-12T22:05:22.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6550000000000004e-06 2024-09-12T22:05:22.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004104+0000", 2024-09-12T22:05:22.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.468e-06 2024-09-12T22:05:22.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096513+0000", 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092409162000000003 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096535+0000", 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2158e-05 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099774+0000", 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032391299999999998 2024-09-12T22:05:22.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099817+0000", 2024-09-12T22:05:22.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2512000000000002e-05 2024-09-12T22:05:22.962 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.962 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.962 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.962 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128892 5.d 5:b6ff55b5:::benchmark_data_smithi043_32659_object128891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:22.963 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:22.963 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.856471898000002, 2024-09-12T22:05:22.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095940712999999997, 2024-09-12T22:05:22.963 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.963 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.963 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.963 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.963 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.963 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.963 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128892 2024-09-12T22:05:22.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.963 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:22.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004839+0000", 2024-09-12T22:05:22.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004840+0000", 2024-09-12T22:05:22.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:22.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.004898+0000", 2024-09-12T22:05:22.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8044000000000002e-05 2024-09-12T22:05:22.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096366+0000", 2024-09-12T22:05:22.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091467557000000005 2024-09-12T22:05:22.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096382+0000", 2024-09-12T22:05:22.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:05:22.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096498+0000", 2024-09-12T22:05:22.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011594700000000001 2024-09-12T22:05:22.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096811+0000", 2024-09-12T22:05:22.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031350300000000002 2024-09-12T22:05:22.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:22.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097013+0000", 2024-09-12T22:05:22.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020195099999999999 2024-09-12T22:05:22.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099417+0000", 2024-09-12T22:05:22.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024036819999999999 2024-09-12T22:05:22.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:22.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100616+0000", 2024-09-12T22:05:22.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011990569999999999 2024-09-12T22:05:22.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100673+0000", 2024-09-12T22:05:22.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6997999999999999e-05 2024-09-12T22:05:22.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.100780+0000", 2024-09-12T22:05:22.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106983 2024-09-12T22:05:22.971 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.971 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.971 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.972 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:128896 5.6 e42/40 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head v 42'7990, mlcod=42'7986)", 2024-09-12T22:05:22.972 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:22.972 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.855792796000003, 2024-09-12T22:05:22.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097119591000000005, 2024-09-12T22:05:22.972 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.973 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.973 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.973 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:22.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005518+0000", 2024-09-12T22:05:22.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005519+0000", 2024-09-12T22:05:22.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:05:22.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.005522+0000", 2024-09-12T22:05:22.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:05:22.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096683+0000", 2024-09-12T22:05:22.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.091161833999999997 2024-09-12T22:05:22.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.096691+0000", 2024-09-12T22:05:22.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:05:22.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097890+0000", 2024-09-12T22:05:22.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001199627 2024-09-12T22:05:22.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.097909+0000", 2024-09-12T22:05:22.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8746e-05 2024-09-12T22:05:22.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102559+0000", 2024-09-12T22:05:22.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046501590000000001 2024-09-12T22:05:22.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102638+0000", 2024-09-12T22:05:22.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8835e-05 2024-09-12T22:05:22.980 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.980 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.980 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:207316 5.d 5:b199774a:::benchmark_data_smithi043_32659_object40078:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.413331275000001, 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.095080382000000005, 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 207316 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:22.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447980+0000", 2024-09-12T22:05:22.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447981+0000", 2024-09-12T22:05:22.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1999999999999998e-07 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447985+0000", 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1910000000000002e-06 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.447999+0000", 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4185000000000001e-05 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448006+0000", 2024-09-12T22:05:22.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8929999999999999e-06 2024-09-12T22:05:22.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448050+0000", 2024-09-12T22:05:22.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4406999999999997e-05 2024-09-12T22:05:22.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448236+0000", 2024-09-12T22:05:22.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018612899999999999 2024-09-12T22:05:22.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:22.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.448357+0000", 2024-09-12T22:05:22.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000120303 2024-09-12T22:05:22.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:22.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450305+0000", 2024-09-12T22:05:22.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001947952 2024-09-12T22:05:22.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.542919+0000", 2024-09-12T22:05:22.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.092613928999999998 2024-09-12T22:05:22.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.542971+0000", 2024-09-12T22:05:22.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2083000000000003e-05 2024-09-12T22:05:22.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.543060+0000", 2024-09-12T22:05:22.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9489999999999999e-05 2024-09-12T22:05:22.986 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.986 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.987 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.987 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:207325 5.9 5:98263198:::benchmark_data_smithi043_32659_object40087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:22.987 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:22.987 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.411182303, 2024-09-12T22:05:22.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.089568523999999997, 2024-09-12T22:05:22.987 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:22.987 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:22.987 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:22.987 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:22.987 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:22.987 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:22.987 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 207325 2024-09-12T22:05:22.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.988 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:22.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:22.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:22.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:22.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:22.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:22.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:22.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450129+0000", 2024-09-12T22:05:22.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3399999999999999e-07 2024-09-12T22:05:22.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:22.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450132+0000", 2024-09-12T22:05:22.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:05:22.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:22.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450139+0000", 2024-09-12T22:05:22.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6290000000000004e-06 2024-09-12T22:05:22.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:22.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450144+0000", 2024-09-12T22:05:22.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3290000000000001e-06 2024-09-12T22:05:22.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:22.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450205+0000", 2024-09-12T22:05:22.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0504999999999998e-05 2024-09-12T22:05:22.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:22.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450373+0000", 2024-09-12T22:05:22.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000168314 2024-09-12T22:05:22.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:22.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.450485+0000", 2024-09-12T22:05:22.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011231299999999999 2024-09-12T22:05:22.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:22.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.452226+0000", 2024-09-12T22:05:22.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017412409999999999 2024-09-12T22:05:22.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:22.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539592+0000", 2024-09-12T22:05:22.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.087365211999999998 2024-09-12T22:05:22.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:22.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539633+0000", 2024-09-12T22:05:22.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1165000000000003e-05 2024-09-12T22:05:22.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:22.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:22.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:22.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:09.539697+0000", 2024-09-12T22:05:22.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4519999999999999e-05 2024-09-12T22:05:22.995 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.995 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.995 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.995 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:22.995 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:22.995 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:22.998 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:22.995+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:22.998 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:23.098 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:23.096+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:23.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:05:23.141 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:242313 5.7 5:eb1c0415:::benchmark_data_smithi043_32659_object75075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T22:05:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:23.135031+0000", 2024-09-12T22:05:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0055630610000000002, 2024-09-12T22:05:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055808469999999999, 2024-09-12T22:05:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 242313 2024-09-12T22:05:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135031+0000", 2024-09-12T22:05:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135031+0000", 2024-09-12T22:05:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135031+0000", 2024-09-12T22:05:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999996e-07 2024-09-12T22:05:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135038+0000", 2024-09-12T22:05:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-09-12T22:05:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135052+0000", 2024-09-12T22:05:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4521e-05 2024-09-12T22:05:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135059+0000", 2024-09-12T22:05:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2289999999999997e-06 2024-09-12T22:05:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135123+0000", 2024-09-12T22:05:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3157999999999994e-05 2024-09-12T22:05:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135225+0000", 2024-09-12T22:05:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102179 2024-09-12T22:05:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135303+0000", 2024-09-12T22:05:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7911000000000007e-05 2024-09-12T22:05:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.139221+0000", 2024-09-12T22:05:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039183960000000002 2024-09-12T22:05:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:242314 5.7 5:ee9ff2fb:::benchmark_data_smithi043_32659_object75076:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T22:05:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:23.135218+0000", 2024-09-12T22:05:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0053753589999999997, 2024-09-12T22:05:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054540040000000001, 2024-09-12T22:05:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 242314 2024-09-12T22:05:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135218+0000", 2024-09-12T22:05:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135218+0000", 2024-09-12T22:05:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135219+0000", 2024-09-12T22:05:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135223+0000", 2024-09-12T22:05:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5599999999999998e-06 2024-09-12T22:05:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135231+0000", 2024-09-12T22:05:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6929999999999996e-06 2024-09-12T22:05:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.135238+0000", 2024-09-12T22:05:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7000000000000002e-06 2024-09-12T22:05:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.136834+0000", 2024-09-12T22:05:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001595888 2024-09-12T22:05:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.136987+0000", 2024-09-12T22:05:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015287300000000001 2024-09-12T22:05:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.137106+0000", 2024-09-12T22:05:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011898800000000001 2024-09-12T22:05:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.139263+0000", 2024-09-12T22:05:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021576130000000001 2024-09-12T22:05:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:242323 5.5 5:a1c58bd6:::benchmark_data_smithi043_32659_object75085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T22:05:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:23.136657+0000", 2024-09-12T22:05:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0039362939999999999, 2024-09-12T22:05:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040608270000000004, 2024-09-12T22:05:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 242323 2024-09-12T22:05:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.136657+0000", 2024-09-12T22:05:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.136657+0000", 2024-09-12T22:05:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.136658+0000", 2024-09-12T22:05:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1100000000000005e-07 2024-09-12T22:05:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.136662+0000", 2024-09-12T22:05:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2950000000000004e-06 2024-09-12T22:05:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.136671+0000", 2024-09-12T22:05:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.136679+0000", 2024-09-12T22:05:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7710000000000006e-06 2024-09-12T22:05:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.136721+0000", 2024-09-12T22:05:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1297000000000001e-05 2024-09-12T22:05:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.136870+0000", 2024-09-12T22:05:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014992099999999999 2024-09-12T22:05:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.137333+0000", 2024-09-12T22:05:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000462991 2024-09-12T22:05:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.139904+0000", 2024-09-12T22:05:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0025707410000000001 2024-09-12T22:05:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:242327 5.f e58/40 5:f934c840:::benchmark_data_smithi043_32659_object75089:head v 58'15192, mlcod=58'15187)", 2024-09-12T22:05:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:23.140583+0000", 2024-09-12T22:05:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 1.0288e-05, 2024-09-12T22:05:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017786599999999999, 2024-09-12T22:05:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:23.164 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:23.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:23.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140583+0000", 2024-09-12T22:05:23.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:23.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:23.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140583+0000", 2024-09-12T22:05:23.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:23.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:23.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140584+0000", 2024-09-12T22:05:23.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.82e-07 2024-09-12T22:05:23.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:23.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140587+0000", 2024-09-12T22:05:23.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5190000000000001e-06 2024-09-12T22:05:23.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:23.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140596+0000", 2024-09-12T22:05:23.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7690000000000002e-06 2024-09-12T22:05:23.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:23.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140601+0000", 2024-09-12T22:05:23.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2989999999999996e-06 2024-09-12T22:05:23.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:23.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140636+0000", 2024-09-12T22:05:23.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:05:23.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:23.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140648+0000", 2024-09-12T22:05:23.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1698999999999999e-05 2024-09-12T22:05:23.169 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:23.170 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:23.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:23.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.170 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:242328 5.c 5:36956b76:::benchmark_data_smithi043_32659_object75090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T22:05:23.170 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:23.140598+0000", 2024-09-12T22:05:23.170 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999952, 2024-09-12T22:05:23.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000195119, 2024-09-12T22:05:23.171 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:23.171 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:23.171 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:23.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:23.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:23.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:23.172 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 242328 2024-09-12T22:05:23.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.172 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:23.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:23.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140598+0000", 2024-09-12T22:05:23.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:23.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:23.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140598+0000", 2024-09-12T22:05:23.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:23.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:23.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140599+0000", 2024-09-12T22:05:23.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0950000000000001e-06 2024-09-12T22:05:23.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:23.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140604+0000", 2024-09-12T22:05:23.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.527e-06 2024-09-12T22:05:23.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:23.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140614+0000", 2024-09-12T22:05:23.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0377000000000001e-05 2024-09-12T22:05:23.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:23.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140621+0000", 2024-09-12T22:05:23.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4810000000000003e-06 2024-09-12T22:05:23.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:23.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:23.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:23.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:23.140674+0000", 2024-09-12T22:05:23.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3263000000000001e-05 2024-09-12T22:05:23.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:23.178 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:23.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:23.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:23.178 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:23.178 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 5 2024-09-12T22:05:23.178 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:23.180 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:23.221 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:23.220+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:23.254 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:23.274 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:23.274 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:23.294 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:23.294 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:23.298 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:23.298 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:23.299 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:23.298+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:23.367 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:23.367 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:23.380 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:23.422 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:23.421+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:23.500 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:23.499+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:23.572 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:23.572 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:23.584 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:23.601 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:23.600+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:23.702 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:23.700+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:23.741 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:23.741 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:23.756 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:23.802 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:23.801+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:23.903 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:23.902+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:23.918 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:23.918 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:23.933 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:24.004 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:05:24.005 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:24.003+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:24.094 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:24.094 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:24.105 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:24.104+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:24.108 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:24.207 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:24.206+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:24.255 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:24.255 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:24.267 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:24.311 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:24.310+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:24.409 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:24.408+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:24.410 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:24.410 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:24.422 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:24.548 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:24.509+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:24.578 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:24.578 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:24.591 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:24.636 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:24.635+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:24.713 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:24.711+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:24.752 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:24.752 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:24.766 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:24.813 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:24.812+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:24.914 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:24.913+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:24.964 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:24.964 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:24.967 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-09-12T22:05:24.977 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:25.021 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:25.018+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:25.115 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:25.114+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:25.170 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:25.170 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:25.183 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:25.217 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:25.216+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:25.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:05:25.317 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:25.316+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:25.324 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:25.325 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:25.337 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:25.408 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:25.418 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:25.417+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:25.428 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:25.429 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:25.448 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:25.448 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:25.451 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:25.452 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:25.518 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:25.517+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:25.529 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:25.529 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:25.542 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:25.620 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:25.619+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:25.695 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.281281237000002, 2024-09-12T22:05:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.281101307, 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.281034865999999, 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.280978423000001, 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.280909962999999, 2024-09-12T22:05:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:25.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:25.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:25.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:25.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:25.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:25.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:25.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.280852228000001, 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:25.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:25.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:25.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:25.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:25.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:25.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:25.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:25.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:25.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:25.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:25.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:25.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:25.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:25.730 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.731 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.731 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.731 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:25.731 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:25.731 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.280784535999999, 2024-09-12T22:05:25.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:25.731 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.731 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.731 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.731 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.731 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.731 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.732 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:25.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.732 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.280729473999997, 2024-09-12T22:05:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.240081953999997, 2024-09-12T22:05:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.237468225999997, 2024-09-12T22:05:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.692254130000002, 2024-09-12T22:05:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.691775642000003, 2024-09-12T22:05:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.689280342000004, 2024-09-12T22:05:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.688199550999997, 2024-09-12T22:05:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.686963988999999, 2024-09-12T22:05:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.246223500999999, 2024-09-12T22:05:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.241693074000001, 2024-09-12T22:05:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.241669044999998, 2024-09-12T22:05:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.241491396000001, 2024-09-12T22:05:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.239472858999999, 2024-09-12T22:05:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:25.821 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:25.823 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:25.824 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:25.821+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:25.923 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:25.922+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:25.984 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:25.984 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:25.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.984 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:249931 5.8 5:1b581679:::benchmark_data_smithi043_32659_object82693:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:25.984 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.977796+0000", 2024-09-12T22:05:25.984 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0038070270000000002, 2024-09-12T22:05:25.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038308499999999998, 2024-09-12T22:05:25.984 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:25.984 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:25.984 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:25.985 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:25.985 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:25.985 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.985 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 249931 2024-09-12T22:05:25.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.985 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:25.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:25.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977796+0000", 2024-09-12T22:05:25.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:25.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:25.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977796+0000", 2024-09-12T22:05:25.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:25.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:25.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977796+0000", 2024-09-12T22:05:25.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4300000000000003e-07 2024-09-12T22:05:25.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:25.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977799+0000", 2024-09-12T22:05:25.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7080000000000002e-06 2024-09-12T22:05:25.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:25.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977806+0000", 2024-09-12T22:05:25.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3180000000000001e-06 2024-09-12T22:05:25.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977812+0000", 2024-09-12T22:05:25.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1890000000000004e-06 2024-09-12T22:05:25.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:25.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.979735+0000", 2024-09-12T22:05:25.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019220179999999999 2024-09-12T22:05:25.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:25.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.979977+0000", 2024-09-12T22:05:25.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00024240199999999999 2024-09-12T22:05:25.988 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:25.988 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:25.988 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:25.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.988 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:249932 5.9 5:9dd85c2f:::benchmark_data_smithi043_32659_object82694:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:25.988 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.977826+0000", 2024-09-12T22:05:25.988 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0037770970000000001, 2024-09-12T22:05:25.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038683540000000001, 2024-09-12T22:05:25.988 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:25.989 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:25.989 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:25.989 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:25.989 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:25.989 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.989 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 249932 2024-09-12T22:05:25.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.989 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:25.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:25.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977826+0000", 2024-09-12T22:05:25.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:25.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977826+0000", 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977826+0000", 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9999999999999997e-07 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977829+0000", 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2620000000000001e-06 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:25.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977835+0000", 2024-09-12T22:05:25.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9859999999999999e-06 2024-09-12T22:05:25.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977840+0000", 2024-09-12T22:05:25.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0810000000000001e-06 2024-09-12T22:05:25.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:25.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981559+0000", 2024-09-12T22:05:25.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003719806 2024-09-12T22:05:25.991 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:25.992 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:25.992 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:25.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.992 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:249934 5.f 5:fd0e4319:::benchmark_data_smithi043_32659_object82696:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:25.992 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.978229+0000", 2024-09-12T22:05:25.992 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0033739619999999999, 2024-09-12T22:05:25.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035212609999999999, 2024-09-12T22:05:25.992 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:25.992 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:25.992 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:25.992 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:25.992 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:25.992 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:25.993 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 249934 2024-09-12T22:05:25.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.993 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:25.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:25.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978229+0000", 2024-09-12T22:05:25.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:25.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:25.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978229+0000", 2024-09-12T22:05:25.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:25.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978230+0000", 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978233+0000", 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.568e-06 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978241+0000", 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6499999999999996e-06 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978247+0000", 2024-09-12T22:05:25.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1199999999999999e-06 2024-09-12T22:05:25.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:25.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978294+0000", 2024-09-12T22:05:25.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7280999999999997e-05 2024-09-12T22:05:25.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:25.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978444+0000", 2024-09-12T22:05:25.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015011399999999999 2024-09-12T22:05:25.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:25.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978543+0000", 2024-09-12T22:05:25.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8615000000000004e-05 2024-09-12T22:05:25.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:25.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980199+0000", 2024-09-12T22:05:25.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001656516 2024-09-12T22:05:25.996 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:25.996 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:25.996 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:25.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.997 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:249933 5.c e59/40 5:3f527ddd:::benchmark_data_smithi043_32659_object82695:head v 59'15627, mlcod=59'15625)", 2024-09-12T22:05:25.997 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.978279+0000", 2024-09-12T22:05:25.997 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0033237570000000001, 2024-09-12T22:05:25.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003547077, 2024-09-12T22:05:25.997 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:25.997 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:25.997 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:25.997 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:25.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:25.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978279+0000", 2024-09-12T22:05:25.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:25.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978279+0000", 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978280+0000", 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7400000000000003e-07 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978289+0000", 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0410000000000003e-06 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:25.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978297+0000", 2024-09-12T22:05:25.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1899999999999995e-06 2024-09-12T22:05:25.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:25.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978303+0000", 2024-09-12T22:05:25.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6110000000000001e-06 2024-09-12T22:05:25.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:25.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:25.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:25.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978351+0000", 2024-09-12T22:05:25.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8699000000000002e-05 2024-09-12T22:05:25.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978370+0000", 2024-09-12T22:05:26.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8875000000000001e-05 2024-09-12T22:05:26.000 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.000 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.000 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.000 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:249936 5.0 5:0d621642:::benchmark_data_smithi043_32659_object82698:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.000 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.980503+0000", 2024-09-12T22:05:26.000 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0010995250000000001, 2024-09-12T22:05:26.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0013790899999999999, 2024-09-12T22:05:26.000 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.001 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.001 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:26.001 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.001 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.001 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.001 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 249936 2024-09-12T22:05:26.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.001 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980503+0000", 2024-09-12T22:05:26.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980503+0000", 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980504+0000", 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980508+0000", 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2230000000000001e-06 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980514+0000", 2024-09-12T22:05:26.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1419999999999998e-06 2024-09-12T22:05:26.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980519+0000", 2024-09-12T22:05:26.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3919999999999996e-06 2024-09-12T22:05:26.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980568+0000", 2024-09-12T22:05:26.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9184999999999997e-05 2024-09-12T22:05:26.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980738+0000", 2024-09-12T22:05:26.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000169722 2024-09-12T22:05:26.004 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.004 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.004 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.004 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:249935 5.c e59/40 5:30d119c5:::benchmark_data_smithi043_32659_object82697:head v 59'15628, mlcod=59'15625)", 2024-09-12T22:05:26.004 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.980847+0000", 2024-09-12T22:05:26.004 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00075618300000000001, 2024-09-12T22:05:26.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001101082, 2024-09-12T22:05:26.004 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980847+0000", 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980847+0000", 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980847+0000", 2024-09-12T22:05:26.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6599999999999996e-07 2024-09-12T22:05:26.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980852+0000", 2024-09-12T22:05:26.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1490000000000002e-06 2024-09-12T22:05:26.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980860+0000", 2024-09-12T22:05:26.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9680000000000006e-06 2024-09-12T22:05:26.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980866+0000", 2024-09-12T22:05:26.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6110000000000001e-06 2024-09-12T22:05:26.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980929+0000", 2024-09-12T22:05:26.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3435999999999994e-05 2024-09-12T22:05:26.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980950+0000", 2024-09-12T22:05:26.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0996e-05 2024-09-12T22:05:26.007 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:249916 5.8 5:1ee68f15:::benchmark_data_smithi043_32659_object82678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.973971+0000", 2024-09-12T22:05:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0076317570000000003, 2024-09-12T22:05:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0080274330000000005, 2024-09-12T22:05:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 249916 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.973971+0000", 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.973971+0000", 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.973971+0000", 2024-09-12T22:05:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6399999999999998e-07 2024-09-12T22:05:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.973973+0000", 2024-09-12T22:05:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.827e-06 2024-09-12T22:05:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.973979+0000", 2024-09-12T22:05:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.032e-06 2024-09-12T22:05:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.973984+0000", 2024-09-12T22:05:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.702e-06 2024-09-12T22:05:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.976083+0000", 2024-09-12T22:05:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020988159999999999 2024-09-12T22:05:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.976349+0000", 2024-09-12T22:05:26.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000265989 2024-09-12T22:05:26.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981864+0000", 2024-09-12T22:05:26.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0055148549999999999 2024-09-12T22:05:26.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981909+0000", 2024-09-12T22:05:26.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5841999999999999e-05 2024-09-12T22:05:26.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981998+0000", 2024-09-12T22:05:26.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9005999999999995e-05 2024-09-12T22:05:26.013 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.013 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.013 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.013 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.3 e 59/59 lb 5:c328e52f:::benchmark_data_smithi043_32659_object160164:head)", 2024-09-12T22:05:26.013 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.981035+0000", 2024-09-12T22:05:26.013 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00056775300000000005, 2024-09-12T22:05:26.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0010425899999999999, 2024-09-12T22:05:26.013 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.013 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.013 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:26.014 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981035+0000", 2024-09-12T22:05:26.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981035+0000", 2024-09-12T22:05:26.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981035+0000", 2024-09-12T22:05:26.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4999999999999998e-07 2024-09-12T22:05:26.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981042+0000", 2024-09-12T22:05:26.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8190000000000003e-06 2024-09-12T22:05:26.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981050+0000", 2024-09-12T22:05:26.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:05:26.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981055+0000", 2024-09-12T22:05:26.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9559999999999996e-06 2024-09-12T22:05:26.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982025+0000", 2024-09-12T22:05:26.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000969694 2024-09-12T22:05:26.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982038+0000", 2024-09-12T22:05:26.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2670000000000001e-05 2024-09-12T22:05:26.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982080+0000", 2024-09-12T22:05:26.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2341e-05 2024-09-12T22:05:26.017 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.017 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.017 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.017 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:249930 5.9 e59/40)", 2024-09-12T22:05:26.017 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.981498+0000", 2024-09-12T22:05:26.017 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000105109, 2024-09-12T22:05:26.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00064183399999999998, 2024-09-12T22:05:26.017 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981498+0000", 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981498+0000", 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981498+0000", 2024-09-12T22:05:26.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3900000000000004e-07 2024-09-12T22:05:26.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981503+0000", 2024-09-12T22:05:26.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4279999999999998e-06 2024-09-12T22:05:26.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981511+0000", 2024-09-12T22:05:26.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:05:26.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981517+0000", 2024-09-12T22:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2990000000000002e-06 2024-09-12T22:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:249938 5.b 5:dcbca3f0:::benchmark_data_smithi043_32659_object82700:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.981987+0000", 2024-09-12T22:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9996161, 2024-09-12T22:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020337799999999999, 2024-09-12T22:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 249938 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981987+0000", 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981987+0000", 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981988+0000", 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4099999999999997e-07 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.981992+0000", 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5539999999999999e-06 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982002+0000", 2024-09-12T22:05:26.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5489999999999995e-06 2024-09-12T22:05:26.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982008+0000", 2024-09-12T22:05:26.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.387e-06 2024-09-12T22:05:26.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982090+0000", 2024-09-12T22:05:26.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1830999999999996e-05 2024-09-12T22:05:26.023 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.023 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.023 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:249919 5.8 5:1a19aafc:::benchmark_data_smithi043_32659_object82681:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.974245+0000", 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0073577360000000001, 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0080022200000000009, 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 249919 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.024 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.974245+0000", 2024-09-12T22:05:26.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.974245+0000", 2024-09-12T22:05:26.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.974246+0000", 2024-09-12T22:05:26.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1800000000000005e-07 2024-09-12T22:05:26.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.974251+0000", 2024-09-12T22:05:26.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9139999999999999e-06 2024-09-12T22:05:26.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.974261+0000", 2024-09-12T22:05:26.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9140000000000003e-06 2024-09-12T22:05:26.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.974268+0000", 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9700000000000002e-06 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977986+0000", 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037183820000000001 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978174+0000", 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018833200000000001 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.028 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:249940 5.6 5:6928e0dd:::benchmark_data_smithi043_32659_object82702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.028 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.982030+0000", 2024-09-12T22:05:26.028 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9995723, 2024-09-12T22:05:26.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027847499999999998, 2024-09-12T22:05:26.028 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.028 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.028 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:26.028 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.028 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.028 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.028 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 249940 2024-09-12T22:05:26.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.028 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982030+0000", 2024-09-12T22:05:26.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982030+0000", 2024-09-12T22:05:26.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982031+0000", 2024-09-12T22:05:26.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0800000000000005e-07 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982034+0000", 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5639999999999999e-06 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982040+0000", 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7630000000000003e-06 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982045+0000", 2024-09-12T22:05:26.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1410000000000004e-06 2024-09-12T22:05:26.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982084+0000", 2024-09-12T22:05:26.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8852e-05 2024-09-12T22:05:26.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982177+0000", 2024-09-12T22:05:26.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3011999999999996e-05 2024-09-12T22:05:26.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982238+0000", 2024-09-12T22:05:26.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0328000000000002e-05 2024-09-12T22:05:26.032 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.032 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.032 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.032 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:249941 5.6 5.5f43e746 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.032 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.982123+0000", 2024-09-12T22:05:26.032 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9994802, 2024-09-12T22:05:26.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000254369, 2024-09-12T22:05:26.032 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.032 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.032 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:26.032 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 249941 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982123+0000", 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982123+0000", 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982124+0000", 2024-09-12T22:05:26.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9699999999999995e-07 2024-09-12T22:05:26.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982128+0000", 2024-09-12T22:05:26.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5709999999999999e-06 2024-09-12T22:05:26.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982136+0000", 2024-09-12T22:05:26.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3240000000000003e-06 2024-09-12T22:05:26.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982143+0000", 2024-09-12T22:05:26.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6050000000000003e-06 2024-09-12T22:05:26.035 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.035 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.035 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.035 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:249923 5.d 5:b9828e6d:::benchmark_data_smithi043_32659_object82685:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.035 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.974600+0000", 2024-09-12T22:05:26.035 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0070024320000000003, 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0078327410000000007, 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 249923 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.974600+0000", 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.974600+0000", 2024-09-12T22:05:26.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.974601+0000", 2024-09-12T22:05:26.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9599999999999999e-07 2024-09-12T22:05:26.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.974605+0000", 2024-09-12T22:05:26.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:05:26.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.974614+0000", 2024-09-12T22:05:26.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5259999999999999e-06 2024-09-12T22:05:26.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.974621+0000", 2024-09-12T22:05:26.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6390000000000003e-06 2024-09-12T22:05:26.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.975741+0000", 2024-09-12T22:05:26.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011198740000000001 2024-09-12T22:05:26.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.975958+0000", 2024-09-12T22:05:26.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000217257 2024-09-12T22:05:26.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.976078+0000", 2024-09-12T22:05:26.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119879 2024-09-12T22:05:26.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977927+0000", 2024-09-12T22:05:26.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018493310000000001 2024-09-12T22:05:26.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982417+0000", 2024-09-12T22:05:26.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0044899390000000001 2024-09-12T22:05:26.040 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.040 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.040 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.040 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:249928 5.0 5:09c319ab:::benchmark_data_smithi043_32659_object82690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.041 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.977585+0000", 2024-09-12T22:05:26.041 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0040177670000000002, 2024-09-12T22:05:26.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004939232, 2024-09-12T22:05:26.041 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.041 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.041 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:26.041 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.041 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.041 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.041 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 249928 2024-09-12T22:05:26.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.041 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977585+0000", 2024-09-12T22:05:26.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977585+0000", 2024-09-12T22:05:26.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977586+0000", 2024-09-12T22:05:26.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.92e-07 2024-09-12T22:05:26.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977590+0000", 2024-09-12T22:05:26.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4009999999999999e-06 2024-09-12T22:05:26.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977599+0000", 2024-09-12T22:05:26.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9730000000000003e-06 2024-09-12T22:05:26.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977606+0000", 2024-09-12T22:05:26.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0049999999999998e-06 2024-09-12T22:05:26.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977856+0000", 2024-09-12T22:05:26.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025009799999999998 2024-09-12T22:05:26.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977996+0000", 2024-09-12T22:05:26.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000139486 2024-09-12T22:05:26.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.982522+0000", 2024-09-12T22:05:26.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045260769999999999 2024-09-12T22:05:26.045 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.045 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.045 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.045 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:249929 5.e 5:74444646:::benchmark_data_smithi043_32659_object82691:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.045 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.977619+0000", 2024-09-12T22:05:26.045 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0039839039999999999, 2024-09-12T22:05:26.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049776769999999998, 2024-09-12T22:05:26.045 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.045 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.045 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:26.045 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 249929 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977619+0000", 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977619+0000", 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977619+0000", 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977622+0000", 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4040000000000002e-06 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977629+0000", 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9009999999999997e-06 2024-09-12T22:05:26.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977634+0000", 2024-09-12T22:05:26.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0679999999999996e-06 2024-09-12T22:05:26.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980025+0000", 2024-09-12T22:05:26.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023910870000000001 2024-09-12T22:05:26.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980176+0000", 2024-09-12T22:05:26.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015101000000000001 2024-09-12T22:05:26.049 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.049 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.049 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.049 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:249930 5.9 5:935e66c1:::benchmark_data_smithi043_32659_object82692:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.049 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:25.977755+0000", 2024-09-12T22:05:26.049 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0038481069999999999, 2024-09-12T22:05:26.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049094990000000003, 2024-09-12T22:05:26.049 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.049 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.049 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:26.049 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.049 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 249930 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977755+0000", 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977755+0000", 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977755+0000", 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8899999999999999e-07 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977759+0000", 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2990000000000001e-06 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977766+0000", 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8050000000000007e-06 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.977773+0000", 2024-09-12T22:05:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1870000000000002e-06 2024-09-12T22:05:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.978179+0000", 2024-09-12T22:05:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00040599100000000002 2024-09-12T22:05:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.979973+0000", 2024-09-12T22:05:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017941319999999999 2024-09-12T22:05:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:25.980080+0000", 2024-09-12T22:05:26.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000107694 2024-09-12T22:05:26.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.053 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.053 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:26.053 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 17 2024-09-12T22:05:26.053 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:26.055 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:26.055 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:26.053+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:26.155 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:26.155+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:26.257 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:26.256+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:26.259 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:26.259 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:26.259 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:26.259 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:26.259 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:26.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:26.359 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:26.357+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:26.459 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:26.458+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:26.482 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:26.482 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:26.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:26.482 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:26.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.482 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:26.482 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:26.482 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 47.480913725000001, 2024-09-12T22:05:26.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:26.482 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.482 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.483 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.483 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.483 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.483 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.483 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:26.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.483 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:26.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:26.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:26.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:26.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:26.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:26.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:26.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:26.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:26.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:26.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:26.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:26.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.487 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.487 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:26.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:26.487 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.487 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.487 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.487 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:26.487 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:26.487 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 47.479094062000001, 2024-09-12T22:05:26.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:26.487 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.488 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.488 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.488 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.488 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.488 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.488 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:26.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.488 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:26.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:26.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:26.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:26.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:26.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:26.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:26.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:26.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:26.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:26.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:26.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:26.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:26.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:26.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:26.492 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.492 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.492 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.492 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:26.492 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 47.478560248000001, 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:26.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:26.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:26.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:26.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:26.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:26.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:26.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:26.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:26.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:26.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:26.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:26.497 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.497 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.497 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.497 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:26.497 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 47.476745409000003, 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:26.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:26.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:26.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:26.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:26.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:26.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:26.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:26.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:26.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:26.502 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.502 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.502 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.502 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.502 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.5146516209999996, 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:26.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:26.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:05:26.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:05:26.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:05:26.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:05:26.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:05:26.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:05:26.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:05:26.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:05:26.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:05:26.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:05:26.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:05:26.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:05:26.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:05:26.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:05:26.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:05:26.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:05:26.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:05:26.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:05:26.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:05:26.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:05:26.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.509 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.5126188960000002, 2024-09-12T22:05:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:05:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:05:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:26.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:26.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:26.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:05:26.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:05:26.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:05:26.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:05:26.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:05:26.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:05:26.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:05:26.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:05:26.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:05:26.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:05:26.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:26.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:05:26.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:05:26.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:05:26.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:05:26.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:05:26.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:05:26.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:05:26.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:05:26.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:05:26.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:05:26.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:05:26.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:05:26.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.516 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.516 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:05:26.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:05:26.516 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.516 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.516 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.516 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.516 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:26.516 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.5096066319999997, 2024-09-12T22:05:26.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:05:26.517 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.517 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.517 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.517 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.517 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.517 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.517 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:05:26.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.517 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.517 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.517 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:26.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:26.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:05:26.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:05:26.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:05:26.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:26.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:05:26.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:05:26.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:05:26.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:05:26.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:05:26.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:05:26.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:05:26.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:05:26.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:05:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:05:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:05:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:05:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:05:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:05:26.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:05:26.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:05:26.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:05:26.523 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.523 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.523 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.523 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.523 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:26.523 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.5086201419999998, 2024-09-12T22:05:26.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:05:26.524 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.524 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.524 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.524 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.524 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.524 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.524 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:05:26.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.524 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:26.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:05:26.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:05:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:05:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:05:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:05:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:05:26.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:05:26.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:05:26.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:05:26.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:05:26.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:05:26.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:05:26.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:05:26.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:05:26.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:05:26.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:05:26.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:05:26.529 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.532 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.532 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.532 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.532 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:26.532 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.5035335080000003, 2024-09-12T22:05:26.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:05:26.533 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.533 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.533 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.533 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.533 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.533 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.533 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:05:26.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.533 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:26.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:26.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:05:26.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:05:26.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:05:26.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:05:26.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:05:26.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:05:26.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:05:26.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:05:26.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:05:26.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:05:26.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:05:26.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:05:26.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:05:26.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:05:26.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:05:26.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:05:26.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:05:26.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:05:26.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:05:26.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:05:26.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:05:26.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:05:26.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:05:26.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:05:26.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:05:26.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:05:26.539 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.539 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.539 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.539 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.539 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:26.539 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.5007785360000003, 2024-09-12T22:05:26.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:05:26.539 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.539 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.539 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:05:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:05:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:05:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:05:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:05:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:05:26.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:05:26.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:05:26.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:05:26.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:05:26.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:05:26.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:05:26.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:05:26.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:05:26.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:05:26.545 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.545 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.545 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.545 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.492803651, 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.546 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:26.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:26.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:05:26.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:05:26.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:05:26.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:05:26.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:05:26.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:05:26.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:05:26.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:05:26.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:05:26.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:05:26.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:05:26.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:05:26.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:05:26.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:05:26.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:05:26.551 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.552 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.552 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.552 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.552 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:26.552 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.4848778750000005, 2024-09-12T22:05:26.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:05:26.552 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.552 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.552 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.552 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.552 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.553 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.553 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:05:26.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.553 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:26.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:26.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:05:26.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:05:26.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:05:26.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:05:26.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:05:26.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:05:26.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:26.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.556 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:05:26.556 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:05:26.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.556 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:05:26.556 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:05:26.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.557 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:05:26.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:05:26.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.557 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.557 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:05:26.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:05:26.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.557 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.557 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:05:26.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:05:26.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:05:26.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:05:26.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:05:26.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:05:26.558 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.558 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.558 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.558 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.4833815929999998, 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.560 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:05:26.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:05:26.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:05:26.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:05:26.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:05:26.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:26.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:05:26.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:05:26.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:05:26.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:05:26.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:05:26.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:05:26.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.563 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.563 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:05:26.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:05:26.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.563 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.563 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:05:26.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:05:26.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.563 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.563 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:05:26.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:05:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:05:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:05:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:05:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:05:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:05:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241896 5.6 5:6ef8d923:::benchmark_data_smithi043_32659_object74658:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.4471884089999998, 2024-09-12T22:05:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99264745399999998, 2024-09-12T22:05:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.566 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.566 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.566 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.566 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241896 2024-09-12T22:05:26.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.566 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:26.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:26.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.567 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.567 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031744+0000", 2024-09-12T22:05:26.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8100000000000001e-07 2024-09-12T22:05:26.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.567 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.567 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031749+0000", 2024-09-12T22:05:26.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.437e-06 2024-09-12T22:05:26.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.567 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031757+0000", 2024-09-12T22:05:26.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6999999999999997e-06 2024-09-12T22:05:26.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031765+0000", 2024-09-12T22:05:26.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6709999999999999e-06 2024-09-12T22:05:26.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031809+0000", 2024-09-12T22:05:26.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3970000000000001e-05 2024-09-12T22:05:26.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031817+0000", 2024-09-12T22:05:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6580000000000002e-06 2024-09-12T22:05:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020952+0000", 2024-09-12T22:05:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.98913576299999995 2024-09-12T22:05:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021031+0000", 2024-09-12T22:05:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8483000000000001e-05 2024-09-12T22:05:26.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.570 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.570 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021091+0000", 2024-09-12T22:05:26.570 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0287000000000001e-05 2024-09-12T22:05:26.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.570 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.570 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024109+0000", 2024-09-12T22:05:26.570 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030178269999999998 2024-09-12T22:05:26.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.570 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.570 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024255+0000", 2024-09-12T22:05:26.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014615799999999999 2024-09-12T22:05:26.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024305+0000", 2024-09-12T22:05:26.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0259000000000001e-05 2024-09-12T22:05:26.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024391+0000", 2024-09-12T22:05:26.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:05:26.571 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.571 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.571 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.572 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241935 5.6 5:60e2bed8:::benchmark_data_smithi043_32659_object74697:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.572 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:26.572 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.4280987840000003, 2024-09-12T22:05:26.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97487546999999997, 2024-09-12T22:05:26.572 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.572 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.572 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.572 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.572 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.572 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.572 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241935 2024-09-12T22:05:26.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.573 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:26.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:26.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050834+0000", 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2500000000000004e-07 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050838+0000", 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7029999999999997e-06 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050853+0000", 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4545000000000001e-05 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.575 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050859+0000", 2024-09-12T22:05:26.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:05:26.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.575 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.575 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050902+0000", 2024-09-12T22:05:26.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3455999999999999e-05 2024-09-12T22:05:26.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.575 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.575 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050909+0000", 2024-09-12T22:05:26.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6950000000000003e-06 2024-09-12T22:05:26.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022045+0000", 2024-09-12T22:05:26.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97113624700000001 2024-09-12T22:05:26.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022168+0000", 2024-09-12T22:05:26.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012233 2024-09-12T22:05:26.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022235+0000", 2024-09-12T22:05:26.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7651000000000007e-05 2024-09-12T22:05:26.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024398+0000", 2024-09-12T22:05:26.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002163005 2024-09-12T22:05:26.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025575+0000", 2024-09-12T22:05:26.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011767590000000001 2024-09-12T22:05:26.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025624+0000", 2024-09-12T22:05:26.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9217e-05 2024-09-12T22:05:26.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025708+0000", 2024-09-12T22:05:26.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4037999999999997e-05 2024-09-12T22:05:26.578 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.578 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.578 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.578 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241940 5.6 5:60be75db:::benchmark_data_smithi043_32659_object74702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.578 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:26.578 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.4250268310000003, 2024-09-12T22:05:26.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97334840700000003, 2024-09-12T22:05:26.579 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.579 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.579 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.579 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.579 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.579 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.579 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241940 2024-09-12T22:05:26.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.579 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:26.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.580 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.580 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:26.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.580 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.580 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.580 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:26.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4700000000000002e-07 2024-09-12T22:05:26.580 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.580 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.581 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053907+0000", 2024-09-12T22:05:26.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.796e-06 2024-09-12T22:05:26.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.581 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.581 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053912+0000", 2024-09-12T22:05:26.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.622e-06 2024-09-12T22:05:26.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.581 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.581 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053915+0000", 2024-09-12T22:05:26.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3009999999999998e-06 2024-09-12T22:05:26.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053952+0000", 2024-09-12T22:05:26.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6668000000000002e-05 2024-09-12T22:05:26.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053957+0000", 2024-09-12T22:05:26.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5849999999999999e-06 2024-09-12T22:05:26.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023005+0000", 2024-09-12T22:05:26.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.96904800700000004 2024-09-12T22:05:26.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023162+0000", 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015720900000000001 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023284+0000", 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012194200000000001 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025765+0000", 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024806099999999998 2024-09-12T22:05:26.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027176+0000", 2024-09-12T22:05:26.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014111180000000001 2024-09-12T22:05:26.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027204+0000", 2024-09-12T22:05:26.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7970000000000002e-05 2024-09-12T22:05:26.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027253+0000", 2024-09-12T22:05:26.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9231999999999999e-05 2024-09-12T22:05:26.585 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.585 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.585 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.585 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.585 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.585 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241966 5.6 5:6538f108:::benchmark_data_smithi043_32659_object74728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.585 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:26.585 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.4072811820000002, 2024-09-12T22:05:26.585 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95692954799999996, 2024-09-12T22:05:26.585 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.585 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.585 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.585 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.585 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.586 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.586 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241966 2024-09-12T22:05:26.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.586 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:26.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:26.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071651+0000", 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071656+0000", 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7929999999999997e-06 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071669+0000", 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2692e-05 2024-09-12T22:05:26.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071676+0000", 2024-09-12T22:05:26.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:05:26.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071716+0000", 2024-09-12T22:05:26.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9817999999999997e-05 2024-09-12T22:05:26.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071721+0000", 2024-09-12T22:05:26.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.057e-06 2024-09-12T22:05:26.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.589 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.589 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.589 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024429+0000", 2024-09-12T22:05:26.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95270825000000003 2024-09-12T22:05:26.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.589 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.589 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.589 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024544+0000", 2024-09-12T22:05:26.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114045 2024-09-12T22:05:26.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.589 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.589 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.589 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024655+0000", 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111382 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028489+0000", 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038338930000000001 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028497+0000", 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7600000000000002e-06 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.590 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028523+0000", 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6268999999999999e-05 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028580+0000", 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7179999999999998e-05 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241967 5.6 5:6c2d2d65:::benchmark_data_smithi043_32659_object74729:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.407233078, 2024-09-12T22:05:26.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958333094, 2024-09-12T22:05:26.592 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.592 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.592 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.592 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.592 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.592 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.592 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241967 2024-09-12T22:05:26.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.592 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.592 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.592 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:26.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071702+0000", 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6929999999999999e-06 2024-09-12T22:05:26.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.594 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.594 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071709+0000", 2024-09-12T22:05:26.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2470000000000002e-06 2024-09-12T22:05:26.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.594 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.594 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071715+0000", 2024-09-12T22:05:26.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7370000000000003e-06 2024-09-12T22:05:26.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.594 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.594 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071737+0000", 2024-09-12T22:05:26.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1976000000000001e-05 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071740+0000", 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1760000000000002e-06 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025813+0000", 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95407325399999998 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025956+0000", 2024-09-12T22:05:26.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014283699999999999 2024-09-12T22:05:26.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.026055+0000", 2024-09-12T22:05:26.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9088999999999999e-05 2024-09-12T22:05:26.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028628+0000", 2024-09-12T22:05:26.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025725209999999999 2024-09-12T22:05:26.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029901+0000", 2024-09-12T22:05:26.597 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012737720000000001 2024-09-12T22:05:26.597 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.597 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.597 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.597 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029954+0000", 2024-09-12T22:05:26.597 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2811e-05 2024-09-12T22:05:26.597 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.597 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.597 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.597 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030032+0000", 2024-09-12T22:05:26.597 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7401e-05 2024-09-12T22:05:26.597 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.597 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.597 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.598 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241968 5.6 5:63b7d78c:::benchmark_data_smithi043_32659_object74730:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.598 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:26.598 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.4072072210000002, 2024-09-12T22:05:26.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958459332, 2024-09-12T22:05:26.598 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.598 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.598 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.598 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.598 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.598 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.598 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241968 2024-09-12T22:05:26.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071725+0000", 2024-09-12T22:05:26.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5600000000000001e-07 2024-09-12T22:05:26.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.600 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.600 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071727+0000", 2024-09-12T22:05:26.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.232e-06 2024-09-12T22:05:26.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.600 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.600 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071733+0000", 2024-09-12T22:05:26.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2750000000000001e-06 2024-09-12T22:05:26.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.600 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.600 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071738+0000", 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9289999999999997e-06 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071769+0000", 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0746e-05 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071774+0000", 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8099999999999997e-06 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.601 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027283+0000", 2024-09-12T22:05:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95550956399999998 2024-09-12T22:05:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027416+0000", 2024-09-12T22:05:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013268399999999999 2024-09-12T22:05:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027532+0000", 2024-09-12T22:05:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115807 2024-09-12T22:05:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030066+0000", 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025343800000000001 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030077+0000", 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1260000000000001e-05 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030116+0000", 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8970999999999997e-05 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.603 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.604 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030184+0000", 2024-09-12T22:05:26.604 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7317999999999995e-05 2024-09-12T22:05:26.604 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.604 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.604 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.604 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.604 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.604 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241974 5.6 5:6b9cdaf2:::benchmark_data_smithi043_32659_object74736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:26.604 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:26.604 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.3939475730000002, 2024-09-12T22:05:26.604 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94774920900000004, 2024-09-12T22:05:26.604 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:26.604 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:26.604 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241974 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:26.605 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:26.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:26.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084985+0000", 2024-09-12T22:05:26.606 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4600000000000004e-07 2024-09-12T22:05:26.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:26.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084989+0000", 2024-09-12T22:05:26.606 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9349999999999996e-06 2024-09-12T22:05:26.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:26.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084999+0000", 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0043e-05 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085004+0000", 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1619999999999999e-06 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085041+0000", 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7469999999999999e-05 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:26.607 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085048+0000", 2024-09-12T22:05:26.608 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:05:26.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.608 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:26.608 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028676+0000", 2024-09-12T22:05:26.608 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94362829599999998 2024-09-12T22:05:26.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.608 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:26.608 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028809+0000", 2024-09-12T22:05:26.608 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013285 2024-09-12T22:05:26.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.608 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028932+0000", 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012289199999999999 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032531+0000", 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035990639999999999 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032584+0000", 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3399999999999997e-05 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.609 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:26.610 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032644+0000", 2024-09-12T22:05:26.610 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0019999999999998e-05 2024-09-12T22:05:26.610 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:26.610 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:26.610 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:26.610 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032733+0000", 2024-09-12T22:05:26.610 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9137999999999999e-05 2024-09-12T22:05:26.610 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.610 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.610 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.610 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:26.610 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:26.610 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:26.612 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:26.610+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:26.612 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:26.713 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:26.712+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:26.759 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:252151 5.2 5:46d54fb5:::benchmark_data_smithi043_32659_object84913:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:26.755147+0000", 2024-09-12T22:05:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0015105819999999999, 2024-09-12T22:05:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015343139999999999, 2024-09-12T22:05:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 252151 2024-09-12T22:05:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755147+0000", 2024-09-12T22:05:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755147+0000", 2024-09-12T22:05:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755147+0000", 2024-09-12T22:05:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1999999999999999e-07 2024-09-12T22:05:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755151+0000", 2024-09-12T22:05:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7680000000000002e-06 2024-09-12T22:05:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755160+0000", 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.003e-06 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755166+0000", 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6119999999999998e-06 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755206+0000", 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0178000000000001e-05 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755306+0000", 2024-09-12T22:05:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9900000000000002e-05 2024-09-12T22:05:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:252149 5.f e59/40 5:f333ca43:::benchmark_data_smithi043_32659_object84911:head v 59'15814, mlcod=59'15811)", 2024-09-12T22:05:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:26.755459+0000", 2024-09-12T22:05:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0011978850000000001, 2024-09-12T22:05:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012924099999999999, 2024-09-12T22:05:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755459+0000", 2024-09-12T22:05:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755459+0000", 2024-09-12T22:05:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755460+0000", 2024-09-12T22:05:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:05:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755465+0000", 2024-09-12T22:05:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7790000000000003e-06 2024-09-12T22:05:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755474+0000", 2024-09-12T22:05:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9279999999999999e-06 2024-09-12T22:05:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755480+0000", 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1920000000000002e-06 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755526+0000", 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5605000000000001e-05 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755545+0000", 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9463e-05 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:252152 5.1 5:825e5c7c:::benchmark_data_smithi043_32659_object84914:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:26.755588+0000", 2024-09-12T22:05:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0010696779999999999, 2024-09-12T22:05:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001223685, 2024-09-12T22:05:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 252152 2024-09-12T22:05:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755588+0000", 2024-09-12T22:05:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755588+0000", 2024-09-12T22:05:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755588+0000", 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1399999999999996e-07 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755593+0000", 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.464e-06 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755602+0000", 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6440000000000006e-06 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755608+0000", 2024-09-12T22:05:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8349999999999998e-06 2024-09-12T22:05:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755666+0000", 2024-09-12T22:05:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7979000000000002e-05 2024-09-12T22:05:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755906+0000", 2024-09-12T22:05:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023933 2024-09-12T22:05:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.756075+0000", 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016976599999999999 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:252154 5.c 5.23666d1c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:26.755836+0000", 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00082089000000000001, 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010264740000000001, 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 252154 2024-09-12T22:05:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755836+0000", 2024-09-12T22:05:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755836+0000", 2024-09-12T22:05:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755837+0000", 2024-09-12T22:05:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:05:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755844+0000", 2024-09-12T22:05:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:05:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755853+0000", 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5319999999999995e-06 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755859+0000", 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1789999999999996e-06 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:252137 5.1 e59/40)", 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:26.755877+0000", 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00077997799999999996, 2024-09-12T22:05:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001037872, 2024-09-12T22:05:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755877+0000", 2024-09-12T22:05:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755877+0000", 2024-09-12T22:05:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755878+0000", 2024-09-12T22:05:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6499999999999999e-07 2024-09-12T22:05:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755881+0000", 2024-09-12T22:05:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.32e-06 2024-09-12T22:05:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755889+0000", 2024-09-12T22:05:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1640000000000001e-06 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755924+0000", 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4356000000000001e-05 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:252155 5.3 5.7497e4d3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:26.755951+0000", 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00070647600000000004, 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010100370000000001, 2024-09-12T22:05:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 252155 2024-09-12T22:05:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755951+0000", 2024-09-12T22:05:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755951+0000", 2024-09-12T22:05:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755951+0000", 2024-09-12T22:05:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4199999999999995e-07 2024-09-12T22:05:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755955+0000", 2024-09-12T22:05:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0690000000000002e-06 2024-09-12T22:05:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755963+0000", 2024-09-12T22:05:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3219999999999993e-06 2024-09-12T22:05:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755969+0000", 2024-09-12T22:05:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7010000000000001e-06 2024-09-12T22:05:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:252153 5.6 e59/57 5:64b00ff9:::benchmark_data_smithi043_32659_object84915:head v 59'15595, mlcod=59'15592)", 2024-09-12T22:05:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:26.756721+0000", 2024-09-12T22:05:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999366, 2024-09-12T22:05:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030006899999999998, 2024-09-12T22:05:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.756721+0000", 2024-09-12T22:05:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.756721+0000", 2024-09-12T22:05:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.756721+0000", 2024-09-12T22:05:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8800000000000002e-07 2024-09-12T22:05:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.756727+0000", 2024-09-12T22:05:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.976e-06 2024-09-12T22:05:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.756739+0000", 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1885000000000001e-05 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.756746+0000", 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1119999999999998e-06 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.756795+0000", 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8758999999999999e-05 2024-09-12T22:05:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.756814+0000", 2024-09-12T22:05:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8899e-05 2024-09-12T22:05:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:252138 5.7 e59/40 ondisk, result = 0)", 2024-09-12T22:05:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:26.756997+0000", 2024-09-12T22:05:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9996605, 2024-09-12T22:05:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5524000000000003e-05, 2024-09-12T22:05:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.756997+0000", 2024-09-12T22:05:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.756997+0000", 2024-09-12T22:05:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.756997+0000", 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.757001+0000", 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3400000000000002e-06 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.757015+0000", 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4331000000000001e-05 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.757020+0000", 2024-09-12T22:05:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7469999999999996e-06 2024-09-12T22:05:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.757060+0000", 2024-09-12T22:05:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9682999999999999e-05 2024-09-12T22:05:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.757065+0000", 2024-09-12T22:05:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9559999999999996e-06 2024-09-12T22:05:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:252137 5.1 5:8372b06f:::benchmark_data_smithi043_32659_object84899:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:26.750209+0000", 2024-09-12T22:05:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0064480750000000002, 2024-09-12T22:05:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069370450000000002, 2024-09-12T22:05:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 252137 2024-09-12T22:05:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750209+0000", 2024-09-12T22:05:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750209+0000", 2024-09-12T22:05:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750210+0000", 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0999999999999999e-07 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750211+0000", 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8029999999999999e-06 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750217+0000", 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8819999999999998e-06 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750222+0000", 2024-09-12T22:05:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.437e-06 2024-09-12T22:05:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.751937+0000", 2024-09-12T22:05:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001715327 2024-09-12T22:05:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.752074+0000", 2024-09-12T22:05:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013713199999999999 2024-09-12T22:05:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.752168+0000", 2024-09-12T22:05:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4049999999999996e-05 2024-09-12T22:05:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753734+0000", 2024-09-12T22:05:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015657239999999999 2024-09-12T22:05:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:252138 5.7 5:e885f07c:::benchmark_data_smithi043_32659_object84900:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:26.750371+0000", 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0062859669999999999, 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0068279940000000004, 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 252138 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750371+0000", 2024-09-12T22:05:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750371+0000", 2024-09-12T22:05:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750372+0000", 2024-09-12T22:05:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2399999999999997e-07 2024-09-12T22:05:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750376+0000", 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3680000000000002e-06 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750383+0000", 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5669999999999997e-06 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750388+0000", 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1950000000000002e-06 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750426+0000", 2024-09-12T22:05:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7669999999999997e-05 2024-09-12T22:05:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750535+0000", 2024-09-12T22:05:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108653 2024-09-12T22:05:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.750606+0000", 2024-09-12T22:05:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1752e-05 2024-09-12T22:05:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.752321+0000", 2024-09-12T22:05:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001714351 2024-09-12T22:05:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.757068+0000", 2024-09-12T22:05:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047474730000000003 2024-09-12T22:05:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.757174+0000", 2024-09-12T22:05:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010596500000000001 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:252145 5.c 5:3c91391f:::benchmark_data_smithi043_32659_object84907:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:26.753041+0000", 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0036159500000000002, 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004262203, 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 252145 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753041+0000", 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753041+0000", 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753043+0000", 2024-09-12T22:05:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2759999999999999e-06 2024-09-12T22:05:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753053+0000", 2024-09-12T22:05:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0156000000000001e-05 2024-09-12T22:05:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753063+0000", 2024-09-12T22:05:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0448000000000001e-05 2024-09-12T22:05:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753070+0000", 2024-09-12T22:05:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0589999999999997e-06 2024-09-12T22:05:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753125+0000", 2024-09-12T22:05:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4571000000000003e-05 2024-09-12T22:05:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753294+0000", 2024-09-12T22:05:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016949000000000001 2024-09-12T22:05:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753414+0000", 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119639 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.757142+0000", 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00372843 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:252147 5.c 5:30d55f30:::benchmark_data_smithi043_32659_object84909:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:26.753676+0000", 2024-09-12T22:05:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0029812570000000002, 2024-09-12T22:05:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037240429999999998, 2024-09-12T22:05:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 252147 2024-09-12T22:05:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753676+0000", 2024-09-12T22:05:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753676+0000", 2024-09-12T22:05:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753677+0000", 2024-09-12T22:05:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:05:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753681+0000", 2024-09-12T22:05:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4660000000000001e-06 2024-09-12T22:05:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753691+0000", 2024-09-12T22:05:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8889999999999997e-06 2024-09-12T22:05:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753698+0000", 2024-09-12T22:05:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.708e-06 2024-09-12T22:05:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755211+0000", 2024-09-12T22:05:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001513407 2024-09-12T22:05:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755373+0000", 2024-09-12T22:05:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016207 2024-09-12T22:05:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755484+0000", 2024-09-12T22:05:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011069300000000001 2024-09-12T22:05:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:252148 5.3 5:c213d2da:::benchmark_data_smithi043_32659_object84910:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:26.753957+0000", 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0026998180000000001, 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035280450000000001, 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 252148 2024-09-12T22:05:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753957+0000", 2024-09-12T22:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753957+0000", 2024-09-12T22:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753958+0000", 2024-09-12T22:05:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1399999999999996e-07 2024-09-12T22:05:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753962+0000", 2024-09-12T22:05:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1400000000000002e-06 2024-09-12T22:05:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753971+0000", 2024-09-12T22:05:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9709999999999993e-06 2024-09-12T22:05:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.753978+0000", 2024-09-12T22:05:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3180000000000003e-06 2024-09-12T22:05:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.754875+0000", 2024-09-12T22:05:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00089773800000000003 2024-09-12T22:05:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.754996+0000", 2024-09-12T22:05:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012102700000000001 2024-09-12T22:05:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:26.755074+0000", 2024-09-12T22:05:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7674000000000002e-05 2024-09-12T22:05:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 13 2024-09-12T22:05:26.814 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:26.816 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:26.816 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:26.814+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:26.917 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:26.915+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:26.982 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:05:27.004 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:27.004 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:27.004 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:27.004 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:27.004 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:27.015 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:27.017 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:27.016+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:27.118 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:27.117+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:27.201 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 53.787904368, 2024-09-12T22:05:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 53.787724437999998, 2024-09-12T22:05:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 53.787657996999997, 2024-09-12T22:05:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 53.787601553999998, 2024-09-12T22:05:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 53.787533093999997, 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 53.787475358999998, 2024-09-12T22:05:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 53.787407666999997, 2024-09-12T22:05:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 53.787352605000002, 2024-09-12T22:05:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.746705085000002, 2024-09-12T22:05:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:27.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:27.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:27.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:27.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:27.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:27.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:27.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:27.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:27.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:27.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:27.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:27.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:27.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:27.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:27.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:27.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:27.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:27.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:27.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:27.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:27.275 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.275 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.275 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.276 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:27.276 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:27.276 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.744091357000002, 2024-09-12T22:05:27.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:27.276 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.277 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.277 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.277 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.277 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.277 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.277 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:27.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.277 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:27.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:27.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:27.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:27.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:27.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:27.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:27.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:27.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:27.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:27.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:27.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:27.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:27.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:27.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:27.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:27.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:27.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:27.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:27.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:27.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:27.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:27.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:27.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:27.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:27.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:27.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:27.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:27.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:27.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.288 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.289 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:27.289 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:27.289 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.198877261, 2024-09-12T22:05:27.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:27.290 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.290 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.290 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.290 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.290 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.290 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.290 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:27.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.291 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:27.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:27.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:27.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:27.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:27.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:27.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:27.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:27.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:27.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:27.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:27.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:27.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:27.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:27.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:27.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:27.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:27.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:27.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:27.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:27.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:27.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:27.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:27.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:27.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.296 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.297 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:27.297 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:27.297 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.198398773000001, 2024-09-12T22:05:27.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:27.297 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.297 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.297 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.298 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:27.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.298 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:27.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:27.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:27.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:27.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:27.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:27.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:27.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:27.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:27.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:27.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:27.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:27.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:27.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:27.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:27.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:27.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:27.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:27.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:27.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:27.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:27.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:27.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.195903473000001, 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.304 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.304 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:27.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.304 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:27.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:27.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:27.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:27.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:27.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:27.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:27.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:27.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:27.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:27.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:27.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:27.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:27.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:27.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:27.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:27.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:27.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:27.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:27.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:27.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:27.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:27.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:27.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:27.311 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.311 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.311 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.311 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:27.311 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:27.311 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.194822682000002, 2024-09-12T22:05:27.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:27.312 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.312 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.312 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.312 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:27.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.313 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:27.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:27.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:27.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:27.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:27.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:27.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:27.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:27.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:27.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:27.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:27.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:27.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:27.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:27.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:27.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:27.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.193587119999997, 2024-09-12T22:05:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.752846632000001, 2024-09-12T22:05:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.748316204999998, 2024-09-12T22:05:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.748292176, 2024-09-12T22:05:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.748114526999998, 2024-09-12T22:05:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.746095990000001, 2024-09-12T22:05:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:27.363 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:27.365 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:27.366 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:27.364+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:27.453 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:05:27.467 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:27.466+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:27.522 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:27.522 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:27.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.522 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:254285 5.b 5:dff2e20a:::benchmark_data_smithi043_32659_object87047:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:27.522 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.508405+0000", 2024-09-12T22:05:27.522 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.011245562000000001, 2024-09-12T22:05:27.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011269664, 2024-09-12T22:05:27.522 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.522 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.522 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:27.522 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 254285 2024-09-12T22:05:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.508405+0000", 2024-09-12T22:05:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.508405+0000", 2024-09-12T22:05:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.508405+0000", 2024-09-12T22:05:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:05:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.508407+0000", 2024-09-12T22:05:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.103e-06 2024-09-12T22:05:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.508413+0000", 2024-09-12T22:05:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9660000000000001e-06 2024-09-12T22:05:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.508418+0000", 2024-09-12T22:05:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8629999999999999e-06 2024-09-12T22:05:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.513912+0000", 2024-09-12T22:05:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0054941310000000002 2024-09-12T22:05:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.514043+0000", 2024-09-12T22:05:27.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013134299999999999 2024-09-12T22:05:27.526 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.526 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.526 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.526 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:254289 5.b 5:ddb31399:::benchmark_data_smithi043_32659_object87051:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:27.526 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.509991+0000", 2024-09-12T22:05:27.526 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0096592620000000001, 2024-09-12T22:05:27.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0097587630000000002, 2024-09-12T22:05:27.526 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.526 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.526 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 254289 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.509991+0000", 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.509991+0000", 2024-09-12T22:05:27.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.509992+0000", 2024-09-12T22:05:27.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4600000000000004e-07 2024-09-12T22:05:27.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.509996+0000", 2024-09-12T22:05:27.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3279999999999999e-06 2024-09-12T22:05:27.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.510004+0000", 2024-09-12T22:05:27.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.225e-06 2024-09-12T22:05:27.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.510011+0000", 2024-09-12T22:05:27.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.99e-06 2024-09-12T22:05:27.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516446+0000", 2024-09-12T22:05:27.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0064346020000000002 2024-09-12T22:05:27.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516590+0000", 2024-09-12T22:05:27.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014467700000000001 2024-09-12T22:05:27.530 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.530 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.530 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.530 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:254292 5.b 5:d2063f00:::benchmark_data_smithi043_32659_object87054:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:27.530 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.511423+0000", 2024-09-12T22:05:27.530 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0082275549999999992, 2024-09-12T22:05:27.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0083912819999999999, 2024-09-12T22:05:27.530 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.530 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.531 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:27.531 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:27.531 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:27.531 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.531 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 254292 2024-09-12T22:05:27.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.531 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.531 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.531 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.511423+0000", 2024-09-12T22:05:27.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.531 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.511423+0000", 2024-09-12T22:05:27.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.511423+0000", 2024-09-12T22:05:27.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4000000000000002e-07 2024-09-12T22:05:27.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.511425+0000", 2024-09-12T22:05:27.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4030000000000001e-06 2024-09-12T22:05:27.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.511432+0000", 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3940000000000001e-06 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.511437+0000", 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8470000000000003e-06 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.517667+0000", 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0062303439999999996 2024-09-12T22:05:27.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.517790+0000", 2024-09-12T22:05:27.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012285599999999999 2024-09-12T22:05:27.534 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.534 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.534 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.534 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:254293 5.4 5:249ffcfe:::benchmark_data_smithi043_32659_object87055:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:27.534 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.514002+0000", 2024-09-12T22:05:27.534 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0056486310000000003, 2024-09-12T22:05:27.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0058987800000000002, 2024-09-12T22:05:27.534 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.535 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.535 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:27.535 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:27.535 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:27.535 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.535 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 254293 2024-09-12T22:05:27.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.535 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.514002+0000", 2024-09-12T22:05:27.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.514002+0000", 2024-09-12T22:05:27.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.514003+0000", 2024-09-12T22:05:27.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2410000000000001e-06 2024-09-12T22:05:27.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.514007+0000", 2024-09-12T22:05:27.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7119999999999999e-06 2024-09-12T22:05:27.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.514017+0000", 2024-09-12T22:05:27.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6479999999999998e-06 2024-09-12T22:05:27.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.514024+0000", 2024-09-12T22:05:27.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.182e-06 2024-09-12T22:05:27.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.514072+0000", 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7256000000000003e-05 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.514220+0000", 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014876200000000001 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:254298 5.0 5:0cabce8d:::benchmark_data_smithi043_32659_object87060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.515119+0000", 2024-09-12T22:05:27.538 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0045315379999999999, 2024-09-12T22:05:27.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0048509879999999997, 2024-09-12T22:05:27.539 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.539 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.539 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:27.539 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:27.539 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:27.539 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.539 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 254298 2024-09-12T22:05:27.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.539 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.539 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.515119+0000", 2024-09-12T22:05:27.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.515119+0000", 2024-09-12T22:05:27.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.515119+0000", 2024-09-12T22:05:27.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:05:27.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.515124+0000", 2024-09-12T22:05:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1840000000000001e-06 2024-09-12T22:05:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.515136+0000", 2024-09-12T22:05:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2159e-05 2024-09-12T22:05:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.515143+0000", 2024-09-12T22:05:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.815e-06 2024-09-12T22:05:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.515193+0000", 2024-09-12T22:05:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0078999999999999e-05 2024-09-12T22:05:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.515386+0000", 2024-09-12T22:05:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019350699999999999 2024-09-12T22:05:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:254299 5.e 5:7bd1a510:::benchmark_data_smithi043_32659_object87061:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.516013+0000", 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0036370790000000001, 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004018237, 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 254299 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516013+0000", 2024-09-12T22:05:27.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516013+0000", 2024-09-12T22:05:27.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516014+0000", 2024-09-12T22:05:27.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7299999999999995e-07 2024-09-12T22:05:27.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516017+0000", 2024-09-12T22:05:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4999999999999999e-06 2024-09-12T22:05:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516025+0000", 2024-09-12T22:05:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4390000000000003e-06 2024-09-12T22:05:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516031+0000", 2024-09-12T22:05:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6449999999999999e-06 2024-09-12T22:05:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516079+0000", 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7913e-05 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516234+0000", 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000154859 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:254300 5.e 5:706f94a7:::benchmark_data_smithi043_32659_object87062:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.516050+0000", 2024-09-12T22:05:27.546 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0035999790000000001, 2024-09-12T22:05:27.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040429070000000001, 2024-09-12T22:05:27.547 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.547 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.547 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:27.547 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:27.547 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:27.547 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.547 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 254300 2024-09-12T22:05:27.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.547 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516050+0000", 2024-09-12T22:05:27.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516050+0000", 2024-09-12T22:05:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516051+0000", 2024-09-12T22:05:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2300000000000002e-07 2024-09-12T22:05:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516053+0000", 2024-09-12T22:05:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5000000000000002e-06 2024-09-12T22:05:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516060+0000", 2024-09-12T22:05:27.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7490000000000001e-06 2024-09-12T22:05:27.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.516065+0000", 2024-09-12T22:05:27.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5890000000000002e-06 2024-09-12T22:05:27.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.517684+0000", 2024-09-12T22:05:27.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0016181259999999999 2024-09-12T22:05:27.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.551 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.517857+0000", 2024-09-12T22:05:27.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000173869 2024-09-12T22:05:27.551 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.551 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.551 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.551 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:254301 5.c e59/40 5:3f6106b9:::benchmark_data_smithi043_32659_object87063:head v 59'15907, mlcod=59'15905)", 2024-09-12T22:05:27.551 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.517215+0000", 2024-09-12T22:05:27.551 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0024351249999999998, 2024-09-12T22:05:27.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0029421690000000001, 2024-09-12T22:05:27.552 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.552 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.552 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:27.552 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.517215+0000", 2024-09-12T22:05:27.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.517215+0000", 2024-09-12T22:05:27.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.517216+0000", 2024-09-12T22:05:27.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.204e-06 2024-09-12T22:05:27.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.517223+0000", 2024-09-12T22:05:27.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2949999999999999e-06 2024-09-12T22:05:27.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.517234+0000", 2024-09-12T22:05:27.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1831000000000001e-05 2024-09-12T22:05:27.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.517241+0000", 2024-09-12T22:05:27.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9190000000000002e-06 2024-09-12T22:05:27.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.517283+0000", 2024-09-12T22:05:27.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1699000000000002e-05 2024-09-12T22:05:27.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.517296+0000", 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2635e-05 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:254302 5.4 5:270662fa:::benchmark_data_smithi043_32659_object87064:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.518782+0000", 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00086803, 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001433567, 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.555 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.556 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:27.556 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:27.556 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:27.556 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.556 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 254302 2024-09-12T22:05:27.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.556 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.556 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.518782+0000", 2024-09-12T22:05:27.556 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.557 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.518782+0000", 2024-09-12T22:05:27.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.557 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.557 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.518783+0000", 2024-09-12T22:05:27.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.003e-06 2024-09-12T22:05:27.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.557 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.557 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.518788+0000", 2024-09-12T22:05:27.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7010000000000004e-06 2024-09-12T22:05:27.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.518796+0000", 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.518803+0000", 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7959999999999998e-06 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.518855+0000", 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1690999999999997e-05 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.559 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519022+0000", 2024-09-12T22:05:27.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016712899999999999 2024-09-12T22:05:27.559 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.559 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.559 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.559 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:254304 5.b 5:d56d540f:::benchmark_data_smithi043_32659_object87066:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:27.559 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.518963+0000", 2024-09-12T22:05:27.559 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00068749000000000002, 2024-09-12T22:05:27.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0013149139999999999, 2024-09-12T22:05:27.559 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.559 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 254304 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.518963+0000", 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.560 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.518963+0000", 2024-09-12T22:05:27.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.518963+0000", 2024-09-12T22:05:27.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9800000000000003e-07 2024-09-12T22:05:27.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.518967+0000", 2024-09-12T22:05:27.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.315e-06 2024-09-12T22:05:27.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.518973+0000", 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3180000000000003e-06 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.518978+0000", 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7310000000000001e-06 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519028+0000", 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0349000000000002e-05 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519200+0000", 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000171714 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:254303 5.c e59/40 5:3537d1a3:::benchmark_data_smithi043_32659_object87065:head v 59'15908, mlcod=59'15905)", 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.519306+0000", 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00034417300000000003, 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0010333650000000001, 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:27.563 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519306+0000", 2024-09-12T22:05:27.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519306+0000", 2024-09-12T22:05:27.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519307+0000", 2024-09-12T22:05:27.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1900000000000002e-07 2024-09-12T22:05:27.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519312+0000", 2024-09-12T22:05:27.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1989999999999997e-06 2024-09-12T22:05:27.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519322+0000", 2024-09-12T22:05:27.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0138e-05 2024-09-12T22:05:27.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519327+0000", 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5439999999999998e-06 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519373+0000", 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5259000000000002e-05 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519384+0000", 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1467e-05 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.567 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:254307 5.e 5:7c3de6c0:::benchmark_data_smithi043_32659_object87069:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:27.567 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.519847+0000", 2024-09-12T22:05:27.567 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9998031, 2024-09-12T22:05:27.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00054942299999999995, 2024-09-12T22:05:27.567 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.567 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.567 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:27.567 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:27.567 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:27.567 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.567 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 254307 2024-09-12T22:05:27.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.567 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519847+0000", 2024-09-12T22:05:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519847+0000", 2024-09-12T22:05:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519848+0000", 2024-09-12T22:05:27.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1299999999999998e-07 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519853+0000", 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6140000000000002e-06 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519864+0000", 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.145e-05 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519871+0000", 2024-09-12T22:05:27.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1849999999999998e-06 2024-09-12T22:05:27.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.570 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.570 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519968+0000", 2024-09-12T22:05:27.570 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6434000000000005e-05 2024-09-12T22:05:27.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.570 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.570 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520100+0000", 2024-09-12T22:05:27.570 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000132335 2024-09-12T22:05:27.570 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.570 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.570 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:254308 5.f 5:f41d78a3:::benchmark_data_smithi043_32659_object87070:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.519889+0000", 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9997606, 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00057357600000000001, 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 254308 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.572 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.572 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519889+0000", 2024-09-12T22:05:27.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.572 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.572 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519889+0000", 2024-09-12T22:05:27.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.572 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.572 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519890+0000", 2024-09-12T22:05:27.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:27.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519893+0000", 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0230000000000001e-06 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519901+0000", 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1249999999999993e-06 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519907+0000", 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6459999999999998e-06 2024-09-12T22:05:27.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519965+0000", 2024-09-12T22:05:27.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8529000000000002e-05 2024-09-12T22:05:27.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520130+0000", 2024-09-12T22:05:27.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000164826 2024-09-12T22:05:27.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:27.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520274+0000", 2024-09-12T22:05:27.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000143442 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDPGPush(5.3 59/40 [PushOp(5:c41d95bd:::benchmark_data_smithi043_32659_object166944:head, version: 47'10371, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:c41d95bd:::benchmark_data_smithi043_32659_object166944:head@47'10371, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.519853+0000", 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9997978, 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00070710499999999997, 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.575 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519853+0000", 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519853+0000", 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519853+0000", 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3500000000000002e-07 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519925+0000", 2024-09-12T22:05:27.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.25e-05 2024-09-12T22:05:27.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519943+0000", 2024-09-12T22:05:27.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7836999999999999e-05 2024-09-12T22:05:27.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519963+0000", 2024-09-12T22:05:27.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9806999999999999e-05 2024-09-12T22:05:27.577 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.577 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.578 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.578 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.3 e 59/59 lb 5:c41cf1d4:::benchmark_data_smithi043_32659_object156587:head)", 2024-09-12T22:05:27.578 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.519982+0000", 2024-09-12T22:05:27.578 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9996686, 2024-09-12T22:05:27.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00063070200000000002, 2024-09-12T22:05:27.578 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.578 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.578 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:27.578 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519982+0000", 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519982+0000", 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519982+0000", 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9799999999999999e-07 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519990+0000", 2024-09-12T22:05:27.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5909999999999998e-06 2024-09-12T22:05:27.580 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.580 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.580 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.519997+0000", 2024-09-12T22:05:27.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2269999999999996e-06 2024-09-12T22:05:27.580 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.580 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.580 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520002+0000", 2024-09-12T22:05:27.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5520000000000004e-06 2024-09-12T22:05:27.580 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.580 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.580 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:254306 5.3 e59/40 5:c3713f89:::benchmark_data_smithi043_32659_object87068:head v 59'15772, mlcod=59'15770)", 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.520159+0000", 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9994907, 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00050219800000000003, 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520159+0000", 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520159+0000", 2024-09-12T22:05:27.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520160+0000", 2024-09-12T22:05:27.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:27.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520164+0000", 2024-09-12T22:05:27.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.746e-06 2024-09-12T22:05:27.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520172+0000", 2024-09-12T22:05:27.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4649999999999997e-06 2024-09-12T22:05:27.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520178+0000", 2024-09-12T22:05:27.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6160000000000001e-06 2024-09-12T22:05:27.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520540+0000", 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000362009 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520562+0000", 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2087e-05 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:254309 5.7 e59/40 5:e55ffeec:::benchmark_data_smithi043_32659_object87071:head v 59'15997, mlcod=59'15995)", 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:27.520192+0000", 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9994578, 2024-09-12T22:05:27.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00052122400000000004, 2024-09-12T22:05:27.585 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:27.585 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:27.585 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:27.585 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:27.585 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.585 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:27.585 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520192+0000", 2024-09-12T22:05:27.585 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.585 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.585 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.585 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:27.585 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520192+0000", 2024-09-12T22:05:27.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:27.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:27.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520192+0000", 2024-09-12T22:05:27.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4200000000000002e-07 2024-09-12T22:05:27.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:27.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520196+0000", 2024-09-12T22:05:27.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3579999999999999e-06 2024-09-12T22:05:27.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:27.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520202+0000", 2024-09-12T22:05:27.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2129999999999996e-06 2024-09-12T22:05:27.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:27.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520208+0000", 2024-09-12T22:05:27.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7389999999999996e-06 2024-09-12T22:05:27.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:27.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520259+0000", 2024-09-12T22:05:27.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1261999999999998e-05 2024-09-12T22:05:27.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:27.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:27.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:27.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:27.520276+0000", 2024-09-12T22:05:27.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7316000000000002e-05 2024-09-12T22:05:27.589 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.589 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:27.589 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.589 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:27.589 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:27.589 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 17 2024-09-12T22:05:27.589 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:27.590 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:27.590 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:27.589+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:27.591 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:27.591 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:27.591 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:27.599 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:27.600 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:27.602 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:27.603 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:27.692 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:27.690+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:27.787 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:27.787 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:27.791 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:27.790+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:27.801 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:27.893 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:27.892+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:27.969 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-09-12T22:05:27.994 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:27.993+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:27.998 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:27.998 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:28.012 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:28.095 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:28.094+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:28.155 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:28.155 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:28.167 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:28.196 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:28.195+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:28.297 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:28.296+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:28.313 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:28.313 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:28.326 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:28.398 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:28.396+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:28.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~65s 2024-09-12T22:05:28.474 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:28.474 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:28.486 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:28.531 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:28.530+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:28.599 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:28.598+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:28.644 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:28.645 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:28.659 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:28.700 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:28.699+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:28.801 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:28.800+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:28.859 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:28.860 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:28.871 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:28.902 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:28.901+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:29.003 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:29.001+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:29.028 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:29.028 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:29.042 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:29.104 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:29.103+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:29.188 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:29.188 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:29.200 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:29.241 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:29.240+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:29.306 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:29.305+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:29.388 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:29.388 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:29.400 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:29.442 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:29.440+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:29.508 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:29.507+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:29.584 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:29.585 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:29.596 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:29.604 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:05:29.640 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:29.639+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:29.710 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:29.709+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:29.715 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:29.733 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:29.733 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:29.753 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:29.753 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:29.756 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:29.756 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:29.762 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:29.762 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:29.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.762 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:260487 5.1 e60/40 5:856c0b7b:::benchmark_data_smithi043_32659_object93249:head v 60'16150, mlcod=60'16148)", 2024-09-12T22:05:29.762 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:29.753920+0000", 2024-09-12T22:05:29.763 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0055393229999999996, 2024-09-12T22:05:29.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0055630619999999997, 2024-09-12T22:05:29.763 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:29.763 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:29.763 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:29.763 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:29.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:29.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.753920+0000", 2024-09-12T22:05:29.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:29.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.753920+0000", 2024-09-12T22:05:29.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.764 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:29.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.753921+0000", 2024-09-12T22:05:29.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:05:29.764 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:29.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.753925+0000", 2024-09-12T22:05:29.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6410000000000001e-06 2024-09-12T22:05:29.764 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:29.765 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.753935+0000", 2024-09-12T22:05:29.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0032e-05 2024-09-12T22:05:29.765 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.765 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:29.765 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.753942+0000", 2024-09-12T22:05:29.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5259999999999999e-06 2024-09-12T22:05:29.765 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.765 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:29.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.754023+0000", 2024-09-12T22:05:29.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0799999999999999e-05 2024-09-12T22:05:29.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:29.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.754040+0000", 2024-09-12T22:05:29.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7136999999999999e-05 2024-09-12T22:05:29.766 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.766 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:29.766 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.766 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:260494 5.d 5:ba40b19e:::benchmark_data_smithi043_32659_object93256:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T22:05:29.766 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:29.755410+0000", 2024-09-12T22:05:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0040492870000000004, 2024-09-12T22:05:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0041423919999999999, 2024-09-12T22:05:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 260494 2024-09-12T22:05:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755410+0000", 2024-09-12T22:05:29.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:29.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755410+0000", 2024-09-12T22:05:29.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:29.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755411+0000", 2024-09-12T22:05:29.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1099999999999995e-07 2024-09-12T22:05:29.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:29.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755414+0000", 2024-09-12T22:05:29.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:05:29.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:29.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755420+0000", 2024-09-12T22:05:29.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1240000000000002e-06 2024-09-12T22:05:29.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:29.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755424+0000", 2024-09-12T22:05:29.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1649999999999999e-06 2024-09-12T22:05:29.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:29.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755463+0000", 2024-09-12T22:05:29.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9026000000000002e-05 2024-09-12T22:05:29.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:29.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755625+0000", 2024-09-12T22:05:29.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016181299999999999 2024-09-12T22:05:29.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:29.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755722+0000", 2024-09-12T22:05:29.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6949999999999998e-05 2024-09-12T22:05:29.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:29.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759195+0000", 2024-09-12T22:05:29.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034729919999999998 2024-09-12T22:05:29.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:29.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759306+0000", 2024-09-12T22:05:29.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000110955 2024-09-12T22:05:29.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:29.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759376+0000", 2024-09-12T22:05:29.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9801000000000005e-05 2024-09-12T22:05:29.772 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.772 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:29.772 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.772 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:260489 5.1 e60/40 5:8b10bfc7:::benchmark_data_smithi043_32659_object93251:head v 60'16151, mlcod=60'16148)", 2024-09-12T22:05:29.772 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:29.755526+0000", 2024-09-12T22:05:29.772 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0039326880000000002, 2024-09-12T22:05:29.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004119536, 2024-09-12T22:05:29.772 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:29.772 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:29.772 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:29.773 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:29.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:29.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755526+0000", 2024-09-12T22:05:29.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:29.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755526+0000", 2024-09-12T22:05:29.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:29.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755527+0000", 2024-09-12T22:05:29.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.51e-07 2024-09-12T22:05:29.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:29.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755532+0000", 2024-09-12T22:05:29.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9790000000000001e-06 2024-09-12T22:05:29.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:29.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755539+0000", 2024-09-12T22:05:29.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3640000000000001e-06 2024-09-12T22:05:29.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755544+0000", 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9470000000000002e-06 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755971+0000", 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00042652400000000001 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.755983+0000", 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1771e-05 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.775 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:29.776 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.776 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:260495 5.9 5:9b54c718:::benchmark_data_smithi043_32659_object93257:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T22:05:29.776 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:29.756291+0000", 2024-09-12T22:05:29.776 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0031682949999999998, 2024-09-12T22:05:29.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034149089999999998, 2024-09-12T22:05:29.776 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:29.776 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:29.776 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:29.776 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:29.776 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:29.776 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 260495 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756291+0000", 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756291+0000", 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:29.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756292+0000", 2024-09-12T22:05:29.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4099999999999998e-07 2024-09-12T22:05:29.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:29.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756296+0000", 2024-09-12T22:05:29.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3390000000000003e-06 2024-09-12T22:05:29.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:29.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756308+0000", 2024-09-12T22:05:29.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2476e-05 2024-09-12T22:05:29.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:29.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756316+0000", 2024-09-12T22:05:29.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5190000000000003e-06 2024-09-12T22:05:29.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:29.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756360+0000", 2024-09-12T22:05:29.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4124e-05 2024-09-12T22:05:29.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:29.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756519+0000", 2024-09-12T22:05:29.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000158803 2024-09-12T22:05:29.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:29.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756619+0000", 2024-09-12T22:05:29.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000100451 2024-09-12T22:05:29.780 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.780 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:29.780 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.780 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:260493 5.5 e60/40 5:a85cc7fa:::benchmark_data_smithi043_32659_object93255:head v 60'16361, mlcod=60'16358)", 2024-09-12T22:05:29.780 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:29.756347+0000", 2024-09-12T22:05:29.780 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0031118650000000001, 2024-09-12T22:05:29.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034307719999999999, 2024-09-12T22:05:29.780 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:29.781 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:29.781 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:29.781 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:29.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:29.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756347+0000", 2024-09-12T22:05:29.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:29.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756347+0000", 2024-09-12T22:05:29.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756348+0000", 2024-09-12T22:05:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4499999999999997e-07 2024-09-12T22:05:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756353+0000", 2024-09-12T22:05:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2190000000000003e-06 2024-09-12T22:05:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756360+0000", 2024-09-12T22:05:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.323e-06 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.756367+0000", 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5320000000000003e-06 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757391+0000", 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001024013 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757409+0000", 2024-09-12T22:05:29.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7859e-05 2024-09-12T22:05:29.784 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.784 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:29.784 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.784 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:260486 5.d e60/40 ondisk, result = 0)", 2024-09-12T22:05:29.784 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:29.757075+0000", 2024-09-12T22:05:29.784 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0023841700000000001, 2024-09-12T22:05:29.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027636480000000001, 2024-09-12T22:05:29.784 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:29.784 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:29.784 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:29.784 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:29.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:29.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757075+0000", 2024-09-12T22:05:29.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:29.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757075+0000", 2024-09-12T22:05:29.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:29.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757076+0000", 2024-09-12T22:05:29.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3099999999999998e-07 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757078+0000", 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8930000000000001e-06 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757086+0000", 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7479999999999993e-06 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757091+0000", 2024-09-12T22:05:29.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9840000000000001e-06 2024-09-12T22:05:29.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:29.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757770+0000", 2024-09-12T22:05:29.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000679198 2024-09-12T22:05:29.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:29.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757776+0000", 2024-09-12T22:05:29.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8529999999999997e-06 2024-09-12T22:05:29.787 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.787 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:29.787 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.788 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:260497 5.3 e60/40 5:cc7a729b:::benchmark_data_smithi043_32659_object93259:head v 60'16160, mlcod=60'16154)", 2024-09-12T22:05:29.788 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:29.757174+0000", 2024-09-12T22:05:29.788 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0022852599999999999, 2024-09-12T22:05:29.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027240839999999999, 2024-09-12T22:05:29.788 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:29.788 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:29.788 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:29.788 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:29.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:29.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757174+0000", 2024-09-12T22:05:29.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757174+0000", 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757174+0000", 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.51e-07 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757178+0000", 2024-09-12T22:05:29.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6610000000000002e-06 2024-09-12T22:05:29.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:29.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757185+0000", 2024-09-12T22:05:29.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0620000000000003e-06 2024-09-12T22:05:29.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:29.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757190+0000", 2024-09-12T22:05:29.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:05:29.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:29.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.758863+0000", 2024-09-12T22:05:29.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001672932 2024-09-12T22:05:29.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:29.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.758896+0000", 2024-09-12T22:05:29.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2802000000000002e-05 2024-09-12T22:05:29.791 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.791 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:29.791 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.791 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:260498 5.f 5:fde08347:::benchmark_data_smithi043_32659_object93260:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T22:05:29.791 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:29.757316+0000", 2024-09-12T22:05:29.792 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0021430389999999998, 2024-09-12T22:05:29.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026437209999999999, 2024-09-12T22:05:29.792 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:29.792 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:29.792 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:29.792 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:29.792 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:29.792 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:29.792 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 260498 2024-09-12T22:05:29.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.792 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:29.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:29.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757316+0000", 2024-09-12T22:05:29.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:29.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757316+0000", 2024-09-12T22:05:29.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:29.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757317+0000", 2024-09-12T22:05:29.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0599999999999999e-07 2024-09-12T22:05:29.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:29.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757321+0000", 2024-09-12T22:05:29.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0400000000000003e-06 2024-09-12T22:05:29.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:29.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757330+0000", 2024-09-12T22:05:29.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2690000000000005e-06 2024-09-12T22:05:29.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:29.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757337+0000", 2024-09-12T22:05:29.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6120000000000004e-06 2024-09-12T22:05:29.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:29.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757390+0000", 2024-09-12T22:05:29.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2800000000000003e-05 2024-09-12T22:05:29.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:29.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757540+0000", 2024-09-12T22:05:29.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015014800000000001 2024-09-12T22:05:29.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:29.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757657+0000", 2024-09-12T22:05:29.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117389 2024-09-12T22:05:29.796 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.797 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:29.797 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.797 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:260499 5.8 5:1c33b7ac:::benchmark_data_smithi043_32659_object93261:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T22:05:29.797 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:29.757612+0000", 2024-09-12T22:05:29.797 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001847621, 2024-09-12T22:05:29.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024190800000000001, 2024-09-12T22:05:29.797 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:29.797 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:29.797 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:29.797 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:29.797 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:29.797 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:29.798 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 260499 2024-09-12T22:05:29.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.798 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:29.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:29.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757612+0000", 2024-09-12T22:05:29.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:29.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757612+0000", 2024-09-12T22:05:29.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:29.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757612+0000", 2024-09-12T22:05:29.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0699999999999996e-07 2024-09-12T22:05:29.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:29.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757616+0000", 2024-09-12T22:05:29.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9809999999999997e-06 2024-09-12T22:05:29.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:29.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757625+0000", 2024-09-12T22:05:29.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6880000000000005e-06 2024-09-12T22:05:29.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.800 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:29.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757631+0000", 2024-09-12T22:05:29.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9089999999999997e-06 2024-09-12T22:05:29.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.800 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:29.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757679+0000", 2024-09-12T22:05:29.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8659000000000003e-05 2024-09-12T22:05:29.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.800 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:29.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.757941+0000", 2024-09-12T22:05:29.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00026128700000000002 2024-09-12T22:05:29.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:29.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759999+0000", 2024-09-12T22:05:29.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020584319999999998 2024-09-12T22:05:29.801 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.801 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:29.801 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.801 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:260501 5.f 5:fcc18ae0:::benchmark_data_smithi043_32659_object93263:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T22:05:29.801 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:29.758877+0000", 2024-09-12T22:05:29.801 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00058267099999999999, 2024-09-12T22:05:29.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012221249999999999, 2024-09-12T22:05:29.802 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:29.802 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:29.802 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:29.802 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:29.802 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:29.802 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:29.802 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 260501 2024-09-12T22:05:29.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.802 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:29.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:29.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.758877+0000", 2024-09-12T22:05:29.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.758877+0000", 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.758877+0000", 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6099999999999999e-07 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.758882+0000", 2024-09-12T22:05:29.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3370000000000001e-06 2024-09-12T22:05:29.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:29.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.758892+0000", 2024-09-12T22:05:29.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0747999999999999e-05 2024-09-12T22:05:29.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:29.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.758899+0000", 2024-09-12T22:05:29.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5030000000000002e-06 2024-09-12T22:05:29.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:29.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759392+0000", 2024-09-12T22:05:29.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00049332 2024-09-12T22:05:29.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:29.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759564+0000", 2024-09-12T22:05:29.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017166100000000001 2024-09-12T22:05:29.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:29.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759672+0000", 2024-09-12T22:05:29.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010812 2024-09-12T22:05:29.805 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.805 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:260500 5.3 e60/40)", 2024-09-12T22:05:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:29.759245+0000", 2024-09-12T22:05:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00021443499999999999, 2024-09-12T22:05:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00092162699999999995, 2024-09-12T22:05:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759245+0000", 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759245+0000", 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759245+0000", 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9999999999999997e-07 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:29.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759251+0000", 2024-09-12T22:05:29.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4569999999999996e-06 2024-09-12T22:05:29.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:29.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759266+0000", 2024-09-12T22:05:29.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4771e-05 2024-09-12T22:05:29.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:29.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759272+0000", 2024-09-12T22:05:29.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0059999999999998e-06 2024-09-12T22:05:29.808 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.808 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:29.809 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.809 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:260502 5.c e60/40 5:393977fd:::benchmark_data_smithi043_32659_object93264:head v 60'16276, mlcod=60'16274)", 2024-09-12T22:05:29.809 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:29.759414+0000", 2024-09-12T22:05:29.809 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.5448000000000003e-05, 2024-09-12T22:05:29.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00078704899999999995, 2024-09-12T22:05:29.809 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:29.809 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:29.809 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:29.809 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:29.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:29.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759414+0000", 2024-09-12T22:05:29.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:29.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759414+0000", 2024-09-12T22:05:29.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:29.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759414+0000", 2024-09-12T22:05:29.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2799999999999996e-07 2024-09-12T22:05:29.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:29.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759418+0000", 2024-09-12T22:05:29.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.89e-06 2024-09-12T22:05:29.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:29.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759434+0000", 2024-09-12T22:05:29.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6350000000000001e-05 2024-09-12T22:05:29.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:29.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759440+0000", 2024-09-12T22:05:29.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4190000000000001e-06 2024-09-12T22:05:29.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:29.812 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759482+0000", 2024-09-12T22:05:29.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2311000000000002e-05 2024-09-12T22:05:29.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:29.812 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759499+0000", 2024-09-12T22:05:29.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7053000000000001e-05 2024-09-12T22:05:29.812 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.812 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:29.812 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.812 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:260498 5.f e60/40)", 2024-09-12T22:05:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:29.759487+0000", 2024-09-12T22:05:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9999723, 2024-09-12T22:05:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00074635800000000003, 2024-09-12T22:05:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759487+0000", 2024-09-12T22:05:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:29.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759487+0000", 2024-09-12T22:05:29.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:29.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759487+0000", 2024-09-12T22:05:29.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2e-07 2024-09-12T22:05:29.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:29.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759490+0000", 2024-09-12T22:05:29.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:05:29.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:29.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759498+0000", 2024-09-12T22:05:29.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0790000000000001e-06 2024-09-12T22:05:29.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:29.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759503+0000", 2024-09-12T22:05:29.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:29.815 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.815 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:29.815 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.815 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:260504 5.a 5:57c63b5e:::benchmark_data_smithi043_32659_object93266:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T22:05:29.816 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:29.759534+0000", 2024-09-12T22:05:29.816 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9999251, 2024-09-12T22:05:29.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00074734400000000005, 2024-09-12T22:05:29.816 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:29.816 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:29.816 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:29.816 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:29.816 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:29.816 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:29.816 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 260504 2024-09-12T22:05:29.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.816 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:29.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759534+0000", 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759534+0000", 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759535+0000", 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6400000000000001e-07 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:29.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759538+0000", 2024-09-12T22:05:29.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4039999999999999e-06 2024-09-12T22:05:29.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:29.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759547+0000", 2024-09-12T22:05:29.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1999999999999994e-06 2024-09-12T22:05:29.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:29.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759559+0000", 2024-09-12T22:05:29.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1993e-05 2024-09-12T22:05:29.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:29.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759605+0000", 2024-09-12T22:05:29.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6675000000000003e-05 2024-09-12T22:05:29.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:29.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:29.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:29.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:29.759766+0000", 2024-09-12T22:05:29.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016097 2024-09-12T22:05:29.819 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.819 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:29.819 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.819 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:29.819 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:29.819 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 14 2024-09-12T22:05:29.820 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:29.821 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:29.821 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:29.820+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:29.923 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:29.921+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:29.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:05:30.022 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:30.021+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:30.028 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:30.029 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:30.029 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:30.029 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:30.029 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:30.043 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:30.128 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:30.127+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:30.224 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:30.222+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:30.248 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:30.248 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:30.248 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:30.249 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:30.249 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.249 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:30.249 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:30.249 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 51.24666208, 2024-09-12T22:05:30.249 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:30.249 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.249 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.249 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.249 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.249 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.249 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.249 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:30.250 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.250 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.250 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.250 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.250 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:30.250 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.250 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.250 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.250 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.250 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:30.250 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.250 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.250 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.250 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:30.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:30.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:30.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:30.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:30.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:30.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:30.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:30.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:30.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:30.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:30.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:30.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:30.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:30.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:30.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:30.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:30.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:30.254 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.254 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.254 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.254 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:30.254 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:30.254 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 51.244842417000001, 2024-09-12T22:05:30.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:30.254 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.254 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.254 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.254 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:30.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:30.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:30.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:30.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:30.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:30.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.257 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:30.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:30.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.257 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:30.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:30.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:30.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:30.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:30.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:30.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:30.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:30.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:30.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:30.259 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.259 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.259 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.259 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:30.259 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:30.259 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 51.244308603, 2024-09-12T22:05:30.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:30.259 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.259 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.260 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.260 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.260 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.260 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.260 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:30.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.260 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:30.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:30.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:30.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:30.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:30.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:30.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:30.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:30.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:30.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:30.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:30.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:30.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:30.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:30.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:30.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:30.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:30.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:30.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:30.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:30.264 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.264 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.264 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.264 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:30.264 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:30.264 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 51.242493764000002, 2024-09-12T22:05:30.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:30.265 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.265 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.265 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.265 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.265 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.265 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.265 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:30.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.265 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:30.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:30.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:30.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:30.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:30.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:30.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:30.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:30.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:30.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:30.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:30.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:30.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:30.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:30.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:30.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:30.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:30.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:30.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:30.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:30.269 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.269 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.270 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.270 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.270 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:30.270 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.280399976, 2024-09-12T22:05:30.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:05:30.270 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.270 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.270 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.270 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.270 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.271 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.271 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:05:30.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.271 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:30.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:30.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:05:30.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:05:30.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:05:30.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:05:30.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:05:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:05:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:05:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:05:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:05:30.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:05:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:05:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:05:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:05:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:05:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:05:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:05:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:05:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:05:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:05:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:05:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:05:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:05:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:05:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:05:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:05:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.278 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.2783672510000006, 2024-09-12T22:05:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:05:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.280 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:05:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:05:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:05:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:05:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:05:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:05:30.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:05:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:05:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:05:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:05:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:05:30.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:05:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:05:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:05:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:05:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:05:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:05:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:05:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:05:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:05:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:05:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:05:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:05:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:05:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:05:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.286 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.2753549870000001, 2024-09-12T22:05:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:05:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:05:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:05:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:05:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:05:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:05:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:05:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:05:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:05:30.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:05:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:05:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:05:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:05:30.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:05:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:05:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:05:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:05:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:05:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:05:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:05:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:05:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:05:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:05:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:05:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:05:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:05:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:05:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.294 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.2743684969999993, 2024-09-12T22:05:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:05:30.296 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.297 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:05:30.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:05:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:05:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:05:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:05:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:05:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:05:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:05:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:05:30.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:05:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:05:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:05:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:05:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:05:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:05:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:05:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:05:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:05:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:05:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:05:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:05:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:05:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:05:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:05:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.2692818629999998, 2024-09-12T22:05:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:05:30.306 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:05:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:05:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:05:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:05:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:05:30.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:05:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:05:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:05:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:05:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:05:30.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:05:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:05:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:05:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:05:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:05:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:05:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:05:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:05:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:05:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:05:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:05:30.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:05:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:05:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:05:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:05:30.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:05:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:05:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.2665268909999998, 2024-09-12T22:05:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:05:30.314 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:05:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:05:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:05:30.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:05:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:05:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:05:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:05:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:05:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:05:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:05:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:05:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:05:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:05:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:05:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:05:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:05:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:05:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:05:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:05:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:05:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:05:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:05:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:05:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:05:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:05:30.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:05:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:05:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.322 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.2585520060000004, 2024-09-12T22:05:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:05:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:05:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:05:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:05:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:05:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:05:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:05:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:05:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:05:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:05:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:05:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:05:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:05:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:05:30.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:05:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:05:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:05:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:05:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:05:30.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:05:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:05:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:05:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:05:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:05:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:05:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:05:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:05:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:05:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:30.329 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.2506262299999999, 2024-09-12T22:05:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:05:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:05:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:05:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:05:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:05:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:05:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:05:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:05:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:05:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:05:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:05:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:05:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:05:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:05:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:05:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:05:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:05:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:05:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:05:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:05:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:05:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:05:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:05:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:05:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:05:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:05:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:05:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.336 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.2491299480000002, 2024-09-12T22:05:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:05:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.337 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:05:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:05:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:05:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:05:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:05:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:05:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:05:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:05:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:05:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:05:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:05:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:05:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:05:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:05:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:05:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:05:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:05:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:05:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:05:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:05:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:05:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:05:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:05:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:05:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.344 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241896 5.6 5:6ef8d923:::benchmark_data_smithi043_32659_object74658:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.2129367640000002, 2024-09-12T22:05:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99264745399999998, 2024-09-12T22:05:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241896 2024-09-12T22:05:30.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:30.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031744+0000", 2024-09-12T22:05:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8100000000000001e-07 2024-09-12T22:05:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031749+0000", 2024-09-12T22:05:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.437e-06 2024-09-12T22:05:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031757+0000", 2024-09-12T22:05:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6999999999999997e-06 2024-09-12T22:05:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031765+0000", 2024-09-12T22:05:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6709999999999999e-06 2024-09-12T22:05:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031809+0000", 2024-09-12T22:05:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3970000000000001e-05 2024-09-12T22:05:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031817+0000", 2024-09-12T22:05:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6580000000000002e-06 2024-09-12T22:05:30.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020952+0000", 2024-09-12T22:05:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.98913576299999995 2024-09-12T22:05:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021031+0000", 2024-09-12T22:05:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8483000000000001e-05 2024-09-12T22:05:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021091+0000", 2024-09-12T22:05:30.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0287000000000001e-05 2024-09-12T22:05:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024109+0000", 2024-09-12T22:05:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030178269999999998 2024-09-12T22:05:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024255+0000", 2024-09-12T22:05:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014615799999999999 2024-09-12T22:05:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024305+0000", 2024-09-12T22:05:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0259000000000001e-05 2024-09-12T22:05:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024391+0000", 2024-09-12T22:05:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:05:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241935 5.6 5:60e2bed8:::benchmark_data_smithi043_32659_object74697:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.1938471390000007, 2024-09-12T22:05:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97487546999999997, 2024-09-12T22:05:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.353 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241935 2024-09-12T22:05:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:30.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050834+0000", 2024-09-12T22:05:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2500000000000004e-07 2024-09-12T22:05:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050838+0000", 2024-09-12T22:05:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7029999999999997e-06 2024-09-12T22:05:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050853+0000", 2024-09-12T22:05:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4545000000000001e-05 2024-09-12T22:05:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050859+0000", 2024-09-12T22:05:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:05:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050902+0000", 2024-09-12T22:05:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3455999999999999e-05 2024-09-12T22:05:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050909+0000", 2024-09-12T22:05:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6950000000000003e-06 2024-09-12T22:05:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022045+0000", 2024-09-12T22:05:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97113624700000001 2024-09-12T22:05:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022168+0000", 2024-09-12T22:05:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012233 2024-09-12T22:05:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022235+0000", 2024-09-12T22:05:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7651000000000007e-05 2024-09-12T22:05:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024398+0000", 2024-09-12T22:05:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002163005 2024-09-12T22:05:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025575+0000", 2024-09-12T22:05:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011767590000000001 2024-09-12T22:05:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025624+0000", 2024-09-12T22:05:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9217e-05 2024-09-12T22:05:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025708+0000", 2024-09-12T22:05:30.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4037999999999997e-05 2024-09-12T22:05:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241940 5.6 5:60be75db:::benchmark_data_smithi043_32659_object74702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.1907751859999998, 2024-09-12T22:05:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97334840700000003, 2024-09-12T22:05:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.361 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241940 2024-09-12T22:05:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4700000000000002e-07 2024-09-12T22:05:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053907+0000", 2024-09-12T22:05:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.796e-06 2024-09-12T22:05:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053912+0000", 2024-09-12T22:05:30.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.622e-06 2024-09-12T22:05:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053915+0000", 2024-09-12T22:05:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3009999999999998e-06 2024-09-12T22:05:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053952+0000", 2024-09-12T22:05:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6668000000000002e-05 2024-09-12T22:05:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053957+0000", 2024-09-12T22:05:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5849999999999999e-06 2024-09-12T22:05:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023005+0000", 2024-09-12T22:05:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.96904800700000004 2024-09-12T22:05:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023162+0000", 2024-09-12T22:05:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015720900000000001 2024-09-12T22:05:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023284+0000", 2024-09-12T22:05:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012194200000000001 2024-09-12T22:05:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025765+0000", 2024-09-12T22:05:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024806099999999998 2024-09-12T22:05:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027176+0000", 2024-09-12T22:05:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014111180000000001 2024-09-12T22:05:30.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027204+0000", 2024-09-12T22:05:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7970000000000002e-05 2024-09-12T22:05:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027253+0000", 2024-09-12T22:05:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9231999999999999e-05 2024-09-12T22:05:30.367 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241966 5.6 5:6538f108:::benchmark_data_smithi043_32659_object74728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.1730295369999997, 2024-09-12T22:05:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95692954799999996, 2024-09-12T22:05:30.368 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241966 2024-09-12T22:05:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071651+0000", 2024-09-12T22:05:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:05:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071656+0000", 2024-09-12T22:05:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7929999999999997e-06 2024-09-12T22:05:30.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071669+0000", 2024-09-12T22:05:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2692e-05 2024-09-12T22:05:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071676+0000", 2024-09-12T22:05:30.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:05:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071716+0000", 2024-09-12T22:05:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9817999999999997e-05 2024-09-12T22:05:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071721+0000", 2024-09-12T22:05:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.057e-06 2024-09-12T22:05:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024429+0000", 2024-09-12T22:05:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95270825000000003 2024-09-12T22:05:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024544+0000", 2024-09-12T22:05:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114045 2024-09-12T22:05:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024655+0000", 2024-09-12T22:05:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111382 2024-09-12T22:05:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028489+0000", 2024-09-12T22:05:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038338930000000001 2024-09-12T22:05:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028497+0000", 2024-09-12T22:05:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7600000000000002e-06 2024-09-12T22:05:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028523+0000", 2024-09-12T22:05:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6268999999999999e-05 2024-09-12T22:05:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028580+0000", 2024-09-12T22:05:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7179999999999998e-05 2024-09-12T22:05:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.376 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241967 5.6 5:6c2d2d65:::benchmark_data_smithi043_32659_object74729:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.1729814330000004, 2024-09-12T22:05:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958333094, 2024-09-12T22:05:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241967 2024-09-12T22:05:30.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071702+0000", 2024-09-12T22:05:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6929999999999999e-06 2024-09-12T22:05:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071709+0000", 2024-09-12T22:05:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2470000000000002e-06 2024-09-12T22:05:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071715+0000", 2024-09-12T22:05:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7370000000000003e-06 2024-09-12T22:05:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071737+0000", 2024-09-12T22:05:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1976000000000001e-05 2024-09-12T22:05:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071740+0000", 2024-09-12T22:05:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1760000000000002e-06 2024-09-12T22:05:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025813+0000", 2024-09-12T22:05:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95407325399999998 2024-09-12T22:05:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025956+0000", 2024-09-12T22:05:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014283699999999999 2024-09-12T22:05:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.026055+0000", 2024-09-12T22:05:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9088999999999999e-05 2024-09-12T22:05:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028628+0000", 2024-09-12T22:05:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025725209999999999 2024-09-12T22:05:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029901+0000", 2024-09-12T22:05:30.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012737720000000001 2024-09-12T22:05:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029954+0000", 2024-09-12T22:05:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2811e-05 2024-09-12T22:05:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030032+0000", 2024-09-12T22:05:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7401e-05 2024-09-12T22:05:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241968 5.6 5:63b7d78c:::benchmark_data_smithi043_32659_object74730:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.1729555759999997, 2024-09-12T22:05:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958459332, 2024-09-12T22:05:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241968 2024-09-12T22:05:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.384 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:30.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:30.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071725+0000", 2024-09-12T22:05:30.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5600000000000001e-07 2024-09-12T22:05:30.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071727+0000", 2024-09-12T22:05:30.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.232e-06 2024-09-12T22:05:30.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071733+0000", 2024-09-12T22:05:30.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2750000000000001e-06 2024-09-12T22:05:30.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071738+0000", 2024-09-12T22:05:30.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9289999999999997e-06 2024-09-12T22:05:30.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071769+0000", 2024-09-12T22:05:30.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0746e-05 2024-09-12T22:05:30.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071774+0000", 2024-09-12T22:05:30.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8099999999999997e-06 2024-09-12T22:05:30.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027283+0000", 2024-09-12T22:05:30.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95550956399999998 2024-09-12T22:05:30.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027416+0000", 2024-09-12T22:05:30.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013268399999999999 2024-09-12T22:05:30.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027532+0000", 2024-09-12T22:05:30.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115807 2024-09-12T22:05:30.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030066+0000", 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025343800000000001 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030077+0000", 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1260000000000001e-05 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030116+0000", 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8970999999999997e-05 2024-09-12T22:05:30.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030184+0000", 2024-09-12T22:05:30.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7317999999999995e-05 2024-09-12T22:05:30.391 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.391 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.391 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.391 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241974 5.6 5:6b9cdaf2:::benchmark_data_smithi043_32659_object74736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:30.391 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:30.391 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.1596959279999997, 2024-09-12T22:05:30.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94774920900000004, 2024-09-12T22:05:30.391 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:30.392 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:30.392 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.392 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:30.392 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:30.392 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.392 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241974 2024-09-12T22:05:30.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.392 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:30.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:30.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:30.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084985+0000", 2024-09-12T22:05:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4600000000000004e-07 2024-09-12T22:05:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084989+0000", 2024-09-12T22:05:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9349999999999996e-06 2024-09-12T22:05:30.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:30.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084999+0000", 2024-09-12T22:05:30.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0043e-05 2024-09-12T22:05:30.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085004+0000", 2024-09-12T22:05:30.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1619999999999999e-06 2024-09-12T22:05:30.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085041+0000", 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7469999999999999e-05 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085048+0000", 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028676+0000", 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94362829599999998 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:30.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028809+0000", 2024-09-12T22:05:30.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013285 2024-09-12T22:05:30.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:30.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028932+0000", 2024-09-12T22:05:30.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012289199999999999 2024-09-12T22:05:30.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:30.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032531+0000", 2024-09-12T22:05:30.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035990639999999999 2024-09-12T22:05:30.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032584+0000", 2024-09-12T22:05:30.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3399999999999997e-05 2024-09-12T22:05:30.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:30.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032644+0000", 2024-09-12T22:05:30.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0019999999999998e-05 2024-09-12T22:05:30.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:30.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:30.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:30.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032733+0000", 2024-09-12T22:05:30.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9137999999999999e-05 2024-09-12T22:05:30.397 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.397 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.398 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.398 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:30.398 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:30.399 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:30.400 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:30.399+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:30.401 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:30.501 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:30.500+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:30.549 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:262777 5.7 5:e69a29d5:::benchmark_data_smithi043_32659_object95539:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T22:05:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:30.545986+0000", 2024-09-12T22:05:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0021167849999999999, 2024-09-12T22:05:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002132751, 2024-09-12T22:05:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 262777 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545986+0000", 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545986+0000", 2024-09-12T22:05:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545987+0000", 2024-09-12T22:05:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:05:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545994+0000", 2024-09-12T22:05:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8900000000000001e-06 2024-09-12T22:05:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546002+0000", 2024-09-12T22:05:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9780000000000005e-06 2024-09-12T22:05:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546006+0000", 2024-09-12T22:05:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6709999999999998e-06 2024-09-12T22:05:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546184+0000", 2024-09-12T22:05:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000178056 2024-09-12T22:05:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546370+0000", 2024-09-12T22:05:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018523899999999999 2024-09-12T22:05:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546496+0000", 2024-09-12T22:05:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126561 2024-09-12T22:05:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.548094+0000", 2024-09-12T22:05:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001597928 2024-09-12T22:05:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:262778 5.1 5:8050977e:::benchmark_data_smithi043_32659_object95540:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T22:05:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:30.546519+0000", 2024-09-12T22:05:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0015837220000000001, 2024-09-12T22:05:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016488729999999999, 2024-09-12T22:05:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 262778 2024-09-12T22:05:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546519+0000", 2024-09-12T22:05:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546519+0000", 2024-09-12T22:05:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546520+0000", 2024-09-12T22:05:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9400000000000005e-07 2024-09-12T22:05:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546523+0000", 2024-09-12T22:05:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2040000000000002e-06 2024-09-12T22:05:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546534+0000", 2024-09-12T22:05:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1092e-05 2024-09-12T22:05:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546539+0000", 2024-09-12T22:05:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8489999999999997e-06 2024-09-12T22:05:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546575+0000", 2024-09-12T22:05:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5704000000000002e-05 2024-09-12T22:05:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546687+0000", 2024-09-12T22:05:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000112564 2024-09-12T22:05:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546761+0000", 2024-09-12T22:05:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4089000000000002e-05 2024-09-12T22:05:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:262769 5.7 5:ea0965da:::benchmark_data_smithi043_32659_object95531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T22:05:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:30.542967+0000", 2024-09-12T22:05:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.005136046, 2024-09-12T22:05:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.005241753, 2024-09-12T22:05:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 262769 2024-09-12T22:05:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.542967+0000", 2024-09-12T22:05:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.542967+0000", 2024-09-12T22:05:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.542968+0000", 2024-09-12T22:05:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5000000000000002e-07 2024-09-12T22:05:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.542971+0000", 2024-09-12T22:05:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8340000000000001e-06 2024-09-12T22:05:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.542979+0000", 2024-09-12T22:05:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9750000000000007e-06 2024-09-12T22:05:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.542985+0000", 2024-09-12T22:05:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1480000000000003e-06 2024-09-12T22:05:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.543059+0000", 2024-09-12T22:05:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3897000000000001e-05 2024-09-12T22:05:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.543185+0000", 2024-09-12T22:05:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012520000000000001 2024-09-12T22:05:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.543250+0000", 2024-09-12T22:05:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5556999999999996e-05 2024-09-12T22:05:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.546157+0000", 2024-09-12T22:05:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029069550000000001 2024-09-12T22:05:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:262772 5.7 5:ef07bc54:::benchmark_data_smithi043_32659_object95534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T22:05:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:30.544222+0000", 2024-09-12T22:05:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.003880456, 2024-09-12T22:05:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040276640000000002, 2024-09-12T22:05:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 262772 2024-09-12T22:05:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.544222+0000", 2024-09-12T22:05:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.544222+0000", 2024-09-12T22:05:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.544224+0000", 2024-09-12T22:05:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.096e-06 2024-09-12T22:05:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.544228+0000", 2024-09-12T22:05:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.763e-06 2024-09-12T22:05:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.544239+0000", 2024-09-12T22:05:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0668e-05 2024-09-12T22:05:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.544246+0000", 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0879999999999997e-06 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.544805+0000", 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00055883500000000004 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.544916+0000", 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110585 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.544987+0000", 2024-09-12T22:05:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1476000000000005e-05 2024-09-12T22:05:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.547784+0000", 2024-09-12T22:05:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027972629999999999 2024-09-12T22:05:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:262773 5.3 5:c4fb6722:::benchmark_data_smithi043_32659_object95535:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:30.545174+0000", 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0029292020000000001, 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031179670000000001, 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 262773 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545174+0000", 2024-09-12T22:05:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545174+0000", 2024-09-12T22:05:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545174+0000", 2024-09-12T22:05:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:05:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545178+0000", 2024-09-12T22:05:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.428e-06 2024-09-12T22:05:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545186+0000", 2024-09-12T22:05:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2160000000000006e-06 2024-09-12T22:05:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545192+0000", 2024-09-12T22:05:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2110000000000003e-06 2024-09-12T22:05:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545258+0000", 2024-09-12T22:05:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5470999999999997e-05 2024-09-12T22:05:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545395+0000", 2024-09-12T22:05:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000137687 2024-09-12T22:05:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545565+0000", 2024-09-12T22:05:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000169987 2024-09-12T22:05:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.547774+0000", 2024-09-12T22:05:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022085469999999999 2024-09-12T22:05:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:262774 5.c 5:3f177125:::benchmark_data_smithi043_32659_object95536:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T22:05:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:30.545489+0000", 2024-09-12T22:05:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0026138120000000001, 2024-09-12T22:05:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002843787, 2024-09-12T22:05:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 262774 2024-09-12T22:05:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545489+0000", 2024-09-12T22:05:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545489+0000", 2024-09-12T22:05:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545490+0000", 2024-09-12T22:05:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:05:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545495+0000", 2024-09-12T22:05:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5430000000000004e-06 2024-09-12T22:05:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545505+0000", 2024-09-12T22:05:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0234999999999999e-05 2024-09-12T22:05:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545512+0000", 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.973e-06 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545561+0000", 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9299999999999999e-05 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545720+0000", 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000159166 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545848+0000", 2024-09-12T22:05:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127909 2024-09-12T22:05:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:262775 5.c 5:316a1240:::benchmark_data_smithi043_32659_object95537:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T22:05:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:30.545530+0000", 2024-09-12T22:05:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0025725869999999999, 2024-09-12T22:05:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002842589, 2024-09-12T22:05:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 262775 2024-09-12T22:05:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545530+0000", 2024-09-12T22:05:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545530+0000", 2024-09-12T22:05:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545531+0000", 2024-09-12T22:05:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6899999999999998e-07 2024-09-12T22:05:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545533+0000", 2024-09-12T22:05:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3690000000000001e-06 2024-09-12T22:05:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545540+0000", 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.545546+0000", 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5270000000000004e-06 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.547710+0000", 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021638590000000002 2024-09-12T22:05:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.547891+0000", 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018098699999999999 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:30.548020+0000", 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000128725 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 7 2024-09-12T22:05:30.583 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:30.585 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:30.630 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:30.627+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:30.703 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:30.702+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:30.728 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:30.728 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:30.728 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:30.729 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:30.729 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:30.739 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:30.823 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:30.822+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:30.904 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:30.903+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:30.923 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.509908039999999, 2024-09-12T22:05:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.509728109999998, 2024-09-12T22:05:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.509661669000003, 2024-09-12T22:05:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:30.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:30.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:30.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:30.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:30.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:30.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:30.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:30.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:30.939 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.939 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.939 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.509605225999998, 2024-09-12T22:05:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.941 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:30.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:30.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:30.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:30.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:30.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:30.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:30.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:30.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:30.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:30.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:30.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:30.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:30.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:30.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:30.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:30.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:30.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:30.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:30.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:30.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:30.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:30.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:30.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:30.946 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.946 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.947 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.947 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:30.947 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:30.947 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.509536765999997, 2024-09-12T22:05:30.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:30.947 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.947 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.947 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.947 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.947 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.947 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.947 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:30.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.948 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:30.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:30.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:30.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:30.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:30.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:30.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:30.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:30.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:30.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:30.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:30.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:30.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:30.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:30.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:30.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:30.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:30.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:30.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:30.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:30.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:30.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:30.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:30.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:30.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:30.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:30.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:30.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:30.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:30.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:30.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:30.953 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.954 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.954 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.954 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:30.954 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:30.954 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.509479030999998, 2024-09-12T22:05:30.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:30.954 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.954 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.954 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.955 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.955 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.955 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.955 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:30.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.956 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:30.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:30.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:30.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:30.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:30.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:30.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:30.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:30.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:30.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:30.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:30.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:30.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:30.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:30.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:30.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:30.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:30.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:30.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:30.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:30.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:30.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:30.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:30.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:30.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:30.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:30.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:30.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:30.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:30.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:30.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:30.961 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.961 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.961 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.962 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:30.962 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:30.962 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.509411339000003, 2024-09-12T22:05:30.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:30.962 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.962 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.962 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.962 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.962 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.962 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.962 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:30.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.962 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:30.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:30.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:30.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:30.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:30.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:30.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:30.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:30.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:30.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:30.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:30.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:30.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:30.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:30.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:30.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:30.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:30.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:30.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:30.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:30.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:30.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:30.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:30.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:30.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:30.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:30.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:30.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:30.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:30.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:30.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:30.970 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.970 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.970 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.970 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:30.971 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:30.971 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.509356277000002, 2024-09-12T22:05:30.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:30.971 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.971 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.971 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.971 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.971 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.971 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.971 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:30.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.972 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:30.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:30.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:30.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:30.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:30.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:30.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:30.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:30.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:30.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:30.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:30.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:30.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:30.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:30.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:30.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:30.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:30.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:30.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:30.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:30.977 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:30.978 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.468708757000002, 2024-09-12T22:05:30.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:30.978 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.978 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.978 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.978 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.978 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.978 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.978 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:30.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.978 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:30.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:30.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:30.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:30.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:30.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:30.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:30.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:30.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:30.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:30.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:30.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:30.983 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.983 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.984 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.984 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:30.984 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:30.984 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.466095029000002, 2024-09-12T22:05:30.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:30.984 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.984 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.984 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.984 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:30.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.985 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:30.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:30.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:30.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:30.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:30.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:30.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:30.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:30.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:30.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.920880932999999, 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:30.990 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.991 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.991 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.991 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.991 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.991 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.991 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:30.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.991 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:30.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:30.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.920402445000001, 2024-09-12T22:05:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:30.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:30.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:30.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:30.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:30.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:30.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:30.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:30.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:30.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:30.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:30.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:30.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:30.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:30.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:31.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:31.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:31.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:31.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:31.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:31.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:31.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:31.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:31.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:31.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:31.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:31.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:31.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:31.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:31.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:31.004 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.004 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:31.004 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.004 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:31.004 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:31.004 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.917907145000001, 2024-09-12T22:05:31.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:31.004 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:31.005 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:31.005 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:31.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:31.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.005 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:31.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.005 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:31.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:31.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:31.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:31.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:31.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:31.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:31.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:31.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:31.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:31.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:31.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:31.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:31.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:31.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:31.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:31.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:31.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:31.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:31.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:31.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:31.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:31.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:31.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:31.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:31.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.916826354000001, 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:31.011 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:31.012 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.012 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:31.012 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:31.012 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.012 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:31.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.012 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:31.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:31.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:31.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:31.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:31.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:31.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:31.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:31.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:31.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:31.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:31.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:31.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:31.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:31.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:31.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:31.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:31.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:31.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:31.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:31.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:31.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:31.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:31.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:31.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:31.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:31.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:31.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:31.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:31.017 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.017 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:31.017 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.017 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:31.017 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:31.017 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.915590792000003, 2024-09-12T22:05:31.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:31.017 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:31.017 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:31.017 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.018 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:31.018 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:31.018 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.018 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:31.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.018 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:31.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:31.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:31.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:31.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:31.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:31.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:31.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:31.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:31.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:31.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:31.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:31.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:31.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:31.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:31.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:31.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:31.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:31.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:31.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.474850304, 2024-09-12T22:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:31.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.024 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:31.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.024 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:31.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:31.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:31.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:31.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:31.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:31.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:31.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:31.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:31.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:31.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:31.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:31.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:31.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:31.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:31.027 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.028 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:31.028 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.028 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:31.028 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:31.028 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.470319877000001, 2024-09-12T22:05:31.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:31.028 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:31.028 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:31.028 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.028 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:31.028 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:31.029 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.029 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:31.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.029 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:31.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:31.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:31.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:31.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:31.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:31.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:31.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:31.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:31.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:31.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:31.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:31.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:31.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:31.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:31.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:31.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:31.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:31.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:31.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:31.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:31.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:31.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:31.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:31.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:31.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:31.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:31.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:31.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:31.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:31.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:31.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:31.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:31.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:31.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:31.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:31.034 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.034 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:31.034 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.035 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:31.035 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:31.035 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.470295847999999, 2024-09-12T22:05:31.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:31.035 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:31.035 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:31.035 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.035 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:31.035 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:31.036 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.036 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:31.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.036 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:31.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:31.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:31.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:31.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:31.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:31.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:31.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:31.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:31.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:31.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:31.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:31.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:31.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:31.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:31.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:31.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:31.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:31.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:31.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:31.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:31.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:31.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:31.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:31.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:31.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:31.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:31.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:31.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:31.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:31.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:31.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:31.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.470118199000002, 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:31.042 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:31.043 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:31.043 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.043 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:31.043 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:31.043 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.043 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:31.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.043 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:31.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:31.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:31.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:31.047 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.048 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:31.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.048 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:31.048 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:31.048 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.468099662, 2024-09-12T22:05:31.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:31.048 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:31.048 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:31.048 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.048 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:31.048 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:31.048 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.049 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:31.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.049 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:31.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:31.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:31.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:31.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:31.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:31.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:31.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:31.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:31.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:31.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:31.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:31.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:31.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:31.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:31.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:31.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:31.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:31.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:31.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:31.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.053 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:31.054 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.054 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:31.054 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:31.054 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:31.056 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-09-12T22:05:31.056 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:31.056 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:31.054+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:31.156 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:31.155+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:31.217 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:31.218 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:31.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.218 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:264593 5.8 5:16ca3181:::benchmark_data_smithi043_32659_object97355:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T22:05:31.218 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.209739+0000", 2024-09-12T22:05:31.218 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0057665140000000004, 2024-09-12T22:05:31.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0057974319999999999, 2024-09-12T22:05:31.218 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.218 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.218 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:31.218 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.218 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.218 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.219 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 264593 2024-09-12T22:05:31.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.219 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.209739+0000", 2024-09-12T22:05:31.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.209739+0000", 2024-09-12T22:05:31.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.209740+0000", 2024-09-12T22:05:31.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:05:31.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.209743+0000", 2024-09-12T22:05:31.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8099999999999999e-06 2024-09-12T22:05:31.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.209753+0000", 2024-09-12T22:05:31.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2939999999999994e-06 2024-09-12T22:05:31.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.209759+0000", 2024-09-12T22:05:31.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1040000000000003e-06 2024-09-12T22:05:31.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.209808+0000", 2024-09-12T22:05:31.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9224999999999997e-05 2024-09-12T22:05:31.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.209955+0000", 2024-09-12T22:05:31.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000147138 2024-09-12T22:05:31.222 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.222 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.222 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.222 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:264595 5.a 5:56fd2adc:::benchmark_data_smithi043_32659_object97357:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T22:05:31.222 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.211499+0000", 2024-09-12T22:05:31.222 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0040062159999999999, 2024-09-12T22:05:31.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0041047369999999998, 2024-09-12T22:05:31.222 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.222 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.222 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:31.223 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.223 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.223 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.223 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 264595 2024-09-12T22:05:31.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.223 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211499+0000", 2024-09-12T22:05:31.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.224 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.224 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211499+0000", 2024-09-12T22:05:31.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.224 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.224 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211500+0000", 2024-09-12T22:05:31.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5099999999999999e-07 2024-09-12T22:05:31.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.224 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.224 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211504+0000", 2024-09-12T22:05:31.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.997e-06 2024-09-12T22:05:31.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211513+0000", 2024-09-12T22:05:31.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7879999999999995e-06 2024-09-12T22:05:31.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211518+0000", 2024-09-12T22:05:31.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8030000000000002e-06 2024-09-12T22:05:31.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211562+0000", 2024-09-12T22:05:31.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3398e-05 2024-09-12T22:05:31.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211707+0000", 2024-09-12T22:05:31.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014503000000000001 2024-09-12T22:05:31.226 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.226 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.226 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.227 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:264596 5.4 5:2269d9b7:::benchmark_data_smithi043_32659_object97358:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T22:05:31.227 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.211530+0000", 2024-09-12T22:05:31.227 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0039754969999999997, 2024-09-12T22:05:31.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0041338190000000004, 2024-09-12T22:05:31.227 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.227 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.227 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:31.227 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.227 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.227 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.227 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 264596 2024-09-12T22:05:31.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211530+0000", 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211530+0000", 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211530+0000", 2024-09-12T22:05:31.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0800000000000001e-07 2024-09-12T22:05:31.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211532+0000", 2024-09-12T22:05:31.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6029999999999999e-06 2024-09-12T22:05:31.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211538+0000", 2024-09-12T22:05:31.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.857e-06 2024-09-12T22:05:31.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211541+0000", 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1590000000000002e-06 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211573+0000", 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2017999999999997e-05 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211706+0000", 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133249 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:264597 5.6 5:61ec8ced:::benchmark_data_smithi043_32659_object97359:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.211546+0000", 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0039591299999999999, 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0041785449999999997, 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 264597 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211546+0000", 2024-09-12T22:05:31.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211546+0000", 2024-09-12T22:05:31.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211546+0000", 2024-09-12T22:05:31.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4200000000000002e-07 2024-09-12T22:05:31.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211548+0000", 2024-09-12T22:05:31.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2720000000000001e-06 2024-09-12T22:05:31.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211551+0000", 2024-09-12T22:05:31.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.428e-06 2024-09-12T22:05:31.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211554+0000", 2024-09-12T22:05:31.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7480000000000002e-06 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211594+0000", 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9681999999999997e-05 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211755+0000", 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016128900000000001 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211877+0000", 2024-09-12T22:05:31.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000122297 2024-09-12T22:05:31.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.213717+0000", 2024-09-12T22:05:31.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018395519999999999 2024-09-12T22:05:31.235 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.235 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.235 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.235 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:264598 5.e 5:7597c07e:::benchmark_data_smithi043_32659_object97360:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T22:05:31.235 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.211560+0000", 2024-09-12T22:05:31.235 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0039455319999999999, 2024-09-12T22:05:31.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004235562, 2024-09-12T22:05:31.236 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.236 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.236 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:31.236 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.236 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.236 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.236 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 264598 2024-09-12T22:05:31.236 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.236 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.236 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.236 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.236 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211560+0000", 2024-09-12T22:05:31.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211560+0000", 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211560+0000", 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211562+0000", 2024-09-12T22:05:31.237 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.88e-06 2024-09-12T22:05:31.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.238 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211568+0000", 2024-09-12T22:05:31.238 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5940000000000001e-06 2024-09-12T22:05:31.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.238 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211571+0000", 2024-09-12T22:05:31.238 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4419999999999998e-06 2024-09-12T22:05:31.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.238 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211621+0000", 2024-09-12T22:05:31.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9947999999999997e-05 2024-09-12T22:05:31.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.239 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211739+0000", 2024-09-12T22:05:31.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117779 2024-09-12T22:05:31.239 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.239 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.239 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.239 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:264599 5.4 5:23982b13:::benchmark_data_smithi043_32659_object97361:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T22:05:31.239 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.211592+0000", 2024-09-12T22:05:31.240 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0039137720000000003, 2024-09-12T22:05:31.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0042673499999999996, 2024-09-12T22:05:31.240 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.240 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.240 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:31.240 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.240 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.240 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.240 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 264599 2024-09-12T22:05:31.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.240 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211592+0000", 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211592+0000", 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211592+0000", 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.242 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211594+0000", 2024-09-12T22:05:31.242 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0449999999999999e-06 2024-09-12T22:05:31.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.242 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.242 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211600+0000", 2024-09-12T22:05:31.242 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2580000000000001e-06 2024-09-12T22:05:31.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.242 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.242 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211606+0000", 2024-09-12T22:05:31.242 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1590000000000001e-06 2024-09-12T22:05:31.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.213308+0000", 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001702828 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.213477+0000", 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000168336 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:264600 5.d 5:bca55144:::benchmark_data_smithi043_32659_object97362:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T22:05:31.243 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.211617+0000", 2024-09-12T22:05:31.244 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0038887409999999998, 2024-09-12T22:05:31.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004300295, 2024-09-12T22:05:31.244 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.244 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.244 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:31.244 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.244 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.244 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.244 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 264600 2024-09-12T22:05:31.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.244 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.244 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211617+0000", 2024-09-12T22:05:31.245 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.245 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.245 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.245 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.245 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211617+0000", 2024-09-12T22:05:31.245 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.245 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.245 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.245 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.245 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211617+0000", 2024-09-12T22:05:31.245 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1500000000000005e-07 2024-09-12T22:05:31.245 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.245 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.245 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.246 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211619+0000", 2024-09-12T22:05:31.246 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2350000000000002e-06 2024-09-12T22:05:31.246 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.246 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.246 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211626+0000", 2024-09-12T22:05:31.246 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7889999999999997e-06 2024-09-12T22:05:31.246 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.246 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.246 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211631+0000", 2024-09-12T22:05:31.247 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8010000000000003e-06 2024-09-12T22:05:31.247 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.247 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.247 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.247 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211673+0000", 2024-09-12T22:05:31.247 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2218999999999997e-05 2024-09-12T22:05:31.247 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.247 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.247 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.247 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211863+0000", 2024-09-12T22:05:31.247 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019017200000000001 2024-09-12T22:05:31.247 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.247 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.247 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.248 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211983+0000", 2024-09-12T22:05:31.248 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119493 2024-09-12T22:05:31.248 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.248 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.248 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.248 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214005+0000", 2024-09-12T22:05:31.248 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020222320000000001 2024-09-12T22:05:31.248 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.248 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.248 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.248 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.249 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.249 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:264594 5.1 e61/40 5:86ec0426:::benchmark_data_smithi043_32659_object97356:head v 61'16420, mlcod=61'16418)", 2024-09-12T22:05:31.249 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.211730+0000", 2024-09-12T22:05:31.249 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00377561, 2024-09-12T22:05:31.249 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004257757, 2024-09-12T22:05:31.249 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.249 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.249 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:31.249 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.249 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.249 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.249 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211730+0000", 2024-09-12T22:05:31.249 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.250 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.250 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.250 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.250 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211730+0000", 2024-09-12T22:05:31.250 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.250 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.250 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.250 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.250 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211730+0000", 2024-09-12T22:05:31.250 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:05:31.250 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.250 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211735+0000", 2024-09-12T22:05:31.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0000000000000004e-06 2024-09-12T22:05:31.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211743+0000", 2024-09-12T22:05:31.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6190000000000002e-06 2024-09-12T22:05:31.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211749+0000", 2024-09-12T22:05:31.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0349999999999998e-06 2024-09-12T22:05:31.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211808+0000", 2024-09-12T22:05:31.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9434000000000001e-05 2024-09-12T22:05:31.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.211832+0000", 2024-09-12T22:05:31.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3382000000000001e-05 2024-09-12T22:05:31.252 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.252 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.252 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:264602 5.4 5:295ce48e:::benchmark_data_smithi043_32659_object97364:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.214208+0000", 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0012978219999999999, 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00183278, 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 264602 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.254 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.254 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214208+0000", 2024-09-12T22:05:31.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.254 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.254 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214208+0000", 2024-09-12T22:05:31.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214209+0000", 2024-09-12T22:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1689999999999999e-06 2024-09-12T22:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214214+0000", 2024-09-12T22:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.977e-06 2024-09-12T22:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214221+0000", 2024-09-12T22:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5519999999999999e-06 2024-09-12T22:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214226+0000", 2024-09-12T22:05:31.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4109999999999998e-06 2024-09-12T22:05:31.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.215053+0000", 2024-09-12T22:05:31.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00082704700000000003 2024-09-12T22:05:31.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.215191+0000", 2024-09-12T22:05:31.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013795600000000001 2024-09-12T22:05:31.257 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.257 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.257 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.257 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:264603 5.4 5.70779864 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T22:05:31.257 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.214237+0000", 2024-09-12T22:05:31.257 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001268763, 2024-09-12T22:05:31.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001859882, 2024-09-12T22:05:31.257 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.257 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.257 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:31.257 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.257 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.258 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.258 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 264603 2024-09-12T22:05:31.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.258 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214237+0000", 2024-09-12T22:05:31.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214237+0000", 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214237+0000", 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214238+0000", 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4720000000000001e-06 2024-09-12T22:05:31.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214247+0000", 2024-09-12T22:05:31.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6789999999999994e-06 2024-09-12T22:05:31.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214251+0000", 2024-09-12T22:05:31.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.749e-06 2024-09-12T22:05:31.261 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.261 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.261 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.261 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:264605 5.e 5:7581a25f:::benchmark_data_smithi043_32659_object97367:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T22:05:31.261 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.214263+0000", 2024-09-12T22:05:31.261 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0012425590000000001, 2024-09-12T22:05:31.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001882599, 2024-09-12T22:05:31.261 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.262 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.262 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:31.262 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.262 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.262 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.262 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 264605 2024-09-12T22:05:31.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.262 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214263+0000", 2024-09-12T22:05:31.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214263+0000", 2024-09-12T22:05:31.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214263+0000", 2024-09-12T22:05:31.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9400000000000001e-07 2024-09-12T22:05:31.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214265+0000", 2024-09-12T22:05:31.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.829e-06 2024-09-12T22:05:31.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214270+0000", 2024-09-12T22:05:31.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2789999999999998e-06 2024-09-12T22:05:31.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214273+0000", 2024-09-12T22:05:31.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9739999999999998e-06 2024-09-12T22:05:31.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214300+0000", 2024-09-12T22:05:31.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6959000000000001e-05 2024-09-12T22:05:31.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214428+0000", 2024-09-12T22:05:31.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012792200000000001 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:264606 5.0 5:089cd6bb:::benchmark_data_smithi043_32659_object97368:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.214282+0000", 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001223226, 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019214760000000001, 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.267 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 264606 2024-09-12T22:05:31.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.267 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214282+0000", 2024-09-12T22:05:31.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214282+0000", 2024-09-12T22:05:31.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214283+0000", 2024-09-12T22:05:31.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.46e-07 2024-09-12T22:05:31.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214285+0000", 2024-09-12T22:05:31.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2409999999999998e-06 2024-09-12T22:05:31.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214290+0000", 2024-09-12T22:05:31.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5860000000000004e-06 2024-09-12T22:05:31.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214295+0000", 2024-09-12T22:05:31.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6190000000000002e-06 2024-09-12T22:05:31.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214329+0000", 2024-09-12T22:05:31.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4178999999999999e-05 2024-09-12T22:05:31.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214471+0000", 2024-09-12T22:05:31.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000141459 2024-09-12T22:05:31.270 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.270 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.270 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.270 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:264607 5.b 5:d7a6b26d:::benchmark_data_smithi043_32659_object97369:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T22:05:31.270 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.214368+0000", 2024-09-12T22:05:31.270 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0011372070000000001, 2024-09-12T22:05:31.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018950359999999999, 2024-09-12T22:05:31.270 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.271 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.271 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:31.271 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.271 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.271 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.271 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 264607 2024-09-12T22:05:31.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.271 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214368+0000", 2024-09-12T22:05:31.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214368+0000", 2024-09-12T22:05:31.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214369+0000", 2024-09-12T22:05:31.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4799999999999998e-07 2024-09-12T22:05:31.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214372+0000", 2024-09-12T22:05:31.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0939999999999999e-06 2024-09-12T22:05:31.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214380+0000", 2024-09-12T22:05:31.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4840000000000004e-06 2024-09-12T22:05:31.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214386+0000", 2024-09-12T22:05:31.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.446e-06 2024-09-12T22:05:31.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214430+0000", 2024-09-12T22:05:31.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4103000000000001e-05 2024-09-12T22:05:31.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214660+0000", 2024-09-12T22:05:31.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022981799999999999 2024-09-12T22:05:31.275 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.275 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.275 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.275 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:264608 5.b 5:d732f023:::benchmark_data_smithi043_32659_object97370:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T22:05:31.275 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.214400+0000", 2024-09-12T22:05:31.275 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0011057059999999999, 2024-09-12T22:05:31.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001922513, 2024-09-12T22:05:31.275 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.275 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.276 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:31.276 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.276 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.276 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.276 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 264608 2024-09-12T22:05:31.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.276 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214400+0000", 2024-09-12T22:05:31.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214400+0000", 2024-09-12T22:05:31.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214400+0000", 2024-09-12T22:05:31.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:05:31.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214402+0000", 2024-09-12T22:05:31.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.317e-06 2024-09-12T22:05:31.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214409+0000", 2024-09-12T22:05:31.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7490000000000001e-06 2024-09-12T22:05:31.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214415+0000", 2024-09-12T22:05:31.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8529999999999997e-06 2024-09-12T22:05:31.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.216236+0000", 2024-09-12T22:05:31.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001821402 2024-09-12T22:05:31.279 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.279 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.279 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.279 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:264604 5.3 e61/40 5:c7312e7a:::benchmark_data_smithi043_32659_object97366:head v 61'16429, mlcod=61'16427)", 2024-09-12T22:05:31.279 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.214517+0000", 2024-09-12T22:05:31.279 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00098826100000000004, 2024-09-12T22:05:31.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018623419999999999, 2024-09-12T22:05:31.279 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.279 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.280 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:31.280 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214517+0000", 2024-09-12T22:05:31.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214517+0000", 2024-09-12T22:05:31.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214518+0000", 2024-09-12T22:05:31.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:05:31.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214526+0000", 2024-09-12T22:05:31.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.106e-06 2024-09-12T22:05:31.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214533+0000", 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7230000000000004e-06 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214539+0000", 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.216230+0000", 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001691283 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.216250+0000", 2024-09-12T22:05:31.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9372e-05 2024-09-12T22:05:31.283 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.283 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.283 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.283 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:264601 5.c e61/40 5:3e02ae74:::benchmark_data_smithi043_32659_object97363:head v 61'16522, mlcod=61'16520)", 2024-09-12T22:05:31.283 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:31.214553+0000", 2024-09-12T22:05:31.283 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00095226999999999996, 2024-09-12T22:05:31.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001879506, 2024-09-12T22:05:31.283 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.283 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.284 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:31.284 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214553+0000", 2024-09-12T22:05:31.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214553+0000", 2024-09-12T22:05:31.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214553+0000", 2024-09-12T22:05:31.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:05:31.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214557+0000", 2024-09-12T22:05:31.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3900000000000002e-06 2024-09-12T22:05:31.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214563+0000", 2024-09-12T22:05:31.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2940000000000002e-06 2024-09-12T22:05:31.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.214568+0000", 2024-09-12T22:05:31.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5159999999999996e-06 2024-09-12T22:05:31.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.215041+0000", 2024-09-12T22:05:31.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00047332500000000003 2024-09-12T22:05:31.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:31.215061+0000", 2024-09-12T22:05:31.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9891e-05 2024-09-12T22:05:31.287 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.287 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.287 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.287 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.287 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:31.287 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 16 2024-09-12T22:05:31.287 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:31.289 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:31.289 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:31.287+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:31.391 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:31.388+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:31.486 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:31.486 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:31.486 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:31.486 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:31.486 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:31.493 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:31.490+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:31.501 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:31.592 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:31.591+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:31.693 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:31.692+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:31.700 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:31.700 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:31.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:31.701 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:31.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.701 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:31.701 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:31.701 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 52.699039929999998, 2024-09-12T22:05:31.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:31.701 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.701 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.701 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.701 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.701 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.702 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.702 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:31.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.702 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:31.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:31.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:31.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:31.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:31.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:31.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:31.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:31.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:31.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:31.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:31.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:31.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:31.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:31.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:31.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:31.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:31.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:31.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:31.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:31.706 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.706 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.706 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.707 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:31.707 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:31.707 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 52.697220266999999, 2024-09-12T22:05:31.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:31.707 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.707 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.707 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.707 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.708 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.708 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.708 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:31.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.708 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:31.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:31.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:31.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:31.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:31.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:31.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:31.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:31.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:31.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:31.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:31.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:31.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:31.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:31.712 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.712 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.712 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.713 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:31.713 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:31.714 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 52.696686452999998, 2024-09-12T22:05:31.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:31.714 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.714 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.714 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.714 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.714 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.714 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.714 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:31.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.716 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:31.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:31.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:31.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:31.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:31.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:31.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:31.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:31.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:31.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:31.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:31.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:31.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:31.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:31.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:31.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:31.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:31.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:31.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:31.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:31.720 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.720 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.720 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 52.694871614, 2024-09-12T22:05:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:31.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:31.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:31.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:31.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:31.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:31.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:31.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:31.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:31.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:31.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:31.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:31.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:31.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:31.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.727 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.727 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:31.727 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7327778259999995, 2024-09-12T22:05:31.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:05:31.727 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.727 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.727 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.728 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.728 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.728 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.728 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:05:31.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.728 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:31.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:31.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:05:31.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:05:31.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:05:31.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:05:31.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:05:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:05:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:05:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:05:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:05:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:05:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:05:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:05:31.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:05:31.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:05:31.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:05:31.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:05:31.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:05:31.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:05:31.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:05:31.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:05:31.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:05:31.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:05:31.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:05:31.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:05:31.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:05:31.734 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.734 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.734 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.734 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.734 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:31.734 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7307451010000001, 2024-09-12T22:05:31.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.736 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:31.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.736 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:31.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:05:31.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.736 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:05:31.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:05:31.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:05:31.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:05:31.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:05:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:05:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:05:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:05:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:05:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:05:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:05:31.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:05:31.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:05:31.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:05:31.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.741 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:31.742 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7277328369999996, 2024-09-12T22:05:31.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:05:31.742 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.742 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.742 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.742 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.742 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.742 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.742 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:05:31.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.742 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:31.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:31.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:05:31.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:05:31.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:05:31.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:05:31.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:05:31.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:05:31.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:05:31.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:05:31.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:05:31.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:05:31.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:05:31.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:05:31.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:05:31.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:05:31.749 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.749 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.749 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.749 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.749 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:31.749 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7267463470000006, 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:31.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:05:31.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:31.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:05:31.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:05:31.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:05:31.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:31.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:05:31.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:05:31.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:05:31.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:05:31.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:05:31.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:31.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:05:31.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:05:31.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:05:31.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:05:31.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:05:31.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:05:31.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:05:31.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:05:31.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.755 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.756 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.756 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.756 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:31.756 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7216597129999993, 2024-09-12T22:05:31.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:05:31.756 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.756 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.756 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.756 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.756 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.756 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.756 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:05:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:05:31.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:05:31.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:05:31.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:05:31.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:05:31.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:05:31.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:05:31.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:05:31.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:05:31.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:05:31.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:05:31.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:05:31.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:05:31.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:05:31.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:05:31.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:05:31.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:05:31.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:05:31.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:05:31.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:05:31.762 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.762 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.762 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.763 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.763 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:31.763 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7189047409999993, 2024-09-12T22:05:31.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:05:31.763 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.765 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.765 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:31.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.765 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:05:31.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:05:31.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:05:31.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:05:31.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:05:31.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:05:31.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:05:31.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:05:31.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:05:31.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:05:31.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:05:31.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:05:31.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:05:31.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:05:31.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:05:31.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:05:31.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:05:31.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:05:31.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:05:31.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:05:31.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:05:31.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.771 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.771 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:31.771 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7109298559999999, 2024-09-12T22:05:31.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:05:31.771 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.771 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.771 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.771 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.771 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.771 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.771 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:05:31.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.772 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:31.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:31.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:05:31.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:05:31.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:05:31.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:05:31.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:05:31.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:05:31.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:05:31.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:05:31.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:05:31.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:05:31.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:05:31.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:05:31.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:05:31.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:05:31.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:05:31.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:05:31.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.776 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:05:31.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:05:31.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.776 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.776 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:05:31.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:05:31.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.776 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.776 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:05:31.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:05:31.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:05:31.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:05:31.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:05:31.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:05:31.777 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.777 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.777 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.778 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.778 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:31.778 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7030040799999995, 2024-09-12T22:05:31.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:05:31.778 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.778 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.778 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.778 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.778 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.778 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.778 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:05:31.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.779 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:31.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:31.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:05:31.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:05:31.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:05:31.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:05:31.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:05:31.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:05:31.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:05:31.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:05:31.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:05:31.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:05:31.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:05:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:05:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:05:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:05:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:05:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:05:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:05:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:05:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:05:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:05:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7015077979999997, 2024-09-12T22:05:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:05:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:05:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:05:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:05:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:05:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:05:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:05:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:05:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:05:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:05:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:05:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:05:31.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:05:31.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:05:31.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:05:31.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:05:31.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:05:31.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:05:31.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:05:31.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:05:31.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:05:31.792 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.793 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.793 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.793 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241896 5.6 5:6ef8d923:::benchmark_data_smithi043_32659_object74658:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.793 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:31.793 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6653146139999997, 2024-09-12T22:05:31.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99264745399999998, 2024-09-12T22:05:31.793 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.793 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.793 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.793 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.793 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.793 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.794 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241896 2024-09-12T22:05:31.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.794 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:31.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:31.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031744+0000", 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8100000000000001e-07 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031749+0000", 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.437e-06 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031757+0000", 2024-09-12T22:05:31.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6999999999999997e-06 2024-09-12T22:05:31.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031765+0000", 2024-09-12T22:05:31.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6709999999999999e-06 2024-09-12T22:05:31.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031809+0000", 2024-09-12T22:05:31.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3970000000000001e-05 2024-09-12T22:05:31.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031817+0000", 2024-09-12T22:05:31.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6580000000000002e-06 2024-09-12T22:05:31.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020952+0000", 2024-09-12T22:05:31.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.98913576299999995 2024-09-12T22:05:31.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021031+0000", 2024-09-12T22:05:31.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8483000000000001e-05 2024-09-12T22:05:31.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021091+0000", 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0287000000000001e-05 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024109+0000", 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030178269999999998 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024255+0000", 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014615799999999999 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024305+0000", 2024-09-12T22:05:31.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0259000000000001e-05 2024-09-12T22:05:31.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024391+0000", 2024-09-12T22:05:31.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:05:31.799 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.799 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.799 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.799 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241935 5.6 5:60e2bed8:::benchmark_data_smithi043_32659_object74697:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.799 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:31.800 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6462249890000002, 2024-09-12T22:05:31.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97487546999999997, 2024-09-12T22:05:31.800 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.800 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.800 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.800 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.800 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.800 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.800 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241935 2024-09-12T22:05:31.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.800 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:31.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:31.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050834+0000", 2024-09-12T22:05:31.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2500000000000004e-07 2024-09-12T22:05:31.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050838+0000", 2024-09-12T22:05:31.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7029999999999997e-06 2024-09-12T22:05:31.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050853+0000", 2024-09-12T22:05:31.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4545000000000001e-05 2024-09-12T22:05:31.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050859+0000", 2024-09-12T22:05:31.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:05:31.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050902+0000", 2024-09-12T22:05:31.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3455999999999999e-05 2024-09-12T22:05:31.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050909+0000", 2024-09-12T22:05:31.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6950000000000003e-06 2024-09-12T22:05:31.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022045+0000", 2024-09-12T22:05:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97113624700000001 2024-09-12T22:05:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022168+0000", 2024-09-12T22:05:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012233 2024-09-12T22:05:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022235+0000", 2024-09-12T22:05:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7651000000000007e-05 2024-09-12T22:05:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024398+0000", 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002163005 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025575+0000", 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011767590000000001 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025624+0000", 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9217e-05 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025708+0000", 2024-09-12T22:05:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4037999999999997e-05 2024-09-12T22:05:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241940 5.6 5:60be75db:::benchmark_data_smithi043_32659_object74702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6431530359999993, 2024-09-12T22:05:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97334840700000003, 2024-09-12T22:05:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241940 2024-09-12T22:05:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:31.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:31.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4700000000000002e-07 2024-09-12T22:05:31.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053907+0000", 2024-09-12T22:05:31.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.796e-06 2024-09-12T22:05:31.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053912+0000", 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.622e-06 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053915+0000", 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3009999999999998e-06 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053952+0000", 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6668000000000002e-05 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053957+0000", 2024-09-12T22:05:31.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5849999999999999e-06 2024-09-12T22:05:31.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023005+0000", 2024-09-12T22:05:31.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.96904800700000004 2024-09-12T22:05:31.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.812 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023162+0000", 2024-09-12T22:05:31.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015720900000000001 2024-09-12T22:05:31.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.812 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023284+0000", 2024-09-12T22:05:31.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012194200000000001 2024-09-12T22:05:31.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.812 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025765+0000", 2024-09-12T22:05:31.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024806099999999998 2024-09-12T22:05:31.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.813 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027176+0000", 2024-09-12T22:05:31.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014111180000000001 2024-09-12T22:05:31.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027204+0000", 2024-09-12T22:05:31.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7970000000000002e-05 2024-09-12T22:05:31.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027253+0000", 2024-09-12T22:05:31.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9231999999999999e-05 2024-09-12T22:05:31.814 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.814 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.814 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.814 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241966 5.6 5:6538f108:::benchmark_data_smithi043_32659_object74728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6254073869999992, 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95692954799999996, 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241966 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:31.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.816 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:31.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.816 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071651+0000", 2024-09-12T22:05:31.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:05:31.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071656+0000", 2024-09-12T22:05:31.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7929999999999997e-06 2024-09-12T22:05:31.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071669+0000", 2024-09-12T22:05:31.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2692e-05 2024-09-12T22:05:31.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071676+0000", 2024-09-12T22:05:31.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:05:31.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071716+0000", 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9817999999999997e-05 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071721+0000", 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.057e-06 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024429+0000", 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95270825000000003 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024544+0000", 2024-09-12T22:05:31.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114045 2024-09-12T22:05:31.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024655+0000", 2024-09-12T22:05:31.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111382 2024-09-12T22:05:31.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028489+0000", 2024-09-12T22:05:31.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038338930000000001 2024-09-12T22:05:31.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028497+0000", 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7600000000000002e-06 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028523+0000", 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6268999999999999e-05 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028580+0000", 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7179999999999998e-05 2024-09-12T22:05:31.820 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.821 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.821 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.821 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241967 5.6 5:6c2d2d65:::benchmark_data_smithi043_32659_object74729:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.821 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:31.821 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6253592829999999, 2024-09-12T22:05:31.821 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958333094, 2024-09-12T22:05:31.821 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.821 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.822 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.822 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.822 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.822 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.822 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241967 2024-09-12T22:05:31.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.822 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.822 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:31.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.823 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:31.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.823 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:31.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:31.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071702+0000", 2024-09-12T22:05:31.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6929999999999999e-06 2024-09-12T22:05:31.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071709+0000", 2024-09-12T22:05:31.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2470000000000002e-06 2024-09-12T22:05:31.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071715+0000", 2024-09-12T22:05:31.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7370000000000003e-06 2024-09-12T22:05:31.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.825 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.825 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071737+0000", 2024-09-12T22:05:31.825 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1976000000000001e-05 2024-09-12T22:05:31.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.825 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.825 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071740+0000", 2024-09-12T22:05:31.825 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1760000000000002e-06 2024-09-12T22:05:31.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.826 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.826 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.826 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025813+0000", 2024-09-12T22:05:31.826 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95407325399999998 2024-09-12T22:05:31.826 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.826 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.826 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.826 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025956+0000", 2024-09-12T22:05:31.826 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014283699999999999 2024-09-12T22:05:31.826 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.826 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.826 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.826 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.026055+0000", 2024-09-12T22:05:31.826 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9088999999999999e-05 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028628+0000", 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025725209999999999 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029901+0000", 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012737720000000001 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029954+0000", 2024-09-12T22:05:31.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2811e-05 2024-09-12T22:05:31.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030032+0000", 2024-09-12T22:05:31.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7401e-05 2024-09-12T22:05:31.828 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.828 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.828 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.828 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241968 5.6 5:63b7d78c:::benchmark_data_smithi043_32659_object74730:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.828 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:31.828 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6253334259999992, 2024-09-12T22:05:31.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958459332, 2024-09-12T22:05:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241968 2024-09-12T22:05:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071725+0000", 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5600000000000001e-07 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071727+0000", 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.232e-06 2024-09-12T22:05:31.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.831 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.831 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.831 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071733+0000", 2024-09-12T22:05:31.831 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2750000000000001e-06 2024-09-12T22:05:31.831 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.831 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.831 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.831 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071738+0000", 2024-09-12T22:05:31.831 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9289999999999997e-06 2024-09-12T22:05:31.831 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.831 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.831 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.831 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071769+0000", 2024-09-12T22:05:31.831 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0746e-05 2024-09-12T22:05:31.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.832 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.832 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071774+0000", 2024-09-12T22:05:31.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8099999999999997e-06 2024-09-12T22:05:31.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027283+0000", 2024-09-12T22:05:31.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95550956399999998 2024-09-12T22:05:31.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027416+0000", 2024-09-12T22:05:31.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013268399999999999 2024-09-12T22:05:31.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027532+0000", 2024-09-12T22:05:31.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115807 2024-09-12T22:05:31.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030066+0000", 2024-09-12T22:05:31.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025343800000000001 2024-09-12T22:05:31.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030077+0000", 2024-09-12T22:05:31.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1260000000000001e-05 2024-09-12T22:05:31.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.835 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.835 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.835 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030116+0000", 2024-09-12T22:05:31.835 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8970999999999997e-05 2024-09-12T22:05:31.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.835 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.835 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.835 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030184+0000", 2024-09-12T22:05:31.835 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7317999999999995e-05 2024-09-12T22:05:31.835 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.836 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.837 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.837 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241974 5.6 5:6b9cdaf2:::benchmark_data_smithi043_32659_object74736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:31.837 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:31.837 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6120737779999992, 2024-09-12T22:05:31.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94774920900000004, 2024-09-12T22:05:31.838 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:31.839 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:31.839 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:31.839 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:31.839 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:31.839 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:31.840 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241974 2024-09-12T22:05:31.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.840 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:31.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:31.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:31.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:31.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:31.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:31.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:31.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084985+0000", 2024-09-12T22:05:31.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4600000000000004e-07 2024-09-12T22:05:31.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:31.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084989+0000", 2024-09-12T22:05:31.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9349999999999996e-06 2024-09-12T22:05:31.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:31.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084999+0000", 2024-09-12T22:05:31.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0043e-05 2024-09-12T22:05:31.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.842 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:31.842 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085004+0000", 2024-09-12T22:05:31.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1619999999999999e-06 2024-09-12T22:05:31.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.842 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.842 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085041+0000", 2024-09-12T22:05:31.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7469999999999999e-05 2024-09-12T22:05:31.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.842 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:31.842 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085048+0000", 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028676+0000", 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94362829599999998 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028809+0000", 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013285 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:31.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028932+0000", 2024-09-12T22:05:31.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012289199999999999 2024-09-12T22:05:31.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:31.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032531+0000", 2024-09-12T22:05:31.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035990639999999999 2024-09-12T22:05:31.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:31.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032584+0000", 2024-09-12T22:05:31.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3399999999999997e-05 2024-09-12T22:05:31.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:31.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032644+0000", 2024-09-12T22:05:31.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0019999999999998e-05 2024-09-12T22:05:31.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:31.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:31.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:31.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032733+0000", 2024-09-12T22:05:31.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9137999999999999e-05 2024-09-12T22:05:31.845 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.845 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.845 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.845 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:31.845 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:31.845 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:31.846 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:05:31.848 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:31.846+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:31.848 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:31.948 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:31.946+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:31.955 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:31.974 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:31.975 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:31.992 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:31.993 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:31.998 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:31.998 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:32.001 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:32.001 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:32.005 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:32.048 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:32.047+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:32.150 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:32.148+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:32.188 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:32.188 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:32.199 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:32.250 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:32.249+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:32.343 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:32.343 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:32.351 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:32.350+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:32.356 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:32.452 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:32.451+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:32.517 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:32.518 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:32.531 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:32.572 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:32.571+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:32.654 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:32.653+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:32.726 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:32.726 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:32.738 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:32.779 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:32.778+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:32.855 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:32.854+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:32.936 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:32.936 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:32.950 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:32.956 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:32.955+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:33.057 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:33.056+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:33.057 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:05:33.091 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:33.092 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:33.104 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:33.158 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:33.156+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:33.249 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:33.249 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:33.258 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:33.257+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:33.262 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:33.359 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:33.358+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:33.450 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:33.450 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:33.460 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:33.458+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:33.463 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:33.560 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:33.559+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:33.621 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:33.622 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:33.635 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:33.680 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:33.679+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:33.763 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:33.761+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:33.796 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:33.796 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:33.810 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:33.864 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:33.863+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:33.965 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:33.964+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:33.987 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-09-12T22:05:34.002 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:05:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:34.034 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:34.077 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:34.076+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:34.111 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:34.131 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:34.131 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:34.151 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:34.151 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:34.154 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:34.154 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:34.168 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:34.166+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:34.186 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:272834 5.c 5:36c229b0:::benchmark_data_smithi043_32659_object105596:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:34.177655+0000", 2024-09-12T22:05:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.007083382, 2024-09-12T22:05:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071007969999999998, 2024-09-12T22:05:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 272834 2024-09-12T22:05:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.177655+0000", 2024-09-12T22:05:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.177655+0000", 2024-09-12T22:05:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.177656+0000", 2024-09-12T22:05:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:05:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.177661+0000", 2024-09-12T22:05:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1440000000000002e-06 2024-09-12T22:05:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.177670+0000", 2024-09-12T22:05:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5890000000000003e-06 2024-09-12T22:05:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.177677+0000", 2024-09-12T22:05:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7859999999999999e-06 2024-09-12T22:05:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.177722+0000", 2024-09-12T22:05:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4832e-05 2024-09-12T22:05:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.177885+0000", 2024-09-12T22:05:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016300700000000001 2024-09-12T22:05:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.177998+0000", 2024-09-12T22:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011372 2024-09-12T22:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181350+0000", 2024-09-12T22:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033519130000000002 2024-09-12T22:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:272837 5.c 5:31fc5a25:::benchmark_data_smithi043_32659_object105599:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:34.178251+0000", 2024-09-12T22:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.006487891, 2024-09-12T22:05:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065542489999999998, 2024-09-12T22:05:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 272837 2024-09-12T22:05:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.178251+0000", 2024-09-12T22:05:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.178251+0000", 2024-09-12T22:05:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.178252+0000", 2024-09-12T22:05:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4399999999999998e-07 2024-09-12T22:05:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.178256+0000", 2024-09-12T22:05:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7310000000000001e-06 2024-09-12T22:05:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.178269+0000", 2024-09-12T22:05:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2595000000000001e-05 2024-09-12T22:05:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.178279+0000", 2024-09-12T22:05:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4579999999999999e-06 2024-09-12T22:05:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.179874+0000", 2024-09-12T22:05:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015954719999999999 2024-09-12T22:05:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.180001+0000", 2024-09-12T22:05:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012671199999999999 2024-09-12T22:05:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.180088+0000", 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6972999999999996e-05 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183010+0000", 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002922605 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:272838 5.c 5:3d644064:::benchmark_data_smithi043_32659_object105600:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:34.178388+0000", 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0063509780000000002, 2024-09-12T22:05:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064597659999999996, 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 272838 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.178388+0000", 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.178388+0000", 2024-09-12T22:05:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.178389+0000", 2024-09-12T22:05:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6400000000000001e-07 2024-09-12T22:05:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.178393+0000", 2024-09-12T22:05:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0450000000000002e-06 2024-09-12T22:05:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.178404+0000", 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.101e-05 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.178412+0000", 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.174e-06 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181379+0000", 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029670370000000001 2024-09-12T22:05:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181541+0000", 2024-09-12T22:05:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000162287 2024-09-12T22:05:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181659+0000", 2024-09-12T22:05:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118187 2024-09-12T22:05:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183314+0000", 2024-09-12T22:05:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016549430000000001 2024-09-12T22:05:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:272841 5.1 5:8e52b8a7:::benchmark_data_smithi043_32659_object105603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:34.181041+0000", 2024-09-12T22:05:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.003697344, 2024-09-12T22:05:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003847764, 2024-09-12T22:05:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 272841 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181041+0000", 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181041+0000", 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181043+0000", 2024-09-12T22:05:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-12T22:05:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181052+0000", 2024-09-12T22:05:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0720000000000006e-06 2024-09-12T22:05:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181061+0000", 2024-09-12T22:05:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7070000000000004e-06 2024-09-12T22:05:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181068+0000", 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0439999999999998e-06 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181104+0000", 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6044999999999998e-05 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181242+0000", 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013778799999999999 2024-09-12T22:05:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181361+0000", 2024-09-12T22:05:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118737 2024-09-12T22:05:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183518+0000", 2024-09-12T22:05:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002156893 2024-09-12T22:05:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:272843 5.3 5:c8777587:::benchmark_data_smithi043_32659_object105605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:34.181091+0000", 2024-09-12T22:05:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0036479149999999998, 2024-09-12T22:05:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038384080000000002, 2024-09-12T22:05:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 272843 2024-09-12T22:05:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181091+0000", 2024-09-12T22:05:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181091+0000", 2024-09-12T22:05:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181091+0000", 2024-09-12T22:05:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:05:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181094+0000", 2024-09-12T22:05:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9170000000000002e-06 2024-09-12T22:05:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181101+0000", 2024-09-12T22:05:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1430000000000001e-06 2024-09-12T22:05:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181107+0000", 2024-09-12T22:05:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6579999999999999e-06 2024-09-12T22:05:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181159+0000", 2024-09-12T22:05:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2345000000000001e-05 2024-09-12T22:05:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181311+0000", 2024-09-12T22:05:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015125300000000001 2024-09-12T22:05:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.181455+0000", 2024-09-12T22:05:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014411 2024-09-12T22:05:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183714+0000", 2024-09-12T22:05:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002259025 2024-09-12T22:05:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:272846 5.c 5:39d3850c:::benchmark_data_smithi043_32659_object105608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:34.183582+0000", 2024-09-12T22:05:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001157085, 2024-09-12T22:05:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0013874670000000001, 2024-09-12T22:05:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 272846 2024-09-12T22:05:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183582+0000", 2024-09-12T22:05:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183582+0000", 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183583+0000", 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.049e-06 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183586+0000", 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6320000000000001e-06 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183595+0000", 2024-09-12T22:05:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2020000000000004e-06 2024-09-12T22:05:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183601+0000", 2024-09-12T22:05:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4620000000000001e-06 2024-09-12T22:05:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183647+0000", 2024-09-12T22:05:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6063999999999998e-05 2024-09-12T22:05:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183813+0000", 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016571199999999999 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183941+0000", 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000128076 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:272847 5.c 5.2cdcb73c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:34.183799+0000", 2024-09-12T22:05:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00093946800000000005, 2024-09-12T22:05:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012199240000000001, 2024-09-12T22:05:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 272847 2024-09-12T22:05:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183799+0000", 2024-09-12T22:05:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183799+0000", 2024-09-12T22:05:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183800+0000", 2024-09-12T22:05:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3e-07 2024-09-12T22:05:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183803+0000", 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4340000000000001e-06 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183811+0000", 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9889999999999992e-06 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183818+0000", 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1890000000000004e-06 2024-09-12T22:05:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:272848 5.7 5:e23b42b7:::benchmark_data_smithi043_32659_object105610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:34.183829+0000", 2024-09-12T22:05:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000909855, 2024-09-12T22:05:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001250335, 2024-09-12T22:05:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 272848 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183829+0000", 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183829+0000", 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183829+0000", 2024-09-12T22:05:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5600000000000001e-07 2024-09-12T22:05:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183831+0000", 2024-09-12T22:05:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9319999999999999e-06 2024-09-12T22:05:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183838+0000", 2024-09-12T22:05:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9469999999999997e-06 2024-09-12T22:05:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183843+0000", 2024-09-12T22:05:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.87e-06 2024-09-12T22:05:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.183930+0000", 2024-09-12T22:05:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7398000000000006e-05 2024-09-12T22:05:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184039+0000", 2024-09-12T22:05:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010841900000000001 2024-09-12T22:05:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184119+0000", 2024-09-12T22:05:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0370999999999993e-05 2024-09-12T22:05:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:272850 5.9 e62/40 5:9bd79608:::benchmark_data_smithi043_32659_object105612:head v 62'17152, mlcod=62'17150)", 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:34.184256+0000", 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000482681, 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00086188300000000003, 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184256+0000", 2024-09-12T22:05:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184256+0000", 2024-09-12T22:05:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184256+0000", 2024-09-12T22:05:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4000000000000002e-07 2024-09-12T22:05:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184260+0000", 2024-09-12T22:05:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7570000000000002e-06 2024-09-12T22:05:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184267+0000", 2024-09-12T22:05:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9929999999999998e-06 2024-09-12T22:05:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184271+0000", 2024-09-12T22:05:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9469999999999996e-06 2024-09-12T22:05:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184316+0000", 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4623000000000003e-05 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184340+0000", 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4074999999999999e-05 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:272834 5.c e62/40)", 2024-09-12T22:05:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:34.184611+0000", 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00012809200000000001, 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00053572199999999998, 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184611+0000", 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184611+0000", 2024-09-12T22:05:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184611+0000", 2024-09-12T22:05:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184614+0000", 2024-09-12T22:05:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2600000000000001e-06 2024-09-12T22:05:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184624+0000", 2024-09-12T22:05:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-06 2024-09-12T22:05:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.184629+0000", 2024-09-12T22:05:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6120000000000001e-06 2024-09-12T22:05:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:272829 5.3 e62/40 ondisk, result = 0)", 2024-09-12T22:05:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:34.185000+0000", 2024-09-12T22:05:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9997387, 2024-09-12T22:05:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018240899999999999, 2024-09-12T22:05:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.185000+0000", 2024-09-12T22:05:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.185000+0000", 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.185001+0000", 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.185006+0000", 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9049999999999996e-06 2024-09-12T22:05:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.185015+0000", 2024-09-12T22:05:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5640000000000002e-06 2024-09-12T22:05:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.185021+0000", 2024-09-12T22:05:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6130000000000003e-06 2024-09-12T22:05:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.185078+0000", 2024-09-12T22:05:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7589e-05 2024-09-12T22:05:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.185087+0000", 2024-09-12T22:05:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5369999999999997e-06 2024-09-12T22:05:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:272852 5.7 5.463f9b87 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:34.185189+0000", 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9995499, 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0237e-05, 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 272852 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.185189+0000", 2024-09-12T22:05:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.185189+0000", 2024-09-12T22:05:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.185190+0000", 2024-09-12T22:05:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-12T22:05:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.185194+0000", 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1370000000000004e-06 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.185204+0000", 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0248000000000001e-05 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:34.185212+0000", 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.481e-06 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 12 2024-09-12T22:05:34.240 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:34.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~71s 2024-09-12T22:05:34.241 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:34.268 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:34.267+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:34.369 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:34.368+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:34.422 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:34.423 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:34.435 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:34.470 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:34.469+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:34.571 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:34.570+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:34.584 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.171323530999999, 2024-09-12T22:05:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:34.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:34.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:34.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.591 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.591 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.591 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:34.591 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:34.591 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.171143600999997, 2024-09-12T22:05:34.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:34.591 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:34.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:34.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:34.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:34.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:34.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:34.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:34.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:34.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:34.596 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.597 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.597 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:34.597 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:34.597 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.171077160000003, 2024-09-12T22:05:34.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:34.598 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.598 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.598 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:34.598 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.599 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.599 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.599 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:34.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.599 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:34.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:34.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:34.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:34.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:34.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:34.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:34.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:34.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:34.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:34.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:34.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:34.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:34.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:34.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:34.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:34.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:34.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:34.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:34.602 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.602 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.603 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.603 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:34.603 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:34.603 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.171020716999998, 2024-09-12T22:05:34.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:34.603 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.603 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.603 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.603 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.603 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.603 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.603 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:34.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.604 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:34.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:34.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:34.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:34.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:34.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:34.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:34.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:34.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:34.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:34.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:34.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:34.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:34.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:34.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:34.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:34.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:34.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:34.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:34.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:34.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:34.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:34.609 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.609 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.609 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.609 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:34.609 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:34.609 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.170952257000003, 2024-09-12T22:05:34.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:34.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:34.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:34.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:34.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:34.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:34.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:34.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:34.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:34.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:34.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:34.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:34.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:34.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:34.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:34.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:34.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:34.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:34.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:34.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:34.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:34.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:34.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:34.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:34.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:34.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:34.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:34.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:34.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.618 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.618 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:34.619 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:34.619 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.170894521999998, 2024-09-12T22:05:34.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:34.619 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.619 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.619 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.619 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:34.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.619 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:34.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:34.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:34.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:34.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:34.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:34.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:34.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:34.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:34.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:34.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:34.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:34.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:34.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:34.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:34.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:34.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:34.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:34.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:34.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:34.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:34.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:34.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:34.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:34.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:34.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:34.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:34.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:34.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:34.628 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.628 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.629 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:34.629 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:34.629 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.170826830000003, 2024-09-12T22:05:34.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:34.629 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.629 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.630 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.630 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:34.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.630 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:34.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:34.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:34.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:34.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:34.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:34.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:34.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:34.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:34.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:34.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:34.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:34.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:34.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:34.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:34.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:34.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:34.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:34.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:34.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:34.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:34.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:34.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:34.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:34.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:34.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:34.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:34.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:34.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:34.637 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.637 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.638 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.638 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:34.638 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:34.638 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.170771768000002, 2024-09-12T22:05:34.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:34.638 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.638 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.638 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.639 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.639 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.639 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.639 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:34.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.639 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:34.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:34.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:34.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:34.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:34.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:34.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:34.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:34.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:34.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:34.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:34.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:34.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:34.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:34.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:34.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:34.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:34.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:34.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:34.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:34.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:34.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:34.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:34.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:34.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:34.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:34.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:34.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:34.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:34.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.649 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.649 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:34.649 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:34.649 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.130124248000001, 2024-09-12T22:05:34.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:34.649 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.649 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.649 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.650 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:34.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.650 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:34.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:34.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:34.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:34.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:34.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:34.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:34.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:34.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:34.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:34.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:34.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:34.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:34.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:34.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:34.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:34.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:34.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:34.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:34.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:34.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:34.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:34.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:34.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:34.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:34.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:34.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:34.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:34.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:34.657 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.657 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.657 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.657 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:34.658 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:34.658 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.127510520000001, 2024-09-12T22:05:34.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:34.658 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.658 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.658 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.658 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:34.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.658 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:34.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:34.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:34.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:34.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:34.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:34.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:34.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:34.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:34.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:34.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:34.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:34.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:34.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:34.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:34.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:34.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:34.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:34.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:34.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:34.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:34.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:34.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:34.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:34.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:34.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:34.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:34.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:34.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:34.666 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.666 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.667 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.667 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:34.667 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:34.667 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.582296423999999, 2024-09-12T22:05:34.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:34.668 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.668 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.668 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.668 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:34.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.668 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:34.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:34.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:34.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:34.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:34.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:34.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:34.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:34.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:34.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:34.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:34.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:34.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:34.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:34.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:34.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:34.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:34.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:34.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:34.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:34.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:34.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:34.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:34.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:34.676 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.676 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.677 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:34.677 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:34.677 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.581817936, 2024-09-12T22:05:34.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:34.678 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.678 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.678 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.678 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.678 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.678 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.678 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:34.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.678 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:34.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:34.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:34.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:34.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:34.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:34.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:34.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:34.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:34.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:34.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:34.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:34.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:34.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:34.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:34.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:34.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:34.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:34.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:34.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:34.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:34.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:34.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.579322636000001, 2024-09-12T22:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:34.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:34.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:34.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:34.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:34.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:34.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:34.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:34.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:34.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:34.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:34.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:34.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:34.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:34.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:34.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:34.691 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.692 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.692 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.692 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:34.692 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:34.692 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.578241845000001, 2024-09-12T22:05:34.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:34.692 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.692 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.692 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.693 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:34.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.693 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:34.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:34.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:34.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:34.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:34.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:34.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:34.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:34.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:34.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:34.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:34.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:34.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:34.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:34.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:34.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:34.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:34.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:34.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:34.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:34.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:34.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:34.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:34.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:34.697 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.697 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.697 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.577006283000003, 2024-09-12T22:05:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.136265795, 2024-09-12T22:05:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.131735368000001, 2024-09-12T22:05:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.131711338999999, 2024-09-12T22:05:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.131533690000001, 2024-09-12T22:05:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.129515153, 2024-09-12T22:05:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:34.733 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:34.734 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:34.735 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:34.733+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:34.835 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:34.834+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:34.891 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:34.891 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:34.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.891 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.3 e 62/62 lb 5:c8afb7dc:::benchmark_data_smithi043_32659_object122930:head)", 2024-09-12T22:05:34.891 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.887801+0000", 2024-09-12T22:05:34.891 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0017196760000000001, 2024-09-12T22:05:34.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001734934, 2024-09-12T22:05:34.891 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.891 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.892 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:34.892 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.887801+0000", 2024-09-12T22:05:34.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.887801+0000", 2024-09-12T22:05:34.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.887801+0000", 2024-09-12T22:05:34.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1600000000000002e-07 2024-09-12T22:05:34.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.887808+0000", 2024-09-12T22:05:34.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7499999999999997e-06 2024-09-12T22:05:34.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.887815+0000", 2024-09-12T22:05:34.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2649999999999999e-06 2024-09-12T22:05:34.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.887825+0000", 2024-09-12T22:05:34.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0257e-05 2024-09-12T22:05:34.894 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.894 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.894 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.894 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:274797 5.3 e62/40)", 2024-09-12T22:05:34.894 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.888024+0000", 2024-09-12T22:05:34.894 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001495718, 2024-09-12T22:05:34.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001542419, 2024-09-12T22:05:34.894 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.895 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.895 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:34.895 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888024+0000", 2024-09-12T22:05:34.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888024+0000", 2024-09-12T22:05:34.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888025+0000", 2024-09-12T22:05:34.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.27e-07 2024-09-12T22:05:34.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888029+0000", 2024-09-12T22:05:34.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1409999999999998e-06 2024-09-12T22:05:34.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888037+0000", 2024-09-12T22:05:34.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6480000000000003e-06 2024-09-12T22:05:34.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888042+0000", 2024-09-12T22:05:34.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8500000000000002e-06 2024-09-12T22:05:34.897 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.897 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.897 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.897 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:274798 5.4 5:2dfd9f16:::benchmark_data_smithi043_32659_object107560:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.897 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.888081+0000", 2024-09-12T22:05:34.897 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0014396610000000001, 2024-09-12T22:05:34.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001514708, 2024-09-12T22:05:34.898 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.898 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.898 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:34.898 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:34.898 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:34.898 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.898 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 274798 2024-09-12T22:05:34.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.898 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888081+0000", 2024-09-12T22:05:34.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888081+0000", 2024-09-12T22:05:34.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888082+0000", 2024-09-12T22:05:34.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.029e-06 2024-09-12T22:05:34.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888086+0000", 2024-09-12T22:05:34.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3200000000000001e-06 2024-09-12T22:05:34.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888096+0000", 2024-09-12T22:05:34.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0492000000000001e-05 2024-09-12T22:05:34.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888102+0000", 2024-09-12T22:05:34.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7780000000000004e-06 2024-09-12T22:05:34.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:34.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888496+0000", 2024-09-12T22:05:34.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00039367500000000001 2024-09-12T22:05:34.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:34.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888655+0000", 2024-09-12T22:05:34.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015907200000000001 2024-09-12T22:05:34.901 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.901 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.901 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.901 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:274800 5.b 5:dd013e62:::benchmark_data_smithi043_32659_object107562:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.902 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.888318+0000", 2024-09-12T22:05:34.902 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001202301, 2024-09-12T22:05:34.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001314859, 2024-09-12T22:05:34.902 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.902 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.902 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:34.902 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:34.902 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:34.902 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.902 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 274800 2024-09-12T22:05:34.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.902 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888318+0000", 2024-09-12T22:05:34.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888318+0000", 2024-09-12T22:05:34.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.903 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.903 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888319+0000", 2024-09-12T22:05:34.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6000000000000003e-07 2024-09-12T22:05:34.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888322+0000", 2024-09-12T22:05:34.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3790000000000002e-06 2024-09-12T22:05:34.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888330+0000", 2024-09-12T22:05:34.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0590000000000003e-06 2024-09-12T22:05:34.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888336+0000", 2024-09-12T22:05:34.904 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7300000000000002e-06 2024-09-12T22:05:34.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:34.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889599+0000", 2024-09-12T22:05:34.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012631630000000001 2024-09-12T22:05:34.905 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.905 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.905 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.905 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:274801 5.b 5.a34d8c8b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.905 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.888469+0000", 2024-09-12T22:05:34.905 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0010513740000000001, 2024-09-12T22:05:34.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011950540000000001, 2024-09-12T22:05:34.906 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.906 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.906 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:34.906 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:34.906 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:34.906 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.906 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 274801 2024-09-12T22:05:34.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.906 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888469+0000", 2024-09-12T22:05:34.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888469+0000", 2024-09-12T22:05:34.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888470+0000", 2024-09-12T22:05:34.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9899999999999999e-07 2024-09-12T22:05:34.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.907 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888474+0000", 2024-09-12T22:05:34.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.155e-06 2024-09-12T22:05:34.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888482+0000", 2024-09-12T22:05:34.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3170000000000002e-06 2024-09-12T22:05:34.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888488+0000", 2024-09-12T22:05:34.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0170000000000002e-06 2024-09-12T22:05:34.908 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.909 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.909 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.909 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:274799 5.c e62/40 5:3c466169:::benchmark_data_smithi043_32659_object107561:head v 62'17199, mlcod=62'17196)", 2024-09-12T22:05:34.909 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.888513+0000", 2024-09-12T22:05:34.909 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001007504, 2024-09-12T22:05:34.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011795320000000001, 2024-09-12T22:05:34.909 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.909 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.909 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:34.909 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.910 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.910 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888513+0000", 2024-09-12T22:05:34.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.910 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.910 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.910 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.910 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888513+0000", 2024-09-12T22:05:34.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.910 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.910 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.910 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.910 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888513+0000", 2024-09-12T22:05:34.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:05:34.910 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.911 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.911 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888517+0000", 2024-09-12T22:05:34.911 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1219999999999997e-06 2024-09-12T22:05:34.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.911 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.911 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888524+0000", 2024-09-12T22:05:34.911 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7569999999999998e-06 2024-09-12T22:05:34.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.911 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.911 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888529+0000", 2024-09-12T22:05:34.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6210000000000003e-06 2024-09-12T22:05:34.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:34.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888718+0000", 2024-09-12T22:05:34.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018898 2024-09-12T22:05:34.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:34.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888729+0000", 2024-09-12T22:05:34.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1238e-05 2024-09-12T22:05:34.912 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.912 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.913 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.913 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:274803 5.7 e62/40 5:e6d737f3:::benchmark_data_smithi043_32659_object107565:head v 62'17265, mlcod=62'17263)", 2024-09-12T22:05:34.913 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.888945+0000", 2024-09-12T22:05:34.913 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000575159, 2024-09-12T22:05:34.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00077987399999999995, 2024-09-12T22:05:34.913 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.913 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.913 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:34.913 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888945+0000", 2024-09-12T22:05:34.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888945+0000", 2024-09-12T22:05:34.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888946+0000", 2024-09-12T22:05:34.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:05:34.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888950+0000", 2024-09-12T22:05:34.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7809999999999996e-06 2024-09-12T22:05:34.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.915 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888960+0000", 2024-09-12T22:05:34.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7170000000000003e-06 2024-09-12T22:05:34.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.916 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.916 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.888967+0000", 2024-09-12T22:05:34.916 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0439999999999998e-06 2024-09-12T22:05:34.916 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.916 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:34.916 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889031+0000", 2024-09-12T22:05:34.916 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3495000000000001e-05 2024-09-12T22:05:34.916 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.916 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:34.916 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889051+0000", 2024-09-12T22:05:34.916 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0635000000000001e-05 2024-09-12T22:05:34.916 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.917 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.917 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.917 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.917 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.917 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:274804 5.4 5.f63a2ce4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.917 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.889554+0000", 2024-09-12T22:05:34.917 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9999661, 2024-09-12T22:05:34.917 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020145499999999999, 2024-09-12T22:05:34.917 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.917 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.917 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:34.917 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:34.917 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:34.917 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.918 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 274804 2024-09-12T22:05:34.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.918 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889554+0000", 2024-09-12T22:05:34.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889554+0000", 2024-09-12T22:05:34.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889555+0000", 2024-09-12T22:05:34.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2699999999999998e-07 2024-09-12T22:05:34.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889559+0000", 2024-09-12T22:05:34.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4680000000000003e-06 2024-09-12T22:05:34.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889571+0000", 2024-09-12T22:05:34.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2088e-05 2024-09-12T22:05:34.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.920 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.920 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889578+0000", 2024-09-12T22:05:34.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7170000000000002e-06 2024-09-12T22:05:34.920 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.920 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.920 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.920 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:274806 5.0 5.74e6c380 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.920 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.889692+0000", 2024-09-12T22:05:34.920 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9998283, 2024-09-12T22:05:34.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3956000000000006e-05, 2024-09-12T22:05:34.921 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.921 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.921 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:34.921 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:34.921 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:34.921 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.921 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 274806 2024-09-12T22:05:34.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.921 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.921 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.921 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889692+0000", 2024-09-12T22:05:34.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.922 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.922 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.922 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.922 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889692+0000", 2024-09-12T22:05:34.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.922 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.922 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.922 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.922 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889693+0000", 2024-09-12T22:05:34.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:05:34.922 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.922 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.922 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.923 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889697+0000", 2024-09-12T22:05:34.923 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8399999999999997e-06 2024-09-12T22:05:34.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.923 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.923 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.923 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889705+0000", 2024-09-12T22:05:34.923 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9220000000000003e-06 2024-09-12T22:05:34.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.923 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.923 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.923 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889718+0000", 2024-09-12T22:05:34.923 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2807e-05 2024-09-12T22:05:34.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.923 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:34.924 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.889778+0000", 2024-09-12T22:05:34.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9781999999999998e-05 2024-09-12T22:05:34.924 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.924 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.924 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.924 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.924 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:274784 5.3 e62/40 5:c571c7d4:::benchmark_data_smithi043_32659_object107546:head v 62'17086, mlcod=62'17083)", 2024-09-12T22:05:34.924 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.884196+0000", 2024-09-12T22:05:34.924 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0053244640000000001, 2024-09-12T22:05:34.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056491110000000001, 2024-09-12T22:05:34.924 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.925 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.925 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:34.925 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884196+0000", 2024-09-12T22:05:34.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884196+0000", 2024-09-12T22:05:34.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884197+0000", 2024-09-12T22:05:34.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2600000000000001e-07 2024-09-12T22:05:34.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884205+0000", 2024-09-12T22:05:34.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4630000000000001e-06 2024-09-12T22:05:34.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884233+0000", 2024-09-12T22:05:34.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8285000000000001e-05 2024-09-12T22:05:34.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884240+0000", 2024-09-12T22:05:34.927 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4239999999999998e-06 2024-09-12T22:05:34.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:34.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884950+0000", 2024-09-12T22:05:34.927 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00071038099999999995 2024-09-12T22:05:34.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:34.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884971+0000", 2024-09-12T22:05:34.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0407e-05 2024-09-12T22:05:34.928 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.928 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.928 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.928 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.928 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.928 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:274791 5.4 5:23fa3d0d:::benchmark_data_smithi043_32659_object107553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.928 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.884433+0000", 2024-09-12T22:05:34.928 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0050874199999999996, 2024-09-12T22:05:34.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0054721650000000002, 2024-09-12T22:05:34.928 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.928 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.928 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:34.928 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 274791 2024-09-12T22:05:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884433+0000", 2024-09-12T22:05:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884433+0000", 2024-09-12T22:05:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884433+0000", 2024-09-12T22:05:34.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1999999999999999e-07 2024-09-12T22:05:34.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884436+0000", 2024-09-12T22:05:34.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6019999999999998e-06 2024-09-12T22:05:34.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884442+0000", 2024-09-12T22:05:34.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.426e-06 2024-09-12T22:05:34.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.931 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884448+0000", 2024-09-12T22:05:34.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3340000000000001e-06 2024-09-12T22:05:34.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:34.931 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884513+0000", 2024-09-12T22:05:34.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5018000000000007e-05 2024-09-12T22:05:34.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:34.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884658+0000", 2024-09-12T22:05:34.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000144969 2024-09-12T22:05:34.932 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.932 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.932 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.932 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:274794 5.4 5:209f44e0:::benchmark_data_smithi043_32659_object107556:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:34.932 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.884557+0000", 2024-09-12T22:05:34.932 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.004962948, 2024-09-12T22:05:34.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0054172680000000003, 2024-09-12T22:05:34.932 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.932 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.932 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:34.933 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:34.933 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:34.933 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:34.933 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 274794 2024-09-12T22:05:34.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.933 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.933 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884557+0000", 2024-09-12T22:05:34.933 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.933 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884557+0000", 2024-09-12T22:05:34.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.934 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884560+0000", 2024-09-12T22:05:34.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.926e-06 2024-09-12T22:05:34.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.934 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884563+0000", 2024-09-12T22:05:34.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2289999999999999e-06 2024-09-12T22:05:34.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.934 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884570+0000", 2024-09-12T22:05:34.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:05:34.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.884576+0000", 2024-09-12T22:05:34.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3000000000000001e-06 2024-09-12T22:05:34.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:34.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.886815+0000", 2024-09-12T22:05:34.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002239516 2024-09-12T22:05:34.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:34.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.886976+0000", 2024-09-12T22:05:34.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016092999999999999 2024-09-12T22:05:34.936 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.936 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.936 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.936 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:274792 5.c e62/40 5:3c319294:::benchmark_data_smithi043_32659_object107554:head v 62'17198, mlcod=62'17196)", 2024-09-12T22:05:34.936 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.885609+0000", 2024-09-12T22:05:34.936 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0039108900000000002, 2024-09-12T22:05:34.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0044320749999999997, 2024-09-12T22:05:34.936 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.937 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.937 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:34.937 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.885609+0000", 2024-09-12T22:05:34.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.885609+0000", 2024-09-12T22:05:34.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.885610+0000", 2024-09-12T22:05:34.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.46e-07 2024-09-12T22:05:34.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.885613+0000", 2024-09-12T22:05:34.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8149999999999999e-06 2024-09-12T22:05:34.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.885621+0000", 2024-09-12T22:05:34.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1230000000000002e-06 2024-09-12T22:05:34.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.939 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.885626+0000", 2024-09-12T22:05:34.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9110000000000001e-06 2024-09-12T22:05:34.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.939 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:34.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.886799+0000", 2024-09-12T22:05:34.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001173625 2024-09-12T22:05:34.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.939 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:34.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.886816+0000", 2024-09-12T22:05:34.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7084000000000001e-05 2024-09-12T22:05:34.940 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.940 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.940 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.940 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:274786 5.3 e62/40 5:cc4df54b:::benchmark_data_smithi043_32659_object107548:head v 62'17087, mlcod=62'17083)", 2024-09-12T22:05:34.940 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.885709+0000", 2024-09-12T22:05:34.940 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0038109789999999999, 2024-09-12T22:05:34.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004391201, 2024-09-12T22:05:34.940 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.940 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.941 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:34.941 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.941 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.885709+0000", 2024-09-12T22:05:34.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.941 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.885709+0000", 2024-09-12T22:05:34.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.885710+0000", 2024-09-12T22:05:34.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.58e-07 2024-09-12T22:05:34.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.885713+0000", 2024-09-12T22:05:34.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7749999999999999e-06 2024-09-12T22:05:34.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.885722+0000", 2024-09-12T22:05:34.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3489999999999992e-06 2024-09-12T22:05:34.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.885727+0000", 2024-09-12T22:05:34.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9320000000000004e-06 2024-09-12T22:05:34.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:34.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.887289+0000", 2024-09-12T22:05:34.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015626749999999999 2024-09-12T22:05:34.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:34.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.887308+0000", 2024-09-12T22:05:34.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8712999999999999e-05 2024-09-12T22:05:34.943 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.944 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.944 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.944 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:274790 5.5 e62/40 5:a23b39f8:::benchmark_data_smithi043_32659_object107552:head v 62'17192, mlcod=62'17187)", 2024-09-12T22:05:34.944 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:34.886542+0000", 2024-09-12T22:05:34.944 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0029785229999999998, 2024-09-12T22:05:34.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003611043, 2024-09-12T22:05:34.944 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:34.944 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:34.944 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:34.944 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:34.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:34.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.886542+0000", 2024-09-12T22:05:34.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:34.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.886542+0000", 2024-09-12T22:05:34.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:34.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:34.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.886542+0000", 2024-09-12T22:05:34.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2600000000000002e-07 2024-09-12T22:05:34.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:34.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.886546+0000", 2024-09-12T22:05:34.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9750000000000001e-06 2024-09-12T22:05:34.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:34.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.886555+0000", 2024-09-12T22:05:34.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3629999999999994e-06 2024-09-12T22:05:34.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:34.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.886561+0000", 2024-09-12T22:05:34.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2689999999999996e-06 2024-09-12T22:05:34.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.887440+0000", 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000879399 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:34.887458+0000", 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8070000000000001e-05 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:34.947 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 15 2024-09-12T22:05:34.948 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:34.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:34.949 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:34.948+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:35.049 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:35.048+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:35.149 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:35.149 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:35.149 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:35.149 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:35.150 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:35.152 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:35.150+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:35.161 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:35.252 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:35.251+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:35.352 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:35.351+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:35.362 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:35.362 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:35.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:35.363 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:35.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.363 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:35.363 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:35.363 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 56.361112085000002, 2024-09-12T22:05:35.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:35.363 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.363 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.363 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.364 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.364 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.364 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.364 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:35.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.364 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:35.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:35.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:35.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:35.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:35.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:35.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:35.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:35.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:35.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:35.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:35.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:35.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:35.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:35.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:35.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:35.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:35.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:35.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:35.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:35.374 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.374 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.374 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.375 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:35.375 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:35.375 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 56.359292422000003, 2024-09-12T22:05:35.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:35.375 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.375 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.375 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.376 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.376 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.376 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.376 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:35.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.376 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:35.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:35.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:35.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:35.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:35.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:35.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:35.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:35.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:35.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:35.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:35.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:35.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:35.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:35.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:35.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:35.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:35.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:35.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:35.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:35.382 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.382 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.382 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.382 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:35.382 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:35.383 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 56.358758608000002, 2024-09-12T22:05:35.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:35.383 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.383 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.383 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.383 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.383 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.383 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.383 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:35.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.384 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:35.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:35.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:35.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:35.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:35.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:35.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:35.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:35.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:35.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:35.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:35.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:35.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:35.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:35.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:35.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:35.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:35.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:35.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:35.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:35.392 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 56.356943768999997, 2024-09-12T22:05:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.394 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:35.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.394 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:35.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:35.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:35.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:35.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:35.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:35.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:35.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:35.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:35.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:35.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:35.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:35.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:35.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:35.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:35.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:35.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:35.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:35.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:35.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:35.399 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.399 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.399 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.399 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.399 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:35.399 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.394849981, 2024-09-12T22:05:35.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:05:35.399 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.399 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.399 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.400 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.400 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.400 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.400 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:05:35.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.400 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:35.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:35.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:05:35.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:05:35.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:05:35.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:05:35.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:05:35.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:05:35.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:05:35.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:05:35.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:05:35.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:05:35.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:05:35.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:05:35.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:05:35.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:05:35.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:05:35.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:05:35.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:05:35.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:05:35.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:05:35.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:05:35.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:05:35.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:05:35.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:05:35.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:05:35.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:05:35.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:05:35.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:05:35.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:05:35.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:05:35.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:05:35.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:05:35.414 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.414 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.414 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.415 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.415 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:35.415 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.392817256000001, 2024-09-12T22:05:35.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:05:35.416 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.416 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.416 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.416 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.416 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.416 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.417 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:05:35.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.417 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:35.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:35.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:35.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:05:35.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:05:35.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:05:35.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:05:35.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:05:35.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:05:35.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:05:35.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:05:35.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:05:35.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:05:35.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:35.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:05:35.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:05:35.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:05:35.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:05:35.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:05:35.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:05:35.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:05:35.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:05:35.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:05:35.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:05:35.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:05:35.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:05:35.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:05:35.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:05:35.431 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.431 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.431 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.432 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.432 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:35.433 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.389804992, 2024-09-12T22:05:35.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:05:35.433 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.433 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.433 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.433 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.433 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.433 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.433 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:05:35.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.433 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:35.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:35.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:05:35.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:05:35.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:05:35.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:35.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:05:35.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:05:35.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:05:35.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:05:35.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:05:35.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:05:35.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:05:35.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:05:35.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:05:35.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:05:35.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:05:35.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:05:35.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.439 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.439 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:05:35.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:05:35.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.439 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.439 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:05:35.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:05:35.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.440 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:05:35.440 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:05:35.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:05:35.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:05:35.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:05:35.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:05:35.441 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.442 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.442 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.442 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.442 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:35.442 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.388818501999999, 2024-09-12T22:05:35.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:05:35.442 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.443 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.443 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.443 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.443 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.443 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.443 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.445 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.445 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:35.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.445 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.445 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:05:35.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:35.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.446 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:05:35.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:05:35.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:05:35.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:35.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:05:35.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:05:35.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:05:35.448 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:05:35.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:05:35.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:35.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.449 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.449 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:05:35.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:05:35.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.450 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:05:35.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:05:35.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.450 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:05:35.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:05:35.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.450 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:05:35.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:05:35.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:05:35.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:05:35.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:05:35.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:05:35.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:05:35.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:05:35.452 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.452 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.452 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.452 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.452 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:35.452 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.383731868, 2024-09-12T22:05:35.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:05:35.452 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.452 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.453 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.453 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.453 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.453 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.453 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:05:35.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.453 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.453 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.453 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:35.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.453 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:05:35.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:05:35.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:05:35.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:05:35.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:05:35.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:05:35.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:05:35.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:05:35.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:05:35.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:05:35.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:05:35.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:05:35.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:05:35.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:05:35.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:05:35.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:05:35.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:05:35.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.459 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.459 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:35.459 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.380976896, 2024-09-12T22:05:35.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:05:35.459 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.459 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.459 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.459 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.459 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.459 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.459 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:05:35.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.459 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:35.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:35.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:05:35.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:05:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:05:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:05:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:05:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:05:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:05:35.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:05:35.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:05:35.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:05:35.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:05:35.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:05:35.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:05:35.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:05:35.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:05:35.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:05:35.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:05:35.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:05:35.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:05:35.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:05:35.465 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.465 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.465 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.465 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.465 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:35.465 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.373002011000001, 2024-09-12T22:05:35.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:05:35.465 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.465 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.466 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.466 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.466 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.466 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.466 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:05:35.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.466 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:35.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:35.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:05:35.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:05:35.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:05:35.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:05:35.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:05:35.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:05:35.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:05:35.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:05:35.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:05:35.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:05:35.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:05:35.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:05:35.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:05:35.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:05:35.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:05:35.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.471 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:05:35.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:05:35.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.471 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:05:35.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:05:35.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:05:35.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:05:35.473 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.473 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.473 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.473 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.473 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:35.473 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.365076235, 2024-09-12T22:05:35.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:05:35.474 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.474 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.474 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.474 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.474 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.474 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.474 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:05:35.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.474 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.474 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.474 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:35.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:35.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:05:35.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:05:35.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:05:35.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:05:35.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:05:35.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:05:35.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:05:35.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:05:35.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:05:35.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:05:35.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:05:35.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:35.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:05:35.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:05:35.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:05:35.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:05:35.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:05:35.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:05:35.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:05:35.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:05:35.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:05:35.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:05:35.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.480 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.480 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:05:35.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:05:35.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.480 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.480 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:05:35.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:05:35.480 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.480 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.480 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.481 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.481 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:35.481 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.363579953, 2024-09-12T22:05:35.481 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:05:35.481 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.481 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.481 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.481 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:05:35.481 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.482 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:35.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:35.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:05:35.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:35.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:05:35.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:05:35.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:05:35.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:05:35.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:05:35.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:35.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:05:35.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:05:35.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:05:35.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:05:35.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:05:35.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:05:35.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:05:35.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:05:35.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241896 5.6 5:6ef8d923:::benchmark_data_smithi043_32659_object74658:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:35.487 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.327386769, 2024-09-12T22:05:35.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99264745399999998, 2024-09-12T22:05:35.488 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.488 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.488 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.488 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.488 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.488 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.488 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241896 2024-09-12T22:05:35.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.488 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:35.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:35.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031744+0000", 2024-09-12T22:05:35.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8100000000000001e-07 2024-09-12T22:05:35.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031749+0000", 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.437e-06 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031757+0000", 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6999999999999997e-06 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031765+0000", 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6709999999999999e-06 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031809+0000", 2024-09-12T22:05:35.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3970000000000001e-05 2024-09-12T22:05:35.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031817+0000", 2024-09-12T22:05:35.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6580000000000002e-06 2024-09-12T22:05:35.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020952+0000", 2024-09-12T22:05:35.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.98913576299999995 2024-09-12T22:05:35.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021031+0000", 2024-09-12T22:05:35.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8483000000000001e-05 2024-09-12T22:05:35.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021091+0000", 2024-09-12T22:05:35.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0287000000000001e-05 2024-09-12T22:05:35.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024109+0000", 2024-09-12T22:05:35.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030178269999999998 2024-09-12T22:05:35.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024255+0000", 2024-09-12T22:05:35.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014615799999999999 2024-09-12T22:05:35.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024305+0000", 2024-09-12T22:05:35.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0259000000000001e-05 2024-09-12T22:05:35.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024391+0000", 2024-09-12T22:05:35.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:05:35.495 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.495 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.495 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.495 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241935 5.6 5:60e2bed8:::benchmark_data_smithi043_32659_object74697:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.495 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:35.495 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.308297144000001, 2024-09-12T22:05:35.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97487546999999997, 2024-09-12T22:05:35.496 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.496 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.496 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.496 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.496 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.496 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.496 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241935 2024-09-12T22:05:35.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.496 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050834+0000", 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2500000000000004e-07 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050838+0000", 2024-09-12T22:05:35.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7029999999999997e-06 2024-09-12T22:05:35.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.498 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.498 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050853+0000", 2024-09-12T22:05:35.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4545000000000001e-05 2024-09-12T22:05:35.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050859+0000", 2024-09-12T22:05:35.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:05:35.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050902+0000", 2024-09-12T22:05:35.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3455999999999999e-05 2024-09-12T22:05:35.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050909+0000", 2024-09-12T22:05:35.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6950000000000003e-06 2024-09-12T22:05:35.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022045+0000", 2024-09-12T22:05:35.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97113624700000001 2024-09-12T22:05:35.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022168+0000", 2024-09-12T22:05:35.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012233 2024-09-12T22:05:35.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022235+0000", 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7651000000000007e-05 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024398+0000", 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002163005 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025575+0000", 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011767590000000001 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025624+0000", 2024-09-12T22:05:35.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9217e-05 2024-09-12T22:05:35.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025708+0000", 2024-09-12T22:05:35.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4037999999999997e-05 2024-09-12T22:05:35.502 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.502 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.502 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.502 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241940 5.6 5:60be75db:::benchmark_data_smithi043_32659_object74702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.502 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:35.502 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.305225191, 2024-09-12T22:05:35.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97334840700000003, 2024-09-12T22:05:35.503 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.503 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.503 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.503 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.503 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.503 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.503 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241940 2024-09-12T22:05:35.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.503 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:35.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:35.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:35.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4700000000000002e-07 2024-09-12T22:05:35.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053907+0000", 2024-09-12T22:05:35.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.796e-06 2024-09-12T22:05:35.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053912+0000", 2024-09-12T22:05:35.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.622e-06 2024-09-12T22:05:35.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053915+0000", 2024-09-12T22:05:35.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3009999999999998e-06 2024-09-12T22:05:35.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053952+0000", 2024-09-12T22:05:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6668000000000002e-05 2024-09-12T22:05:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053957+0000", 2024-09-12T22:05:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5849999999999999e-06 2024-09-12T22:05:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023005+0000", 2024-09-12T22:05:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.96904800700000004 2024-09-12T22:05:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023162+0000", 2024-09-12T22:05:35.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015720900000000001 2024-09-12T22:05:35.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023284+0000", 2024-09-12T22:05:35.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012194200000000001 2024-09-12T22:05:35.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025765+0000", 2024-09-12T22:05:35.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024806099999999998 2024-09-12T22:05:35.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027176+0000", 2024-09-12T22:05:35.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014111180000000001 2024-09-12T22:05:35.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027204+0000", 2024-09-12T22:05:35.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7970000000000002e-05 2024-09-12T22:05:35.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.509 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027253+0000", 2024-09-12T22:05:35.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9231999999999999e-05 2024-09-12T22:05:35.509 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.509 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.509 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.509 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241966 5.6 5:6538f108:::benchmark_data_smithi043_32659_object74728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.509 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:35.510 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.287479542, 2024-09-12T22:05:35.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95692954799999996, 2024-09-12T22:05:35.510 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.510 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.510 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.510 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.510 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241966 2024-09-12T22:05:35.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.510 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.510 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:35.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:35.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071651+0000", 2024-09-12T22:05:35.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:05:35.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071656+0000", 2024-09-12T22:05:35.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7929999999999997e-06 2024-09-12T22:05:35.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071669+0000", 2024-09-12T22:05:35.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2692e-05 2024-09-12T22:05:35.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.512 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071676+0000", 2024-09-12T22:05:35.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:05:35.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071716+0000", 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9817999999999997e-05 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071721+0000", 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.057e-06 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024429+0000", 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95270825000000003 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024544+0000", 2024-09-12T22:05:35.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114045 2024-09-12T22:05:35.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024655+0000", 2024-09-12T22:05:35.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111382 2024-09-12T22:05:35.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028489+0000", 2024-09-12T22:05:35.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038338930000000001 2024-09-12T22:05:35.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028497+0000", 2024-09-12T22:05:35.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7600000000000002e-06 2024-09-12T22:05:35.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028523+0000", 2024-09-12T22:05:35.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6268999999999999e-05 2024-09-12T22:05:35.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.516 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.516 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028580+0000", 2024-09-12T22:05:35.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7179999999999998e-05 2024-09-12T22:05:35.516 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.516 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.516 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.516 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241967 5.6 5:6c2d2d65:::benchmark_data_smithi043_32659_object74729:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.516 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:35.516 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.287431438, 2024-09-12T22:05:35.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958333094, 2024-09-12T22:05:35.517 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.517 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.517 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.517 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.517 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.517 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.517 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241967 2024-09-12T22:05:35.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.517 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.517 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.517 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:35.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071702+0000", 2024-09-12T22:05:35.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6929999999999999e-06 2024-09-12T22:05:35.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071709+0000", 2024-09-12T22:05:35.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2470000000000002e-06 2024-09-12T22:05:35.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071715+0000", 2024-09-12T22:05:35.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7370000000000003e-06 2024-09-12T22:05:35.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071737+0000", 2024-09-12T22:05:35.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1976000000000001e-05 2024-09-12T22:05:35.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071740+0000", 2024-09-12T22:05:35.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1760000000000002e-06 2024-09-12T22:05:35.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025813+0000", 2024-09-12T22:05:35.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95407325399999998 2024-09-12T22:05:35.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025956+0000", 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014283699999999999 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.026055+0000", 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9088999999999999e-05 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028628+0000", 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025725209999999999 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029901+0000", 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012737720000000001 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029954+0000", 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2811e-05 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030032+0000", 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7401e-05 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.522 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.523 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241968 5.6 5:63b7d78c:::benchmark_data_smithi043_32659_object74730:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.523 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:35.523 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.287405581, 2024-09-12T22:05:35.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958459332, 2024-09-12T22:05:35.523 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.523 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.523 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.523 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.524 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.524 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.524 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241968 2024-09-12T22:05:35.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.524 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:35.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:35.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071725+0000", 2024-09-12T22:05:35.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5600000000000001e-07 2024-09-12T22:05:35.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071727+0000", 2024-09-12T22:05:35.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.232e-06 2024-09-12T22:05:35.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.525 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.525 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071733+0000", 2024-09-12T22:05:35.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2750000000000001e-06 2024-09-12T22:05:35.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071738+0000", 2024-09-12T22:05:35.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9289999999999997e-06 2024-09-12T22:05:35.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071769+0000", 2024-09-12T22:05:35.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0746e-05 2024-09-12T22:05:35.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071774+0000", 2024-09-12T22:05:35.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8099999999999997e-06 2024-09-12T22:05:35.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027283+0000", 2024-09-12T22:05:35.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95550956399999998 2024-09-12T22:05:35.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027416+0000", 2024-09-12T22:05:35.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013268399999999999 2024-09-12T22:05:35.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027532+0000", 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115807 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030066+0000", 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025343800000000001 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030077+0000", 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1260000000000001e-05 2024-09-12T22:05:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030116+0000", 2024-09-12T22:05:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8970999999999997e-05 2024-09-12T22:05:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030184+0000", 2024-09-12T22:05:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7317999999999995e-05 2024-09-12T22:05:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241974 5.6 5:6b9cdaf2:::benchmark_data_smithi043_32659_object74736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.274145933, 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94774920900000004, 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241974 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:35.531 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:35.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.531 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:35.531 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:35.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:35.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.531 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:35.531 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084985+0000", 2024-09-12T22:05:35.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4600000000000004e-07 2024-09-12T22:05:35.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084989+0000", 2024-09-12T22:05:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9349999999999996e-06 2024-09-12T22:05:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084999+0000", 2024-09-12T22:05:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0043e-05 2024-09-12T22:05:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085004+0000", 2024-09-12T22:05:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1619999999999999e-06 2024-09-12T22:05:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085041+0000", 2024-09-12T22:05:35.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7469999999999999e-05 2024-09-12T22:05:35.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:35.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085048+0000", 2024-09-12T22:05:35.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:05:35.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:35.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028676+0000", 2024-09-12T22:05:35.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94362829599999998 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028809+0000", 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013285 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028932+0000", 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012289199999999999 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032531+0000", 2024-09-12T22:05:35.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035990639999999999 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032584+0000", 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3399999999999997e-05 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032644+0000", 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0019999999999998e-05 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032733+0000", 2024-09-12T22:05:35.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9137999999999999e-05 2024-09-12T22:05:35.536 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.536 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.536 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.536 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:35.536 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:35.536 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:35.538 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:35.536+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:35.538 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:35.638 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:35.637+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:35.680 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:276934 5.c 5:31363299:::benchmark_data_smithi043_32659_object109696:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:35.678021+0000", 2024-09-12T22:05:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001023166, 2024-09-12T22:05:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001051305, 2024-09-12T22:05:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 276934 2024-09-12T22:05:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678021+0000", 2024-09-12T22:05:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678021+0000", 2024-09-12T22:05:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678022+0000", 2024-09-12T22:05:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7700000000000004e-07 2024-09-12T22:05:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678026+0000", 2024-09-12T22:05:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0090000000000001e-06 2024-09-12T22:05:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:35.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678035+0000", 2024-09-12T22:05:35.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.815e-06 2024-09-12T22:05:35.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678042+0000", 2024-09-12T22:05:35.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9410000000000001e-06 2024-09-12T22:05:35.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:35.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678094+0000", 2024-09-12T22:05:35.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2033999999999997e-05 2024-09-12T22:05:35.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:35.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678294+0000", 2024-09-12T22:05:35.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019998999999999999 2024-09-12T22:05:35.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:35.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678429+0000", 2024-09-12T22:05:35.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000134358 2024-09-12T22:05:35.692 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:35.692 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:35.692 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:35.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.692 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:276935 5.2 5:4102efbc:::benchmark_data_smithi043_32659_object109697:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:35.692 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:35.678070+0000", 2024-09-12T22:05:35.693 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00097369299999999998, 2024-09-12T22:05:35.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010601580000000001, 2024-09-12T22:05:35.693 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:35.693 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:35.693 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:35.693 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:35.693 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:35.693 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.693 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 276935 2024-09-12T22:05:35.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.693 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:35.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:35.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678070+0000", 2024-09-12T22:05:35.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:35.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:35.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678070+0000", 2024-09-12T22:05:35.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:35.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:35.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678071+0000", 2024-09-12T22:05:35.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6400000000000002e-07 2024-09-12T22:05:35.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:35.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678074+0000", 2024-09-12T22:05:35.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-09-12T22:05:35.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:35.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678082+0000", 2024-09-12T22:05:35.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6129999999999998e-06 2024-09-12T22:05:35.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678088+0000", 2024-09-12T22:05:35.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.657e-06 2024-09-12T22:05:35.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:35.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678137+0000", 2024-09-12T22:05:35.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8712999999999999e-05 2024-09-12T22:05:35.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:35.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678323+0000", 2024-09-12T22:05:35.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000186107 2024-09-12T22:05:35.696 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:35.696 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:35.697 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:35.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.697 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:276928 5.6 e62/57 5:6c0e3433:::benchmark_data_smithi043_32659_object109690:head v 62'17170, mlcod=62'17166)", 2024-09-12T22:05:35.697 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:35.678612+0000", 2024-09-12T22:05:35.697 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00043234499999999999, 2024-09-12T22:05:35.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056367699999999995, 2024-09-12T22:05:35.697 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:35.697 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:35.697 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:35.697 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:35.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:35.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678612+0000", 2024-09-12T22:05:35.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:35.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:35.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678612+0000", 2024-09-12T22:05:35.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:35.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:35.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678612+0000", 2024-09-12T22:05:35.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2799999999999996e-07 2024-09-12T22:05:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678616+0000", 2024-09-12T22:05:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1699999999999999e-06 2024-09-12T22:05:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678632+0000", 2024-09-12T22:05:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5500000000000001e-05 2024-09-12T22:05:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678639+0000", 2024-09-12T22:05:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7220000000000002e-06 2024-09-12T22:05:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678685+0000", 2024-09-12T22:05:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6075999999999997e-05 2024-09-12T22:05:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.678698+0000", 2024-09-12T22:05:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3594999999999999e-05 2024-09-12T22:05:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:276939 5.c 5.8cbb543c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:35.679142+0000", 2024-09-12T22:05:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999018, 2024-09-12T22:05:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3972000000000001e-05, 2024-09-12T22:05:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 276939 2024-09-12T22:05:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.679142+0000", 2024-09-12T22:05:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.679142+0000", 2024-09-12T22:05:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.679143+0000", 2024-09-12T22:05:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3099999999999996e-07 2024-09-12T22:05:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.679147+0000", 2024-09-12T22:05:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5930000000000002e-06 2024-09-12T22:05:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.679157+0000", 2024-09-12T22:05:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9879999999999999e-06 2024-09-12T22:05:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.679163+0000", 2024-09-12T22:05:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1970000000000001e-06 2024-09-12T22:05:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:276926 5.c 5:34dbe7aa:::benchmark_data_smithi043_32659_object109688:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:35.675564+0000", 2024-09-12T22:05:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00347949, 2024-09-12T22:05:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003735777, 2024-09-12T22:05:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 276926 2024-09-12T22:05:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.675564+0000", 2024-09-12T22:05:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.675564+0000", 2024-09-12T22:05:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.675565+0000", 2024-09-12T22:05:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1200000000000001e-07 2024-09-12T22:05:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.675570+0000", 2024-09-12T22:05:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7140000000000001e-06 2024-09-12T22:05:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.675582+0000", 2024-09-12T22:05:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1503e-05 2024-09-12T22:05:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.675588+0000", 2024-09-12T22:05:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0610000000000001e-06 2024-09-12T22:05:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.675639+0000", 2024-09-12T22:05:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1292000000000003e-05 2024-09-12T22:05:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.675795+0000", 2024-09-12T22:05:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000156305 2024-09-12T22:05:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.675945+0000", 2024-09-12T22:05:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024299999999999 2024-09-12T22:05:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:276932 5.1 5:8f2fe4cf:::benchmark_data_smithi043_32659_object109694:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T22:05:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:35.676585+0000", 2024-09-12T22:05:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0024590060000000001, 2024-09-12T22:05:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00276904, 2024-09-12T22:05:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 276932 2024-09-12T22:05:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.676585+0000", 2024-09-12T22:05:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.676585+0000", 2024-09-12T22:05:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.676586+0000", 2024-09-12T22:05:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.676589+0000", 2024-09-12T22:05:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3400000000000002e-06 2024-09-12T22:05:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.676596+0000", 2024-09-12T22:05:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3540000000000002e-06 2024-09-12T22:05:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.676601+0000", 2024-09-12T22:05:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.676654+0000", 2024-09-12T22:05:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3288999999999998e-05 2024-09-12T22:05:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.676856+0000", 2024-09-12T22:05:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020211900000000001 2024-09-12T22:05:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.676987+0000", 2024-09-12T22:05:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013036600000000001 2024-09-12T22:05:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:35.679360+0000", 2024-09-12T22:05:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023728339999999999 2024-09-12T22:05:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 6 2024-09-12T22:05:35.714 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:35.715 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:35.739 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:35.738+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:35.839 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:35.838+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:35.896 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:35.896 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:35.909 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:35.940 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:35.939+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:36.002 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:05:36.042 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:36.040+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:36.094 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:36.095 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:36.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:36.095 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:36.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.095 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:36.096 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:36.096 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.679901182999998, 2024-09-12T22:05:36.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:36.096 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.096 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.096 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:36.096 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.097 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:36.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.097 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:36.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:36.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:36.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:36.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:36.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:36.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:36.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:36.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:36.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:36.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:36.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:36.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:36.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:36.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:36.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:36.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:36.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:36.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:36.106 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.107 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.107 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.108 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:36.108 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:36.108 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.679721252999997, 2024-09-12T22:05:36.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:36.108 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.108 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.108 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:36.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.109 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.109 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.109 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:36.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.109 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:36.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:36.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:36.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:36.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:36.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:36.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:36.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:36.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:36.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:36.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:36.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:36.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:36.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:36.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:36.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:36.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:36.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:36.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:36.113 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.113 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.113 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.114 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:36.114 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:36.114 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.679654812000003, 2024-09-12T22:05:36.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:36.114 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.114 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.114 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:36.114 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.115 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.115 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.115 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:36.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.115 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:36.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:36.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:36.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:36.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:36.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:36.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:36.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:36.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:36.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:36.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:36.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:36.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:36.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:36.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:36.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:36.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:36.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:36.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:36.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.121 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.121 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:36.121 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:36.121 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.679598368999997, 2024-09-12T22:05:36.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:36.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:36.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:36.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:36.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:36.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:36.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:36.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:36.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:36.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:36.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:36.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:36.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:36.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:36.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:36.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:36.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:36.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:36.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:36.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:36.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:36.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:36.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:36.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.128 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.128 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:36.128 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:36.128 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.679529909000003, 2024-09-12T22:05:36.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:36.129 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.129 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.129 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.130 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.130 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.130 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:36.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.130 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:36.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:36.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:36.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:36.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:36.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:36.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:36.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:36.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:36.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:36.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:36.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:36.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:36.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:36.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:36.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:36.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:36.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:36.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:36.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:36.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:36.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:36.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:36.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:36.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:36.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:36.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:36.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:36.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:36.136 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.136 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.137 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.137 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:36.137 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:36.137 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.679472173999997, 2024-09-12T22:05:36.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:36.137 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.137 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.137 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.137 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.137 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.137 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.137 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:36.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:36.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:36.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:36.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:36.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:36.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:36.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:36.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:36.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:36.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:36.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:36.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:36.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:36.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:36.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:36.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:36.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:36.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:36.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:36.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:36.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:36.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:36.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:36.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:36.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:36.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:36.145 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.145 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.145 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.145 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:36.145 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:36.145 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.679404482000002, 2024-09-12T22:05:36.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:36.145 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.145 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.145 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.146 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.146 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.146 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:36.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.146 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:36.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:36.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:36.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:36.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:36.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:36.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:36.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:36.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:36.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:36.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:36.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:36.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:36.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:36.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:36.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:36.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:36.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:36.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:36.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:36.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:36.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:36.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:36.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:36.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:36.153 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.154 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.154 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.154 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:36.154 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:36.154 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.679349420000001, 2024-09-12T22:05:36.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:36.155 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.155 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.155 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.155 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.155 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.155 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.155 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:36.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.155 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:36.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:36.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:36.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:36.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:36.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:36.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:36.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:36.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:36.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:36.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:36.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:36.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:36.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:36.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:36.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:36.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:36.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:36.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:36.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:36.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:36.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:36.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:36.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:36.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:36.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:36.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:36.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:36.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:36.162 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.162 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.162 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.162 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:36.162 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:36.162 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.638701900000001, 2024-09-12T22:05:36.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:36.163 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.163 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.163 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.163 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.163 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.163 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.164 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:36.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.164 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:36.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:36.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:36.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:36.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:36.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:36.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:36.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:36.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:36.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:36.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:36.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:36.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:36.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:36.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:36.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:36.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:36.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:36.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:36.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:36.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:36.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:36.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:36.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:36.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:36.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:36.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:36.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:36.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:36.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.170 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.170 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:36.170 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:36.170 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.636088172000001, 2024-09-12T22:05:36.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:36.170 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.171 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.171 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.171 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.171 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.171 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.171 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:36.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.171 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:36.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:36.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:36.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:36.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:36.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:36.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:36.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:36.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:36.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:36.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:36.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:36.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:36.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:36.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:36.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:36.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:36.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:36.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:36.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:36.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:36.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:36.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:36.177 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.177 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.177 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.178 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:36.178 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:36.178 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.090874075999999, 2024-09-12T22:05:36.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:36.178 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.178 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.179 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.179 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:36.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.179 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:36.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:36.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:36.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:36.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:36.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:36.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:36.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:36.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:36.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:36.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:36.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:36.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:36.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:36.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:36.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:36.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:36.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:36.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:36.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:36.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:36.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:36.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:36.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:36.185 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.186 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.186 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.186 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:36.186 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:36.186 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.090395588, 2024-09-12T22:05:36.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:36.186 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.186 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.186 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.186 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.186 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.186 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.187 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:36.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.187 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:36.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:36.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:36.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:36.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:36.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:36.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:36.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:36.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:36.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:36.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:36.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:36.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:36.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:36.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:36.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:36.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:36.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:36.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:36.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:36.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:36.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:36.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:36.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:36.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.193 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.194 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:36.194 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:36.194 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.087900288, 2024-09-12T22:05:36.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:36.194 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.194 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.194 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.194 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:36.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.194 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:36.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:36.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:36.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:36.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:36.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:36.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:36.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:36.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:36.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:36.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:36.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:36.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:36.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:36.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:36.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:36.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:36.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:36.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:36.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:36.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:36.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:36.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.086819497, 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.200 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.201 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.201 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.201 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.201 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.201 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:36.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.201 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:36.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:36.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:36.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:36.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:36.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:36.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:36.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:36.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:36.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:36.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:36.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:36.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:36.205 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.206 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.206 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.206 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:36.206 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:36.206 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.085583935000002, 2024-09-12T22:05:36.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:36.207 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.207 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.207 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.208 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.208 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:36.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.208 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:36.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:36.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:36.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:36.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:36.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:36.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:36.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:36.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:36.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:36.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:36.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:36.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:36.213 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.213 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.213 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.213 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:36.213 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:36.213 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.644843447, 2024-09-12T22:05:36.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:36.213 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:36.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:36.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:36.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:36.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:36.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:36.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:36.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:36.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:36.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:36.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:36.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:36.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:36.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:36.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.220 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.220 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:36.221 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:36.221 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.640313020000001, 2024-09-12T22:05:36.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:36.221 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.221 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.221 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.221 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:36.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.222 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:36.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:36.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:36.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:36.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:36.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:36.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:36.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:36.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:36.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:36.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:36.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:36.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:36.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:36.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:36.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:36.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:36.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:36.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:36.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:36.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:36.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:36.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:36.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:36.228 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.228 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.228 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.228 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:36.229 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:36.229 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.640288990999998, 2024-09-12T22:05:36.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:36.229 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.229 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.230 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.230 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.230 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.230 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.230 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:36.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.230 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:36.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:36.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:36.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:36.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:36.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:36.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:36.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:36.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:36.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:36.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:36.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:36.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:36.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:36.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:36.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:36.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:36.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:36.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:36.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:36.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:36.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:36.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.640111342000001, 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.236 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.236 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.236 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:36.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.236 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:36.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:36.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:36.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:36.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:36.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:36.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:36.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:36.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:36.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:36.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:36.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:36.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:36.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:36.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:36.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:36.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:36.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:36.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.242 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.242 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:36.242 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:36.242 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.638092804999999, 2024-09-12T22:05:36.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:36.242 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:36.243 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:36.243 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:36.243 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:36.243 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:36.243 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:36.243 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:36.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.243 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:36.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:36.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:36.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:36.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:36.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:36.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:36.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:36.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:36.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:36.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:36.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:36.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:36.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:36.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:36.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:36.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:36.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:36.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:36.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:36.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:36.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:36.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:36.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:36.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:36.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:36.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:36.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:36.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:36.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:36.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:36.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:36.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:36.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:36.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:36.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:36.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:36.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:36.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:36.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:36.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:36.253 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.254 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.254 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.254 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:36.254 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:36.254 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:36.255 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:05:36.257 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:36.257 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:36.254+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:36.357 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:36.356+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:36.365 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:36.384 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:36.384 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:36.404 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:36.404 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:36.407 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:36.407 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:36.413 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:36.413 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:36.425 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:36.458 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:36.457+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:36.558 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:36.557+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:36.624 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:36.624 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:36.638 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:36.659 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:36.658+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:36.760 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:36.759+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:36.833 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:36.833 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:36.847 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:36.890 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:36.889+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:36.962 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:36.961+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:36.987 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:36.987 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:36.995 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-09-12T22:05:36.999 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:37.083 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:37.082+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:37.165 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:37.163+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:37.186 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:37.187 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:37.198 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:37.264 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:37.263+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:37.365 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:37.363+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:37.388 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:37.388 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:37.401 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:37.465 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:37.465+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:37.567 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:37.565+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:37.567 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:37.567 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:37.581 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:37.667 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:37.666+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:37.768 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:37.767+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:37.788 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:37.788 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:37.803 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:37.869 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:37.868+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:37.967 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:37.967 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:37.969 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:37.968+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:37.982 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:38.070 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:38.069+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:38.128 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:38.128 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:38.141 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:38.171 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:38.170+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:38.271 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:38.270+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:38.329 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:38.330 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:38.341 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:38.373 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:38.372+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:38.408 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:05:38.496 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:38.497 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:38.505 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:38.515 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:38.532 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:38.472+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:38.553 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:38.553 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:38.574 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:38.573+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:38.574 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:38.575 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:38.577 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:38.578 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:38.655 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:38.656 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:38.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.656 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:284930 5.e 5:7bf4a73a:::benchmark_data_smithi043_32659_object117692:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:38.656 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.645773+0000", 2024-09-12T22:05:38.656 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0077796200000000001, 2024-09-12T22:05:38.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0078057179999999997, 2024-09-12T22:05:38.656 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.656 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.656 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:38.657 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:38.657 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:38.657 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:38.657 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 284930 2024-09-12T22:05:38.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.657 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.645773+0000", 2024-09-12T22:05:38.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.645773+0000", 2024-09-12T22:05:38.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.645773+0000", 2024-09-12T22:05:38.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999997e-07 2024-09-12T22:05:38.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.645777+0000", 2024-09-12T22:05:38.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8410000000000002e-06 2024-09-12T22:05:38.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.645786+0000", 2024-09-12T22:05:38.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.217e-06 2024-09-12T22:05:38.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.645792+0000", 2024-09-12T22:05:38.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.784e-06 2024-09-12T22:05:38.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649400+0000", 2024-09-12T22:05:38.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003607781 2024-09-12T22:05:38.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649557+0000", 2024-09-12T22:05:38.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015651799999999999 2024-09-12T22:05:38.660 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.660 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.660 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.661 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:284931 5.6 5:6f75a716:::benchmark_data_smithi043_32659_object117693:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:38.661 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.646877+0000", 2024-09-12T22:05:38.661 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0066757700000000001, 2024-09-12T22:05:38.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0067768539999999997, 2024-09-12T22:05:38.661 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.661 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.661 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:38.661 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:38.661 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:38.661 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:38.662 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 284931 2024-09-12T22:05:38.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.662 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.646877+0000", 2024-09-12T22:05:38.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.646877+0000", 2024-09-12T22:05:38.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.663 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.663 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.646877+0000", 2024-09-12T22:05:38.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1100000000000005e-07 2024-09-12T22:05:38.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.663 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.663 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.646882+0000", 2024-09-12T22:05:38.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:05:38.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.646890+0000", 2024-09-12T22:05:38.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6370000000000005e-06 2024-09-12T22:05:38.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.646897+0000", 2024-09-12T22:05:38.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5860000000000001e-06 2024-09-12T22:05:38.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649378+0000", 2024-09-12T22:05:38.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002481198 2024-09-12T22:05:38.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649507+0000", 2024-09-12T22:05:38.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000128703 2024-09-12T22:05:38.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:38.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649617+0000", 2024-09-12T22:05:38.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109734 2024-09-12T22:05:38.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:38.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652282+0000", 2024-09-12T22:05:38.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026655419999999999 2024-09-12T22:05:38.666 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.666 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.666 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.666 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:284938 5.e 5:70cde849:::benchmark_data_smithi043_32659_object117700:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:38.666 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.647856+0000", 2024-09-12T22:05:38.666 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.005696235, 2024-09-12T22:05:38.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0058701819999999998, 2024-09-12T22:05:38.667 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.667 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.667 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:38.667 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:38.667 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:38.667 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:38.667 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 284938 2024-09-12T22:05:38.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.667 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.647856+0000", 2024-09-12T22:05:38.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.647856+0000", 2024-09-12T22:05:38.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.647857+0000", 2024-09-12T22:05:38.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:05:38.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.647861+0000", 2024-09-12T22:05:38.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1849999999999997e-06 2024-09-12T22:05:38.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.647871+0000", 2024-09-12T22:05:38.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0168e-05 2024-09-12T22:05:38.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.647877+0000", 2024-09-12T22:05:38.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1689999999999997e-06 2024-09-12T22:05:38.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.650987+0000", 2024-09-12T22:05:38.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031096969999999998 2024-09-12T22:05:38.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651148+0000", 2024-09-12T22:05:38.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000161337 2024-09-12T22:05:38.671 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.671 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.671 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.671 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.671 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.671 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:284939 5.7 e63/40 5:e8648aa0:::benchmark_data_smithi043_32659_object117701:head v 63'17894, mlcod=63'17891)", 2024-09-12T22:05:38.671 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.649172+0000", 2024-09-12T22:05:38.671 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0043801389999999999, 2024-09-12T22:05:38.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046121850000000004, 2024-09-12T22:05:38.671 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.671 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.671 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:38.672 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.672 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649172+0000", 2024-09-12T22:05:38.672 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.672 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649172+0000", 2024-09-12T22:05:38.672 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649173+0000", 2024-09-12T22:05:38.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6099999999999999e-07 2024-09-12T22:05:38.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649178+0000", 2024-09-12T22:05:38.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.904e-06 2024-09-12T22:05:38.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649187+0000", 2024-09-12T22:05:38.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9060000000000008e-06 2024-09-12T22:05:38.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649193+0000", 2024-09-12T22:05:38.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8239999999999996e-06 2024-09-12T22:05:38.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649233+0000", 2024-09-12T22:05:38.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0402999999999999e-05 2024-09-12T22:05:38.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649253+0000", 2024-09-12T22:05:38.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9624999999999999e-05 2024-09-12T22:05:38.675 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.675 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.675 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.675 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:284936 5.c e63/40 5:36e354c7:::benchmark_data_smithi043_32659_object117698:head v 63'17795, mlcod=63'17792)", 2024-09-12T22:05:38.675 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.649299+0000", 2024-09-12T22:05:38.676 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0042537349999999998, 2024-09-12T22:05:38.676 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045456020000000001, 2024-09-12T22:05:38.676 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.676 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.676 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:38.676 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.676 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.676 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.676 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649299+0000", 2024-09-12T22:05:38.676 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.676 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.677 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.677 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.677 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649299+0000", 2024-09-12T22:05:38.677 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.677 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.677 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.677 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.677 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649299+0000", 2024-09-12T22:05:38.677 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6100000000000001e-07 2024-09-12T22:05:38.677 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.677 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.677 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.677 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649304+0000", 2024-09-12T22:05:38.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4429999999999996e-06 2024-09-12T22:05:38.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649311+0000", 2024-09-12T22:05:38.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:05:38.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649316+0000", 2024-09-12T22:05:38.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4940000000000003e-06 2024-09-12T22:05:38.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649361+0000", 2024-09-12T22:05:38.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4270000000000001e-05 2024-09-12T22:05:38.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649388+0000", 2024-09-12T22:05:38.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7265999999999999e-05 2024-09-12T22:05:38.679 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.679 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.679 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.680 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:284940 5.0 5:07253c8b:::benchmark_data_smithi043_32659_object117702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:38.680 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.649637+0000", 2024-09-12T22:05:38.680 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0039154869999999996, 2024-09-12T22:05:38.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0042605109999999998, 2024-09-12T22:05:38.680 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.680 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.680 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:38.680 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:38.680 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:38.680 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:38.681 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 284940 2024-09-12T22:05:38.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.681 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649637+0000", 2024-09-12T22:05:38.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649637+0000", 2024-09-12T22:05:38.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649638+0000", 2024-09-12T22:05:38.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.077e-06 2024-09-12T22:05:38.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649643+0000", 2024-09-12T22:05:38.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9840000000000001e-06 2024-09-12T22:05:38.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.683 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.683 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649653+0000", 2024-09-12T22:05:38.683 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8490000000000001e-06 2024-09-12T22:05:38.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.683 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.683 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.683 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649659+0000", 2024-09-12T22:05:38.683 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:38.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.683 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.683 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.683 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649713+0000", 2024-09-12T22:05:38.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3449000000000003e-05 2024-09-12T22:05:38.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.649875+0000", 2024-09-12T22:05:38.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016233099999999999 2024-09-12T22:05:38.684 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.684 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.684 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.684 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:284944 5.9 5:9cffb0d5:::benchmark_data_smithi043_32659_object117706:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:38.684 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.650739+0000", 2024-09-12T22:05:38.685 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0028131319999999999, 2024-09-12T22:05:38.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032178520000000002, 2024-09-12T22:05:38.685 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.685 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.685 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:38.685 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:38.685 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:38.685 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:38.685 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 284944 2024-09-12T22:05:38.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.685 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.650739+0000", 2024-09-12T22:05:38.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.650739+0000", 2024-09-12T22:05:38.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.650740+0000", 2024-09-12T22:05:38.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0800000000000004e-07 2024-09-12T22:05:38.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.650744+0000", 2024-09-12T22:05:38.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3239999999999996e-06 2024-09-12T22:05:38.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.650765+0000", 2024-09-12T22:05:38.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0355000000000001e-05 2024-09-12T22:05:38.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.650780+0000", 2024-09-12T22:05:38.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5642999999999999e-05 2024-09-12T22:05:38.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.650832+0000", 2024-09-12T22:05:38.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1966999999999999e-05 2024-09-12T22:05:38.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651169+0000", 2024-09-12T22:05:38.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033671599999999998 2024-09-12T22:05:38.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.689 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:38.689 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651286+0000", 2024-09-12T22:05:38.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116758 2024-09-12T22:05:38.689 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.689 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.689 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.689 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:284945 5.8 5:13191e53:::benchmark_data_smithi043_32659_object117707:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:38.690 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.650934+0000", 2024-09-12T22:05:38.690 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0026182969999999999, 2024-09-12T22:05:38.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030916189999999999, 2024-09-12T22:05:38.690 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.690 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.690 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:38.690 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:38.690 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:38.690 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:38.690 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 284945 2024-09-12T22:05:38.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.690 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.650934+0000", 2024-09-12T22:05:38.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.650934+0000", 2024-09-12T22:05:38.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.650935+0000", 2024-09-12T22:05:38.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2799999999999995e-07 2024-09-12T22:05:38.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.650946+0000", 2024-09-12T22:05:38.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0966e-05 2024-09-12T22:05:38.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.650955+0000", 2024-09-12T22:05:38.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.064e-06 2024-09-12T22:05:38.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.650961+0000", 2024-09-12T22:05:38.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1550000000000004e-06 2024-09-12T22:05:38.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651036+0000", 2024-09-12T22:05:38.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5238e-05 2024-09-12T22:05:38.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651247+0000", 2024-09-12T22:05:38.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00021082800000000001 2024-09-12T22:05:38.694 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.694 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.694 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.694 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:284946 5.6 5:66d400ba:::benchmark_data_smithi043_32659_object117708:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:38.694 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.651133+0000", 2024-09-12T22:05:38.694 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0024190359999999998, 2024-09-12T22:05:38.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0029506900000000002, 2024-09-12T22:05:38.695 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.695 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.695 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:38.695 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:38.695 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:38.695 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:38.695 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 284946 2024-09-12T22:05:38.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.695 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651133+0000", 2024-09-12T22:05:38.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.696 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651133+0000", 2024-09-12T22:05:38.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.696 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.696 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651134+0000", 2024-09-12T22:05:38.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9100000000000003e-07 2024-09-12T22:05:38.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651138+0000", 2024-09-12T22:05:38.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9060000000000004e-06 2024-09-12T22:05:38.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651146+0000", 2024-09-12T22:05:38.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4209999999999995e-06 2024-09-12T22:05:38.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651153+0000", 2024-09-12T22:05:38.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4359999999999999e-06 2024-09-12T22:05:38.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652314+0000", 2024-09-12T22:05:38.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011607639999999999 2024-09-12T22:05:38.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652470+0000", 2024-09-12T22:05:38.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015657400000000001 2024-09-12T22:05:38.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:38.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652574+0000", 2024-09-12T22:05:38.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104057 2024-09-12T22:05:38.699 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.699 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.699 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.699 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:284941 5.3 e63/40 5:c588bcfa:::benchmark_data_smithi043_32659_object117703:head v 63'17700, mlcod=63'17698)", 2024-09-12T22:05:38.699 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.651218+0000", 2024-09-12T22:05:38.700 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0023340000000000001, 2024-09-12T22:05:38.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002945189, 2024-09-12T22:05:38.700 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.700 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.700 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:38.700 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651218+0000", 2024-09-12T22:05:38.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651218+0000", 2024-09-12T22:05:38.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651219+0000", 2024-09-12T22:05:38.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9100000000000003e-07 2024-09-12T22:05:38.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651225+0000", 2024-09-12T22:05:38.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7799999999999997e-06 2024-09-12T22:05:38.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651234+0000", 2024-09-12T22:05:38.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.132e-06 2024-09-12T22:05:38.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651240+0000", 2024-09-12T22:05:38.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4710000000000004e-06 2024-09-12T22:05:38.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651948+0000", 2024-09-12T22:05:38.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00070736799999999999 2024-09-12T22:05:38.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651966+0000", 2024-09-12T22:05:38.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7788999999999999e-05 2024-09-12T22:05:38.703 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.703 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.703 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.704 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:284943 5.5 e63/40 5:a243d8d1:::benchmark_data_smithi043_32659_object117705:head v 63'17831, mlcod=63'17829)", 2024-09-12T22:05:38.704 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.651255+0000", 2024-09-12T22:05:38.704 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002297257, 2024-09-12T22:05:38.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0029599679999999999, 2024-09-12T22:05:38.704 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.704 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.704 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:38.704 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651255+0000", 2024-09-12T22:05:38.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651255+0000", 2024-09-12T22:05:38.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651255+0000", 2024-09-12T22:05:38.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6e-07 2024-09-12T22:05:38.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651258+0000", 2024-09-12T22:05:38.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0879999999999999e-06 2024-09-12T22:05:38.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651264+0000", 2024-09-12T22:05:38.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9209999999999997e-06 2024-09-12T22:05:38.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651269+0000", 2024-09-12T22:05:38.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5000000000000001e-06 2024-09-12T22:05:38.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651336+0000", 2024-09-12T22:05:38.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6879999999999997e-05 2024-09-12T22:05:38.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.651357+0000", 2024-09-12T22:05:38.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1758000000000001e-05 2024-09-12T22:05:38.708 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.708 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.708 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.708 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:284947 5.5 e63/40 5:a11c48f3:::benchmark_data_smithi043_32659_object117709:head v 63'17832, mlcod=63'17829)", 2024-09-12T22:05:38.708 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.652874+0000", 2024-09-12T22:05:38.708 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000678482, 2024-09-12T22:05:38.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001392573, 2024-09-12T22:05:38.709 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.709 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.709 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:38.709 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652874+0000", 2024-09-12T22:05:38.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652874+0000", 2024-09-12T22:05:38.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652875+0000", 2024-09-12T22:05:38.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:05:38.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652881+0000", 2024-09-12T22:05:38.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4559999999999997e-06 2024-09-12T22:05:38.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652890+0000", 2024-09-12T22:05:38.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4809999999999995e-06 2024-09-12T22:05:38.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652896+0000", 2024-09-12T22:05:38.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6790000000000002e-06 2024-09-12T22:05:38.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653212+0000", 2024-09-12T22:05:38.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000315767 2024-09-12T22:05:38.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653229+0000", 2024-09-12T22:05:38.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7159e-05 2024-09-12T22:05:38.712 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.712 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.713 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.713 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:284948 5.f 5:f7cae42f:::benchmark_data_smithi043_32659_object117710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:38.713 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.652949+0000", 2024-09-12T22:05:38.713 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00060316299999999998, 2024-09-12T22:05:38.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0013698639999999999, 2024-09-12T22:05:38.713 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.713 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.713 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:38.713 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:38.713 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:38.714 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:38.714 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 284948 2024-09-12T22:05:38.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.714 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652949+0000", 2024-09-12T22:05:38.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652949+0000", 2024-09-12T22:05:38.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652950+0000", 2024-09-12T22:05:38.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1800000000000004e-07 2024-09-12T22:05:38.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652955+0000", 2024-09-12T22:05:38.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6249999999999998e-06 2024-09-12T22:05:38.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652963+0000", 2024-09-12T22:05:38.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2549999999999997e-06 2024-09-12T22:05:38.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.652967+0000", 2024-09-12T22:05:38.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5029999999999999e-06 2024-09-12T22:05:38.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653003+0000", 2024-09-12T22:05:38.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6000000000000001e-05 2024-09-12T22:05:38.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653134+0000", 2024-09-12T22:05:38.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013045299999999999 2024-09-12T22:05:38.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:38.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653239+0000", 2024-09-12T22:05:38.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000104941 2024-09-12T22:05:38.718 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.718 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.718 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.718 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:284949 5.e 5:73a9e41a:::benchmark_data_smithi043_32659_object117711:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:38.718 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.653092+0000", 2024-09-12T22:05:38.718 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00046050799999999999, 2024-09-12T22:05:38.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012915470000000001, 2024-09-12T22:05:38.718 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.718 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.719 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:38.719 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:38.719 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:38.719 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:38.719 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 284949 2024-09-12T22:05:38.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.719 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653092+0000", 2024-09-12T22:05:38.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653092+0000", 2024-09-12T22:05:38.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653093+0000", 2024-09-12T22:05:38.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4199999999999995e-07 2024-09-12T22:05:38.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653096+0000", 2024-09-12T22:05:38.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.738e-06 2024-09-12T22:05:38.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653105+0000", 2024-09-12T22:05:38.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5650000000000002e-06 2024-09-12T22:05:38.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653112+0000", 2024-09-12T22:05:38.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5290000000000003e-06 2024-09-12T22:05:38.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653162+0000", 2024-09-12T22:05:38.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9617000000000003e-05 2024-09-12T22:05:38.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653360+0000", 2024-09-12T22:05:38.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019833000000000001 2024-09-12T22:05:38.722 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.722 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.722 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.723 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:284951 5.9 5:9e2f1b68:::benchmark_data_smithi043_32659_object117713:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:38.723 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.653194+0000", 2024-09-12T22:05:38.723 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00035862900000000001, 2024-09-12T22:05:38.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012763970000000001, 2024-09-12T22:05:38.723 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.723 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.723 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:38.723 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:38.723 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:38.723 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:38.724 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 284951 2024-09-12T22:05:38.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.724 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653194+0000", 2024-09-12T22:05:38.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653194+0000", 2024-09-12T22:05:38.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653194+0000", 2024-09-12T22:05:38.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4499999999999997e-07 2024-09-12T22:05:38.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653198+0000", 2024-09-12T22:05:38.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.54e-06 2024-09-12T22:05:38.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653206+0000", 2024-09-12T22:05:38.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7849999999999992e-06 2024-09-12T22:05:38.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653213+0000", 2024-09-12T22:05:38.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:05:38.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653272+0000", 2024-09-12T22:05:38.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8335000000000003e-05 2024-09-12T22:05:38.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653431+0000", 2024-09-12T22:05:38.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000159722 2024-09-12T22:05:38.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:38.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653534+0000", 2024-09-12T22:05:38.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010246099999999999 2024-09-12T22:05:38.727 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.728 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.728 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.728 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:284944 5.9 e63/40)", 2024-09-12T22:05:38.728 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.653554+0000", 2024-09-12T22:05:38.728 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9999986, 2024-09-12T22:05:38.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00097945600000000008, 2024-09-12T22:05:38.728 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.728 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.728 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:38.728 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653554+0000", 2024-09-12T22:05:38.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653554+0000", 2024-09-12T22:05:38.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653556+0000", 2024-09-12T22:05:38.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0279999999999999e-06 2024-09-12T22:05:38.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653559+0000", 2024-09-12T22:05:38.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.596e-06 2024-09-12T22:05:38.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653568+0000", 2024-09-12T22:05:38.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9390000000000003e-06 2024-09-12T22:05:38.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653574+0000", 2024-09-12T22:05:38.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4079999999999997e-06 2024-09-12T22:05:38.731 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.731 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.731 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.731 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:284950 5.c e63/40 5:38047293:::benchmark_data_smithi043_32659_object117712:head v 63'17796, mlcod=63'17793)", 2024-09-12T22:05:38.731 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:38.653585+0000", 2024-09-12T22:05:38.732 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9999676, 2024-09-12T22:05:38.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00099730499999999998, 2024-09-12T22:05:38.732 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:38.732 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:38.732 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:38.732 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:38.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:38.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653585+0000", 2024-09-12T22:05:38.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:38.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653585+0000", 2024-09-12T22:05:38.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:38.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:38.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653585+0000", 2024-09-12T22:05:38.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:05:38.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:38.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653588+0000", 2024-09-12T22:05:38.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9500000000000001e-06 2024-09-12T22:05:38.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:38.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653593+0000", 2024-09-12T22:05:38.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.451e-06 2024-09-12T22:05:38.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:38.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653597+0000", 2024-09-12T22:05:38.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9230000000000004e-06 2024-09-12T22:05:38.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:38.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653663+0000", 2024-09-12T22:05:38.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5994999999999994e-05 2024-09-12T22:05:38.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:38.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:38.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:38.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:38.653681+0000", 2024-09-12T22:05:38.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7838000000000001e-05 2024-09-12T22:05:38.735 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.735 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:38.735 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.735 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:38.735 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:38.736 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 17 2024-09-12T22:05:38.736 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:38.737 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:38.738 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:38.735+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:38.837 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:38.836+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:38.896 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:38.896 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:38.896 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:38.909 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:38.939 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:38.937+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:39.009 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:05:39.040 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:39.038+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:39.106 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:39.107 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:39.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:39.107 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:39.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.107 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:39.107 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:39.107 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 60.105730606000002, 2024-09-12T22:05:39.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:39.107 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.107 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.107 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.107 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.108 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.108 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.108 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:39.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.108 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:39.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:39.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:39.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:39.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:39.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:39.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:39.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:39.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:39.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:39.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:39.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:39.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:39.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:39.112 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.112 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.112 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.112 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:39.112 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:39.112 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 60.103910943000002, 2024-09-12T22:05:39.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:39.112 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.112 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.113 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.113 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.113 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.113 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.113 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:39.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.113 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:39.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:39.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:39.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:39.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:39.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:39.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:39.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:39.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:39.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:39.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:39.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:39.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:39.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:39.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:39.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:39.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 60.103377129000002, 2024-09-12T22:05:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 60.101562289999997, 2024-09-12T22:05:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.139468502, 2024-09-12T22:05:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:05:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:05:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:05:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:05:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:05:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:05:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:05:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:05:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:05:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:05:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:05:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:05:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:05:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:05:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:05:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:05:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:05:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:05:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:05:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:05:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:05:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:05:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:05:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:05:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:05:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:05:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:05:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:05:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:05:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:05:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:05:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:05:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:05:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.137435777, 2024-09-12T22:05:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:05:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:05:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:05:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:05:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:05:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:05:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:05:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:05:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:05:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:05:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:05:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:39.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.140 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:05:39.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:05:39.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.140 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:05:39.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:05:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:05:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:05:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:05:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:05:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:05:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:05:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:05:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:05:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:05:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:05:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.134423513000002, 2024-09-12T22:05:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:05:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:05:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:05:39.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:05:39.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:05:39.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:39.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:05:39.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:05:39.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:05:39.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:05:39.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:05:39.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:05:39.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:05:39.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:05:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:05:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:05:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:05:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:05:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:05:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:05:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:05:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:05:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:05:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:05:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:05:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:05:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:05:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:05:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.133437022999999, 2024-09-12T22:05:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:05:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:05:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.151 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.151 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:39.151 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.151 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.151 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.151 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:39.151 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.151 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.151 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.151 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:05:39.151 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:39.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.152 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.152 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.152 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:05:39.152 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:05:39.152 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.152 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.152 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.152 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:05:39.152 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:39.152 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.152 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.152 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.152 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:05:39.152 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:05:39.153 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.153 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.153 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:05:39.153 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:05:39.153 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.153 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.153 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:05:39.153 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:39.153 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.153 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.153 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:05:39.154 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:05:39.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.154 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.154 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.154 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:05:39.154 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:05:39.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.154 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.154 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.154 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:05:39.154 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:05:39.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.154 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.155 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.155 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:05:39.155 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:05:39.155 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.155 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.155 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.155 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:05:39.155 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:05:39.155 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.155 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.155 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.155 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:05:39.155 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:05:39.155 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.156 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.156 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.156 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:05:39.156 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:05:39.156 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.156 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.156 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.156 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.156 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.156 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.156 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:39.156 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.128350389000001, 2024-09-12T22:05:39.156 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:05:39.157 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.157 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.157 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.157 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.157 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.157 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.157 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:05:39.157 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.157 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.157 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.157 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.157 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:39.157 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.157 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.158 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.158 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.158 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:39.158 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.158 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.158 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.158 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.158 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:05:39.158 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:05:39.158 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.158 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.158 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.158 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:05:39.158 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:05:39.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.159 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.159 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.159 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:05:39.159 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:05:39.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.159 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.159 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.159 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:05:39.159 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:05:39.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.159 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.159 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.159 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:05:39.160 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:05:39.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.160 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.160 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.160 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:05:39.160 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:05:39.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.160 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.160 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.160 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:05:39.160 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:05:39.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:05:39.161 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.162 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.162 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.162 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:05:39.162 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:05:39.162 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.162 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.162 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.162 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:05:39.162 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:05:39.162 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.162 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.162 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.162 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:05:39.162 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:05:39.163 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.163 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.163 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.163 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.163 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.163 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.163 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:39.163 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.125595417, 2024-09-12T22:05:39.163 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:05:39.163 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.163 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.163 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.163 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.163 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.164 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.164 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:05:39.164 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.164 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.164 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.164 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.164 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:39.164 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.164 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.164 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.164 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.164 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:39.164 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.165 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.165 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.165 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:05:39.165 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:05:39.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.165 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.165 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.165 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:05:39.165 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:05:39.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.165 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.165 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.166 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:05:39.166 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:05:39.166 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.166 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.166 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.166 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:05:39.166 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:05:39.166 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.166 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.166 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.166 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:05:39.166 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:05:39.166 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.166 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.167 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.167 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:05:39.167 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:05:39.167 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.167 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.167 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.167 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:05:39.167 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:05:39.167 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.167 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.167 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.167 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:05:39.167 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:05:39.168 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.168 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.168 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.168 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:05:39.168 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:05:39.168 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.168 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.168 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.168 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:05:39.168 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:05:39.168 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.168 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.168 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.169 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:05:39.169 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:05:39.169 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.169 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.169 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.169 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:05:39.169 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:05:39.169 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.169 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.169 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.169 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:05:39.169 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:05:39.169 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.169 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.170 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.170 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.170 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.170 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.170 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:39.170 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.117620532, 2024-09-12T22:05:39.170 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:05:39.170 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.170 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.170 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.170 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.170 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.170 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.170 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:05:39.171 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.171 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.171 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.171 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.171 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:39.171 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.171 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.171 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.171 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.171 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:39.171 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.171 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.171 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.172 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.172 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:05:39.172 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:05:39.172 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.172 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.172 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.172 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:05:39.172 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:05:39.172 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.172 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.172 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.172 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:05:39.172 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:05:39.172 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.173 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.173 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.173 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:05:39.173 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:05:39.173 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.173 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.173 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.173 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:05:39.173 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:05:39.173 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.173 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.173 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.173 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:05:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:05:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:05:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:05:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:05:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:05:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.175 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:05:39.175 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:05:39.175 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.175 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.175 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.175 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:05:39.175 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:05:39.175 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.175 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.175 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.175 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:05:39.175 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:05:39.175 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.175 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.176 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.176 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:05:39.176 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:05:39.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.176 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.176 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.176 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:05:39.176 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:05:39.176 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.176 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.176 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.176 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.176 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.177 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:39.177 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.109694756, 2024-09-12T22:05:39.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:05:39.177 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.177 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.177 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.177 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.177 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.177 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.177 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:05:39.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.177 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:39.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:39.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:05:39.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:05:39.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.179 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:05:39.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:05:39.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.179 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:05:39.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:05:39.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.179 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:05:39.180 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:05:39.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.180 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.180 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.180 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:05:39.180 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:05:39.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.180 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.180 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.180 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:05:39.180 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:39.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.180 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.180 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.181 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:05:39.181 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:05:39.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.181 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.181 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.181 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:05:39.181 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:05:39.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.181 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.181 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.181 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:05:39.181 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:05:39.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:05:39.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.183 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.183 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.183 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:05:39.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:05:39.183 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.183 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.183 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.183 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.183 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.183 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:39.183 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.108198474000002, 2024-09-12T22:05:39.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:05:39.184 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.184 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.184 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.184 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.184 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.184 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.184 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:05:39.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.184 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:39.184 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:39.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:05:39.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:39.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:05:39.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:05:39.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:05:39.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:05:39.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:05:39.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:39.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:05:39.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:05:39.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:05:39.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:05:39.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:05:39.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:05:39.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.188 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.188 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:05:39.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:05:39.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.188 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.188 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:05:39.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:05:39.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.188 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.188 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:05:39.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:05:39.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:05:39.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:05:39.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:05:39.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:39.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.190 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:05:39.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:05:39.190 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.190 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.190 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.190 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.190 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241896 5.6 5:6ef8d923:::benchmark_data_smithi043_32659_object74658:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.190 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:39.190 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.07200529, 2024-09-12T22:05:39.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99264745399999998, 2024-09-12T22:05:39.190 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.190 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.191 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.191 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.191 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.191 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.191 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241896 2024-09-12T22:05:39.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.191 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.191 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:39.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:39.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031744+0000", 2024-09-12T22:05:39.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8100000000000001e-07 2024-09-12T22:05:39.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031749+0000", 2024-09-12T22:05:39.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.437e-06 2024-09-12T22:05:39.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031757+0000", 2024-09-12T22:05:39.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6999999999999997e-06 2024-09-12T22:05:39.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031765+0000", 2024-09-12T22:05:39.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6709999999999999e-06 2024-09-12T22:05:39.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031809+0000", 2024-09-12T22:05:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3970000000000001e-05 2024-09-12T22:05:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031817+0000", 2024-09-12T22:05:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6580000000000002e-06 2024-09-12T22:05:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020952+0000", 2024-09-12T22:05:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.98913576299999995 2024-09-12T22:05:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021031+0000", 2024-09-12T22:05:39.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8483000000000001e-05 2024-09-12T22:05:39.195 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021091+0000", 2024-09-12T22:05:39.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0287000000000001e-05 2024-09-12T22:05:39.195 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024109+0000", 2024-09-12T22:05:39.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030178269999999998 2024-09-12T22:05:39.195 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024255+0000", 2024-09-12T22:05:39.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014615799999999999 2024-09-12T22:05:39.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024305+0000", 2024-09-12T22:05:39.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0259000000000001e-05 2024-09-12T22:05:39.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024391+0000", 2024-09-12T22:05:39.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:05:39.197 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.197 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.197 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.197 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241935 5.6 5:60e2bed8:::benchmark_data_smithi043_32659_object74697:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.197 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:39.197 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.052915665, 2024-09-12T22:05:39.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97487546999999997, 2024-09-12T22:05:39.197 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.197 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.197 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.197 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.197 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241935 2024-09-12T22:05:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.199 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.199 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050834+0000", 2024-09-12T22:05:39.199 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2500000000000004e-07 2024-09-12T22:05:39.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.199 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.199 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050838+0000", 2024-09-12T22:05:39.199 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7029999999999997e-06 2024-09-12T22:05:39.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.199 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.199 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050853+0000", 2024-09-12T22:05:39.199 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4545000000000001e-05 2024-09-12T22:05:39.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.200 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.200 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050859+0000", 2024-09-12T22:05:39.200 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:05:39.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.200 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.200 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050902+0000", 2024-09-12T22:05:39.200 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3455999999999999e-05 2024-09-12T22:05:39.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.200 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.200 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050909+0000", 2024-09-12T22:05:39.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6950000000000003e-06 2024-09-12T22:05:39.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022045+0000", 2024-09-12T22:05:39.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97113624700000001 2024-09-12T22:05:39.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022168+0000", 2024-09-12T22:05:39.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012233 2024-09-12T22:05:39.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022235+0000", 2024-09-12T22:05:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7651000000000007e-05 2024-09-12T22:05:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024398+0000", 2024-09-12T22:05:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002163005 2024-09-12T22:05:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025575+0000", 2024-09-12T22:05:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011767590000000001 2024-09-12T22:05:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025624+0000", 2024-09-12T22:05:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9217e-05 2024-09-12T22:05:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025708+0000", 2024-09-12T22:05:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4037999999999997e-05 2024-09-12T22:05:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241940 5.6 5:60be75db:::benchmark_data_smithi043_32659_object74702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.204 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:39.204 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.049843712000001, 2024-09-12T22:05:39.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97334840700000003, 2024-09-12T22:05:39.204 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.204 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.204 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.204 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.204 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.204 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.204 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241940 2024-09-12T22:05:39.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.204 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.204 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:39.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:39.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:39.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4700000000000002e-07 2024-09-12T22:05:39.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053907+0000", 2024-09-12T22:05:39.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.796e-06 2024-09-12T22:05:39.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053912+0000", 2024-09-12T22:05:39.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.622e-06 2024-09-12T22:05:39.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053915+0000", 2024-09-12T22:05:39.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3009999999999998e-06 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053952+0000", 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6668000000000002e-05 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053957+0000", 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5849999999999999e-06 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023005+0000", 2024-09-12T22:05:39.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.96904800700000004 2024-09-12T22:05:39.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023162+0000", 2024-09-12T22:05:39.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015720900000000001 2024-09-12T22:05:39.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023284+0000", 2024-09-12T22:05:39.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012194200000000001 2024-09-12T22:05:39.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025765+0000", 2024-09-12T22:05:39.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024806099999999998 2024-09-12T22:05:39.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027176+0000", 2024-09-12T22:05:39.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014111180000000001 2024-09-12T22:05:39.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027204+0000", 2024-09-12T22:05:39.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7970000000000002e-05 2024-09-12T22:05:39.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027253+0000", 2024-09-12T22:05:39.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9231999999999999e-05 2024-09-12T22:05:39.210 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.210 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.210 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.210 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241966 5.6 5:6538f108:::benchmark_data_smithi043_32659_object74728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.210 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:39.210 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.032098062999999, 2024-09-12T22:05:39.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95692954799999996, 2024-09-12T22:05:39.210 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.210 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.210 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.211 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.211 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.211 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.211 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241966 2024-09-12T22:05:39.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.211 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:39.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:39.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071651+0000", 2024-09-12T22:05:39.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:05:39.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071656+0000", 2024-09-12T22:05:39.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7929999999999997e-06 2024-09-12T22:05:39.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071669+0000", 2024-09-12T22:05:39.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2692e-05 2024-09-12T22:05:39.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071676+0000", 2024-09-12T22:05:39.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:05:39.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071716+0000", 2024-09-12T22:05:39.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9817999999999997e-05 2024-09-12T22:05:39.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071721+0000", 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.057e-06 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024429+0000", 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95270825000000003 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024544+0000", 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114045 2024-09-12T22:05:39.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024655+0000", 2024-09-12T22:05:39.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111382 2024-09-12T22:05:39.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028489+0000", 2024-09-12T22:05:39.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038338930000000001 2024-09-12T22:05:39.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028497+0000", 2024-09-12T22:05:39.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7600000000000002e-06 2024-09-12T22:05:39.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028523+0000", 2024-09-12T22:05:39.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6268999999999999e-05 2024-09-12T22:05:39.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028580+0000", 2024-09-12T22:05:39.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7179999999999998e-05 2024-09-12T22:05:39.216 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.216 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.216 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241967 5.6 5:6c2d2d65:::benchmark_data_smithi043_32659_object74729:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.032049958999998, 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958333094, 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241967 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.217 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:39.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:39.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:39.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:39.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071702+0000", 2024-09-12T22:05:39.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6929999999999999e-06 2024-09-12T22:05:39.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071709+0000", 2024-09-12T22:05:39.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2470000000000002e-06 2024-09-12T22:05:39.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071715+0000", 2024-09-12T22:05:39.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7370000000000003e-06 2024-09-12T22:05:39.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071737+0000", 2024-09-12T22:05:39.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1976000000000001e-05 2024-09-12T22:05:39.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071740+0000", 2024-09-12T22:05:39.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1760000000000002e-06 2024-09-12T22:05:39.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025813+0000", 2024-09-12T22:05:39.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95407325399999998 2024-09-12T22:05:39.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025956+0000", 2024-09-12T22:05:39.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014283699999999999 2024-09-12T22:05:39.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.026055+0000", 2024-09-12T22:05:39.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9088999999999999e-05 2024-09-12T22:05:39.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028628+0000", 2024-09-12T22:05:39.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025725209999999999 2024-09-12T22:05:39.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029901+0000", 2024-09-12T22:05:39.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012737720000000001 2024-09-12T22:05:39.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029954+0000", 2024-09-12T22:05:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2811e-05 2024-09-12T22:05:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030032+0000", 2024-09-12T22:05:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7401e-05 2024-09-12T22:05:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241968 5.6 5:63b7d78c:::benchmark_data_smithi043_32659_object74730:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.223 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.032024102000001, 2024-09-12T22:05:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958459332, 2024-09-12T22:05:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241968 2024-09-12T22:05:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.224 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071725+0000", 2024-09-12T22:05:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5600000000000001e-07 2024-09-12T22:05:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071727+0000", 2024-09-12T22:05:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.232e-06 2024-09-12T22:05:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071733+0000", 2024-09-12T22:05:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2750000000000001e-06 2024-09-12T22:05:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071738+0000", 2024-09-12T22:05:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9289999999999997e-06 2024-09-12T22:05:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071769+0000", 2024-09-12T22:05:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0746e-05 2024-09-12T22:05:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071774+0000", 2024-09-12T22:05:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8099999999999997e-06 2024-09-12T22:05:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027283+0000", 2024-09-12T22:05:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95550956399999998 2024-09-12T22:05:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027416+0000", 2024-09-12T22:05:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013268399999999999 2024-09-12T22:05:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027532+0000", 2024-09-12T22:05:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115807 2024-09-12T22:05:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030066+0000", 2024-09-12T22:05:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025343800000000001 2024-09-12T22:05:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030077+0000", 2024-09-12T22:05:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1260000000000001e-05 2024-09-12T22:05:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030116+0000", 2024-09-12T22:05:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8970999999999997e-05 2024-09-12T22:05:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030184+0000", 2024-09-12T22:05:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7317999999999995e-05 2024-09-12T22:05:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241974 5.6 5:6b9cdaf2:::benchmark_data_smithi043_32659_object74736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 17.018764453999999, 2024-09-12T22:05:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94774920900000004, 2024-09-12T22:05:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:39.230 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241974 2024-09-12T22:05:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084985+0000", 2024-09-12T22:05:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4600000000000004e-07 2024-09-12T22:05:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084989+0000", 2024-09-12T22:05:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9349999999999996e-06 2024-09-12T22:05:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084999+0000", 2024-09-12T22:05:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0043e-05 2024-09-12T22:05:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085004+0000", 2024-09-12T22:05:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1619999999999999e-06 2024-09-12T22:05:39.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085041+0000", 2024-09-12T22:05:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7469999999999999e-05 2024-09-12T22:05:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085048+0000", 2024-09-12T22:05:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:05:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028676+0000", 2024-09-12T22:05:39.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94362829599999998 2024-09-12T22:05:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028809+0000", 2024-09-12T22:05:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013285 2024-09-12T22:05:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028932+0000", 2024-09-12T22:05:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012289199999999999 2024-09-12T22:05:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:39.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032531+0000", 2024-09-12T22:05:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035990639999999999 2024-09-12T22:05:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032584+0000", 2024-09-12T22:05:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3399999999999997e-05 2024-09-12T22:05:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032644+0000", 2024-09-12T22:05:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0019999999999998e-05 2024-09-12T22:05:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:39.236 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032733+0000", 2024-09-12T22:05:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9137999999999999e-05 2024-09-12T22:05:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:39.237 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:39.237 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:39.238 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:39.237+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:39.239 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:39.338 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:39.337+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:39.381 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:39.381 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:286942 5.7 5:e002217e:::benchmark_data_smithi043_32659_object119704:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:39.378569+0000", 2024-09-12T22:05:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001971169, 2024-09-12T22:05:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019866039999999999, 2024-09-12T22:05:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 286942 2024-09-12T22:05:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.378569+0000", 2024-09-12T22:05:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.378569+0000", 2024-09-12T22:05:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.378570+0000", 2024-09-12T22:05:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1030000000000001e-06 2024-09-12T22:05:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.378575+0000", 2024-09-12T22:05:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0660000000000003e-06 2024-09-12T22:05:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.378584+0000", 2024-09-12T22:05:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0529999999999996e-06 2024-09-12T22:05:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.378590+0000", 2024-09-12T22:05:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2330000000000003e-06 2024-09-12T22:05:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.378629+0000", 2024-09-12T22:05:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8665000000000003e-05 2024-09-12T22:05:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.378786+0000", 2024-09-12T22:05:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015763600000000001 2024-09-12T22:05:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.378909+0000", 2024-09-12T22:05:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012269399999999999 2024-09-12T22:05:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.380144+0000", 2024-09-12T22:05:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001234724 2024-09-12T22:05:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:286941 5.6 e63/57)", 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:39.380552+0000", 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999881, 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5943999999999998e-05, 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.380552+0000", 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.380552+0000", 2024-09-12T22:05:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.380552+0000", 2024-09-12T22:05:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1900000000000002e-07 2024-09-12T22:05:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.380557+0000", 2024-09-12T22:05:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3069999999999996e-06 2024-09-12T22:05:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.380564+0000", 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0210000000000002e-06 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.380569+0000", 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0889999999999999e-06 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:286931 5.7 5:e05c13e2:::benchmark_data_smithi043_32659_object119693:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:39.374570+0000", 2024-09-12T22:05:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0059699810000000001, 2024-09-12T22:05:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060682549999999998, 2024-09-12T22:05:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 286931 2024-09-12T22:05:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374570+0000", 2024-09-12T22:05:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374570+0000", 2024-09-12T22:05:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374571+0000", 2024-09-12T22:05:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0189999999999999e-06 2024-09-12T22:05:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374575+0000", 2024-09-12T22:05:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3270000000000002e-06 2024-09-12T22:05:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374584+0000", 2024-09-12T22:05:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3300000000000005e-06 2024-09-12T22:05:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374591+0000", 2024-09-12T22:05:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4999999999999996e-06 2024-09-12T22:05:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374928+0000", 2024-09-12T22:05:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033658499999999998 2024-09-12T22:05:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.375086+0000", 2024-09-12T22:05:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015828399999999999 2024-09-12T22:05:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.375191+0000", 2024-09-12T22:05:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010494500000000001 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.378218+0000", 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003027287 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:286932 5.c 5:3dc3a718:::benchmark_data_smithi043_32659_object119694:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:39.374614+0000", 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0059254479999999998, 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060648969999999996, 2024-09-12T22:05:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 286932 2024-09-12T22:05:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374614+0000", 2024-09-12T22:05:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374614+0000", 2024-09-12T22:05:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374615+0000", 2024-09-12T22:05:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7e-07 2024-09-12T22:05:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374617+0000", 2024-09-12T22:05:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.232e-06 2024-09-12T22:05:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374623+0000", 2024-09-12T22:05:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:05:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374629+0000", 2024-09-12T22:05:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5979999999999996e-06 2024-09-12T22:05:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374675+0000", 2024-09-12T22:05:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6811000000000003e-05 2024-09-12T22:05:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374815+0000", 2024-09-12T22:05:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013924 2024-09-12T22:05:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374896+0000", 2024-09-12T22:05:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1306999999999999e-05 2024-09-12T22:05:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.378244+0000", 2024-09-12T22:05:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003348349 2024-09-12T22:05:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:286933 5.3 5:c782ff08:::benchmark_data_smithi043_32659_object119695:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:39.374650+0000", 2024-09-12T22:05:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0058894139999999999, 2024-09-12T22:05:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060728830000000003, 2024-09-12T22:05:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 286933 2024-09-12T22:05:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374650+0000", 2024-09-12T22:05:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374650+0000", 2024-09-12T22:05:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374651+0000", 2024-09-12T22:05:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2799999999999996e-07 2024-09-12T22:05:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374653+0000", 2024-09-12T22:05:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4830000000000002e-06 2024-09-12T22:05:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374660+0000", 2024-09-12T22:05:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8759999999999999e-06 2024-09-12T22:05:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374666+0000", 2024-09-12T22:05:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.259e-06 2024-09-12T22:05:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374742+0000", 2024-09-12T22:05:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6728000000000001e-05 2024-09-12T22:05:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374828+0000", 2024-09-12T22:05:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5963000000000003e-05 2024-09-12T22:05:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374898+0000", 2024-09-12T22:05:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9803999999999998e-05 2024-09-12T22:05:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.376252+0000", 2024-09-12T22:05:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001353885 2024-09-12T22:05:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:286936 5.c 5:3749645b:::benchmark_data_smithi043_32659_object119698:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:39.374680+0000", 2024-09-12T22:05:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.005859703, 2024-09-12T22:05:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060831419999999997, 2024-09-12T22:05:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 286936 2024-09-12T22:05:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374680+0000", 2024-09-12T22:05:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374680+0000", 2024-09-12T22:05:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374681+0000", 2024-09-12T22:05:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8599999999999998e-07 2024-09-12T22:05:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374683+0000", 2024-09-12T22:05:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6680000000000001e-06 2024-09-12T22:05:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374690+0000", 2024-09-12T22:05:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7209999999999997e-06 2024-09-12T22:05:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374696+0000", 2024-09-12T22:05:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6250000000000004e-06 2024-09-12T22:05:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.376792+0000", 2024-09-12T22:05:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002096325 2024-09-12T22:05:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.376959+0000", 2024-09-12T22:05:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016662900000000001 2024-09-12T22:05:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.377051+0000", 2024-09-12T22:05:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2374999999999996e-05 2024-09-12T22:05:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.378542+0000", 2024-09-12T22:05:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001490714 2024-09-12T22:05:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:286937 5.7 5:ed51dcb2:::benchmark_data_smithi043_32659_object119699:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:39.374705+0000", 2024-09-12T22:05:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0058351260000000004, 2024-09-12T22:05:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060980440000000004, 2024-09-12T22:05:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 286937 2024-09-12T22:05:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374705+0000", 2024-09-12T22:05:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374705+0000", 2024-09-12T22:05:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374705+0000", 2024-09-12T22:05:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0200000000000002e-07 2024-09-12T22:05:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374707+0000", 2024-09-12T22:05:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0669999999999999e-06 2024-09-12T22:05:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374713+0000", 2024-09-12T22:05:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9039999999999997e-06 2024-09-12T22:05:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374718+0000", 2024-09-12T22:05:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0980000000000001e-06 2024-09-12T22:05:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.376925+0000", 2024-09-12T22:05:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002207025 2024-09-12T22:05:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.377029+0000", 2024-09-12T22:05:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010385799999999999 2024-09-12T22:05:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.377125+0000", 2024-09-12T22:05:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5796000000000002e-05 2024-09-12T22:05:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.378517+0000", 2024-09-12T22:05:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0013922800000000001 2024-09-12T22:05:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:286940 5.1 5:8517549c:::benchmark_data_smithi043_32659_object119702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T22:05:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:39.374925+0000", 2024-09-12T22:05:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0056151159999999999, 2024-09-12T22:05:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059203060000000002, 2024-09-12T22:05:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 286940 2024-09-12T22:05:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374925+0000", 2024-09-12T22:05:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374925+0000", 2024-09-12T22:05:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374925+0000", 2024-09-12T22:05:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:05:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374929+0000", 2024-09-12T22:05:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.551e-06 2024-09-12T22:05:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374937+0000", 2024-09-12T22:05:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0609999999999996e-06 2024-09-12T22:05:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374943+0000", 2024-09-12T22:05:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.241e-06 2024-09-12T22:05:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.374980+0000", 2024-09-12T22:05:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7219999999999999e-05 2024-09-12T22:05:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.375094+0000", 2024-09-12T22:05:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113582 2024-09-12T22:05:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.375165+0000", 2024-09-12T22:05:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0759999999999993e-05 2024-09-12T22:05:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:39.376495+0000", 2024-09-12T22:05:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0013306310000000001 2024-09-12T22:05:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 8 2024-09-12T22:05:39.419 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:39.420 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:39.461 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:39.460+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:39.541 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:39.539+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:39.602 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:39.602 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:39.603 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:39.603 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:39.603 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:39.613 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:39.642 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:39.641+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:39.743 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:39.742+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:39.801 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.388576287000006, 2024-09-12T22:05:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.388396357000005, 2024-09-12T22:05:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.388329916000004, 2024-09-12T22:05:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.388273472999998, 2024-09-12T22:05:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.388205013000004, 2024-09-12T22:05:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.388147278000005, 2024-09-12T22:05:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.388079586000003, 2024-09-12T22:05:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.388024524000002, 2024-09-12T22:05:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.347377003999995, 2024-09-12T22:05:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.344763275999995, 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:39.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:39.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:39.864 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.864 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.864 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.864 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:39.864 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:39.864 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.79954918, 2024-09-12T22:05:39.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:39.865 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.865 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.865 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.865 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.865 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.865 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.865 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:39.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.865 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:39.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:39.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:39.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:39.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:39.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:39.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:39.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:39.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:39.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:39.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:39.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:39.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:39.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:39.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:39.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:39.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:39.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:39.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:39.870 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.870 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.870 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.870 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:39.870 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:39.870 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.799070692000001, 2024-09-12T22:05:39.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:39.870 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.871 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.871 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.871 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:39.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.871 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:39.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:39.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:39.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:39.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:39.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:39.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:39.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:39.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:39.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:39.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:39.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:39.876 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.876 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.876 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.876 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:39.876 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:39.876 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.796575392000001, 2024-09-12T22:05:39.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:39.876 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.876 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.876 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:39.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:39.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:39.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:39.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:39.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:39.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:39.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:39.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:39.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:39.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:39.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:39.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:39.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:39.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:39.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:39.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:39.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:39.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.885 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.885 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.885 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:39.885 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:39.885 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.795494601000001, 2024-09-12T22:05:39.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:39.885 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.885 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.885 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:39.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:39.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:39.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:39.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:39.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:39.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:39.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:39.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:39.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:39.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:39.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:39.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:39.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:39.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:39.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:39.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:39.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:39.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:39.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:39.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:39.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:39.890 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.890 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.890 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.891 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:39.891 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:39.891 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.794259038999996, 2024-09-12T22:05:39.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:39.891 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.891 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.891 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.891 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:39.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.891 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:39.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:39.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:39.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:39.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:39.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:39.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:39.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:39.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:39.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:39.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:39.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:39.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:39.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:39.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:39.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:39.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:39.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:39.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.896 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.896 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.353518551000001, 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:39.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:39.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:39.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:39.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:39.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:39.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:39.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:39.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:39.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:39.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:39.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:39.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:39.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:39.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.901 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.902 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:39.902 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:39.902 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.348988124000002, 2024-09-12T22:05:39.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:39.902 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.902 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.902 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.902 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:39.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.902 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:39.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:39.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:39.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:39.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:39.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:39.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:39.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:39.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:39.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:39.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:39.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:39.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:39.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:39.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:39.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:39.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:39.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:39.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:39.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:39.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:39.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:39.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:39.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:39.907 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.907 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.907 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.907 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:39.907 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:39.908 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.348964094999999, 2024-09-12T22:05:39.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:39.908 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.908 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.908 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.908 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:39.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.908 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:39.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:39.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:39.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:39.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:39.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:39.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:39.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:39.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:39.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:39.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:39.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:39.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:39.913 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.913 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.913 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.913 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:39.913 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:39.913 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.348786445999998, 2024-09-12T22:05:39.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:39.913 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:39.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:39.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:39.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:39.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:39.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:39.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:39.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:39.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:39.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:39.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.346767909, 2024-09-12T22:05:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:39.925 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:39.926 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:39.925+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:39.927 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-09-12T22:05:40.026 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:40.025+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:40.089 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:40.089 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:40.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.089 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:288868 5.a 5:556251ba:::benchmark_data_smithi043_32659_object121630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T22:05:40.089 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.081634+0000", 2024-09-12T22:05:40.090 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002675504, 2024-09-12T22:05:40.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027023899999999998, 2024-09-12T22:05:40.090 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.090 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.090 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:40.090 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.090 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.090 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.090 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 288868 2024-09-12T22:05:40.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.090 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.081634+0000", 2024-09-12T22:05:40.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.081634+0000", 2024-09-12T22:05:40.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.081636+0000", 2024-09-12T22:05:40.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1340000000000001e-06 2024-09-12T22:05:40.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.081641+0000", 2024-09-12T22:05:40.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.091e-06 2024-09-12T22:05:40.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.081651+0000", 2024-09-12T22:05:40.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0351e-05 2024-09-12T22:05:40.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.081659+0000", 2024-09-12T22:05:40.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4659999999999999e-06 2024-09-12T22:05:40.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.081745+0000", 2024-09-12T22:05:40.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5782e-05 2024-09-12T22:05:40.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.081927+0000", 2024-09-12T22:05:40.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018156499999999999 2024-09-12T22:05:40.093 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.093 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.093 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.094 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:288873 5.b 5:d6aff46d:::benchmark_data_smithi043_32659_object121635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T22:05:40.094 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.082547+0000", 2024-09-12T22:05:40.094 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0017629810000000001, 2024-09-12T22:05:40.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001867044, 2024-09-12T22:05:40.094 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.094 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.094 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:40.094 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.094 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.094 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.094 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 288873 2024-09-12T22:05:40.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.094 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082547+0000", 2024-09-12T22:05:40.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082547+0000", 2024-09-12T22:05:40.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082548+0000", 2024-09-12T22:05:40.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6400000000000001e-07 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082552+0000", 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3250000000000001e-06 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082563+0000", 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0710000000000001e-05 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082570+0000", 2024-09-12T22:05:40.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4710000000000001e-06 2024-09-12T22:05:40.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082626+0000", 2024-09-12T22:05:40.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6008000000000003e-05 2024-09-12T22:05:40.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082779+0000", 2024-09-12T22:05:40.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000153103 2024-09-12T22:05:40.097 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.097 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.097 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.098 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:288870 5.7 e64/40 5:ea1d6dc0:::benchmark_data_smithi043_32659_object121632:head v 64'18157, mlcod=64'18155)", 2024-09-12T22:05:40.098 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.082596+0000", 2024-09-12T22:05:40.098 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001714204, 2024-09-12T22:05:40.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018784139999999999, 2024-09-12T22:05:40.098 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.098 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.098 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:40.098 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082596+0000", 2024-09-12T22:05:40.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082596+0000", 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082596+0000", 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0800000000000001e-07 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082600+0000", 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9720000000000003e-06 2024-09-12T22:05:40.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082608+0000", 2024-09-12T22:05:40.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5610000000000001e-06 2024-09-12T22:05:40.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082612+0000", 2024-09-12T22:05:40.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8509999999999998e-06 2024-09-12T22:05:40.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082651+0000", 2024-09-12T22:05:40.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8804999999999999e-05 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082669+0000", 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7655999999999998e-05 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:288876 5.e 5:76470439:::benchmark_data_smithi043_32659_object121638:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.082603+0000", 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0017068739999999999, 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001925747, 2024-09-12T22:05:40.101 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.102 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.102 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:40.102 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.102 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.102 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.102 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 288876 2024-09-12T22:05:40.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.102 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.102 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082603+0000", 2024-09-12T22:05:40.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082603+0000", 2024-09-12T22:05:40.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082604+0000", 2024-09-12T22:05:40.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:05:40.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082606+0000", 2024-09-12T22:05:40.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7209999999999999e-06 2024-09-12T22:05:40.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082613+0000", 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.204e-06 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082619+0000", 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4639999999999997e-06 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082677+0000", 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8499999999999999e-05 2024-09-12T22:05:40.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082841+0000", 2024-09-12T22:05:40.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016385299999999999 2024-09-12T22:05:40.105 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.105 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.105 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.105 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:288877 5.b 5:d6927ee3:::benchmark_data_smithi043_32659_object121639:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T22:05:40.105 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.082633+0000", 2024-09-12T22:05:40.105 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0016773929999999999, 2024-09-12T22:05:40.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019574380000000001, 2024-09-12T22:05:40.105 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 288877 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082633+0000", 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082633+0000", 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082633+0000", 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082635+0000", 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3599999999999999e-06 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082642+0000", 2024-09-12T22:05:40.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3890000000000002e-06 2024-09-12T22:05:40.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082648+0000", 2024-09-12T22:05:40.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9399999999999999e-06 2024-09-12T22:05:40.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084436+0000", 2024-09-12T22:05:40.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001788015 2024-09-12T22:05:40.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084574+0000", 2024-09-12T22:05:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013783 2024-09-12T22:05:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:288878 5.6 5:62bffa37:::benchmark_data_smithi043_32659_object121640:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T22:05:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.082655+0000", 2024-09-12T22:05:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0016551719999999999, 2024-09-12T22:05:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019950129999999999, 2024-09-12T22:05:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 288878 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082655+0000", 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082655+0000", 2024-09-12T22:05:40.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082655+0000", 2024-09-12T22:05:40.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4099999999999999e-07 2024-09-12T22:05:40.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082657+0000", 2024-09-12T22:05:40.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0439999999999998e-06 2024-09-12T22:05:40.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082664+0000", 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082668+0000", 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9540000000000003e-06 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.083406+0000", 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00073762199999999995 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.083572+0000", 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016543800000000001 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.083681+0000", 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010948800000000001 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:288879 5.e 5:770e5dcf:::benchmark_data_smithi043_32659_object121641:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.082675+0000", 2024-09-12T22:05:40.113 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0016349680000000001, 2024-09-12T22:05:40.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020425809999999999, 2024-09-12T22:05:40.114 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.114 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.114 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:40.114 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.114 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.114 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.114 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 288879 2024-09-12T22:05:40.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.114 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082675+0000", 2024-09-12T22:05:40.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082675+0000", 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082675+0000", 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8599999999999999e-07 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082677+0000", 2024-09-12T22:05:40.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9850000000000001e-06 2024-09-12T22:05:40.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082683+0000", 2024-09-12T22:05:40.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7610000000000004e-06 2024-09-12T22:05:40.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082688+0000", 2024-09-12T22:05:40.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7829999999999998e-06 2024-09-12T22:05:40.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084431+0000", 2024-09-12T22:05:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001743365 2024-09-12T22:05:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084591+0000", 2024-09-12T22:05:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000159667 2024-09-12T22:05:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:288880 5.9 5.f29f7289 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T22:05:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.082697+0000", 2024-09-12T22:05:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0016125429999999999, 2024-09-12T22:05:40.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020814409999999998, 2024-09-12T22:05:40.118 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.118 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.118 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:40.118 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.118 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.118 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.118 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 288880 2024-09-12T22:05:40.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.118 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.118 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082697+0000", 2024-09-12T22:05:40.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082697+0000", 2024-09-12T22:05:40.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082698+0000", 2024-09-12T22:05:40.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6599999999999996e-07 2024-09-12T22:05:40.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082701+0000", 2024-09-12T22:05:40.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5229999999999998e-06 2024-09-12T22:05:40.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.120 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082708+0000", 2024-09-12T22:05:40.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.007e-06 2024-09-12T22:05:40.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.120 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082714+0000", 2024-09-12T22:05:40.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4710000000000004e-06 2024-09-12T22:05:40.120 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.121 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.121 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.121 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:288881 5.6 5.dd31d7e6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T22:05:40.121 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.082727+0000", 2024-09-12T22:05:40.121 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0015826049999999999, 2024-09-12T22:05:40.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002106732, 2024-09-12T22:05:40.121 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.121 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.121 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:40.121 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.121 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.121 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.122 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 288881 2024-09-12T22:05:40.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.122 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082727+0000", 2024-09-12T22:05:40.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082727+0000", 2024-09-12T22:05:40.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082728+0000", 2024-09-12T22:05:40.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:40.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082730+0000", 2024-09-12T22:05:40.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1830000000000001e-06 2024-09-12T22:05:40.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082736+0000", 2024-09-12T22:05:40.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1809999999999998e-06 2024-09-12T22:05:40.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.124 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.124 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082741+0000", 2024-09-12T22:05:40.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.198e-06 2024-09-12T22:05:40.124 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.124 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.124 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.124 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.124 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:288882 5.f 5:fa66d16b:::benchmark_data_smithi043_32659_object121644:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T22:05:40.124 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.082754+0000", 2024-09-12T22:05:40.124 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001556214, 2024-09-12T22:05:40.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002137281, 2024-09-12T22:05:40.124 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.125 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.125 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:40.125 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.125 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.125 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.125 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 288882 2024-09-12T22:05:40.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.125 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082754+0000", 2024-09-12T22:05:40.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082754+0000", 2024-09-12T22:05:40.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082754+0000", 2024-09-12T22:05:40.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.46e-07 2024-09-12T22:05:40.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082757+0000", 2024-09-12T22:05:40.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3530000000000002e-06 2024-09-12T22:05:40.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082763+0000", 2024-09-12T22:05:40.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3110000000000002e-06 2024-09-12T22:05:40.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082768+0000", 2024-09-12T22:05:40.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.87e-06 2024-09-12T22:05:40.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082812+0000", 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4048000000000002e-05 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.083008+0000", 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000195964 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.083108+0000", 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000100009 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.129 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:288871 5.3 e64/40 5:c9e47343:::benchmark_data_smithi043_32659_object121633:head v 64'17951, mlcod=64'17949)", 2024-09-12T22:05:40.129 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.082960+0000", 2024-09-12T22:05:40.129 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001349631, 2024-09-12T22:05:40.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020004580000000001, 2024-09-12T22:05:40.129 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.129 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.129 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:40.129 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082960+0000", 2024-09-12T22:05:40.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082960+0000", 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082961+0000", 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5499999999999998e-07 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082966+0000", 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2669999999999997e-06 2024-09-12T22:05:40.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.131 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.131 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082974+0000", 2024-09-12T22:05:40.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7770000000000002e-06 2024-09-12T22:05:40.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.131 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.131 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082981+0000", 2024-09-12T22:05:40.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2509999999999997e-06 2024-09-12T22:05:40.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.131 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.131 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.083053+0000", 2024-09-12T22:05:40.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2028999999999998e-05 2024-09-12T22:05:40.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.132 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.083070+0000", 2024-09-12T22:05:40.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6697999999999998e-05 2024-09-12T22:05:40.132 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.132 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.132 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.132 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:288874 5.5 e64/40 5:a6d6eeb4:::benchmark_data_smithi043_32659_object121636:head v 64'18062, mlcod=64'18060)", 2024-09-12T22:05:40.132 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.082992+0000", 2024-09-12T22:05:40.132 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001317728, 2024-09-12T22:05:40.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002024578, 2024-09-12T22:05:40.133 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.133 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.133 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:40.133 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082992+0000", 2024-09-12T22:05:40.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082992+0000", 2024-09-12T22:05:40.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082992+0000", 2024-09-12T22:05:40.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5699999999999999e-07 2024-09-12T22:05:40.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.082996+0000", 2024-09-12T22:05:40.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.371e-06 2024-09-12T22:05:40.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.083001+0000", 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2490000000000001e-06 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.083005+0000", 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9040000000000002e-06 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.083061+0000", 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6107000000000003e-05 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.083077+0000", 2024-09-12T22:05:40.136 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6356999999999999e-05 2024-09-12T22:05:40.136 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.136 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.136 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.136 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:288884 5.b 5.398b18cb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T22:05:40.136 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.084315+0000", 2024-09-12T22:05:40.136 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9999948, 2024-09-12T22:05:40.136 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00075779600000000003, 2024-09-12T22:05:40.136 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.136 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.136 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 288884 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084315+0000", 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084315+0000", 2024-09-12T22:05:40.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.138 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084317+0000", 2024-09-12T22:05:40.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.189e-06 2024-09-12T22:05:40.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.138 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084322+0000", 2024-09-12T22:05:40.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3519999999999997e-06 2024-09-12T22:05:40.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.138 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084332+0000", 2024-09-12T22:05:40.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7589999999999992e-06 2024-09-12T22:05:40.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084339+0000", 2024-09-12T22:05:40.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1949999999999997e-06 2024-09-12T22:05:40.139 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.139 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.139 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.139 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:288883 5.c e64/40 5:3a8c8e72:::benchmark_data_smithi043_32659_object121645:head v 64'18037, mlcod=64'18035)", 2024-09-12T22:05:40.139 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.084580+0000", 2024-09-12T22:05:40.139 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9997306, 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00054781899999999995, 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084580+0000", 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084580+0000", 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084580+0000", 2024-09-12T22:05:40.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2600000000000001e-07 2024-09-12T22:05:40.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084586+0000", 2024-09-12T22:05:40.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.772e-06 2024-09-12T22:05:40.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084596+0000", 2024-09-12T22:05:40.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9750000000000002e-06 2024-09-12T22:05:40.142 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.142 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.142 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084613+0000", 2024-09-12T22:05:40.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6935999999999998e-05 2024-09-12T22:05:40.142 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.142 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.142 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084656+0000", 2024-09-12T22:05:40.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2522999999999999e-05 2024-09-12T22:05:40.142 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.142 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.142 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084674+0000", 2024-09-12T22:05:40.143 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:05:40.143 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.143 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.143 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.143 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.143 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:288872 5.3 e64/40 5:c51150b0:::benchmark_data_smithi043_32659_object121634:head v 64'17952, mlcod=64'17949)", 2024-09-12T22:05:40.143 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.084629+0000", 2024-09-12T22:05:40.143 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.999681, 2024-09-12T22:05:40.143 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00055557700000000002, 2024-09-12T22:05:40.143 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.143 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.143 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:40.143 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084629+0000", 2024-09-12T22:05:40.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084629+0000", 2024-09-12T22:05:40.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084629+0000", 2024-09-12T22:05:40.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:05:40.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084633+0000", 2024-09-12T22:05:40.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5410000000000001e-06 2024-09-12T22:05:40.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084638+0000", 2024-09-12T22:05:40.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6890000000000001e-06 2024-09-12T22:05:40.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084642+0000", 2024-09-12T22:05:40.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1439999999999996e-06 2024-09-12T22:05:40.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084962+0000", 2024-09-12T22:05:40.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000320002 2024-09-12T22:05:40.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084983+0000", 2024-09-12T22:05:40.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0944000000000001e-05 2024-09-12T22:05:40.146 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.146 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:288875 5.7 e64/40 5:ea111524:::benchmark_data_smithi043_32659_object121637:head v 64'18158, mlcod=64'18155)", 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:40.084651+0000", 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9996586, 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00059519300000000005, 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084651+0000", 2024-09-12T22:05:40.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.148 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.148 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084651+0000", 2024-09-12T22:05:40.148 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.148 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.148 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084651+0000", 2024-09-12T22:05:40.148 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.04e-07 2024-09-12T22:05:40.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.148 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.148 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084654+0000", 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.807e-06 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084660+0000", 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3519999999999997e-06 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084663+0000", 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7680000000000002e-06 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.149 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084833+0000", 2024-09-12T22:05:40.150 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016918799999999999 2024-09-12T22:05:40.150 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.150 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.150 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.150 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:40.084850+0000", 2024-09-12T22:05:40.150 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7342000000000001e-05 2024-09-12T22:05:40.150 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.150 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.150 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.150 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.150 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:40.150 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 16 2024-09-12T22:05:40.150 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:40.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~76s 2024-09-12T22:05:40.152 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:40.150+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:40.152 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:40.252 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:40.251+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:40.308 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:40.402 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:40.402 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:40.402 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:40.402 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:40.404 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:40.404 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:40.402+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:40.504 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:40.503+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:40.579 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:05:40.605 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:40.604+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:40.609 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:40.609 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:40.609 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:40.610 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:40.610 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.610 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:40.610 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:40.610 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 61.608265865999996, 2024-09-12T22:05:40.610 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:40.610 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.610 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.610 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.610 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.610 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.610 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.610 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:40.611 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.611 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.611 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.611 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.611 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:40.611 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.611 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.611 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.611 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.611 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:40.611 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.611 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.611 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.611 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.612 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:40.612 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:40.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.612 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:40.612 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:40.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.612 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:40.612 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:40.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.613 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.613 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.613 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:40.613 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:40.613 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.613 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.613 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.613 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:40.613 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:40.613 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.614 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.614 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.614 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:40.614 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:40.614 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.614 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.615 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.615 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:40.615 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:40.615 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.615 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.615 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.615 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:40.615 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:40.615 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.615 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.615 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.615 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:40.615 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:40.616 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.616 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.616 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.616 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.616 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.616 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:40.616 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:40.616 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 61.606446202999997, 2024-09-12T22:05:40.616 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:40.616 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.616 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.616 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.617 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.617 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.617 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.617 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:40.617 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.617 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.617 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.617 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.618 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:40.618 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.618 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.618 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:40.618 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.618 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.618 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:40.618 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:40.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.620 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.620 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:40.620 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:40.620 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.620 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.620 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:40.621 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:40.621 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.621 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.621 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.621 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:40.621 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:40.621 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.621 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.621 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.621 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:40.621 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:40.621 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.621 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.621 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.622 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:40.622 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:40.622 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.622 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.622 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.622 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.622 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.622 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:40.622 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:40.622 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 61.605912388999997, 2024-09-12T22:05:40.622 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:40.622 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.622 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.622 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.623 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.623 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.623 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.623 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:40.623 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.623 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.623 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.623 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.623 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:40.623 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.623 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.623 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.623 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.623 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:40.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:40.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:40.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:40.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:40.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.625 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:40.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:40.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.625 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.625 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:40.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:40.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.625 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.625 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:40.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:40.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:40.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:40.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.626 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:40.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:40.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.626 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:40.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:40.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.627 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.627 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:40.627 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:40.627 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.627 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.627 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.627 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.628 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:40.628 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:40.628 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 61.604097549999999, 2024-09-12T22:05:40.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:40.628 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.628 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.628 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.628 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.628 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.628 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.628 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:40.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.628 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.629 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.629 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:40.629 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.629 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.629 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.629 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.629 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:40.629 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.629 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.629 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.629 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.629 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:40.629 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:40.629 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:40.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:40.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:40.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:40.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:40.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:40.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:40.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:40.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:40.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:40.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:40.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:40.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:40.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:40.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:40.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:40.632 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.632 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.633 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.633 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.633 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.633 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.633 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:40.633 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.642003762000002, 2024-09-12T22:05:40.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:05:40.633 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.633 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.633 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.633 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.633 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.633 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.633 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:05:40.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.634 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:40.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:40.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:05:40.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:05:40.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:05:40.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:05:40.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.636 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:05:40.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:05:40.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.636 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:05:40.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:05:40.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.637 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:05:40.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:05:40.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:05:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:05:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:05:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:05:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:05:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:05:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:05:40.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:05:40.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:05:40.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:05:40.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:05:40.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:05:40.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:05:40.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.640 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:05:40.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:05:40.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.640 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:05:40.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:05:40.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.641 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:05:40.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:05:40.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.641 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:05:40.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:05:40.641 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.641 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.641 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.639971036999999, 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:40.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:40.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:40.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:05:40.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:05:40.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:05:40.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:05:40.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:05:40.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.645 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.645 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:05:40.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:05:40.645 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.645 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.645 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:05:40.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:05:40.645 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.645 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.645 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:05:40.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:05:40.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:05:40.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:05:40.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:05:40.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:05:40.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:05:40.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:05:40.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:05:40.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:05:40.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:05:40.648 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.648 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.648 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.648 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.648 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:40.648 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.636958773, 2024-09-12T22:05:40.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:05:40.649 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.649 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.649 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.649 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.649 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.649 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.649 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:05:40.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.649 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.649 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.650 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.650 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:40.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.650 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.650 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.650 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:40.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.650 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.650 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.650 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:05:40.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:05:40.650 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:05:40.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.652 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.652 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:05:40.652 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:05:40.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.652 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.652 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:05:40.652 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:05:40.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.652 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.652 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.653 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:05:40.654 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:05:40.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.654 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.654 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:05:40.654 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:05:40.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.654 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.654 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:05:40.654 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:05:40.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.654 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.655 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:05:40.655 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:05:40.655 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.655 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.655 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.655 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.655 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.655 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:40.655 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.635972283000001, 2024-09-12T22:05:40.655 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:05:40.655 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.656 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.656 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.656 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.656 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.656 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.656 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:05:40.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.656 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.656 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:40.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:40.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:05:40.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:40.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:05:40.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:05:40.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:05:40.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:05:40.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:40.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:05:40.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:05:40.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:05:40.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:05:40.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:05:40.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:05:40.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:05:40.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:05:40.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:05:40.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:05:40.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:05:40.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:05:40.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:05:40.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:05:40.662 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.662 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.662 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.662 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.662 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:40.663 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.630885649, 2024-09-12T22:05:40.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:05:40.663 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.663 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.663 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.663 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.663 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.663 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.663 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:05:40.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.663 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.663 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:40.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:40.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:05:40.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:05:40.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:05:40.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:05:40.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:05:40.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:05:40.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:05:40.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:05:40.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:05:40.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:05:40.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:05:40.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:05:40.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:05:40.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:05:40.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.667 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:05:40.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:05:40.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.667 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:05:40.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:05:40.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:05:40.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:05:40.669 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.669 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.669 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.669 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.669 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:40.669 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.628130677000001, 2024-09-12T22:05:40.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:05:40.669 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.669 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.669 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:05:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:40.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.671 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.671 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.671 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.671 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:05:40.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:05:40.671 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.671 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.671 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.671 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:05:40.672 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:05:40.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.672 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:05:40.672 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:05:40.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.672 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:05:40.672 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:05:40.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:05:40.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:05:40.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:05:40.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:05:40.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:05:40.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:05:40.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:05:40.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:05:40.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:05:40.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:05:40.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:05:40.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:05:40.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:05:40.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:05:40.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:05:40.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:05:40.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.676 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.676 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:05:40.676 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:05:40.676 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.676 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.676 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.676 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.676 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.676 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.676 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:40.676 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.620155791999998, 2024-09-12T22:05:40.676 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:05:40.676 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.676 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:40.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:05:40.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:05:40.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:05:40.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:05:40.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:05:40.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:05:40.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:05:40.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:05:40.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:05:40.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:05:40.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:05:40.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:05:40.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:05:40.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:05:40.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:05:40.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:05:40.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:05:40.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:05:40.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:05:40.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:05:40.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:05:40.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:05:40.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:05:40.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:05:40.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:05:40.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:05:40.682 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.682 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.683 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.683 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.683 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.683 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:40.683 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.612230016000002, 2024-09-12T22:05:40.683 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:05:40.683 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.683 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.683 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.683 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.683 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.683 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.683 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:05:40.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.684 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:40.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:40.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:05:40.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:05:40.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:05:40.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:05:40.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:05:40.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:05:40.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:05:40.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:05:40.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:05:40.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:05:40.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:05:40.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:40.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:05:40.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:05:40.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:05:40.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:05:40.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:05:40.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:05:40.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:05:40.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.689 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.689 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:05:40.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:05:40.689 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.689 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.689 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.689 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.689 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:40.689 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.610733734, 2024-09-12T22:05:40.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:40.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:05:40.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:40.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:05:40.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:05:40.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:05:40.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:05:40.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:05:40.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:40.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:05:40.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:05:40.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:05:40.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:05:40.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:05:40.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:05:40.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.696 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241896 5.6 5:6ef8d923:::benchmark_data_smithi043_32659_object74658:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.696 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:40.696 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.574540550000002, 2024-09-12T22:05:40.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99264745399999998, 2024-09-12T22:05:40.696 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.696 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.696 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.696 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.696 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.696 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.696 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241896 2024-09-12T22:05:40.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.696 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:40.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:40.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031744+0000", 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8100000000000001e-07 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031749+0000", 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.437e-06 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031757+0000", 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6999999999999997e-06 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031765+0000", 2024-09-12T22:05:40.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6709999999999999e-06 2024-09-12T22:05:40.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031809+0000", 2024-09-12T22:05:40.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3970000000000001e-05 2024-09-12T22:05:40.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031817+0000", 2024-09-12T22:05:40.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6580000000000002e-06 2024-09-12T22:05:40.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020952+0000", 2024-09-12T22:05:40.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.98913576299999995 2024-09-12T22:05:40.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021031+0000", 2024-09-12T22:05:40.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8483000000000001e-05 2024-09-12T22:05:40.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021091+0000", 2024-09-12T22:05:40.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0287000000000001e-05 2024-09-12T22:05:40.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024109+0000", 2024-09-12T22:05:40.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030178269999999998 2024-09-12T22:05:40.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024255+0000", 2024-09-12T22:05:40.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014615799999999999 2024-09-12T22:05:40.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024305+0000", 2024-09-12T22:05:40.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0259000000000001e-05 2024-09-12T22:05:40.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024391+0000", 2024-09-12T22:05:40.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:05:40.702 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.702 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.702 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.702 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241935 5.6 5:60e2bed8:::benchmark_data_smithi043_32659_object74697:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.702 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:40.702 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.555450924999999, 2024-09-12T22:05:40.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97487546999999997, 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241935 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:40.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050834+0000", 2024-09-12T22:05:40.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2500000000000004e-07 2024-09-12T22:05:40.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050838+0000", 2024-09-12T22:05:40.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7029999999999997e-06 2024-09-12T22:05:40.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050853+0000", 2024-09-12T22:05:40.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4545000000000001e-05 2024-09-12T22:05:40.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050859+0000", 2024-09-12T22:05:40.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:05:40.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050902+0000", 2024-09-12T22:05:40.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3455999999999999e-05 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050909+0000", 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6950000000000003e-06 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022045+0000", 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97113624700000001 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022168+0000", 2024-09-12T22:05:40.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012233 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022235+0000", 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7651000000000007e-05 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024398+0000", 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002163005 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025575+0000", 2024-09-12T22:05:40.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011767590000000001 2024-09-12T22:05:40.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025624+0000", 2024-09-12T22:05:40.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9217e-05 2024-09-12T22:05:40.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025708+0000", 2024-09-12T22:05:40.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4037999999999997e-05 2024-09-12T22:05:40.708 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.708 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.708 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241940 5.6 5:60be75db:::benchmark_data_smithi043_32659_object74702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.552378972, 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97334840700000003, 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241940 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.709 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:40.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:40.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:40.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4700000000000002e-07 2024-09-12T22:05:40.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053907+0000", 2024-09-12T22:05:40.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.796e-06 2024-09-12T22:05:40.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053912+0000", 2024-09-12T22:05:40.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.622e-06 2024-09-12T22:05:40.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053915+0000", 2024-09-12T22:05:40.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3009999999999998e-06 2024-09-12T22:05:40.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053952+0000", 2024-09-12T22:05:40.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6668000000000002e-05 2024-09-12T22:05:40.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053957+0000", 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5849999999999999e-06 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023005+0000", 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.96904800700000004 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023162+0000", 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015720900000000001 2024-09-12T22:05:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023284+0000", 2024-09-12T22:05:40.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012194200000000001 2024-09-12T22:05:40.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025765+0000", 2024-09-12T22:05:40.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024806099999999998 2024-09-12T22:05:40.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027176+0000", 2024-09-12T22:05:40.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014111180000000001 2024-09-12T22:05:40.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027204+0000", 2024-09-12T22:05:40.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7970000000000002e-05 2024-09-12T22:05:40.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027253+0000", 2024-09-12T22:05:40.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9231999999999999e-05 2024-09-12T22:05:40.715 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.715 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.715 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.716 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241966 5.6 5:6538f108:::benchmark_data_smithi043_32659_object74728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.716 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:40.716 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.534633323000001, 2024-09-12T22:05:40.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95692954799999996, 2024-09-12T22:05:40.716 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.716 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.716 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.716 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.716 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.716 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.716 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241966 2024-09-12T22:05:40.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.716 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071651+0000", 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:05:40.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071656+0000", 2024-09-12T22:05:40.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7929999999999997e-06 2024-09-12T22:05:40.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071669+0000", 2024-09-12T22:05:40.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2692e-05 2024-09-12T22:05:40.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071676+0000", 2024-09-12T22:05:40.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071716+0000", 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9817999999999997e-05 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071721+0000", 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.057e-06 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024429+0000", 2024-09-12T22:05:40.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95270825000000003 2024-09-12T22:05:40.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024544+0000", 2024-09-12T22:05:40.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114045 2024-09-12T22:05:40.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024655+0000", 2024-09-12T22:05:40.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111382 2024-09-12T22:05:40.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028489+0000", 2024-09-12T22:05:40.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038338930000000001 2024-09-12T22:05:40.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028497+0000", 2024-09-12T22:05:40.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7600000000000002e-06 2024-09-12T22:05:40.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028523+0000", 2024-09-12T22:05:40.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6268999999999999e-05 2024-09-12T22:05:40.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028580+0000", 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7179999999999998e-05 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241967 5.6 5:6c2d2d65:::benchmark_data_smithi043_32659_object74729:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.534585219, 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958333094, 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.723 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.723 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.723 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.723 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.723 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241967 2024-09-12T22:05:40.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.723 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:40.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:40.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:40.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:40.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071702+0000", 2024-09-12T22:05:40.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6929999999999999e-06 2024-09-12T22:05:40.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071709+0000", 2024-09-12T22:05:40.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2470000000000002e-06 2024-09-12T22:05:40.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071715+0000", 2024-09-12T22:05:40.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7370000000000003e-06 2024-09-12T22:05:40.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071737+0000", 2024-09-12T22:05:40.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1976000000000001e-05 2024-09-12T22:05:40.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071740+0000", 2024-09-12T22:05:40.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1760000000000002e-06 2024-09-12T22:05:40.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025813+0000", 2024-09-12T22:05:40.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95407325399999998 2024-09-12T22:05:40.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025956+0000", 2024-09-12T22:05:40.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014283699999999999 2024-09-12T22:05:40.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.026055+0000", 2024-09-12T22:05:40.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9088999999999999e-05 2024-09-12T22:05:40.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028628+0000", 2024-09-12T22:05:40.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025725209999999999 2024-09-12T22:05:40.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029901+0000", 2024-09-12T22:05:40.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012737720000000001 2024-09-12T22:05:40.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029954+0000", 2024-09-12T22:05:40.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2811e-05 2024-09-12T22:05:40.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030032+0000", 2024-09-12T22:05:40.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7401e-05 2024-09-12T22:05:40.729 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.729 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.729 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.729 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241968 5.6 5:63b7d78c:::benchmark_data_smithi043_32659_object74730:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.729 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:40.729 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.534559362, 2024-09-12T22:05:40.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958459332, 2024-09-12T22:05:40.729 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.729 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.729 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.730 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.730 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.730 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.730 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241968 2024-09-12T22:05:40.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.730 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:40.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:40.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071725+0000", 2024-09-12T22:05:40.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5600000000000001e-07 2024-09-12T22:05:40.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071727+0000", 2024-09-12T22:05:40.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.232e-06 2024-09-12T22:05:40.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071733+0000", 2024-09-12T22:05:40.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2750000000000001e-06 2024-09-12T22:05:40.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071738+0000", 2024-09-12T22:05:40.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9289999999999997e-06 2024-09-12T22:05:40.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071769+0000", 2024-09-12T22:05:40.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0746e-05 2024-09-12T22:05:40.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071774+0000", 2024-09-12T22:05:40.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8099999999999997e-06 2024-09-12T22:05:40.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027283+0000", 2024-09-12T22:05:40.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95550956399999998 2024-09-12T22:05:40.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027416+0000", 2024-09-12T22:05:40.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013268399999999999 2024-09-12T22:05:40.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027532+0000", 2024-09-12T22:05:40.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115807 2024-09-12T22:05:40.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030066+0000", 2024-09-12T22:05:40.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025343800000000001 2024-09-12T22:05:40.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030077+0000", 2024-09-12T22:05:40.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1260000000000001e-05 2024-09-12T22:05:40.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030116+0000", 2024-09-12T22:05:40.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8970999999999997e-05 2024-09-12T22:05:40.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.736 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030184+0000", 2024-09-12T22:05:40.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7317999999999995e-05 2024-09-12T22:05:40.736 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.736 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.736 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.736 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241974 5.6 5:6b9cdaf2:::benchmark_data_smithi043_32659_object74736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:40.736 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:40.737 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.521299714000001, 2024-09-12T22:05:40.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94774920900000004, 2024-09-12T22:05:40.737 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:40.737 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:40.737 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:40.737 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:40.737 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:40.737 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:40.737 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241974 2024-09-12T22:05:40.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.737 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:40.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:40.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084985+0000", 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4600000000000004e-07 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084989+0000", 2024-09-12T22:05:40.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9349999999999996e-06 2024-09-12T22:05:40.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:40.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084999+0000", 2024-09-12T22:05:40.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0043e-05 2024-09-12T22:05:40.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:40.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085004+0000", 2024-09-12T22:05:40.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1619999999999999e-06 2024-09-12T22:05:40.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085041+0000", 2024-09-12T22:05:40.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7469999999999999e-05 2024-09-12T22:05:40.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:40.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085048+0000", 2024-09-12T22:05:40.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:05:40.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:40.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028676+0000", 2024-09-12T22:05:40.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94362829599999998 2024-09-12T22:05:40.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:40.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028809+0000", 2024-09-12T22:05:40.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013285 2024-09-12T22:05:40.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:40.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028932+0000", 2024-09-12T22:05:40.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012289199999999999 2024-09-12T22:05:40.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:40.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032531+0000", 2024-09-12T22:05:40.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035990639999999999 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032584+0000", 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3399999999999997e-05 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032644+0000", 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0019999999999998e-05 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032733+0000", 2024-09-12T22:05:40.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9137999999999999e-05 2024-09-12T22:05:40.743 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.743 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.743 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.743 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:40.743 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:40.743 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:40.744 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:40.744 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:40.745 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:40.745 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:40.746 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:40.743+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:40.746 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:40.747 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:40.747 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:40.747 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:40.845 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:40.844+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:40.894 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:40.894 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:40.906 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:40.946 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:40.945+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:41.047 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:41.046+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:41.090 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:41.090 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:41.103 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:41.187 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:41.186+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:41.265 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:41.265 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:41.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:41.316 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:41.247+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:41.350 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:41.349+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:41.411 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:41.411 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:41.423 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:41.465 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:41.464+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:41.551 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:41.550+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:41.626 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:41.626 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:41.639 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:41.684 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:41.683+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:41.753 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:41.752+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:41.795 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:41.795 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:41.809 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:41.854 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:41.853+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:41.957 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:41.954+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:41.965 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:41.965 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:41.977 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:42.018 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:05:42.056 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:42.055+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:42.157 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:42.156+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:42.165 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:42.165 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:42.179 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:42.258 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:42.257+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:42.358 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:42.357+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:42.369 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:42.369 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:42.381 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:42.459 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:42.458+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:42.541 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:42.541 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:42.554 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:42.598 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:42.597+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:42.661 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:42.660+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:42.704 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:42.705 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:42.719 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:42.749 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:05:42.762 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:42.760+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:42.858 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:42.863 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:42.861+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:42.875 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:42.875 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:42.896 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:42.896 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:42.898 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:42.899 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:42.924 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:42.924 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:42.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:42.924 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:42.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.924 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:42.924 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:42.924 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 63.921821401999999, 2024-09-12T22:05:42.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:42.924 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:42.925 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:42.925 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:42.925 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:42.925 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:42.925 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:42.925 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:42.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.925 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:42.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:42.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:42.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:42.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:42.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:42.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:42.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:42.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:42.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:42.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:42.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:42.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:42.927 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:42.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:42.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:42.927 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:42.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.927 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:42.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:42.928 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.928 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.928 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:42.928 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:42.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:42.928 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.928 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.928 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:42.928 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:42.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:42.928 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.928 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.928 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:42.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:42.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:42.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:42.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:42.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:42.929 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.929 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:42.929 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.929 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:42.930 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:42.930 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 63.920001739, 2024-09-12T22:05:42.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:42.930 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:42.930 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:42.930 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:42.930 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:42.930 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:42.930 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:42.930 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:42.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.930 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:42.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.931 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:42.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:42.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:42.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.932 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:42.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:42.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:42.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.932 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:42.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:42.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:42.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:42.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.934 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:42.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:42.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:42.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.934 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:42.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:42.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:42.934 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.934 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:42.934 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 63.919467924999999, 2024-09-12T22:05:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:42.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:42.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:42.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:42.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:42.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:42.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:42.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:42.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:42.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:42.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:42.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:42.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:42.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:42.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:42.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:42.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.939 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:42.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:42.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:42.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.939 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:42.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:42.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:42.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:42.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:42.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:42.940 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.940 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:42.940 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.940 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:42.940 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:42.940 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 63.917653086000001, 2024-09-12T22:05:42.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:42.940 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:42.940 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:42.941 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:42.941 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:42.941 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:42.941 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:42.941 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:42.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.941 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:42.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:42.941 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:42.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:42.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:42.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:42.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:42.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:42.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:42.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:42.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:42.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:42.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:42.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:42.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:42.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:42.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:42.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:42.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:42.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:42.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:42.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:42.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:42.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:42.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:42.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:42.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:42.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:42.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:42.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:42.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:42.946 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.946 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:42.946 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.947 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:42.947 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:42.947 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.955559298000001, 2024-09-12T22:05:42.947 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:05:42.947 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:42.947 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:42.947 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:42.947 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:42.947 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:42.947 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:42.947 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:05:42.947 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.947 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:42.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.948 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:42.948 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:42.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.948 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:42.948 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:42.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.948 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:42.948 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:05:42.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:05:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:05:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:05:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:05:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:05:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:05:42.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:05:42.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:05:42.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:05:42.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:05:42.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:05:42.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:05:42.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:05:42.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:05:42.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:42.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:05:42.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:05:42.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:05:42.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:05:42.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:42.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:05:42.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:05:42.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:42.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:05:42.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:05:42.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:42.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:05:42.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:05:42.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:42.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:05:42.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:05:42.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:42.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:05:42.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:05:42.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:42.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:05:42.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:05:42.954 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.954 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:42.954 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.955 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:42.955 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:42.955 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.953526573000001, 2024-09-12T22:05:42.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:05:42.955 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:42.955 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:42.955 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:42.955 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:42.955 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:42.955 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:42.955 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:05:42.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.956 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:42.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:42.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:42.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:42.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:42.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:42.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:42.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:05:42.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:42.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:05:42.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:05:42.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:42.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:05:42.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:05:42.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:42.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:05:42.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:05:42.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:05:42.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:05:42.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:42.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:05:42.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:42.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:05:42.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:05:42.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:42.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:05:42.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:05:42.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:42.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:05:42.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:05:42.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:42.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:05:42.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:05:42.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:42.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:05:42.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:05:42.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:42.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:05:42.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:05:42.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:42.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:05:42.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:05:42.962 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.962 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.950514308999999, 2024-09-12T22:05:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:05:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:05:42.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.964 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:42.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:42.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:42.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:42.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:42.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:42.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:05:42.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:05:42.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:42.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:05:42.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:42.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:42.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:05:42.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:05:42.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:42.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:05:42.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:05:42.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:05:42.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:05:42.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:42.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:05:42.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:05:42.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:05:42.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:05:42.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:42.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:05:42.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:05:42.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:42.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:05:42.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:05:42.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:42.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:05:42.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:05:42.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:42.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:05:42.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:05:42.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:42.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:05:42.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:05:42.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:42.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:05:42.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:05:42.969 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.969 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:42.969 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.969 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:42.970 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:42.970 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.949527819, 2024-09-12T22:05:42.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:05:42.970 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:42.970 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:42.970 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:42.970 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:42.970 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:42.970 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:42.970 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:05:42.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.970 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:42.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:42.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:42.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:42.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:42.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:42.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:05:42.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:42.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:42.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:05:42.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:05:42.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:42.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:05:42.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:42.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:42.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:05:42.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:05:42.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:05:42.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:05:42.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:42.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:05:42.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:42.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:05:42.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:05:42.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:42.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:05:42.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:05:42.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:42.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:05:42.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:05:42.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:42.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:05:42.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:05:42.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:42.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:05:42.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:05:42.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:42.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:05:42.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:05:42.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:42.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:05:42.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:05:42.976 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.976 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:42.976 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.976 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:42.976 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:42.977 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.944441184999999, 2024-09-12T22:05:42.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:05:42.977 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:42.977 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:42.977 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:42.977 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:42.977 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:42.977 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:42.977 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:05:42.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.977 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:42.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:42.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:42.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:42.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:42.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:42.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:05:42.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:05:42.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:42.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:05:42.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:05:42.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:42.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:05:42.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:05:42.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:42.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:05:42.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:05:42.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:05:42.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:05:42.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:42.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:05:42.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:05:42.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:05:42.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:05:42.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:42.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:05:42.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:05:42.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:42.981 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:05:42.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:05:42.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.981 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:42.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:05:42.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:05:42.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:42.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:05:42.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:05:42.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:42.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:05:42.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:05:42.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:42.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:05:42.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:05:42.983 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.983 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:42.983 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.983 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:42.983 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:42.983 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.941686213000001, 2024-09-12T22:05:42.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:05:42.983 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:42.984 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:42.984 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:42.984 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:42.984 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:42.984 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:42.984 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:05:42.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.984 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:42.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:42.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:42.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:05:42.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:42.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:05:42.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:05:42.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:42.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:05:42.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:05:42.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:05:42.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:05:42.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:42.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:05:42.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:05:42.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:05:42.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:05:42.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:05:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:05:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:05:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:05:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:05:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:05:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:42.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:05:42.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:05:42.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:42.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:05:42.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:05:42.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:42.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:05:42.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:05:42.989 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.990 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:42.990 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.990 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:42.990 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:42.990 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.933711328000001, 2024-09-12T22:05:42.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:05:42.990 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:42.990 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:42.990 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:42.990 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:42.990 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:42.990 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:42.991 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:05:42.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.991 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:42.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:42.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:42.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:42.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:42.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:42.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:05:42.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:05:42.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:42.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:05:42.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:05:42.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:42.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:05:42.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:05:42.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:42.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:05:42.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:05:42.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:05:42.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:05:42.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:42.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:05:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:05:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:05:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:05:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:05:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:05:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:42.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:05:42.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:05:42.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:42.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:05:42.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:05:42.996 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.996 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:42.996 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:42.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.996 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:42.996 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:42.997 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.925785552000001, 2024-09-12T22:05:42.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:05:42.997 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:42.997 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:42.997 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:42.997 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:42.997 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:42.997 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:42.997 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:05:42.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.997 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:42.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:42.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:42.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:42.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:42.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:42.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:42.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:05:42.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:05:42.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:42.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:05:42.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:05:42.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:42.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:05:42.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:05:42.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:42.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:42.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:05:42.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:05:42.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:42.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:05:43.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:05:43.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:05:43.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:43.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:05:43.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:05:43.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:43.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:05:43.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:05:43.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:43.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:05:43.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:05:43.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:05:43.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:05:43.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:05:43.003 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.003 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.003 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.003 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:43.003 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:43.003 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.924289269999999, 2024-09-12T22:05:43.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:05:43.003 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.003 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.003 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.003 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.003 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.004 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.004 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:05:43.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.004 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:43.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:43.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:05:43.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:43.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:05:43.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:05:43.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:05:43.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:05:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:05:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:05:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:05:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:05:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:05:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:05:43.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:05:43.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:05:43.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:05:43.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:43.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:05:43.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:05:43.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:05:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:05:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:05:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241896 5.6 5:6ef8d923:::benchmark_data_smithi043_32659_object74658:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.888096086000001, 2024-09-12T22:05:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99264745399999998, 2024-09-12T22:05:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241896 2024-09-12T22:05:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:43.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:43.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031744+0000", 2024-09-12T22:05:43.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8100000000000001e-07 2024-09-12T22:05:43.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031749+0000", 2024-09-12T22:05:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.437e-06 2024-09-12T22:05:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031757+0000", 2024-09-12T22:05:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6999999999999997e-06 2024-09-12T22:05:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031765+0000", 2024-09-12T22:05:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6709999999999999e-06 2024-09-12T22:05:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031809+0000", 2024-09-12T22:05:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3970000000000001e-05 2024-09-12T22:05:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031817+0000", 2024-09-12T22:05:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6580000000000002e-06 2024-09-12T22:05:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020952+0000", 2024-09-12T22:05:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.98913576299999995 2024-09-12T22:05:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021031+0000", 2024-09-12T22:05:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8483000000000001e-05 2024-09-12T22:05:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021091+0000", 2024-09-12T22:05:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0287000000000001e-05 2024-09-12T22:05:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024109+0000", 2024-09-12T22:05:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030178269999999998 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024255+0000", 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014615799999999999 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024305+0000", 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0259000000000001e-05 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024391+0000", 2024-09-12T22:05:43.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:05:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241935 5.6 5:60e2bed8:::benchmark_data_smithi043_32659_object74697:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.869006461000001, 2024-09-12T22:05:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97487546999999997, 2024-09-12T22:05:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.016 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241935 2024-09-12T22:05:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050834+0000", 2024-09-12T22:05:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2500000000000004e-07 2024-09-12T22:05:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050838+0000", 2024-09-12T22:05:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7029999999999997e-06 2024-09-12T22:05:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050853+0000", 2024-09-12T22:05:43.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4545000000000001e-05 2024-09-12T22:05:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050859+0000", 2024-09-12T22:05:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:05:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050902+0000", 2024-09-12T22:05:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3455999999999999e-05 2024-09-12T22:05:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050909+0000", 2024-09-12T22:05:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6950000000000003e-06 2024-09-12T22:05:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022045+0000", 2024-09-12T22:05:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97113624700000001 2024-09-12T22:05:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022168+0000", 2024-09-12T22:05:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012233 2024-09-12T22:05:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022235+0000", 2024-09-12T22:05:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7651000000000007e-05 2024-09-12T22:05:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024398+0000", 2024-09-12T22:05:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002163005 2024-09-12T22:05:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025575+0000", 2024-09-12T22:05:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011767590000000001 2024-09-12T22:05:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025624+0000", 2024-09-12T22:05:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9217e-05 2024-09-12T22:05:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025708+0000", 2024-09-12T22:05:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4037999999999997e-05 2024-09-12T22:05:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.022 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241940 5.6 5:60be75db:::benchmark_data_smithi043_32659_object74702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.865934507999999, 2024-09-12T22:05:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97334840700000003, 2024-09-12T22:05:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241940 2024-09-12T22:05:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4700000000000002e-07 2024-09-12T22:05:43.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053907+0000", 2024-09-12T22:05:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.796e-06 2024-09-12T22:05:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053912+0000", 2024-09-12T22:05:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.622e-06 2024-09-12T22:05:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053915+0000", 2024-09-12T22:05:43.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3009999999999998e-06 2024-09-12T22:05:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053952+0000", 2024-09-12T22:05:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6668000000000002e-05 2024-09-12T22:05:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053957+0000", 2024-09-12T22:05:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5849999999999999e-06 2024-09-12T22:05:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023005+0000", 2024-09-12T22:05:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.96904800700000004 2024-09-12T22:05:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023162+0000", 2024-09-12T22:05:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015720900000000001 2024-09-12T22:05:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023284+0000", 2024-09-12T22:05:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012194200000000001 2024-09-12T22:05:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025765+0000", 2024-09-12T22:05:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024806099999999998 2024-09-12T22:05:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027176+0000", 2024-09-12T22:05:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014111180000000001 2024-09-12T22:05:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027204+0000", 2024-09-12T22:05:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7970000000000002e-05 2024-09-12T22:05:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027253+0000", 2024-09-12T22:05:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9231999999999999e-05 2024-09-12T22:05:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241966 5.6 5:6538f108:::benchmark_data_smithi043_32659_object74728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.848188859, 2024-09-12T22:05:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95692954799999996, 2024-09-12T22:05:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.029 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241966 2024-09-12T22:05:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071651+0000", 2024-09-12T22:05:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:05:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071656+0000", 2024-09-12T22:05:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7929999999999997e-06 2024-09-12T22:05:43.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071669+0000", 2024-09-12T22:05:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2692e-05 2024-09-12T22:05:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071676+0000", 2024-09-12T22:05:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:05:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071716+0000", 2024-09-12T22:05:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9817999999999997e-05 2024-09-12T22:05:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071721+0000", 2024-09-12T22:05:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.057e-06 2024-09-12T22:05:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024429+0000", 2024-09-12T22:05:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95270825000000003 2024-09-12T22:05:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024544+0000", 2024-09-12T22:05:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114045 2024-09-12T22:05:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024655+0000", 2024-09-12T22:05:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111382 2024-09-12T22:05:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028489+0000", 2024-09-12T22:05:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038338930000000001 2024-09-12T22:05:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028497+0000", 2024-09-12T22:05:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7600000000000002e-06 2024-09-12T22:05:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028523+0000", 2024-09-12T22:05:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6268999999999999e-05 2024-09-12T22:05:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028580+0000", 2024-09-12T22:05:43.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7179999999999998e-05 2024-09-12T22:05:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241967 5.6 5:6c2d2d65:::benchmark_data_smithi043_32659_object74729:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.848140754999999, 2024-09-12T22:05:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958333094, 2024-09-12T22:05:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.036 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241967 2024-09-12T22:05:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071702+0000", 2024-09-12T22:05:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6929999999999999e-06 2024-09-12T22:05:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071709+0000", 2024-09-12T22:05:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2470000000000002e-06 2024-09-12T22:05:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071715+0000", 2024-09-12T22:05:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7370000000000003e-06 2024-09-12T22:05:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071737+0000", 2024-09-12T22:05:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1976000000000001e-05 2024-09-12T22:05:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071740+0000", 2024-09-12T22:05:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1760000000000002e-06 2024-09-12T22:05:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025813+0000", 2024-09-12T22:05:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95407325399999998 2024-09-12T22:05:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025956+0000", 2024-09-12T22:05:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014283699999999999 2024-09-12T22:05:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.026055+0000", 2024-09-12T22:05:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9088999999999999e-05 2024-09-12T22:05:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028628+0000", 2024-09-12T22:05:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025725209999999999 2024-09-12T22:05:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029901+0000", 2024-09-12T22:05:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012737720000000001 2024-09-12T22:05:43.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029954+0000", 2024-09-12T22:05:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2811e-05 2024-09-12T22:05:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030032+0000", 2024-09-12T22:05:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7401e-05 2024-09-12T22:05:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241968 5.6 5:63b7d78c:::benchmark_data_smithi043_32659_object74730:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.848114897999999, 2024-09-12T22:05:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958459332, 2024-09-12T22:05:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241968 2024-09-12T22:05:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.043 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071725+0000", 2024-09-12T22:05:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5600000000000001e-07 2024-09-12T22:05:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071727+0000", 2024-09-12T22:05:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.232e-06 2024-09-12T22:05:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071733+0000", 2024-09-12T22:05:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2750000000000001e-06 2024-09-12T22:05:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071738+0000", 2024-09-12T22:05:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9289999999999997e-06 2024-09-12T22:05:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071769+0000", 2024-09-12T22:05:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0746e-05 2024-09-12T22:05:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071774+0000", 2024-09-12T22:05:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8099999999999997e-06 2024-09-12T22:05:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027283+0000", 2024-09-12T22:05:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95550956399999998 2024-09-12T22:05:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027416+0000", 2024-09-12T22:05:43.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013268399999999999 2024-09-12T22:05:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027532+0000", 2024-09-12T22:05:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115807 2024-09-12T22:05:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030066+0000", 2024-09-12T22:05:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025343800000000001 2024-09-12T22:05:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030077+0000", 2024-09-12T22:05:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1260000000000001e-05 2024-09-12T22:05:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030116+0000", 2024-09-12T22:05:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8970999999999997e-05 2024-09-12T22:05:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030184+0000", 2024-09-12T22:05:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7317999999999995e-05 2024-09-12T22:05:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.049 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241974 5.6 5:6b9cdaf2:::benchmark_data_smithi043_32659_object74736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.83485525, 2024-09-12T22:05:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94774920900000004, 2024-09-12T22:05:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.050 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241974 2024-09-12T22:05:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084985+0000", 2024-09-12T22:05:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4600000000000004e-07 2024-09-12T22:05:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084989+0000", 2024-09-12T22:05:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9349999999999996e-06 2024-09-12T22:05:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084999+0000", 2024-09-12T22:05:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0043e-05 2024-09-12T22:05:43.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085004+0000", 2024-09-12T22:05:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1619999999999999e-06 2024-09-12T22:05:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085041+0000", 2024-09-12T22:05:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7469999999999999e-05 2024-09-12T22:05:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085048+0000", 2024-09-12T22:05:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:05:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028676+0000", 2024-09-12T22:05:43.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94362829599999998 2024-09-12T22:05:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028809+0000", 2024-09-12T22:05:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013285 2024-09-12T22:05:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028932+0000", 2024-09-12T22:05:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012289199999999999 2024-09-12T22:05:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:43.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032531+0000", 2024-09-12T22:05:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035990639999999999 2024-09-12T22:05:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032584+0000", 2024-09-12T22:05:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3399999999999997e-05 2024-09-12T22:05:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032644+0000", 2024-09-12T22:05:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0019999999999998e-05 2024-09-12T22:05:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032733+0000", 2024-09-12T22:05:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9137999999999999e-05 2024-09-12T22:05:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.057 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.057 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:43.059 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-09-12T22:05:43.059 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:43.057+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:43.060 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:43.159 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:43.158+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:43.182 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-12T22:05:43.183 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:43.192 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:43.260 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:43.259+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:43.297 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:43.297 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:43.298 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:43.307 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:43.361 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:43.360+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:43.415 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.00217877, 2024-09-12T22:05:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.001998839999999, 2024-09-12T22:05:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.001932398999998, 2024-09-12T22:05:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.001875956000006, 2024-09-12T22:05:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.001807495999998, 2024-09-12T22:05:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.001749760999999, 2024-09-12T22:05:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.001682068999997, 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.001627006999996, 2024-09-12T22:05:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.960979487000003, 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.958365759000003, 2024-09-12T22:05:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.413151662999994, 2024-09-12T22:05:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:43.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:43.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:43.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:43.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.496 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:43.496 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:43.496 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.412673174999995, 2024-09-12T22:05:43.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:43.496 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.496 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.496 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.496 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.496 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.496 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.496 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:43.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.497 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:43.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:43.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:43.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:43.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:43.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:43.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:43.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:43.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:43.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:43.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:43.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:43.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:43.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:43.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:43.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:43.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:43.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:43.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:43.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:43.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:43.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:43.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:43.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:43.502 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.502 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.502 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.502 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:43.502 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:43.502 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.410177875000002, 2024-09-12T22:05:43.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:43.502 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.502 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.503 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.503 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.503 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.503 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.503 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:43.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.503 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:43.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:43.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:43.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:43.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:43.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:43.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:43.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:43.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:43.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:43.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:43.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:43.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:43.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:43.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:43.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:43.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:43.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:43.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.508 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.409097083999995, 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:43.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:43.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:43.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:43.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:43.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:43.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:43.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:43.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:43.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:43.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:43.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:43.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:43.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:43.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:43.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:43.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.407861522000005, 2024-09-12T22:05:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:43.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:43.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:43.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:43.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:43.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:43.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:43.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:43.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:43.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:43.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:43.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:43.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:43.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:43.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:43.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:43.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:43.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:43.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:43.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:43.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:43.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:43.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:43.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:43.521 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.521 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.522 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:43.522 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:43.522 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.967121034000002, 2024-09-12T22:05:43.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:43.522 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.522 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.522 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.522 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:43.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:43.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:43.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:43.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:43.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:43.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:43.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:43.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:43.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:43.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:43.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.962590607000003, 2024-09-12T22:05:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.528 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:43.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.528 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:43.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:43.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:43.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:43.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:43.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:43.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:43.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:43.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:43.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:43.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:43.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:43.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:43.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:43.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:43.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:43.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:43.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:43.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:43.533 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.533 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.533 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.533 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:43.533 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:43.533 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.962566578000001, 2024-09-12T22:05:43.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:43.533 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.533 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.533 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.534 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:43.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.534 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:43.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:43.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:43.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:43.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:43.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:43.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:43.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:43.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:43.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:43.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:43.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:43.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:43.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.962388928999999, 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.539 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.540 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.540 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:43.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.540 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:43.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:43.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:43.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:43.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:43.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:43.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:43.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:43.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:43.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:43.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:43.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:43.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:43.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:43.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:43.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:43.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:43.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:43.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:43.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:43.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:43.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:43.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:43.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:43.545 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.545 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.545 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.546 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:43.546 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:43.546 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.960370392000002, 2024-09-12T22:05:43.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:43.546 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:43.546 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:43.546 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:43.547 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:43.547 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:43.547 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.547 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:43.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.547 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:43.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:43.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:43.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:43.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:43.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:43.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:43.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:43.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:43.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:43.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:43.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:43.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:43.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:43.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:43.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:43.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:43.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:43.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:43.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:43.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:43.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:43.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:43.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:43.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:43.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:43.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:43.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:43.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:43.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:43.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:43.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:43.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:43.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:43.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:43.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:43.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:43.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:43.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:43.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:43.556 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.557 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.557 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.557 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:43.557 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:43.557 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:43.562 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:43.560+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:43.562 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:43.662 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:43.661+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:43.676 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:43.676 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:43.676 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.677 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296921 5.3 5.c6493f83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.677 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.084330+0000", 2024-09-12T22:05:43.677 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.59086911399999997, 2024-09-12T22:05:43.677 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.59088432899999999, 2024-09-12T22:05:43.677 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.677 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.677 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.677 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.677 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.677 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.677 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296921 2024-09-12T22:05:43.677 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.677 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084330+0000", 2024-09-12T22:05:43.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084330+0000", 2024-09-12T22:05:43.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084331+0000", 2024-09-12T22:05:43.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6499999999999999e-07 2024-09-12T22:05:43.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084333+0000", 2024-09-12T22:05:43.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5189999999999999e-06 2024-09-12T22:05:43.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084342+0000", 2024-09-12T22:05:43.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.132e-06 2024-09-12T22:05:43.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084348+0000", 2024-09-12T22:05:43.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:05:43.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084380+0000", 2024-09-12T22:05:43.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2166999999999999e-05 2024-09-12T22:05:43.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.683 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.683 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.683 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084385+0000", 2024-09-12T22:05:43.683 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2789999999999998e-06 2024-09-12T22:05:43.683 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.683 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.683 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.684 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296969 5.3 5.8d210223 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.684 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.136824+0000", 2024-09-12T22:05:43.684 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.53837546599999997, 2024-09-12T22:05:43.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.53842953699999996, 2024-09-12T22:05:43.684 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.685 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.685 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.685 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.685 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.685 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.685 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296969 2024-09-12T22:05:43.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.686 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.136824+0000", 2024-09-12T22:05:43.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.136824+0000", 2024-09-12T22:05:43.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.136825+0000", 2024-09-12T22:05:43.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6799999999999999e-07 2024-09-12T22:05:43.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.136828+0000", 2024-09-12T22:05:43.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.027e-06 2024-09-12T22:05:43.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.689 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.689 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.136834+0000", 2024-09-12T22:05:43.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5420000000000002e-06 2024-09-12T22:05:43.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.689 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.136839+0000", 2024-09-12T22:05:43.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6129999999999997e-06 2024-09-12T22:05:43.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.136876+0000", 2024-09-12T22:05:43.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6816999999999997e-05 2024-09-12T22:05:43.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.136881+0000", 2024-09-12T22:05:43.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:05:43.691 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.691 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.691 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.691 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296956 5.3 5.94167c63 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.691 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.123300+0000", 2024-09-12T22:05:43.691 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.551899688, 2024-09-12T22:05:43.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.55198635399999996, 2024-09-12T22:05:43.691 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.691 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.691 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.692 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.692 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.692 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.692 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296956 2024-09-12T22:05:43.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.692 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.123300+0000", 2024-09-12T22:05:43.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.123300+0000", 2024-09-12T22:05:43.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.123300+0000", 2024-09-12T22:05:43.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9599999999999999e-07 2024-09-12T22:05:43.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.123304+0000", 2024-09-12T22:05:43.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.002e-06 2024-09-12T22:05:43.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.123312+0000", 2024-09-12T22:05:43.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6410000000000002e-06 2024-09-12T22:05:43.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.123319+0000", 2024-09-12T22:05:43.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7560000000000002e-06 2024-09-12T22:05:43.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.123365+0000", 2024-09-12T22:05:43.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6733000000000001e-05 2024-09-12T22:05:43.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.123373+0000", 2024-09-12T22:05:43.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0559999999999999e-06 2024-09-12T22:05:43.696 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.696 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.696 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.696 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296741 5.3 5.2e430983 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.696 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:43.696 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.65834171399999997, 2024-09-12T22:05:43.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.65847825100000001, 2024-09-12T22:05:43.696 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.696 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.696 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.696 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.696 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.697 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.697 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296741 2024-09-12T22:05:43.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.697 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:43.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:43.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016859+0000", 2024-09-12T22:05:43.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5600000000000004e-07 2024-09-12T22:05:43.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016863+0000", 2024-09-12T22:05:43.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5510000000000001e-06 2024-09-12T22:05:43.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016873+0000", 2024-09-12T22:05:43.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5319999999999995e-06 2024-09-12T22:05:43.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016879+0000", 2024-09-12T22:05:43.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5100000000000004e-06 2024-09-12T22:05:43.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016934+0000", 2024-09-12T22:05:43.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4734999999999997e-05 2024-09-12T22:05:43.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016941+0000", 2024-09-12T22:05:43.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1319999999999996e-06 2024-09-12T22:05:43.700 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.700 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.700 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.700 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296971 5.3 5.37c2943 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.700 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.140691+0000", 2024-09-12T22:05:43.700 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.53450836000000002, 2024-09-12T22:05:43.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.53467834800000003, 2024-09-12T22:05:43.701 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.701 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.701 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.701 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.701 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.701 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.701 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296971 2024-09-12T22:05:43.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.701 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.140691+0000", 2024-09-12T22:05:43.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.140691+0000", 2024-09-12T22:05:43.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.140692+0000", 2024-09-12T22:05:43.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.61e-07 2024-09-12T22:05:43.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.140696+0000", 2024-09-12T22:05:43.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7969999999999998e-06 2024-09-12T22:05:43.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.140703+0000", 2024-09-12T22:05:43.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0539999999999997e-06 2024-09-12T22:05:43.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.140707+0000", 2024-09-12T22:05:43.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6330000000000004e-06 2024-09-12T22:05:43.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.140742+0000", 2024-09-12T22:05:43.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4544e-05 2024-09-12T22:05:43.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.140746+0000", 2024-09-12T22:05:43.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4880000000000001e-06 2024-09-12T22:05:43.704 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.704 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.704 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.705 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296793 5.3 5.216bdaa3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.705 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:43.705 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.63777944499999994, 2024-09-12T22:05:43.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.63798259899999998, 2024-09-12T22:05:43.705 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.705 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.705 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.705 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.705 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.706 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.706 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296793 2024-09-12T22:05:43.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.706 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:43.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:43.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037421+0000", 2024-09-12T22:05:43.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:05:43.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037425+0000", 2024-09-12T22:05:43.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9539999999999998e-06 2024-09-12T22:05:43.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037432+0000", 2024-09-12T22:05:43.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:05:43.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037436+0000", 2024-09-12T22:05:43.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4320000000000001e-06 2024-09-12T22:05:43.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037496+0000", 2024-09-12T22:05:43.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9385999999999997e-05 2024-09-12T22:05:43.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037503+0000", 2024-09-12T22:05:43.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:05:43.709 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.709 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.709 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.709 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296905 5.3 5.49782ba3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.710 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.076778+0000", 2024-09-12T22:05:43.710 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.59842089899999995, 2024-09-12T22:05:43.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.59865694000000003, 2024-09-12T22:05:43.710 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.710 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.710 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.710 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.710 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.710 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.710 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296905 2024-09-12T22:05:43.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.710 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076778+0000", 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076778+0000", 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076779+0000", 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3e-07 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076782+0000", 2024-09-12T22:05:43.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0790000000000001e-06 2024-09-12T22:05:43.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076790+0000", 2024-09-12T22:05:43.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0050000000000004e-06 2024-09-12T22:05:43.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.713 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.713 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076795+0000", 2024-09-12T22:05:43.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4139999999999996e-06 2024-09-12T22:05:43.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.713 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.713 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076838+0000", 2024-09-12T22:05:43.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591999999999999e-05 2024-09-12T22:05:43.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.713 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.713 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076844+0000", 2024-09-12T22:05:43.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:43.714 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.714 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.714 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.714 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296865 5.3 5.c6ee8703 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.714 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.060875+0000", 2024-09-12T22:05:43.714 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.614324219, 2024-09-12T22:05:43.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.614603703, 2024-09-12T22:05:43.714 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.714 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.714 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.714 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.714 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296865 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060875+0000", 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060875+0000", 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060876+0000", 2024-09-12T22:05:43.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6500000000000008e-07 2024-09-12T22:05:43.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060881+0000", 2024-09-12T22:05:43.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:05:43.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060892+0000", 2024-09-12T22:05:43.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1583000000000001e-05 2024-09-12T22:05:43.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060899+0000", 2024-09-12T22:05:43.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.742e-06 2024-09-12T22:05:43.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.061193+0000", 2024-09-12T22:05:43.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00029414099999999999 2024-09-12T22:05:43.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.061201+0000", 2024-09-12T22:05:43.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9200000000000004e-06 2024-09-12T22:05:43.718 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.718 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.718 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.718 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296926 5.3 5.19543113 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.718 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.087117+0000", 2024-09-12T22:05:43.718 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.58808206799999996, 2024-09-12T22:05:43.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.58839498199999996, 2024-09-12T22:05:43.718 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.718 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.718 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.718 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.719 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.719 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.719 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296926 2024-09-12T22:05:43.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.719 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.719 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087117+0000", 2024-09-12T22:05:43.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.719 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087117+0000", 2024-09-12T22:05:43.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087118+0000", 2024-09-12T22:05:43.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3200000000000004e-07 2024-09-12T22:05:43.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087122+0000", 2024-09-12T22:05:43.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:05:43.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087131+0000", 2024-09-12T22:05:43.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9020000000000005e-06 2024-09-12T22:05:43.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087138+0000", 2024-09-12T22:05:43.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.832e-06 2024-09-12T22:05:43.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087178+0000", 2024-09-12T22:05:43.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9727000000000001e-05 2024-09-12T22:05:43.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087183+0000", 2024-09-12T22:05:43.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9810000000000003e-06 2024-09-12T22:05:43.722 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.722 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.722 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.722 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296796 5.3 5.a4bb93d3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.722 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.63748181599999998, 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.63782916899999997, 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296796 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:43.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:43.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037719+0000", 2024-09-12T22:05:43.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1069999999999999e-06 2024-09-12T22:05:43.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037723+0000", 2024-09-12T22:05:43.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1400000000000002e-06 2024-09-12T22:05:43.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037734+0000", 2024-09-12T22:05:43.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0991e-05 2024-09-12T22:05:43.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037741+0000", 2024-09-12T22:05:43.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6059999999999997e-06 2024-09-12T22:05:43.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037790+0000", 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9112e-05 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037797+0000", 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296931 5.3 5.5dbb4bf3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.090332+0000", 2024-09-12T22:05:43.726 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.58486748200000005, 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.58524736499999996, 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296931 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.090332+0000", 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.090332+0000", 2024-09-12T22:05:43.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.090332+0000", 2024-09-12T22:05:43.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2099999999999997e-07 2024-09-12T22:05:43.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.090335+0000", 2024-09-12T22:05:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5900000000000002e-06 2024-09-12T22:05:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.090341+0000", 2024-09-12T22:05:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4420000000000003e-06 2024-09-12T22:05:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.090345+0000", 2024-09-12T22:05:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9949999999999999e-06 2024-09-12T22:05:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.090377+0000", 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1605e-05 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.090382+0000", 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6439999999999999e-06 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296774 5.3 5.f49c5793 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.64459609200000001, 2024-09-12T22:05:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.64500855400000001, 2024-09-12T22:05:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296774 2024-09-12T22:05:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:43.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:43.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030604+0000", 2024-09-12T22:05:43.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:05:43.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030607+0000", 2024-09-12T22:05:43.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0860000000000002e-06 2024-09-12T22:05:43.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030615+0000", 2024-09-12T22:05:43.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8120000000000008e-06 2024-09-12T22:05:43.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030620+0000", 2024-09-12T22:05:43.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6080000000000003e-06 2024-09-12T22:05:43.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030662+0000", 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1925999999999998e-05 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030670+0000", 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2359999999999998e-06 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296933 5.3 5.71a6a533 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.734 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.093089+0000", 2024-09-12T22:05:43.735 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.58210998899999999, 2024-09-12T22:05:43.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.582559771, 2024-09-12T22:05:43.735 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.735 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.735 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.735 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.735 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.735 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.735 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296933 2024-09-12T22:05:43.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.735 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.736 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.093089+0000", 2024-09-12T22:05:43.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.736 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.093089+0000", 2024-09-12T22:05:43.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.736 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.093090+0000", 2024-09-12T22:05:43.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:43.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.093094+0000", 2024-09-12T22:05:43.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8809999999999998e-06 2024-09-12T22:05:43.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.093105+0000", 2024-09-12T22:05:43.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0614e-05 2024-09-12T22:05:43.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.093112+0000", 2024-09-12T22:05:43.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6490000000000008e-06 2024-09-12T22:05:43.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.093147+0000", 2024-09-12T22:05:43.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5086999999999998e-05 2024-09-12T22:05:43.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.093153+0000", 2024-09-12T22:05:43.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9440000000000002e-06 2024-09-12T22:05:43.738 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.739 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.739 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.739 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296917 5.3 5.a1220643 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.739 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:43.739 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.59445883099999997, 2024-09-12T22:05:43.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.59494136399999997, 2024-09-12T22:05:43.739 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.739 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.739 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.739 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.739 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.739 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296917 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:43.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7000000000000004e-07 2024-09-12T22:05:43.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080744+0000", 2024-09-12T22:05:43.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2320000000000001e-06 2024-09-12T22:05:43.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080752+0000", 2024-09-12T22:05:43.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2980000000000003e-06 2024-09-12T22:05:43.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080758+0000", 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080802+0000", 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4607000000000002e-05 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080811+0000", 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9020000000000005e-06 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.742 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.743 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.743 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296918 5.3 5.b01617c3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.743 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.081205+0000", 2024-09-12T22:05:43.743 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.59399432299999999, 2024-09-12T22:05:43.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.59451377599999999, 2024-09-12T22:05:43.743 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.743 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.743 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.743 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.743 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.743 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.743 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296918 2024-09-12T22:05:43.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.744 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081205+0000", 2024-09-12T22:05:43.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081205+0000", 2024-09-12T22:05:43.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081206+0000", 2024-09-12T22:05:43.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5899999999999995e-07 2024-09-12T22:05:43.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081210+0000", 2024-09-12T22:05:43.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0169999999999998e-06 2024-09-12T22:05:43.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081220+0000", 2024-09-12T22:05:43.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0573e-05 2024-09-12T22:05:43.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081229+0000", 2024-09-12T22:05:43.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8270000000000004e-06 2024-09-12T22:05:43.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081274+0000", 2024-09-12T22:05:43.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5102999999999998e-05 2024-09-12T22:05:43.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081282+0000", 2024-09-12T22:05:43.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3159999999999999e-06 2024-09-12T22:05:43.748 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.748 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.748 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.748 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296897 5.3 5.8553f9c3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:43.748 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:43.748 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.60128864900000001, 2024-09-12T22:05:43.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.60184084199999999, 2024-09-12T22:05:43.748 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:43.748 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296897 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:43.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:43.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:43.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:43.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:43.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:05:43.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:43.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073913+0000", 2024-09-12T22:05:43.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8789999999999999e-06 2024-09-12T22:05:43.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:43.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073918+0000", 2024-09-12T22:05:43.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:05:43.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:43.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073923+0000", 2024-09-12T22:05:43.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8450000000000002e-06 2024-09-12T22:05:43.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:43.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073989+0000", 2024-09-12T22:05:43.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5610000000000004e-05 2024-09-12T22:05:43.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:43.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:43.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:43.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073997+0000", 2024-09-12T22:05:43.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0830000000000004e-06 2024-09-12T22:05:43.752 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.752 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:43.752 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.752 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:43.752 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:43.752 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 16 2024-09-12T22:05:43.752 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:43.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:43.797 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:43.796+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:43.863 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:43.862+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:43.864 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:43.864 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:43.864 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:43.864 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:43.864 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:43.874 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:43.964 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:43.964+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:44.029 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128879 5.b 5:d562d8e2:::benchmark_data_smithi043_32659_object128878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 65.028726453999994, 2024-09-12T22:05:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.10100495700000001, 2024-09-12T22:05:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128879 2024-09-12T22:05:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.031 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:44.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998018+0000", 2024-09-12T22:05:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998019+0000", 2024-09-12T22:05:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:05:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998113+0000", 2024-09-12T22:05:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3768000000000001e-05 2024-09-12T22:05:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998123+0000", 2024-09-12T22:05:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0029e-05 2024-09-12T22:05:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.998129+0000", 2024-09-12T22:05:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.849e-06 2024-09-12T22:05:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999345+0000", 2024-09-12T22:05:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012150850000000001 2024-09-12T22:05:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999430+0000", 2024-09-12T22:05:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5876000000000002e-05 2024-09-12T22:05:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098824+0000", 2024-09-12T22:05:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099393741999999993 2024-09-12T22:05:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.098917+0000", 2024-09-12T22:05:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2769999999999994e-05 2024-09-12T22:05:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099023+0000", 2024-09-12T22:05:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105939 2024-09-12T22:05:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128880 5.0 5:03c1fbf4:::benchmark_data_smithi043_32659_object128879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 65.026906791000002, 2024-09-12T22:05:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.099302011999999995, 2024-09-12T22:05:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128880 2024-09-12T22:05:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999838+0000", 2024-09-12T22:05:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999839+0000", 2024-09-12T22:05:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:05:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999973+0000", 2024-09-12T22:05:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000133764 2024-09-12T22:05:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999983+0000", 2024-09-12T22:05:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0518e-05 2024-09-12T22:05:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:38.999990+0000", 2024-09-12T22:05:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8630000000000002e-06 2024-09-12T22:05:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000126+0000", 2024-09-12T22:05:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000135847 2024-09-12T22:05:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.001250+0000", 2024-09-12T22:05:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011238470000000001 2024-09-12T22:05:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099001+0000", 2024-09-12T22:05:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.097750823000000001 2024-09-12T22:05:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099060+0000", 2024-09-12T22:05:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9750999999999998e-05 2024-09-12T22:05:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.099140+0000", 2024-09-12T22:05:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9278999999999998e-05 2024-09-12T22:05:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128884 5.0 5:040fe6db:::benchmark_data_smithi043_32659_object128883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 65.026372976999994, 2024-09-12T22:05:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.104107771, 2024-09-12T22:05:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128884 2024-09-12T22:05:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000371+0000", 2024-09-12T22:05:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000372+0000", 2024-09-12T22:05:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000450+0000", 2024-09-12T22:05:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8262000000000004e-05 2024-09-12T22:05:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000459+0000", 2024-09-12T22:05:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-06 2024-09-12T22:05:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.000465+0000", 2024-09-12T22:05:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7950000000000004e-06 2024-09-12T22:05:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003145+0000", 2024-09-12T22:05:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026804670000000002 2024-09-12T22:05:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003284+0000", 2024-09-12T22:05:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013927300000000001 2024-09-12T22:05:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104331+0000", 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.101046499 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104389+0000", 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7742999999999999e-05 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.104479+0000", 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0476000000000006e-05 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:128888 5.e 5:79a796ca:::benchmark_data_smithi043_32659_object128887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 65.024558138000003, 2024-09-12T22:05:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.100357289, 2024-09-12T22:05:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 128888 2024-09-12T22:05:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002186+0000", 2024-09-12T22:05:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002187+0000", 2024-09-12T22:05:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:05:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002225+0000", 2024-09-12T22:05:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8176000000000002e-05 2024-09-12T22:05:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002235+0000", 2024-09-12T22:05:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7620000000000007e-06 2024-09-12T22:05:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.002241+0000", 2024-09-12T22:05:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2890000000000003e-06 2024-09-12T22:05:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003407+0000", 2024-09-12T22:05:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001165719 2024-09-12T22:05:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.003522+0000", 2024-09-12T22:05:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011490800000000001 2024-09-12T22:05:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102407+0000", 2024-09-12T22:05:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.098885032999999997 2024-09-12T22:05:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102487+0000", 2024-09-12T22:05:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0135000000000004e-05 2024-09-12T22:05:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:04:39.102544+0000", 2024-09-12T22:05:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6495e-05 2024-09-12T22:05:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.062464349999999, 2024-09-12T22:05:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:05:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:05:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:05:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:05:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:05:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:05:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:05:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:05:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:05:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:05:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:05:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:05:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:05:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:05:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:05:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:05:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:05:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:05:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:05:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:05:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:05:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:05:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:05:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:05:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:05:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:05:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:05:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:05:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:05:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:05:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:05:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:05:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:05:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.060431625, 2024-09-12T22:05:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:05:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:05:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:05:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:05:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:05:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:05:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:05:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:05:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:05:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:05:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:05:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:05:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:05:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:05:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:05:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:05:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:05:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:05:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:05:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:05:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:05:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:05:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:05:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:05:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:05:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.057419361000001, 2024-09-12T22:05:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:05:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:05:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:05:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:05:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:05:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:05:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:05:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:05:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:05:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:05:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:05:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:05:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:05:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:05:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:05:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:05:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:05:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:05:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:05:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:05:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:05:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:05:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:05:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:05:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:05:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:05:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:05:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.056432870999998, 2024-09-12T22:05:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:05:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:05:44.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.082 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:44.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:44.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:05:44.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:44.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:05:44.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:05:44.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:05:44.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:44.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:05:44.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:05:44.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:05:44.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:05:44.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:05:44.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:44.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:05:44.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:05:44.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:05:44.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:05:44.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:05:44.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:05:44.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:05:44.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:05:44.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:05:44.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:05:44.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:05:44.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:05:44.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:05:44.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:05:44.089 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.089 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.089 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.089 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.051346237000001, 2024-09-12T22:05:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:05:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:05:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:44.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:44.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:05:44.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:05:44.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:05:44.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:05:44.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:05:44.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:05:44.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:05:44.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:05:44.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:05:44.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:05:44.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:05:44.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:05:44.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:05:44.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:05:44.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:05:44.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:05:44.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:05:44.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:05:44.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:05:44.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:05:44.096 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.097 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.097 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.097 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.097 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:44.097 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.048591264999999, 2024-09-12T22:05:44.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:05:44.097 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.097 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.097 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.097 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.098 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.098 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.098 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:05:44.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.098 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:44.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:44.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:05:44.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:05:44.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:05:44.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:05:44.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:05:44.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:05:44.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:05:44.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:05:44.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:05:44.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:05:44.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:05:44.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:05:44.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:05:44.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:05:44.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.102 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:05:44.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:05:44.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:05:44.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:05:44.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:05:44.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:05:44.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:05:44.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:05:44.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:05:44.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:05:44.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:05:44.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:05:44.106 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.106 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.107 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.107 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.107 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:44.107 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.040616379999999, 2024-09-12T22:05:44.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:05:44.107 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.108 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.108 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.108 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.108 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.108 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.108 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:05:44.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.109 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:44.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:44.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:05:44.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:05:44.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:05:44.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:05:44.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:05:44.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:05:44.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:05:44.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:05:44.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:05:44.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:05:44.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:05:44.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:05:44.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:05:44.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:05:44.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:05:44.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:05:44.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:05:44.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:05:44.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:05:44.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:05:44.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:05:44.116 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.116 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.116 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.116 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.117 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:44.117 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.032690603999999, 2024-09-12T22:05:44.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:05:44.117 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.117 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.117 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.117 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.117 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.117 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.117 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:05:44.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.117 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.118 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:44.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.118 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:44.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.118 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:05:44.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:05:44.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.120 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:05:44.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:05:44.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.120 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:05:44.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:44.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:05:44.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:05:44.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:05:44.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:05:44.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:05:44.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:05:44.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:05:44.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:05:44.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:05:44.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:05:44.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:05:44.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:05:44.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:05:44.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:05:44.123 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.123 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.123 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.124 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.124 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.124 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:44.124 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.031194322000001, 2024-09-12T22:05:44.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:05:44.124 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.124 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.124 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.124 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.124 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.124 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.125 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:05:44.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.125 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:44.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:44.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:05:44.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:44.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:05:44.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:05:44.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:05:44.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:05:44.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:05:44.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:44.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:05:44.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:05:44.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:05:44.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:05:44.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:05:44.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:05:44.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:05:44.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:05:44.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:05:44.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:05:44.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:05:44.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:05:44.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:05:44.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:05:44.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:05:44.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:44.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:05:44.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:05:44.131 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.131 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.131 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.131 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241896 5.6 5:6ef8d923:::benchmark_data_smithi043_32659_object74658:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.131 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:44.131 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.995001137999999, 2024-09-12T22:05:44.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99264745399999998, 2024-09-12T22:05:44.131 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.131 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.131 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.132 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.132 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.132 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.132 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241896 2024-09-12T22:05:44.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.132 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.132 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:44.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031743+0000", 2024-09-12T22:05:44.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031744+0000", 2024-09-12T22:05:44.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8100000000000001e-07 2024-09-12T22:05:44.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031749+0000", 2024-09-12T22:05:44.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.437e-06 2024-09-12T22:05:44.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031757+0000", 2024-09-12T22:05:44.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6999999999999997e-06 2024-09-12T22:05:44.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031765+0000", 2024-09-12T22:05:44.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6709999999999999e-06 2024-09-12T22:05:44.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031809+0000", 2024-09-12T22:05:44.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3970000000000001e-05 2024-09-12T22:05:44.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.031817+0000", 2024-09-12T22:05:44.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6580000000000002e-06 2024-09-12T22:05:44.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.136 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.136 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020952+0000", 2024-09-12T22:05:44.136 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.98913576299999995 2024-09-12T22:05:44.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.136 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.136 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021031+0000", 2024-09-12T22:05:44.136 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8483000000000001e-05 2024-09-12T22:05:44.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.136 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.136 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021091+0000", 2024-09-12T22:05:44.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0287000000000001e-05 2024-09-12T22:05:44.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024109+0000", 2024-09-12T22:05:44.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030178269999999998 2024-09-12T22:05:44.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024255+0000", 2024-09-12T22:05:44.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014615799999999999 2024-09-12T22:05:44.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.138 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024305+0000", 2024-09-12T22:05:44.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0259000000000001e-05 2024-09-12T22:05:44.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.138 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024391+0000", 2024-09-12T22:05:44.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:05:44.138 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.138 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.138 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.139 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241935 5.6 5:60e2bed8:::benchmark_data_smithi043_32659_object74697:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.139 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:44.139 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.975911513, 2024-09-12T22:05:44.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97487546999999997, 2024-09-12T22:05:44.139 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.139 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.139 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.139 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.139 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.139 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.140 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241935 2024-09-12T22:05:44.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.140 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.140 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:44.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050833+0000", 2024-09-12T22:05:44.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050834+0000", 2024-09-12T22:05:44.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2500000000000004e-07 2024-09-12T22:05:44.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.142 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050838+0000", 2024-09-12T22:05:44.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7029999999999997e-06 2024-09-12T22:05:44.142 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.142 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.142 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050853+0000", 2024-09-12T22:05:44.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4545000000000001e-05 2024-09-12T22:05:44.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.143 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.143 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.143 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050859+0000", 2024-09-12T22:05:44.143 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:05:44.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.143 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.143 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050902+0000", 2024-09-12T22:05:44.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3455999999999999e-05 2024-09-12T22:05:44.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.050909+0000", 2024-09-12T22:05:44.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6950000000000003e-06 2024-09-12T22:05:44.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022045+0000", 2024-09-12T22:05:44.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97113624700000001 2024-09-12T22:05:44.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022168+0000", 2024-09-12T22:05:44.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012233 2024-09-12T22:05:44.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022235+0000", 2024-09-12T22:05:44.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7651000000000007e-05 2024-09-12T22:05:44.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024398+0000", 2024-09-12T22:05:44.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002163005 2024-09-12T22:05:44.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025575+0000", 2024-09-12T22:05:44.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011767590000000001 2024-09-12T22:05:44.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025624+0000", 2024-09-12T22:05:44.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9217e-05 2024-09-12T22:05:44.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025708+0000", 2024-09-12T22:05:44.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4037999999999997e-05 2024-09-12T22:05:44.147 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.148 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.148 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.148 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241940 5.6 5:60be75db:::benchmark_data_smithi043_32659_object74702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.148 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:44.148 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.972839560000001, 2024-09-12T22:05:44.148 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.97334840700000003, 2024-09-12T22:05:44.148 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.148 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.148 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.148 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.149 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.149 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.149 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241940 2024-09-12T22:05:44.149 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.149 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.149 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.149 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.149 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:44.149 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.149 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.149 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.149 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.149 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:44.149 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.150 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.150 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.150 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.150 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053905+0000", 2024-09-12T22:05:44.150 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4700000000000002e-07 2024-09-12T22:05:44.150 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.150 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.150 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.150 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053907+0000", 2024-09-12T22:05:44.150 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.796e-06 2024-09-12T22:05:44.150 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.150 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.150 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.150 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053912+0000", 2024-09-12T22:05:44.151 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.622e-06 2024-09-12T22:05:44.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.151 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.151 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.151 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053915+0000", 2024-09-12T22:05:44.151 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3009999999999998e-06 2024-09-12T22:05:44.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.151 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.151 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.151 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053952+0000", 2024-09-12T22:05:44.151 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6668000000000002e-05 2024-09-12T22:05:44.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.152 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.152 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.152 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.053957+0000", 2024-09-12T22:05:44.152 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5849999999999999e-06 2024-09-12T22:05:44.152 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.152 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.152 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.152 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023005+0000", 2024-09-12T22:05:44.152 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.96904800700000004 2024-09-12T22:05:44.152 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.152 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.152 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023162+0000", 2024-09-12T22:05:44.153 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015720900000000001 2024-09-12T22:05:44.153 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.153 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.153 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.023284+0000", 2024-09-12T22:05:44.153 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012194200000000001 2024-09-12T22:05:44.153 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.153 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.153 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025765+0000", 2024-09-12T22:05:44.153 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024806099999999998 2024-09-12T22:05:44.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.154 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.154 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.154 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027176+0000", 2024-09-12T22:05:44.154 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014111180000000001 2024-09-12T22:05:44.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.155 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.155 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.155 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027204+0000", 2024-09-12T22:05:44.155 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7970000000000002e-05 2024-09-12T22:05:44.155 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.156 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.156 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.156 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027253+0000", 2024-09-12T22:05:44.156 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9231999999999999e-05 2024-09-12T22:05:44.156 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.156 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.156 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.157 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.157 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.157 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241966 5.6 5:6538f108:::benchmark_data_smithi043_32659_object74728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.157 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:44.157 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.955093910999999, 2024-09-12T22:05:44.157 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95692954799999996, 2024-09-12T22:05:44.157 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.157 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.157 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.157 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.157 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.158 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.158 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241966 2024-09-12T22:05:44.158 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.158 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.158 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.158 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.158 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:44.159 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.159 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.159 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.159 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071650+0000", 2024-09-12T22:05:44.159 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.159 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.159 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.159 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071651+0000", 2024-09-12T22:05:44.160 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:05:44.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.160 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.160 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.160 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071656+0000", 2024-09-12T22:05:44.160 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7929999999999997e-06 2024-09-12T22:05:44.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.160 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.160 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.160 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071669+0000", 2024-09-12T22:05:44.161 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2692e-05 2024-09-12T22:05:44.161 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.161 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.161 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.161 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071676+0000", 2024-09-12T22:05:44.161 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4800000000000004e-06 2024-09-12T22:05:44.161 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.162 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.162 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.162 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071716+0000", 2024-09-12T22:05:44.162 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9817999999999997e-05 2024-09-12T22:05:44.162 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.162 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.162 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.163 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071721+0000", 2024-09-12T22:05:44.163 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.057e-06 2024-09-12T22:05:44.163 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.163 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.163 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.163 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024429+0000", 2024-09-12T22:05:44.164 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95270825000000003 2024-09-12T22:05:44.164 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.164 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.164 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.164 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024544+0000", 2024-09-12T22:05:44.164 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114045 2024-09-12T22:05:44.164 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.165 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.165 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.165 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024655+0000", 2024-09-12T22:05:44.165 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111382 2024-09-12T22:05:44.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.165 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.166 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.166 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028489+0000", 2024-09-12T22:05:44.166 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038338930000000001 2024-09-12T22:05:44.166 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.166 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.166 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.167 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028497+0000", 2024-09-12T22:05:44.167 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7600000000000002e-06 2024-09-12T22:05:44.167 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.167 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.167 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.167 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028523+0000", 2024-09-12T22:05:44.168 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6268999999999999e-05 2024-09-12T22:05:44.168 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.168 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.168 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.168 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028580+0000", 2024-09-12T22:05:44.168 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7179999999999998e-05 2024-09-12T22:05:44.169 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.169 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.169 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.169 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.169 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.169 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241967 5.6 5:6c2d2d65:::benchmark_data_smithi043_32659_object74729:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.169 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:44.170 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.955045807000001, 2024-09-12T22:05:44.170 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958333094, 2024-09-12T22:05:44.170 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.170 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.170 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.170 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.170 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.170 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.170 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241967 2024-09-12T22:05:44.170 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.171 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.172 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.172 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.172 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:44.172 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.173 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.173 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.173 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.173 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:44.173 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.173 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.174 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.174 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.174 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071699+0000", 2024-09-12T22:05:44.174 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:05:44.174 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.174 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.175 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.175 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071702+0000", 2024-09-12T22:05:44.175 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6929999999999999e-06 2024-09-12T22:05:44.175 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.175 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.175 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.176 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071709+0000", 2024-09-12T22:05:44.176 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2470000000000002e-06 2024-09-12T22:05:44.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.176 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.176 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.176 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071715+0000", 2024-09-12T22:05:44.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7370000000000003e-06 2024-09-12T22:05:44.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.177 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.177 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071737+0000", 2024-09-12T22:05:44.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1976000000000001e-05 2024-09-12T22:05:44.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071740+0000", 2024-09-12T22:05:44.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1760000000000002e-06 2024-09-12T22:05:44.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.179 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025813+0000", 2024-09-12T22:05:44.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95407325399999998 2024-09-12T22:05:44.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.179 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.025956+0000", 2024-09-12T22:05:44.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014283699999999999 2024-09-12T22:05:44.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.180 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.180 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.180 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.026055+0000", 2024-09-12T22:05:44.180 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9088999999999999e-05 2024-09-12T22:05:44.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.181 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.181 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.181 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028628+0000", 2024-09-12T22:05:44.181 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025725209999999999 2024-09-12T22:05:44.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.181 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.181 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.181 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029901+0000", 2024-09-12T22:05:44.181 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012737720000000001 2024-09-12T22:05:44.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.029954+0000", 2024-09-12T22:05:44.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2811e-05 2024-09-12T22:05:44.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030032+0000", 2024-09-12T22:05:44.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7401e-05 2024-09-12T22:05:44.182 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.182 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.182 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.183 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.183 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241968 5.6 5:63b7d78c:::benchmark_data_smithi043_32659_object74730:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.183 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:44.183 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.955019950000001, 2024-09-12T22:05:44.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.958459332, 2024-09-12T22:05:44.183 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.183 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.183 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.183 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.183 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.183 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.183 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241968 2024-09-12T22:05:44.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.184 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:44.184 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071724+0000", 2024-09-12T22:05:44.184 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071725+0000", 2024-09-12T22:05:44.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5600000000000001e-07 2024-09-12T22:05:44.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071727+0000", 2024-09-12T22:05:44.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.232e-06 2024-09-12T22:05:44.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071733+0000", 2024-09-12T22:05:44.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2750000000000001e-06 2024-09-12T22:05:44.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071738+0000", 2024-09-12T22:05:44.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9289999999999997e-06 2024-09-12T22:05:44.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071769+0000", 2024-09-12T22:05:44.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0746e-05 2024-09-12T22:05:44.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.071774+0000", 2024-09-12T22:05:44.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8099999999999997e-06 2024-09-12T22:05:44.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027283+0000", 2024-09-12T22:05:44.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.95550956399999998 2024-09-12T22:05:44.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027416+0000", 2024-09-12T22:05:44.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013268399999999999 2024-09-12T22:05:44.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.188 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.188 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.027532+0000", 2024-09-12T22:05:44.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115807 2024-09-12T22:05:44.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.188 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.188 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030066+0000", 2024-09-12T22:05:44.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025343800000000001 2024-09-12T22:05:44.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.188 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030077+0000", 2024-09-12T22:05:44.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1260000000000001e-05 2024-09-12T22:05:44.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030116+0000", 2024-09-12T22:05:44.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8970999999999997e-05 2024-09-12T22:05:44.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.030184+0000", 2024-09-12T22:05:44.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7317999999999995e-05 2024-09-12T22:05:44.189 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.189 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.190 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.190 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.190 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241974 5.6 5:6b9cdaf2:::benchmark_data_smithi043_32659_object74736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:44.190 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:44.190 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.941760301999999, 2024-09-12T22:05:44.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94774920900000004, 2024-09-12T22:05:44.190 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:44.190 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:44.190 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.191 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:44.191 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:44.191 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.191 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241974 2024-09-12T22:05:44.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.191 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:44.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:44.191 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:44.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:44.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084984+0000", 2024-09-12T22:05:44.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:44.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:44.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084985+0000", 2024-09-12T22:05:44.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4600000000000004e-07 2024-09-12T22:05:44.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:44.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084989+0000", 2024-09-12T22:05:44.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9349999999999996e-06 2024-09-12T22:05:44.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:44.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.084999+0000", 2024-09-12T22:05:44.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0043e-05 2024-09-12T22:05:44.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085004+0000", 2024-09-12T22:05:44.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1619999999999999e-06 2024-09-12T22:05:44.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.194 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085041+0000", 2024-09-12T22:05:44.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7469999999999999e-05 2024-09-12T22:05:44.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.194 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:22.085048+0000", 2024-09-12T22:05:44.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:05:44.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:44.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028676+0000", 2024-09-12T22:05:44.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.94362829599999998 2024-09-12T22:05:44.195 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:44.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028809+0000", 2024-09-12T22:05:44.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013285 2024-09-12T22:05:44.195 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:44.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.028932+0000", 2024-09-12T22:05:44.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012289199999999999 2024-09-12T22:05:44.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:44.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032531+0000", 2024-09-12T22:05:44.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035990639999999999 2024-09-12T22:05:44.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032584+0000", 2024-09-12T22:05:44.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3399999999999997e-05 2024-09-12T22:05:44.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:44.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032644+0000", 2024-09-12T22:05:44.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0019999999999998e-05 2024-09-12T22:05:44.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:44.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:44.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:44.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.032733+0000", 2024-09-12T22:05:44.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9137999999999999e-05 2024-09-12T22:05:44.198 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.198 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.198 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.198 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:44.198 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:44.198 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:44.199 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:44.198+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:44.199 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:44.300 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:44.299+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:44.337 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:44.337 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:44.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.337 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:297677 5.c 5:309bb48e:::benchmark_data_smithi043_32659_object130439:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T22:05:44.337 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:44.333682+0000", 2024-09-12T22:05:44.337 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0023282490000000001, 2024-09-12T22:05:44.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023479030000000001, 2024-09-12T22:05:44.337 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.337 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.338 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:44.338 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.338 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.338 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.338 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 297677 2024-09-12T22:05:44.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.338 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333682+0000", 2024-09-12T22:05:44.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333682+0000", 2024-09-12T22:05:44.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333683+0000", 2024-09-12T22:05:44.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8400000000000002e-07 2024-09-12T22:05:44.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333687+0000", 2024-09-12T22:05:44.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1459999999999998e-06 2024-09-12T22:05:44.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333698+0000", 2024-09-12T22:05:44.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0883999999999999e-05 2024-09-12T22:05:44.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333704+0000", 2024-09-12T22:05:44.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4179999999999996e-06 2024-09-12T22:05:44.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333740+0000", 2024-09-12T22:05:44.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6819000000000001e-05 2024-09-12T22:05:44.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333854+0000", 2024-09-12T22:05:44.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011377 2024-09-12T22:05:44.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333966+0000", 2024-09-12T22:05:44.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000112074 2024-09-12T22:05:44.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.341 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.342 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:297678 5.1 5:8c71feaa:::benchmark_data_smithi043_32659_object130440:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T22:05:44.342 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:44.333873+0000", 2024-09-12T22:05:44.342 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0021371699999999999, 2024-09-12T22:05:44.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022448659999999999, 2024-09-12T22:05:44.342 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.342 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.342 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:44.342 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.342 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.343 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 297678 2024-09-12T22:05:44.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.343 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333873+0000", 2024-09-12T22:05:44.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333873+0000", 2024-09-12T22:05:44.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333874+0000", 2024-09-12T22:05:44.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:05:44.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333876+0000", 2024-09-12T22:05:44.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.261e-06 2024-09-12T22:05:44.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333882+0000", 2024-09-12T22:05:44.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3239999999999999e-06 2024-09-12T22:05:44.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333887+0000", 2024-09-12T22:05:44.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8539999999999996e-06 2024-09-12T22:05:44.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.333933+0000", 2024-09-12T22:05:44.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5781000000000001e-05 2024-09-12T22:05:44.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334091+0000", 2024-09-12T22:05:44.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157949 2024-09-12T22:05:44.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334211+0000", 2024-09-12T22:05:44.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120387 2024-09-12T22:05:44.346 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.346 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.346 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.347 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:297683 5.5 5:adf38d33:::benchmark_data_smithi043_32659_object130445:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T22:05:44.347 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:44.334050+0000", 2024-09-12T22:05:44.347 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001959971, 2024-09-12T22:05:44.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021403350000000002, 2024-09-12T22:05:44.347 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.347 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.347 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:44.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.347 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 297683 2024-09-12T22:05:44.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.347 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334050+0000", 2024-09-12T22:05:44.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334050+0000", 2024-09-12T22:05:44.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334051+0000", 2024-09-12T22:05:44.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:05:44.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334055+0000", 2024-09-12T22:05:44.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.658e-06 2024-09-12T22:05:44.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334061+0000", 2024-09-12T22:05:44.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2650000000000002e-06 2024-09-12T22:05:44.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334065+0000", 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0659999999999997e-06 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334241+0000", 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017599 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334378+0000", 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000136785 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334480+0000", 2024-09-12T22:05:44.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102432 2024-09-12T22:05:44.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.351 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.351 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:297689 5.c 5:3ceaf78d:::benchmark_data_smithi043_32659_object130451:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T22:05:44.351 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:44.334275+0000", 2024-09-12T22:05:44.351 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0017355890000000001, 2024-09-12T22:05:44.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019834259999999999, 2024-09-12T22:05:44.351 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.351 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.351 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:44.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.352 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 297689 2024-09-12T22:05:44.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.352 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334275+0000", 2024-09-12T22:05:44.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334275+0000", 2024-09-12T22:05:44.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334275+0000", 2024-09-12T22:05:44.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6400000000000002e-07 2024-09-12T22:05:44.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334279+0000", 2024-09-12T22:05:44.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1209999999999998e-06 2024-09-12T22:05:44.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334285+0000", 2024-09-12T22:05:44.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5459999999999997e-06 2024-09-12T22:05:44.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.334290+0000", 2024-09-12T22:05:44.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6090000000000003e-06 2024-09-12T22:05:44.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.335939+0000", 2024-09-12T22:05:44.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001649235 2024-09-12T22:05:44.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.336106+0000", 2024-09-12T22:05:44.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016712899999999999 2024-09-12T22:05:44.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.336223+0000", 2024-09-12T22:05:44.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117317 2024-09-12T22:05:44.362 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.362 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.362 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:297679 5.3 e66/65 5:cfc9f098:::benchmark_data_smithi043_32659_object130441:head v 66'18500, mlcod=66'18498)", 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:44.335933+0000", 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.7750999999999995e-05, 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00038983399999999998, 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.335933+0000", 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.335933+0000", 2024-09-12T22:05:44.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.335933+0000", 2024-09-12T22:05:44.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:05:44.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.335945+0000", 2024-09-12T22:05:44.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2037e-05 2024-09-12T22:05:44.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.335954+0000", 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9530000000000005e-06 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.335961+0000", 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5089999999999999e-06 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.336013+0000", 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1876999999999998e-05 2024-09-12T22:05:44.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.336032+0000", 2024-09-12T22:05:44.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9419000000000002e-05 2024-09-12T22:05:44.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.366 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.366 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:297682 5.f e66/40 5:f8a2db27:::benchmark_data_smithi043_32659_object130444:head v 66'18659, mlcod=66'18657)", 2024-09-12T22:05:44.366 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:44.335998+0000", 2024-09-12T22:05:44.366 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 1.2879e-05, 2024-09-12T22:05:44.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000379269, 2024-09-12T22:05:44.367 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.367 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.367 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:44.367 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.335998+0000", 2024-09-12T22:05:44.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.335998+0000", 2024-09-12T22:05:44.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.335998+0000", 2024-09-12T22:05:44.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:05:44.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.336001+0000", 2024-09-12T22:05:44.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3550000000000001e-06 2024-09-12T22:05:44.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.336008+0000", 2024-09-12T22:05:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7920000000000004e-06 2024-09-12T22:05:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.336013+0000", 2024-09-12T22:05:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8609999999999997e-06 2024-09-12T22:05:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.336058+0000", 2024-09-12T22:05:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4638999999999997e-05 2024-09-12T22:05:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:44.336078+0000", 2024-09-12T22:05:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0516000000000001e-05 2024-09-12T22:05:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 6 2024-09-12T22:05:44.370 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:44.371 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:44.401 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:44.400+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:44.502 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:44.501+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:44.559 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:44.560 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:44.571 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:44.612 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:44.611+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:44.704 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:44.703+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:44.755 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.341500487999994, 2024-09-12T22:05:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.341320558000007, 2024-09-12T22:05:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.341254117000005, 2024-09-12T22:05:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.341197674, 2024-09-12T22:05:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.341129214000006, 2024-09-12T22:05:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.341071478999993, 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.341003787000005, 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.340948725000004, 2024-09-12T22:05:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.300301204999997, 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.297687476999997, 2024-09-12T22:05:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.752473381000001, 2024-09-12T22:05:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.751994893000003, 2024-09-12T22:05:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:44.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:44.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:44.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:44.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:44.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:44.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:44.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:44.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:44.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:44.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:44.831 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.831 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.831 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.832 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:44.832 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:44.832 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.749499592999996, 2024-09-12T22:05:44.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:44.832 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.832 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.832 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.832 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.832 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.832 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.832 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:44.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:44.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:44.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:44.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:44.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:44.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:44.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:44.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:44.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:44.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:44.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:44.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:44.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:44.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:44.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:44.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:44.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:44.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:44.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:44.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:44.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:44.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:44.837 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.837 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.837 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.748418802000003, 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:44.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:44.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:44.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:44.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:44.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:44.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:44.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:44.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:44.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:44.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:44.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:44.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:44.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:44.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:44.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:44.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:44.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:44.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.843 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.843 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:44.843 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:44.843 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.747183239999998, 2024-09-12T22:05:44.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:44.844 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.844 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.844 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.844 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:44.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.844 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:44.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:44.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:44.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:44.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:44.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:44.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:44.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:44.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:44.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:44.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:44.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:44.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:44.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:44.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:44.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.849 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.849 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:44.849 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:44.849 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.306442752000002, 2024-09-12T22:05:44.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:44.849 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.849 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.849 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.850 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:44.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.850 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:44.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:44.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:44.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:44.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:44.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:44.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:44.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:44.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:44.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:44.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:44.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:44.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:44.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:44.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:44.854 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.854 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.854 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.854 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:44.854 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:44.854 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.301912325000004, 2024-09-12T22:05:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:44.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:44.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:44.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:44.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:44.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:44.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:44.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:44.860 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.860 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.860 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.860 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:44.860 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:44.860 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.301888296000001, 2024-09-12T22:05:44.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:44.860 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.860 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.861 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.861 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.861 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.861 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.861 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:44.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.861 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:44.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:44.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:44.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:44.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:44.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:44.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:44.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:44.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:44.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:44.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:44.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:44.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:44.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:44.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:44.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:44.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:44.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.301710647, 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.866 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.867 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.867 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:44.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.867 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:44.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:44.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:44.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:44.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:44.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:44.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:44.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:44.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:44.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:44.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:44.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:44.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:44.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:44.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:44.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:44.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:44.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:44.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:44.872 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.872 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.872 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.872 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:44.872 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:44.872 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.299692110000002, 2024-09-12T22:05:44.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:44.872 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:44.872 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:44.872 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:44.872 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:44.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:44.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:44.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:44.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:44.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:44.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:44.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:44.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:44.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:44.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:44.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:44.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:44.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:44.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:44.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:44.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:44.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:44.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:44.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:44.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:44.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:44.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:44.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:44.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:44.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:44.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:44.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:44.878 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.878 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.878 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.878 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:44.878 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:44.878 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:44.879 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:44.880 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:44.878+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:44.900 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:05:44.981 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:44.979+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:45.022 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:45.042 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:45.042 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:45.043 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:45.043 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:45.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.044 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.7 e 66/66 lb 5:e4fee76a:::benchmark_data_smithi043_32659_object163357:head)", 2024-09-12T22:05:45.044 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:45.037562+0000", 2024-09-12T22:05:45.044 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0043756469999999999, 2024-09-12T22:05:45.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043959799999999999, 2024-09-12T22:05:45.044 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:45.044 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:45.044 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:45.044 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:45.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:45.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.037562+0000", 2024-09-12T22:05:45.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:45.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.037562+0000", 2024-09-12T22:05:45.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:45.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.037563+0000", 2024-09-12T22:05:45.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1300000000000001e-07 2024-09-12T22:05:45.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:45.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.037569+0000", 2024-09-12T22:05:45.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8560000000000001e-06 2024-09-12T22:05:45.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:45.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.037576+0000", 2024-09-12T22:05:45.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9240000000000001e-06 2024-09-12T22:05:45.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:45.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.037582+0000", 2024-09-12T22:05:45.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.186e-06 2024-09-12T22:05:45.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:45.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041908+0000", 2024-09-12T22:05:45.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043266789999999999 2024-09-12T22:05:45.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:45.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041921+0000", 2024-09-12T22:05:45.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2374999999999999e-05 2024-09-12T22:05:45.047 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.048 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:45.048 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.048 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:299680 5.7 e66/40 5:e03d19f2:::benchmark_data_smithi043_32659_object132442:head v 66'18856, mlcod=66'18853)", 2024-09-12T22:05:45.048 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:45.037589+0000", 2024-09-12T22:05:45.048 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0043491470000000003, 2024-09-12T22:05:45.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0044375780000000002, 2024-09-12T22:05:45.048 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:45.048 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:45.048 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:45.048 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:45.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:45.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.037589+0000", 2024-09-12T22:05:45.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:45.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.037589+0000", 2024-09-12T22:05:45.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:45.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.037589+0000", 2024-09-12T22:05:45.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1299999999999999e-07 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.037592+0000", 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.118e-06 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.037598+0000", 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4299999999999997e-06 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.037601+0000", 2024-09-12T22:05:45.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7780000000000001e-06 2024-09-12T22:05:45.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:45.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.037849+0000", 2024-09-12T22:05:45.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000247693 2024-09-12T22:05:45.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:45.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.037867+0000", 2024-09-12T22:05:45.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7611000000000001e-05 2024-09-12T22:05:45.051 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.051 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:45.051 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.052 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:299683 5.3 5:c2481951:::benchmark_data_smithi043_32659_object132445:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T22:05:45.052 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:45.038218+0000", 2024-09-12T22:05:45.052 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.003719754, 2024-09-12T22:05:45.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038724150000000001, 2024-09-12T22:05:45.052 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:45.052 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:45.052 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:45.052 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:45.053 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:45.053 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:45.053 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 299683 2024-09-12T22:05:45.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.053 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:45.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:45.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038218+0000", 2024-09-12T22:05:45.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:45.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038218+0000", 2024-09-12T22:05:45.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:45.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038219+0000", 2024-09-12T22:05:45.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:05:45.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:45.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038224+0000", 2024-09-12T22:05:45.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.977e-06 2024-09-12T22:05:45.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038234+0000", 2024-09-12T22:05:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0137e-05 2024-09-12T22:05:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038241+0000", 2024-09-12T22:05:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4019999999999999e-06 2024-09-12T22:05:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038408+0000", 2024-09-12T22:05:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016678900000000001 2024-09-12T22:05:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:45.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038547+0000", 2024-09-12T22:05:45.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013910699999999999 2024-09-12T22:05:45.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:45.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038663+0000", 2024-09-12T22:05:45.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115857 2024-09-12T22:05:45.056 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.056 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:45.056 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:299684 5.e 5:7f8c3938:::benchmark_data_smithi043_32659_object132446:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:45.038257+0000", 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0036804770000000001, 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0039041829999999999, 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 299684 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:45.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:45.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038257+0000", 2024-09-12T22:05:45.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:45.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038257+0000", 2024-09-12T22:05:45.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:45.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038258+0000", 2024-09-12T22:05:45.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2300000000000002e-07 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038261+0000", 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.621e-06 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038267+0000", 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2750000000000001e-06 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038273+0000", 2024-09-12T22:05:45.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5479999999999998e-06 2024-09-12T22:05:45.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:45.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038531+0000", 2024-09-12T22:05:45.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025749600000000002 2024-09-12T22:05:45.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:45.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038676+0000", 2024-09-12T22:05:45.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014482399999999999 2024-09-12T22:05:45.060 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.060 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:45.060 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.061 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:299687 5.b 5:d398d8c4:::benchmark_data_smithi043_32659_object132449:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T22:05:45.061 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:45.038441+0000", 2024-09-12T22:05:45.061 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0034964530000000001, 2024-09-12T22:05:45.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003779831, 2024-09-12T22:05:45.061 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:45.061 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:45.061 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:45.061 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:45.061 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:45.061 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:45.061 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 299687 2024-09-12T22:05:45.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.062 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:45.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:45.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038441+0000", 2024-09-12T22:05:45.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:45.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038441+0000", 2024-09-12T22:05:45.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:45.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038442+0000", 2024-09-12T22:05:45.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4499999999999996e-07 2024-09-12T22:05:45.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:45.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038446+0000", 2024-09-12T22:05:45.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.49e-06 2024-09-12T22:05:45.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:45.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038453+0000", 2024-09-12T22:05:45.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6850000000000001e-06 2024-09-12T22:05:45.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:45.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038459+0000", 2024-09-12T22:05:45.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6729999999999997e-06 2024-09-12T22:05:45.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:45.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.039555+0000", 2024-09-12T22:05:45.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0010958929999999999 2024-09-12T22:05:45.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:45.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.039701+0000", 2024-09-12T22:05:45.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000146417 2024-09-12T22:05:45.065 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.065 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:45.065 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.066 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:299688 5.3 5:c69c52e6:::benchmark_data_smithi043_32659_object132450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T22:05:45.066 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:45.038468+0000", 2024-09-12T22:05:45.066 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0034700270000000001, 2024-09-12T22:05:45.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003819598, 2024-09-12T22:05:45.066 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:45.066 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:45.066 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:45.066 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:45.066 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:45.066 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:45.066 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 299688 2024-09-12T22:05:45.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.066 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:45.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:45.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038468+0000", 2024-09-12T22:05:45.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:45.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038468+0000", 2024-09-12T22:05:45.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:45.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038468+0000", 2024-09-12T22:05:45.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.96e-07 2024-09-12T22:05:45.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:45.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038470+0000", 2024-09-12T22:05:45.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.934e-06 2024-09-12T22:05:45.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:45.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038475+0000", 2024-09-12T22:05:45.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3489999999999999e-06 2024-09-12T22:05:45.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:45.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038479+0000", 2024-09-12T22:05:45.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9570000000000004e-06 2024-09-12T22:05:45.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:45.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040243+0000", 2024-09-12T22:05:45.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017639470000000001 2024-09-12T22:05:45.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:45.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040354+0000", 2024-09-12T22:05:45.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011083500000000001 2024-09-12T22:05:45.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:45.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040455+0000", 2024-09-12T22:05:45.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000100945 2024-09-12T22:05:45.070 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.070 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:45.070 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.070 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:299690 5.a 5:5ece717e:::benchmark_data_smithi043_32659_object132452:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T22:05:45.070 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:45.038976+0000", 2024-09-12T22:05:45.070 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0029617799999999998, 2024-09-12T22:05:45.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033846570000000001, 2024-09-12T22:05:45.071 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:45.071 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:45.071 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:45.071 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:45.071 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:45.071 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:45.071 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 299690 2024-09-12T22:05:45.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.071 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:45.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:45.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038976+0000", 2024-09-12T22:05:45.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:45.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038976+0000", 2024-09-12T22:05:45.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:45.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038977+0000", 2024-09-12T22:05:45.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2500000000000004e-07 2024-09-12T22:05:45.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:45.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038981+0000", 2024-09-12T22:05:45.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0160000000000002e-06 2024-09-12T22:05:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038990+0000", 2024-09-12T22:05:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9800000000000004e-06 2024-09-12T22:05:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.038996+0000", 2024-09-12T22:05:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.212e-06 2024-09-12T22:05:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.039046+0000", 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9319e-05 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.039205+0000", 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015908799999999999 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:299692 5.d 5:b94d6c90:::benchmark_data_smithi043_32659_object132454:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:45.039746+0000", 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002191574, 2024-09-12T22:05:45.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026815530000000001, 2024-09-12T22:05:45.075 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:45.075 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:45.075 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:45.075 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:45.075 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:45.075 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:45.075 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 299692 2024-09-12T22:05:45.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.075 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:45.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:45.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.039746+0000", 2024-09-12T22:05:45.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:45.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.039746+0000", 2024-09-12T22:05:45.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:45.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.039747+0000", 2024-09-12T22:05:45.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2900000000000003e-07 2024-09-12T22:05:45.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:45.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.039751+0000", 2024-09-12T22:05:45.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9190000000000001e-06 2024-09-12T22:05:45.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:45.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.039760+0000", 2024-09-12T22:05:45.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.217e-06 2024-09-12T22:05:45.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:45.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.039767+0000", 2024-09-12T22:05:45.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8600000000000004e-06 2024-09-12T22:05:45.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:45.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040468+0000", 2024-09-12T22:05:45.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00070082499999999997 2024-09-12T22:05:45.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:45.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040614+0000", 2024-09-12T22:05:45.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014578599999999999 2024-09-12T22:05:45.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:45.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040713+0000", 2024-09-12T22:05:45.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9646000000000001e-05 2024-09-12T22:05:45.078 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.079 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:45.079 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.079 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:299693 5.a 5:59b468b0:::benchmark_data_smithi043_32659_object132455:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T22:05:45.079 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:45.040659+0000", 2024-09-12T22:05:45.079 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0012793590000000001, 2024-09-12T22:05:45.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001824397, 2024-09-12T22:05:45.079 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:45.079 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:45.079 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:45.079 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:45.079 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:45.079 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:45.080 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 299693 2024-09-12T22:05:45.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.080 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:45.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:45.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040659+0000", 2024-09-12T22:05:45.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:45.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040659+0000", 2024-09-12T22:05:45.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:45.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040659+0000", 2024-09-12T22:05:45.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6099999999999999e-07 2024-09-12T22:05:45.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:45.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040664+0000", 2024-09-12T22:05:45.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5589999999999999e-06 2024-09-12T22:05:45.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:45.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040673+0000", 2024-09-12T22:05:45.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.738e-06 2024-09-12T22:05:45.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:45.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040679+0000", 2024-09-12T22:05:45.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4999999999999996e-06 2024-09-12T22:05:45.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:45.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040744+0000", 2024-09-12T22:05:45.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5241999999999996e-05 2024-09-12T22:05:45.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:45.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040891+0000", 2024-09-12T22:05:45.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000146334 2024-09-12T22:05:45.083 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.083 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:45.083 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.083 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:299683 5.3 e66/65 ondisk, result = 0)", 2024-09-12T22:05:45.083 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:45.040711+0000", 2024-09-12T22:05:45.083 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001227433, 2024-09-12T22:05:45.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00184176, 2024-09-12T22:05:45.083 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:45.083 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040711+0000", 2024-09-12T22:05:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040711+0000", 2024-09-12T22:05:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:45.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040711+0000", 2024-09-12T22:05:45.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:45.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:45.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040713+0000", 2024-09-12T22:05:45.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3209999999999999e-06 2024-09-12T22:05:45.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:45.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040720+0000", 2024-09-12T22:05:45.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.579e-06 2024-09-12T22:05:45.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.040725+0000", 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5300000000000004e-06 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.042528+0000", 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001802307 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.042535+0000", 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2590000000000003e-06 2024-09-12T22:05:45.086 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.087 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:45.087 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.087 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:299695 5.e 5:7909a2c2:::benchmark_data_smithi043_32659_object132457:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T22:05:45.087 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:45.041505+0000", 2024-09-12T22:05:45.087 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00043262500000000001, 2024-09-12T22:05:45.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001104446, 2024-09-12T22:05:45.087 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:45.087 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:45.087 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:45.087 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:45.087 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:45.087 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:45.088 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 299695 2024-09-12T22:05:45.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.088 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:45.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:45.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041505+0000", 2024-09-12T22:05:45.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:45.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041505+0000", 2024-09-12T22:05:45.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:45.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041506+0000", 2024-09-12T22:05:45.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:05:45.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:45.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041511+0000", 2024-09-12T22:05:45.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.403e-06 2024-09-12T22:05:45.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:45.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041520+0000", 2024-09-12T22:05:45.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8630000000000003e-06 2024-09-12T22:05:45.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:45.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041527+0000", 2024-09-12T22:05:45.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:05:45.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:45.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041574+0000", 2024-09-12T22:05:45.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7583999999999997e-05 2024-09-12T22:05:45.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:45.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041724+0000", 2024-09-12T22:05:45.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000149918 2024-09-12T22:05:45.091 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.091 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:45.091 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.091 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:299696 5.e 5.fc4e59fe (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T22:05:45.091 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:45.041567+0000", 2024-09-12T22:05:45.091 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00037092499999999998, 2024-09-12T22:05:45.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001106833, 2024-09-12T22:05:45.091 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:45.091 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:45.091 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:45.092 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:45.092 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:45.092 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:45.092 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 299696 2024-09-12T22:05:45.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.092 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:45.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:45.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041567+0000", 2024-09-12T22:05:45.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:45.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041567+0000", 2024-09-12T22:05:45.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:45.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:45.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041568+0000", 2024-09-12T22:05:45.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4199999999999995e-07 2024-09-12T22:05:45.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:45.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041571+0000", 2024-09-12T22:05:45.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6169999999999998e-06 2024-09-12T22:05:45.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041580+0000", 2024-09-12T22:05:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4300000000000006e-06 2024-09-12T22:05:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:45.041585+0000", 2024-09-12T22:05:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5820000000000001e-06 2024-09-12T22:05:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 12 2024-09-12T22:05:45.095 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:45.095 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:05:45.096 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:45.097 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:45.095+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:45.097 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:45.098 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:45.098 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:45.099 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:45.197 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:45.196+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:45.298 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:45.298 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:45.298 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:45.297+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:45.311 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:45.399 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:45.397+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:45.465 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:45.466 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:45.480 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:45.528 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:45.527+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:45.600 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:45.599+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:45.627 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:45.627 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:45.641 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:45.702 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:45.701+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:45.803 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:45.801+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:45.831 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:45.831 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:45.845 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:45.904 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:45.903+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:45.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~82s 2024-09-12T22:05:45.989 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:45.989 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:46.002 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:46.005 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:46.003+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:46.021 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-09-12T22:05:46.106 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:46.105+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:46.162 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:46.162 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:46.175 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:46.206 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:46.205+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:46.308 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:46.307+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:46.375 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:46.376 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:46.390 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:46.409 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:46.407+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:46.510 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:46.508+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:46.548 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:46.549 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:46.562 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:46.611 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:46.610+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:46.706 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:46.706 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:46.711 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:46.710+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:46.717 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:46.812 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:46.811+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:46.899 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:46.900 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:46.911 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:46.913 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:46.912+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:47.014 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:47.013+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:47.096 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:47.097 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:47.100 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:05:47.109 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:47.153 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:47.152+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:47.208 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:47.216 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:47.215+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:47.226 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:47.226 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:47.246 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:47.246 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:47.249 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:47.250 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:47.265 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:47.265 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:47.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.266 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:305493 5.3 5:c3805f66:::benchmark_data_smithi043_32659_object138255:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:47.266 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.262849+0000", 2024-09-12T22:05:47.266 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00070735600000000002, 2024-09-12T22:05:47.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00072936599999999996, 2024-09-12T22:05:47.266 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.266 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.266 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:47.266 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.266 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.266 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.266 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 305493 2024-09-12T22:05:47.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.267 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262849+0000", 2024-09-12T22:05:47.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262849+0000", 2024-09-12T22:05:47.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262850+0000", 2024-09-12T22:05:47.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5499999999999997e-07 2024-09-12T22:05:47.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262854+0000", 2024-09-12T22:05:47.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0040000000000001e-06 2024-09-12T22:05:47.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262865+0000", 2024-09-12T22:05:47.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0657e-05 2024-09-12T22:05:47.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262872+0000", 2024-09-12T22:05:47.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9609999999999999e-06 2024-09-12T22:05:47.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262919+0000", 2024-09-12T22:05:47.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7265000000000002e-05 2024-09-12T22:05:47.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263034+0000", 2024-09-12T22:05:47.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115104 2024-09-12T22:05:47.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263144+0000", 2024-09-12T22:05:47.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109917 2024-09-12T22:05:47.271 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.271 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.271 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.271 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:305494 5.a 5:5bf35b89:::benchmark_data_smithi043_32659_object138256:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:47.271 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.262888+0000", 2024-09-12T22:05:47.271 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00066825299999999995, 2024-09-12T22:05:47.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00076200300000000003, 2024-09-12T22:05:47.271 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 305494 2024-09-12T22:05:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262888+0000", 2024-09-12T22:05:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262888+0000", 2024-09-12T22:05:47.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262889+0000", 2024-09-12T22:05:47.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0500000000000004e-07 2024-09-12T22:05:47.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262891+0000", 2024-09-12T22:05:47.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6450000000000001e-06 2024-09-12T22:05:47.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262899+0000", 2024-09-12T22:05:47.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8949999999999998e-06 2024-09-12T22:05:47.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262905+0000", 2024-09-12T22:05:47.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5310000000000001e-06 2024-09-12T22:05:47.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262941+0000", 2024-09-12T22:05:47.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5784999999999997e-05 2024-09-12T22:05:47.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263034+0000", 2024-09-12T22:05:47.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3517000000000006e-05 2024-09-12T22:05:47.275 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.275 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.275 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.275 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:305491 5.c e67/40 5:36e8d731:::benchmark_data_smithi043_32659_object138253:head v 67'19033, mlcod=67'19031)", 2024-09-12T22:05:47.275 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.263067+0000", 2024-09-12T22:05:47.275 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00048999899999999997, 2024-09-12T22:05:47.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00064341799999999998, 2024-09-12T22:05:47.276 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.276 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.276 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:47.276 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263067+0000", 2024-09-12T22:05:47.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263067+0000", 2024-09-12T22:05:47.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263067+0000", 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3399999999999999e-07 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263075+0000", 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9340000000000006e-06 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263084+0000", 2024-09-12T22:05:47.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7299999999999994e-06 2024-09-12T22:05:47.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263090+0000", 2024-09-12T22:05:47.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9519999999999999e-06 2024-09-12T22:05:47.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263139+0000", 2024-09-12T22:05:47.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9546000000000003e-05 2024-09-12T22:05:47.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263156+0000", 2024-09-12T22:05:47.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6807e-05 2024-09-12T22:05:47.279 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.279 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.279 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.279 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:305490 5.1 e67/40 5:81bbf737:::benchmark_data_smithi043_32659_object138252:head v 67'19014, mlcod=67'19012)", 2024-09-12T22:05:47.279 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.263115+0000", 2024-09-12T22:05:47.279 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00044186099999999999, 2024-09-12T22:05:47.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00064627900000000004, 2024-09-12T22:05:47.279 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.279 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.280 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:47.280 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263115+0000", 2024-09-12T22:05:47.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263115+0000", 2024-09-12T22:05:47.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263115+0000", 2024-09-12T22:05:47.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.58e-07 2024-09-12T22:05:47.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263118+0000", 2024-09-12T22:05:47.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2279999999999998e-06 2024-09-12T22:05:47.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263124+0000", 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1510000000000001e-06 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263129+0000", 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.352e-06 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263244+0000", 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115295 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263261+0000", 2024-09-12T22:05:47.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7163000000000002e-05 2024-09-12T22:05:47.283 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.283 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.283 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.283 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:305492 5.5 e67/40)", 2024-09-12T22:05:47.283 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.263160+0000", 2024-09-12T22:05:47.283 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00039648, 2024-09-12T22:05:47.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00064983499999999997, 2024-09-12T22:05:47.283 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.283 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.283 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:47.283 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263160+0000", 2024-09-12T22:05:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263160+0000", 2024-09-12T22:05:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263160+0000", 2024-09-12T22:05:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1399999999999998e-07 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263165+0000", 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9320000000000004e-06 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263172+0000", 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3890000000000002e-06 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.263176+0000", 2024-09-12T22:05:47.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3030000000000001e-06 2024-09-12T22:05:47.286 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.286 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.286 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.286 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:305479 5.d 5:bf9388bb:::benchmark_data_smithi043_32659_object138241:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:47.286 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.256211+0000", 2024-09-12T22:05:47.286 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0073456980000000003, 2024-09-12T22:05:47.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0076502039999999999, 2024-09-12T22:05:47.286 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.286 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.286 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:47.286 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 305479 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.256211+0000", 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.256211+0000", 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.256212+0000", 2024-09-12T22:05:47.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6299999999999993e-07 2024-09-12T22:05:47.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.256216+0000", 2024-09-12T22:05:47.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.968e-06 2024-09-12T22:05:47.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.256225+0000", 2024-09-12T22:05:47.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3079999999999997e-06 2024-09-12T22:05:47.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.256232+0000", 2024-09-12T22:05:47.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:05:47.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258466+0000", 2024-09-12T22:05:47.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002233844 2024-09-12T22:05:47.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258610+0000", 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014465499999999999 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258713+0000", 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000102395 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.260848+0000", 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021356109999999999 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.291 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:305478 5.5 e67/40 5:a6d18231:::benchmark_data_smithi043_32659_object138240:head v 67'19081, mlcod=67'19078)", 2024-09-12T22:05:47.291 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.256909+0000", 2024-09-12T22:05:47.291 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0066478789999999998, 2024-09-12T22:05:47.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0070256980000000004, 2024-09-12T22:05:47.291 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.291 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.291 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:47.291 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.256909+0000", 2024-09-12T22:05:47.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.256909+0000", 2024-09-12T22:05:47.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.256909+0000", 2024-09-12T22:05:47.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7100000000000001e-07 2024-09-12T22:05:47.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.256916+0000", 2024-09-12T22:05:47.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6780000000000003e-06 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.256925+0000", 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0420000000000008e-06 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.256931+0000", 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0689999999999998e-06 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258760+0000", 2024-09-12T22:05:47.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018287069999999999 2024-09-12T22:05:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258776+0000", 2024-09-12T22:05:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6266e-05 2024-09-12T22:05:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:305481 5.7 e67/40 5:e058e185:::benchmark_data_smithi043_32659_object138243:head v 67'19195, mlcod=67'19193)", 2024-09-12T22:05:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.257623+0000", 2024-09-12T22:05:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0059332380000000004, 2024-09-12T22:05:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0063658050000000004, 2024-09-12T22:05:47.295 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.295 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.295 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:47.295 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.257623+0000", 2024-09-12T22:05:47.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.257623+0000", 2024-09-12T22:05:47.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.257624+0000", 2024-09-12T22:05:47.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7000000000000004e-07 2024-09-12T22:05:47.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.257629+0000", 2024-09-12T22:05:47.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3040000000000004e-06 2024-09-12T22:05:47.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.257638+0000", 2024-09-12T22:05:47.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4169999999999992e-06 2024-09-12T22:05:47.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.257645+0000", 2024-09-12T22:05:47.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:05:47.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.257686+0000", 2024-09-12T22:05:47.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1112999999999998e-05 2024-09-12T22:05:47.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.257707+0000", 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0876000000000001e-05 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:305482 5.b 5:dad1071d:::benchmark_data_smithi043_32659_object138244:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.257963+0000", 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0055939010000000001, 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0060792279999999999, 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 305482 2024-09-12T22:05:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.257963+0000", 2024-09-12T22:05:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.257963+0000", 2024-09-12T22:05:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.257964+0000", 2024-09-12T22:05:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0389999999999999e-06 2024-09-12T22:05:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.257969+0000", 2024-09-12T22:05:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4009999999999996e-06 2024-09-12T22:05:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.257982+0000", 2024-09-12T22:05:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3217999999999999e-05 2024-09-12T22:05:47.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.257990+0000", 2024-09-12T22:05:47.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9510000000000006e-06 2024-09-12T22:05:47.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258044+0000", 2024-09-12T22:05:47.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4191999999999999e-05 2024-09-12T22:05:47.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258194+0000", 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014961600000000001 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:305483 5.b 5:d4b6a231:::benchmark_data_smithi043_32659_object138245:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.258127+0000", 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0054294110000000003, 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0059735609999999996, 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.302 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.303 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.303 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 305483 2024-09-12T22:05:47.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.303 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258127+0000", 2024-09-12T22:05:47.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258127+0000", 2024-09-12T22:05:47.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258128+0000", 2024-09-12T22:05:47.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9899999999999999e-07 2024-09-12T22:05:47.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258132+0000", 2024-09-12T22:05:47.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6990000000000001e-06 2024-09-12T22:05:47.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258143+0000", 2024-09-12T22:05:47.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1005999999999999e-05 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258149+0000", 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.883e-06 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.259853+0000", 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017035259999999999 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.260029+0000", 2024-09-12T22:05:47.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017595999999999999 2024-09-12T22:05:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:305484 5.e 5:761e6795:::benchmark_data_smithi043_32659_object138246:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.258186+0000", 2024-09-12T22:05:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0053706750000000001, 2024-09-12T22:05:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0059732689999999998, 2024-09-12T22:05:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 305484 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258186+0000", 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258186+0000", 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258187+0000", 2024-09-12T22:05:47.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1299999999999999e-07 2024-09-12T22:05:47.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258190+0000", 2024-09-12T22:05:47.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1750000000000001e-06 2024-09-12T22:05:47.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258199+0000", 2024-09-12T22:05:47.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6229999999999992e-06 2024-09-12T22:05:47.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258205+0000", 2024-09-12T22:05:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0480000000000004e-06 2024-09-12T22:05:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258412+0000", 2024-09-12T22:05:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000206257 2024-09-12T22:05:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258571+0000", 2024-09-12T22:05:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015907900000000001 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:305485 5.f 5:f7bb4c50:::benchmark_data_smithi043_32659_object138247:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.258304+0000", 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0052527340000000002, 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0059141280000000003, 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.310 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.311 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 305485 2024-09-12T22:05:47.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.311 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258304+0000", 2024-09-12T22:05:47.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258304+0000", 2024-09-12T22:05:47.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258305+0000", 2024-09-12T22:05:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9700000000000005e-07 2024-09-12T22:05:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258308+0000", 2024-09-12T22:05:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:05:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258319+0000", 2024-09-12T22:05:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0755e-05 2024-09-12T22:05:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258326+0000", 2024-09-12T22:05:47.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:05:47.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258408+0000", 2024-09-12T22:05:47.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2677999999999997e-05 2024-09-12T22:05:47.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258593+0000", 2024-09-12T22:05:47.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000184437 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258710+0000", 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117571 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.260715+0000", 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002004713 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.315 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:305486 5.5 e67/40 5:ae9b2dfe:::benchmark_data_smithi043_32659_object138248:head v 67'19082, mlcod=67'19078)", 2024-09-12T22:05:47.315 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.258736+0000", 2024-09-12T22:05:47.315 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0048206339999999999, 2024-09-12T22:05:47.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0055502160000000002, 2024-09-12T22:05:47.315 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.315 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.315 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:47.315 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258736+0000", 2024-09-12T22:05:47.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258736+0000", 2024-09-12T22:05:47.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258736+0000", 2024-09-12T22:05:47.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:05:47.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258741+0000", 2024-09-12T22:05:47.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1930000000000003e-06 2024-09-12T22:05:47.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258749+0000", 2024-09-12T22:05:47.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9910000000000002e-06 2024-09-12T22:05:47.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.258754+0000", 2024-09-12T22:05:47.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2050000000000001e-06 2024-09-12T22:05:47.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.260790+0000", 2024-09-12T22:05:47.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020366669999999998 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.260809+0000", 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8544999999999999e-05 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:305487 5.e 5:7d6622a5:::benchmark_data_smithi043_32659_object138249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.259565+0000", 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0039911859999999999, 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047744989999999998, 2024-09-12T22:05:47.318 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 305487 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.259565+0000", 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.259565+0000", 2024-09-12T22:05:47.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.259567+0000", 2024-09-12T22:05:47.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.209e-06 2024-09-12T22:05:47.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.259571+0000", 2024-09-12T22:05:47.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6709999999999998e-06 2024-09-12T22:05:47.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.259584+0000", 2024-09-12T22:05:47.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3115000000000001e-05 2024-09-12T22:05:47.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.259594+0000", 2024-09-12T22:05:47.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:05:47.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.259939+0000", 2024-09-12T22:05:47.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00034595300000000003 2024-09-12T22:05:47.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.260059+0000", 2024-09-12T22:05:47.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119102 2024-09-12T22:05:47.322 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.322 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.322 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.322 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:305488 5.e 5:78118016:::benchmark_data_smithi043_32659_object138250:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:47.322 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.262665+0000", 2024-09-12T22:05:47.322 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00089139500000000001, 2024-09-12T22:05:47.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001736252, 2024-09-12T22:05:47.322 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 305488 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262665+0000", 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262665+0000", 2024-09-12T22:05:47.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262666+0000", 2024-09-12T22:05:47.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.009e-06 2024-09-12T22:05:47.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262671+0000", 2024-09-12T22:05:47.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3580000000000002e-06 2024-09-12T22:05:47.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262685+0000", 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3811999999999999e-05 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262694+0000", 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1810000000000007e-06 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262734+0000", 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9910000000000002e-05 2024-09-12T22:05:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.326 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.326 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.326 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:305489 5.8 5:1478a3eb:::benchmark_data_smithi043_32659_object138251:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:47.326 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:47.262712+0000", 2024-09-12T22:05:47.326 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00084473999999999997, 2024-09-12T22:05:47.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017430569999999999, 2024-09-12T22:05:47.326 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.326 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.326 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:47.326 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.326 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.326 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 305489 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262712+0000", 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262712+0000", 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262712+0000", 2024-09-12T22:05:47.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5199999999999997e-07 2024-09-12T22:05:47.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262715+0000", 2024-09-12T22:05:47.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7300000000000001e-06 2024-09-12T22:05:47.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262723+0000", 2024-09-12T22:05:47.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3590000000000008e-06 2024-09-12T22:05:47.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262729+0000", 2024-09-12T22:05:47.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5740000000000003e-06 2024-09-12T22:05:47.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262759+0000", 2024-09-12T22:05:47.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0108999999999999e-05 2024-09-12T22:05:47.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:47.262881+0000", 2024-09-12T22:05:47.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000121913 2024-09-12T22:05:47.329 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.330 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.330 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.330 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.330 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:47.330 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 16 2024-09-12T22:05:47.330 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:47.331 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:47.332 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:47.330+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:47.432 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:47.431+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:47.529 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:47.529 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:47.529 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:47.529 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:47.529 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:47.533 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:47.532+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:47.542 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:47.635 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:47.634+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:47.735 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:47.734+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:47.748 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:47.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:47.748 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.780702498, 2024-09-12T22:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:47.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:47.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:05:47.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:05:47.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:05:47.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:05:47.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:05:47.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:05:47.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:05:47.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:05:47.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:05:47.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:05:47.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:05:47.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:05:47.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:05:47.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:05:47.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:05:47.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:05:47.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:05:47.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:05:47.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:05:47.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:05:47.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.755 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.756 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.756 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:47.756 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:47.756 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.778669773000001, 2024-09-12T22:05:47.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:05:47.756 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.756 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.756 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.756 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.756 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.756 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:47.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:05:47.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:05:47.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:05:47.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:05:47.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:05:47.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:05:47.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:05:47.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:05:47.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:05:47.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:05:47.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:05:47.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:05:47.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:05:47.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:05:47.762 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.762 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.762 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.762 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:47.762 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:47.762 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.775657508999998, 2024-09-12T22:05:47.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:05:47.762 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.763 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.763 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.763 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.763 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.763 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.763 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:05:47.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.763 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:47.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:47.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.764 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:05:47.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:05:47.764 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:05:47.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:47.765 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.765 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.765 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:05:47.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:05:47.765 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.765 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.765 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:05:47.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:05:47.765 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:05:47.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:05:47.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:05:47.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:05:47.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:05:47.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:05:47.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:05:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:05:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:05:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:05:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:05:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:05:47.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:05:47.769 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.769 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.769 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.769 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:47.769 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:47.769 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.774671018999999, 2024-09-12T22:05:47.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:05:47.769 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.769 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.769 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.769 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.770 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.770 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.770 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:05:47.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.770 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:47.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:47.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:05:47.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:47.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:05:47.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:05:47.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:05:47.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:47.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:05:47.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:05:47.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:05:47.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:05:47.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:05:47.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:47.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:05:47.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:05:47.776 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.776 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.776 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.776 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:47.776 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:47.776 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.769584385000002, 2024-09-12T22:05:47.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:05:47.776 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.776 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.776 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.777 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.777 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.777 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.777 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:05:47.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.777 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:47.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:47.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:05:47.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:05:47.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:05:47.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:05:47.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:05:47.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:05:47.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:05:47.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:05:47.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:05:47.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:05:47.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:05:47.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:05:47.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:05:47.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:05:47.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:05:47.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:05:47.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:05:47.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:05:47.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:05:47.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:05:47.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.783 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:47.783 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:47.783 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.766829413, 2024-09-12T22:05:47.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:05:47.783 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.783 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.783 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.783 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.783 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.783 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.783 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:05:47.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.783 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:47.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:47.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:05:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:05:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:05:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:05:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:05:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:05:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:05:47.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:05:47.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:05:47.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:05:47.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:05:47.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:05:47.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:05:47.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:05:47.789 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.789 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.789 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.789 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:47.789 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:47.789 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.758854528000001, 2024-09-12T22:05:47.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:05:47.789 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.790 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.790 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.790 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.790 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.790 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.790 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:05:47.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.790 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:47.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:05:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:05:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:05:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:05:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:05:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:05:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:05:47.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:05:47.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:05:47.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:05:47.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:05:47.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:05:47.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:05:47.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:05:47.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:05:47.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:05:47.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:05:47.795 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.795 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.795 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.796 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:47.796 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:47.796 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.750928752, 2024-09-12T22:05:47.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:05:47.796 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.796 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.796 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.796 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.796 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.796 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.796 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:05:47.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.796 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:47.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:47.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:05:47.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:05:47.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:05:47.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:05:47.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:05:47.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:05:47.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:05:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:05:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:05:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:05:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:05:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:05:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:05:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:05:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:05:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:05:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:05:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.749432469999999, 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.803 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.803 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.803 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.803 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.803 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:05:47.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.803 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:47.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:47.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:05:47.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:47.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:05:47.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:05:47.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:05:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:05:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:05:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:05:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:05:47.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:05:47.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:05:47.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:05:47.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:05:47.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:05:47.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:05:47.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:05:47.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:47.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:05:47.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:05:47.808 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.808 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.809 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.809 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296741 5.3 5:c190c274:::benchmark_data_smithi043_32659_object129503:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:47.809 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:47.809 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.7281248580000002, 2024-09-12T22:05:47.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.051784984, 2024-09-12T22:05:47.809 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.809 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.809 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.809 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.809 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.809 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.809 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296741 2024-09-12T22:05:47.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.810 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:47.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:47.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016859+0000", 2024-09-12T22:05:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5600000000000004e-07 2024-09-12T22:05:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016863+0000", 2024-09-12T22:05:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5510000000000001e-06 2024-09-12T22:05:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016873+0000", 2024-09-12T22:05:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5319999999999995e-06 2024-09-12T22:05:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.812 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016879+0000", 2024-09-12T22:05:47.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5100000000000004e-06 2024-09-12T22:05:47.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.812 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016934+0000", 2024-09-12T22:05:47.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4734999999999997e-05 2024-09-12T22:05:47.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.812 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016941+0000", 2024-09-12T22:05:47.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1319999999999996e-06 2024-09-12T22:05:47.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.813 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055352+0000", 2024-09-12T22:05:47.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0384109260000001 2024-09-12T22:05:47.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.813 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055496+0000", 2024-09-12T22:05:47.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014437400000000001 2024-09-12T22:05:47.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.813 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055835+0000", 2024-09-12T22:05:47.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000338339 2024-09-12T22:05:47.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065163+0000", 2024-09-12T22:05:47.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093287690000000006 2024-09-12T22:05:47.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068506+0000", 2024-09-12T22:05:47.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033423620000000002 2024-09-12T22:05:47.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068557+0000", 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1057000000000003e-05 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068643+0000", 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5741000000000005e-05 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296774 5.3 5:c9ea392f:::benchmark_data_smithi043_32659_object129536:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:47.815 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.7143792360000001, 2024-09-12T22:05:47.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0383883359999999, 2024-09-12T22:05:47.816 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.816 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.816 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.816 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.816 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.816 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.816 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296774 2024-09-12T22:05:47.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.816 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.816 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:47.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:47.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030604+0000", 2024-09-12T22:05:47.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:05:47.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030607+0000", 2024-09-12T22:05:47.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0860000000000002e-06 2024-09-12T22:05:47.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030615+0000", 2024-09-12T22:05:47.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8120000000000008e-06 2024-09-12T22:05:47.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030620+0000", 2024-09-12T22:05:47.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6080000000000003e-06 2024-09-12T22:05:47.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030662+0000", 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1925999999999998e-05 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030670+0000", 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2359999999999998e-06 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065202+0000", 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0345323989999999 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065348+0000", 2024-09-12T22:05:47.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145575 2024-09-12T22:05:47.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065476+0000", 2024-09-12T22:05:47.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012800999999999999 2024-09-12T22:05:47.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068690+0000", 2024-09-12T22:05:47.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032143929999999999 2024-09-12T22:05:47.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068869+0000", 2024-09-12T22:05:47.821 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000179152 2024-09-12T22:05:47.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068914+0000", 2024-09-12T22:05:47.821 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4629999999999998e-05 2024-09-12T22:05:47.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068992+0000", 2024-09-12T22:05:47.821 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7885000000000004e-05 2024-09-12T22:05:47.821 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.822 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.822 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.822 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296793 5.3 5:c55bd684:::benchmark_data_smithi043_32659_object129555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:47.822 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:47.822 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.7075625890000001, 2024-09-12T22:05:47.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0317046320000001, 2024-09-12T22:05:47.822 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.822 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.822 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.822 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.822 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.822 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.823 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296793 2024-09-12T22:05:47.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.823 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.823 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:47.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.823 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:47.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037421+0000", 2024-09-12T22:05:47.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:05:47.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037425+0000", 2024-09-12T22:05:47.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9539999999999998e-06 2024-09-12T22:05:47.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037432+0000", 2024-09-12T22:05:47.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:05:47.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037436+0000", 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4320000000000001e-06 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037496+0000", 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9385999999999997e-05 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037503+0000", 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:05:47.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.826 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.826 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.826 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066427+0000", 2024-09-12T22:05:47.826 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.028923877 2024-09-12T22:05:47.826 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.826 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.826 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.826 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066519+0000", 2024-09-12T22:05:47.826 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1867000000000007e-05 2024-09-12T22:05:47.826 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.826 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.826 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.826 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066598+0000", 2024-09-12T22:05:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9175e-05 2024-09-12T22:05:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068804+0000", 2024-09-12T22:05:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002205664 2024-09-12T22:05:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069004+0000", 2024-09-12T22:05:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000200769 2024-09-12T22:05:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069050+0000", 2024-09-12T22:05:47.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5522999999999998e-05 2024-09-12T22:05:47.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069125+0000", 2024-09-12T22:05:47.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4530000000000006e-05 2024-09-12T22:05:47.828 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.828 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.828 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.828 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296796 5.3 5:cbc9dd25:::benchmark_data_smithi043_32659_object129558:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:47.828 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.7072649599999998, 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0315259400000001, 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296796 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:47.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.830 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:47.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.830 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037719+0000", 2024-09-12T22:05:47.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1069999999999999e-06 2024-09-12T22:05:47.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.830 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037723+0000", 2024-09-12T22:05:47.831 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1400000000000002e-06 2024-09-12T22:05:47.831 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.831 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.831 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.831 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037734+0000", 2024-09-12T22:05:47.831 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0991e-05 2024-09-12T22:05:47.831 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.831 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.831 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.831 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037741+0000", 2024-09-12T22:05:47.831 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6059999999999997e-06 2024-09-12T22:05:47.831 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.831 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.831 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.832 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037790+0000", 2024-09-12T22:05:47.832 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9112e-05 2024-09-12T22:05:47.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.832 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.832 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037797+0000", 2024-09-12T22:05:47.832 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:05:47.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.832 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.832 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067455+0000", 2024-09-12T22:05:47.832 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0296586320000001 2024-09-12T22:05:47.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067568+0000", 2024-09-12T22:05:47.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112895 2024-09-12T22:05:47.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067686+0000", 2024-09-12T22:05:47.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117879 2024-09-12T22:05:47.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068856+0000", 2024-09-12T22:05:47.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011693949999999999 2024-09-12T22:05:47.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069132+0000", 2024-09-12T22:05:47.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027629599999999999 2024-09-12T22:05:47.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069171+0000", 2024-09-12T22:05:47.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9536000000000002e-05 2024-09-12T22:05:47.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069243+0000", 2024-09-12T22:05:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2033999999999995e-05 2024-09-12T22:05:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296865 5.3 5:c0e17763:::benchmark_data_smithi043_32659_object129627:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.060875+0000", 2024-09-12T22:05:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.6841073629999999, 2024-09-12T22:05:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0133217349999999, 2024-09-12T22:05:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.836 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.836 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.836 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.836 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.836 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296865 2024-09-12T22:05:47.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.836 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.836 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.836 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.836 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060875+0000", 2024-09-12T22:05:47.836 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.836 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.836 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060875+0000", 2024-09-12T22:05:47.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.837 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060876+0000", 2024-09-12T22:05:47.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6500000000000008e-07 2024-09-12T22:05:47.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.837 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060881+0000", 2024-09-12T22:05:47.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:05:47.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060892+0000", 2024-09-12T22:05:47.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1583000000000001e-05 2024-09-12T22:05:47.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060899+0000", 2024-09-12T22:05:47.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.742e-06 2024-09-12T22:05:47.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.061193+0000", 2024-09-12T22:05:47.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00029414099999999999 2024-09-12T22:05:47.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.839 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.839 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.061201+0000", 2024-09-12T22:05:47.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9200000000000004e-06 2024-09-12T22:05:47.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.839 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.839 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069278+0000", 2024-09-12T22:05:47.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.008076857 2024-09-12T22:05:47.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.839 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069396+0000", 2024-09-12T22:05:47.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118504 2024-09-12T22:05:47.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069510+0000", 2024-09-12T22:05:47.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114079 2024-09-12T22:05:47.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074033+0000", 2024-09-12T22:05:47.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045228459999999996 2024-09-12T22:05:47.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074086+0000", 2024-09-12T22:05:47.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2395999999999998e-05 2024-09-12T22:05:47.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074143+0000", 2024-09-12T22:05:47.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7518000000000001e-05 2024-09-12T22:05:47.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074197+0000", 2024-09-12T22:05:47.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3613999999999999e-05 2024-09-12T22:05:47.841 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296897 5.3 5:c39fcaa1:::benchmark_data_smithi043_32659_object129659:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.6710717930000003, 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.000488958, 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.842 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296897 2024-09-12T22:05:47.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.843 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:47.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:47.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:05:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073913+0000", 2024-09-12T22:05:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8789999999999999e-06 2024-09-12T22:05:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073918+0000", 2024-09-12T22:05:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:05:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073923+0000", 2024-09-12T22:05:47.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8450000000000002e-06 2024-09-12T22:05:47.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073989+0000", 2024-09-12T22:05:47.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5610000000000004e-05 2024-09-12T22:05:47.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073997+0000", 2024-09-12T22:05:47.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0830000000000004e-06 2024-09-12T22:05:47.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.070494+0000", 2024-09-12T22:05:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99649657700000005 2024-09-12T22:05:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.070622+0000", 2024-09-12T22:05:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000128336 2024-09-12T22:05:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.070737+0000", 2024-09-12T22:05:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115021 2024-09-12T22:05:47.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.847 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074248+0000", 2024-09-12T22:05:47.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035110129999999999 2024-09-12T22:05:47.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.847 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074261+0000", 2024-09-12T22:05:47.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3127e-05 2024-09-12T22:05:47.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.847 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074310+0000", 2024-09-12T22:05:47.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8930000000000001e-05 2024-09-12T22:05:47.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074400+0000", 2024-09-12T22:05:47.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9716999999999995e-05 2024-09-12T22:05:47.848 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.848 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.848 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.848 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296905 5.3 5:c5d41e92:::benchmark_data_smithi043_32659_object129667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:47.849 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.076778+0000", 2024-09-12T22:05:47.849 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.6682040430000002, 2024-09-12T22:05:47.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.997726954, 2024-09-12T22:05:47.849 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.849 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.849 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.849 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.849 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.849 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.849 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296905 2024-09-12T22:05:47.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.852 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076778+0000", 2024-09-12T22:05:47.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076778+0000", 2024-09-12T22:05:47.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076779+0000", 2024-09-12T22:05:47.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3e-07 2024-09-12T22:05:47.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076782+0000", 2024-09-12T22:05:47.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0790000000000001e-06 2024-09-12T22:05:47.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.854 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076790+0000", 2024-09-12T22:05:47.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0050000000000004e-06 2024-09-12T22:05:47.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.854 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076795+0000", 2024-09-12T22:05:47.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4139999999999996e-06 2024-09-12T22:05:47.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.854 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076838+0000", 2024-09-12T22:05:47.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591999999999999e-05 2024-09-12T22:05:47.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076844+0000", 2024-09-12T22:05:47.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:47.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.071643+0000", 2024-09-12T22:05:47.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99479885499999998 2024-09-12T22:05:47.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.071749+0000", 2024-09-12T22:05:47.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106165 2024-09-12T22:05:47.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.071864+0000", 2024-09-12T22:05:47.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011547 2024-09-12T22:05:47.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074409+0000", 2024-09-12T22:05:47.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025444550000000002 2024-09-12T22:05:47.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074429+0000", 2024-09-12T22:05:47.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0412e-05 2024-09-12T22:05:47.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074455+0000", 2024-09-12T22:05:47.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6318000000000001e-05 2024-09-12T22:05:47.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074505+0000", 2024-09-12T22:05:47.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0086000000000001e-05 2024-09-12T22:05:47.857 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.857 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296917 5.3 5:c2604485:::benchmark_data_smithi043_32659_object129679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.6642419750000004, 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99672535699999998, 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296917 2024-09-12T22:05:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:47.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7000000000000004e-07 2024-09-12T22:05:47.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080744+0000", 2024-09-12T22:05:47.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2320000000000001e-06 2024-09-12T22:05:47.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080752+0000", 2024-09-12T22:05:47.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2980000000000003e-06 2024-09-12T22:05:47.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080758+0000", 2024-09-12T22:05:47.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:05:47.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080802+0000", 2024-09-12T22:05:47.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4607000000000002e-05 2024-09-12T22:05:47.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080811+0000", 2024-09-12T22:05:47.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9020000000000005e-06 2024-09-12T22:05:47.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.072838+0000", 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99202686100000004 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.072952+0000", 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000113606 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.073064+0000", 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0001126 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074554+0000", 2024-09-12T22:05:47.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014899609999999999 2024-09-12T22:05:47.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077381+0000", 2024-09-12T22:05:47.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028265400000000002 2024-09-12T22:05:47.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077408+0000", 2024-09-12T22:05:47.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7508000000000002e-05 2024-09-12T22:05:47.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077466+0000", 2024-09-12T22:05:47.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7707000000000002e-05 2024-09-12T22:05:47.864 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.864 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.864 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.864 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296918 5.3 5:c3e8680d:::benchmark_data_smithi043_32659_object129680:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:47.864 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.081205+0000", 2024-09-12T22:05:47.864 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.6637774670000001, 2024-09-12T22:05:47.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99634571100000002, 2024-09-12T22:05:47.864 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.865 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.865 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.865 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.865 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.865 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.865 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296918 2024-09-12T22:05:47.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.865 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081205+0000", 2024-09-12T22:05:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081205+0000", 2024-09-12T22:05:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081206+0000", 2024-09-12T22:05:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5899999999999995e-07 2024-09-12T22:05:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081210+0000", 2024-09-12T22:05:47.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0169999999999998e-06 2024-09-12T22:05:47.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081220+0000", 2024-09-12T22:05:47.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0573e-05 2024-09-12T22:05:47.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081229+0000", 2024-09-12T22:05:47.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8270000000000004e-06 2024-09-12T22:05:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081274+0000", 2024-09-12T22:05:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5102999999999998e-05 2024-09-12T22:05:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081282+0000", 2024-09-12T22:05:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3159999999999999e-06 2024-09-12T22:05:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074575+0000", 2024-09-12T22:05:47.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99329281599999997 2024-09-12T22:05:47.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074651+0000", 2024-09-12T22:05:47.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6202e-05 2024-09-12T22:05:47.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074715+0000", 2024-09-12T22:05:47.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4115999999999994e-05 2024-09-12T22:05:47.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077371+0000", 2024-09-12T22:05:47.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026562119999999998 2024-09-12T22:05:47.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077474+0000", 2024-09-12T22:05:47.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000102437 2024-09-12T22:05:47.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.871 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077498+0000", 2024-09-12T22:05:47.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4445000000000001e-05 2024-09-12T22:05:47.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.871 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.871 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077551+0000", 2024-09-12T22:05:47.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2787999999999997e-05 2024-09-12T22:05:47.871 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.871 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.871 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.871 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296921 5.3 5:c1fc9263:::benchmark_data_smithi043_32659_object129683:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:47.871 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.084330+0000", 2024-09-12T22:05:47.872 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.6606522579999998, 2024-09-12T22:05:47.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99642918800000002, 2024-09-12T22:05:47.872 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.872 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.872 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.872 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.872 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.872 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.872 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296921 2024-09-12T22:05:47.872 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.872 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084330+0000", 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084330+0000", 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084331+0000", 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6499999999999999e-07 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084333+0000", 2024-09-12T22:05:47.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5189999999999999e-06 2024-09-12T22:05:47.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084342+0000", 2024-09-12T22:05:47.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.132e-06 2024-09-12T22:05:47.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084348+0000", 2024-09-12T22:05:47.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:05:47.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084380+0000", 2024-09-12T22:05:47.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2166999999999999e-05 2024-09-12T22:05:47.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084385+0000", 2024-09-12T22:05:47.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2789999999999998e-06 2024-09-12T22:05:47.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.075392+0000", 2024-09-12T22:05:47.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99100684299999997 2024-09-12T22:05:47.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.075503+0000", 2024-09-12T22:05:47.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111119 2024-09-12T22:05:47.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.075609+0000", 2024-09-12T22:05:47.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105516 2024-09-12T22:05:47.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077607+0000", 2024-09-12T22:05:47.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019978349999999999 2024-09-12T22:05:47.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080656+0000", 2024-09-12T22:05:47.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030494860000000001 2024-09-12T22:05:47.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080683+0000", 2024-09-12T22:05:47.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6721999999999999e-05 2024-09-12T22:05:47.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080759+0000", 2024-09-12T22:05:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6631000000000005e-05 2024-09-12T22:05:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296926 5.3 5:c88c2a98:::benchmark_data_smithi043_32659_object129688:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.087117+0000", 2024-09-12T22:05:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.6578652119999999, 2024-09-12T22:05:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99371757999999999, 2024-09-12T22:05:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296926 2024-09-12T22:05:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087117+0000", 2024-09-12T22:05:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:47.879 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087117+0000", 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087118+0000", 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3200000000000004e-07 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087122+0000", 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:47.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087131+0000", 2024-09-12T22:05:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9020000000000005e-06 2024-09-12T22:05:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087138+0000", 2024-09-12T22:05:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.832e-06 2024-09-12T22:05:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087178+0000", 2024-09-12T22:05:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9727000000000001e-05 2024-09-12T22:05:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087183+0000", 2024-09-12T22:05:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9810000000000003e-06 2024-09-12T22:05:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.076485+0000", 2024-09-12T22:05:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.98930243299999998 2024-09-12T22:05:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.076572+0000", 2024-09-12T22:05:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6493e-05 2024-09-12T22:05:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.076633+0000", 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1136000000000006e-05 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.079747+0000", 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031138609999999999 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080765+0000", 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001018232 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080790+0000", 2024-09-12T22:05:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5099000000000001e-05 2024-09-12T22:05:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080835+0000", 2024-09-12T22:05:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4903e-05 2024-09-12T22:05:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:47.884 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:47.886 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:47.885+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:47.886 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:47.987 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:47.985+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:48.031 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:307554 5.7 5:ed6b1c8f:::benchmark_data_smithi043_32659_object140316:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:48.021312+0000", 2024-09-12T22:05:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0086871710000000005, 2024-09-12T22:05:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0087038140000000007, 2024-09-12T22:05:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 307554 2024-09-12T22:05:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021312+0000", 2024-09-12T22:05:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021312+0000", 2024-09-12T22:05:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021313+0000", 2024-09-12T22:05:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-12T22:05:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021317+0000", 2024-09-12T22:05:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.454e-06 2024-09-12T22:05:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021327+0000", 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8449999999999998e-06 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021344+0000", 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6634999999999999e-05 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021392+0000", 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8573999999999999e-05 2024-09-12T22:05:48.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021566+0000", 2024-09-12T22:05:48.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017318100000000001 2024-09-12T22:05:48.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021700+0000", 2024-09-12T22:05:48.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013405700000000001 2024-09-12T22:05:48.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.025234+0000", 2024-09-12T22:05:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003533947 2024-09-12T22:05:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:307555 5.7 5:e615f4ec:::benchmark_data_smithi043_32659_object140317:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:48.021365+0000", 2024-09-12T22:05:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0086341500000000002, 2024-09-12T22:05:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008710822, 2024-09-12T22:05:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 307555 2024-09-12T22:05:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021365+0000", 2024-09-12T22:05:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021365+0000", 2024-09-12T22:05:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021366+0000", 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8400000000000004e-07 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021368+0000", 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.712e-06 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021377+0000", 2024-09-12T22:05:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6410000000000008e-06 2024-09-12T22:05:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.021382+0000", 2024-09-12T22:05:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3709999999999999e-06 2024-09-12T22:05:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.023379+0000", 2024-09-12T22:05:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019964480000000001 2024-09-12T22:05:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.023497+0000", 2024-09-12T22:05:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118187 2024-09-12T22:05:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.023586+0000", 2024-09-12T22:05:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9499000000000005e-05 2024-09-12T22:05:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.025275+0000", 2024-09-12T22:05:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00168892 2024-09-12T22:05:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:307566 5.1 5:816a288e:::benchmark_data_smithi043_32659_object140328:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:48.025261+0000", 2024-09-12T22:05:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0047377069999999999, 2024-09-12T22:05:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048740930000000003, 2024-09-12T22:05:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 307566 2024-09-12T22:05:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.025261+0000", 2024-09-12T22:05:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.025261+0000", 2024-09-12T22:05:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.025262+0000", 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000003e-07 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.025267+0000", 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5970000000000002e-06 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.025278+0000", 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0951999999999999e-05 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.025285+0000", 2024-09-12T22:05:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7449999999999998e-06 2024-09-12T22:05:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.025330+0000", 2024-09-12T22:05:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.545e-05 2024-09-12T22:05:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.025491+0000", 2024-09-12T22:05:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160908 2024-09-12T22:05:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.025611+0000", 2024-09-12T22:05:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120201 2024-09-12T22:05:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.027486+0000", 2024-09-12T22:05:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018746920000000001 2024-09-12T22:05:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:307570 5.7 5:e41906ba:::benchmark_data_smithi043_32659_object140332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:48.026019+0000", 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0039801519999999998, 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041724839999999997, 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 307570 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026019+0000", 2024-09-12T22:05:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026019+0000", 2024-09-12T22:05:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026020+0000", 2024-09-12T22:05:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6400000000000002e-07 2024-09-12T22:05:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026023+0000", 2024-09-12T22:05:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5829999999999998e-06 2024-09-12T22:05:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026032+0000", 2024-09-12T22:05:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6859999999999995e-06 2024-09-12T22:05:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026037+0000", 2024-09-12T22:05:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7430000000000002e-06 2024-09-12T22:05:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026669+0000", 2024-09-12T22:05:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063268000000000005 2024-09-12T22:05:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026786+0000", 2024-09-12T22:05:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011675099999999999 2024-09-12T22:05:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026898+0000", 2024-09-12T22:05:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111978 2024-09-12T22:05:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.028525+0000", 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00162659 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:307568 5.9 e67/40 5:9af71619:::benchmark_data_smithi043_32659_object140330:head v 67'19379, mlcod=67'19377)", 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:48.026654+0000", 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.003345265, 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035795710000000001, 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026654+0000", 2024-09-12T22:05:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026654+0000", 2024-09-12T22:05:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026654+0000", 2024-09-12T22:05:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-07 2024-09-12T22:05:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026658+0000", 2024-09-12T22:05:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:05:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026666+0000", 2024-09-12T22:05:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:05:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026670+0000", 2024-09-12T22:05:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:05:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026712+0000", 2024-09-12T22:05:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1968999999999997e-05 2024-09-12T22:05:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.026731+0000", 2024-09-12T22:05:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9085000000000001e-05 2024-09-12T22:05:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:307574 5.d e67/40 5:b848ad9d:::benchmark_data_smithi043_32659_object140336:head v 67'18958, mlcod=67'18956)", 2024-09-12T22:05:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:48.028685+0000", 2024-09-12T22:05:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0013141400000000001, 2024-09-12T22:05:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015878660000000001, 2024-09-12T22:05:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.028685+0000", 2024-09-12T22:05:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.028685+0000", 2024-09-12T22:05:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.028686+0000", 2024-09-12T22:05:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8500000000000001e-07 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.028689+0000", 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9969999999999999e-06 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.028695+0000", 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2199999999999997e-06 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.028700+0000", 2024-09-12T22:05:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4389999999999999e-06 2024-09-12T22:05:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.028737+0000", 2024-09-12T22:05:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7122999999999997e-05 2024-09-12T22:05:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.028753+0000", 2024-09-12T22:05:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-12T22:05:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:307580 5.1 5:823403d0:::benchmark_data_smithi043_32659_object140342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:48.029194+0000", 2024-09-12T22:05:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00080545300000000003, 2024-09-12T22:05:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011192870000000001, 2024-09-12T22:05:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 307580 2024-09-12T22:05:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.029194+0000", 2024-09-12T22:05:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.029194+0000", 2024-09-12T22:05:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.029195+0000", 2024-09-12T22:05:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7999999999999993e-07 2024-09-12T22:05:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.029199+0000", 2024-09-12T22:05:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.029210+0000", 2024-09-12T22:05:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1019000000000001e-05 2024-09-12T22:05:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.029217+0000", 2024-09-12T22:05:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6050000000000003e-06 2024-09-12T22:05:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.029281+0000", 2024-09-12T22:05:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4618999999999999e-05 2024-09-12T22:05:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.029469+0000", 2024-09-12T22:05:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187219 2024-09-12T22:05:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:48.029593+0000", 2024-09-12T22:05:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124134 2024-09-12T22:05:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 7 2024-09-12T22:05:48.066 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:48.067 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:05:48.068 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:48.088 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:48.087+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:48.188 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:48.187+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:48.252 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:48.252 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:48.252 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:48.252 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:48.253 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:48.263 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:48.304 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:48.303+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:48.390 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:48.388+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:48.444 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:48.444 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:48.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:48.444 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:48.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.445 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:48.445 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:48.445 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.030669141999994, 2024-09-12T22:05:48.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:48.445 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.445 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.445 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:48.445 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.445 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.445 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.445 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:48.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.446 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:48.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:48.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:48.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:48.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:48.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:48.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:48.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:48.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.450 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.450 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.450 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:48.450 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:48.450 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.030489212000006, 2024-09-12T22:05:48.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:48.450 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.450 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.450 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:48.450 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.450 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.451 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.451 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:48.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.451 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:48.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:48.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:48.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:48.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:48.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:48.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:48.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:48.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:48.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:48.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:48.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:48.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:48.455 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.455 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.455 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.455 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:48.455 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:48.455 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.030422771000005, 2024-09-12T22:05:48.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:48.455 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.455 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.455 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:48.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.456 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:48.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.456 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:48.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:48.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:48.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:48.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:48.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:48.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:48.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:48.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:48.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:48.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:48.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:48.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:48.459 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.030366327999999, 2024-09-12T22:05:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.030297868000005, 2024-09-12T22:05:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.030240133000007, 2024-09-12T22:05:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.030172441000005, 2024-09-12T22:05:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.030117379000004, 2024-09-12T22:05:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.989469858999996, 2024-09-12T22:05:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.986856130999996, 2024-09-12T22:05:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.441642035000001, 2024-09-12T22:05:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.441163547000002, 2024-09-12T22:05:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.438668246999995, 2024-09-12T22:05:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.437587456000003, 2024-09-12T22:05:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.436351893999998, 2024-09-12T22:05:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 38.995611406000002, 2024-09-12T22:05:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 38.991080979000003, 2024-09-12T22:05:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 38.991056950000001, 2024-09-12T22:05:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 38.990879301, 2024-09-12T22:05:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:48.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:48.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:48.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:48.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:48.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:48.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:48.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:48.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:48.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:48.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:48.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:48.569 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.569 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 38.988860764000002, 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:48.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.571 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:48.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:48.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:48.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:48.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:48.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:48.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:48.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:48.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:48.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:48.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:48.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:48.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:48.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:48.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:48.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:48.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:48.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:48.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:48.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:48.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:48.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:48.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:48.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:48.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:48.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:48.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:48.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:48.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:48.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.575 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:48.576 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:48.576 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:48.577 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:48.577 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:48.575+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:48.678 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:48.677+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:48.739 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:48.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.739 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "pg_backfill(progress 5.7 e 67/67 lb 5:ea80a6ff:::benchmark_data_smithi043_32659_object166115:head)", 2024-09-12T22:05:48.739 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.736005+0000", 2024-09-12T22:05:48.739 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00080710799999999996, 2024-09-12T22:05:48.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000832065, 2024-09-12T22:05:48.739 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.739 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.740 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:48.740 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736005+0000", 2024-09-12T22:05:48.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736005+0000", 2024-09-12T22:05:48.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736005+0000", 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2199999999999999e-07 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736012+0000", 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3429999999999998e-06 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736020+0000", 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7719999999999994e-06 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736026+0000", 2024-09-12T22:05:48.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.365e-06 2024-09-12T22:05:48.742 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.742 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.742 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.742 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:309541 5.4 5:2ad83d0c:::benchmark_data_smithi043_32659_object142303:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.742 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.728246+0000", 2024-09-12T22:05:48.742 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.008565919, 2024-09-12T22:05:48.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0086449549999999993, 2024-09-12T22:05:48.742 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.742 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.743 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:48.743 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:48.743 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:48.743 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.743 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 309541 2024-09-12T22:05:48.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.743 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.728246+0000", 2024-09-12T22:05:48.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.728246+0000", 2024-09-12T22:05:48.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.728247+0000", 2024-09-12T22:05:48.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1689999999999999e-06 2024-09-12T22:05:48.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.728251+0000", 2024-09-12T22:05:48.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9999999999999998e-06 2024-09-12T22:05:48.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.728259+0000", 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1310000000000006e-06 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.728265+0000", 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2169999999999999e-06 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.729746+0000", 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014803220000000001 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.729891+0000", 2024-09-12T22:05:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145449 2024-09-12T22:05:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736749+0000", 2024-09-12T22:05:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0068575229999999999 2024-09-12T22:05:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:309555 5.3 e67/65)", 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.736061+0000", 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00075075800000000002, 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00089683700000000005, 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736061+0000", 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736061+0000", 2024-09-12T22:05:48.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736061+0000", 2024-09-12T22:05:48.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7899999999999999e-07 2024-09-12T22:05:48.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736064+0000", 2024-09-12T22:05:48.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8459999999999999e-06 2024-09-12T22:05:48.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736071+0000", 2024-09-12T22:05:48.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6120000000000004e-06 2024-09-12T22:05:48.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736076+0000", 2024-09-12T22:05:48.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3410000000000002e-06 2024-09-12T22:05:48.749 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.749 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.749 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.749 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:309566 5.8 5:18cf460b:::benchmark_data_smithi043_32659_object142328:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.749 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.736065+0000", 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00074649799999999995, 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00094015199999999998, 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 309566 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736065+0000", 2024-09-12T22:05:48.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736065+0000", 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736066+0000", 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1999999999999999e-07 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736069+0000", 2024-09-12T22:05:48.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6399999999999999e-06 2024-09-12T22:05:48.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736077+0000", 2024-09-12T22:05:48.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3710000000000002e-06 2024-09-12T22:05:48.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736082+0000", 2024-09-12T22:05:48.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.395e-06 2024-09-12T22:05:48.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:48.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736131+0000", 2024-09-12T22:05:48.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8952999999999997e-05 2024-09-12T22:05:48.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:48.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736284+0000", 2024-09-12T22:05:48.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015307600000000001 2024-09-12T22:05:48.753 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.753 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.753 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.753 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:309567 5.0 5:0058a47a:::benchmark_data_smithi043_32659_object142329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.753 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.736096+0000", 2024-09-12T22:05:48.753 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00071538299999999999, 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00096904999999999995, 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 309567 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736096+0000", 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736096+0000", 2024-09-12T22:05:48.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736097+0000", 2024-09-12T22:05:48.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:05:48.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736099+0000", 2024-09-12T22:05:48.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0789999999999999e-06 2024-09-12T22:05:48.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736105+0000", 2024-09-12T22:05:48.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8640000000000001e-06 2024-09-12T22:05:48.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736109+0000", 2024-09-12T22:05:48.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:05:48.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:48.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736229+0000", 2024-09-12T22:05:48.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011948200000000001 2024-09-12T22:05:48.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:48.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736672+0000", 2024-09-12T22:05:48.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00044328100000000001 2024-09-12T22:05:48.757 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.757 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.757 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.757 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:309562 5.7 e67/40 5:e9f65495:::benchmark_data_smithi043_32659_object142324:head v 67'19458, mlcod=67'19456)", 2024-09-12T22:05:48.757 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.736273+0000", 2024-09-12T22:05:48.757 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00053839399999999998, 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00084993700000000004, 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736273+0000", 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736273+0000", 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736274+0000", 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4000000000000001e-07 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736280+0000", 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4330000000000001e-06 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736291+0000", 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0705e-05 2024-09-12T22:05:48.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736298+0000", 2024-09-12T22:05:48.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.652e-06 2024-09-12T22:05:48.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:48.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736431+0000", 2024-09-12T22:05:48.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013360999999999999 2024-09-12T22:05:48.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:48.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736451+0000", 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9431000000000001e-05 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:309558 5.9 e67/40)", 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.736877+0000", 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9999347, 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00029965500000000002, 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736877+0000", 2024-09-12T22:05:48.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736877+0000", 2024-09-12T22:05:48.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736878+0000", 2024-09-12T22:05:48.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4000000000000001e-07 2024-09-12T22:05:48.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736882+0000", 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0960000000000003e-06 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736891+0000", 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5610000000000004e-06 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736898+0000", 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3929999999999996e-06 2024-09-12T22:05:48.763 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.764 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.764 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.764 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.764 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:309550 5.3 5:cb7ae394:::benchmark_data_smithi043_32659_object142312:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.764 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.732726+0000", 2024-09-12T22:05:48.764 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0040857319999999999, 2024-09-12T22:05:48.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0044991839999999998, 2024-09-12T22:05:48.764 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.764 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.764 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:48.764 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:48.764 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:48.764 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 309550 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.732726+0000", 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.732726+0000", 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.765 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.732726+0000", 2024-09-12T22:05:48.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4600000000000005e-07 2024-09-12T22:05:48.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.732729+0000", 2024-09-12T22:05:48.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8159999999999998e-06 2024-09-12T22:05:48.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.732737+0000", 2024-09-12T22:05:48.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4390000000000003e-06 2024-09-12T22:05:48.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.732743+0000", 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1340000000000001e-06 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.732779+0000", 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6362000000000002e-05 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.732864+0000", 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4779999999999998e-05 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:48.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.732930+0000", 2024-09-12T22:05:48.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6335999999999996e-05 2024-09-12T22:05:48.768 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.768 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.768 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.768 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:309555 5.3 5:cdeb05f7:::benchmark_data_smithi043_32659_object142317:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.768 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.734203+0000", 2024-09-12T22:05:48.768 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0026090649999999998, 2024-09-12T22:05:48.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003096746, 2024-09-12T22:05:48.769 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.769 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.769 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:48.769 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:48.769 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:48.769 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.769 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 309555 2024-09-12T22:05:48.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.769 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734203+0000", 2024-09-12T22:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734203+0000", 2024-09-12T22:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734204+0000", 2024-09-12T22:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.257e-06 2024-09-12T22:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734208+0000", 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2830000000000003e-06 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734220+0000", 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1620000000000001e-05 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734226+0000", 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:48.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734443+0000", 2024-09-12T22:05:48.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000216987 2024-09-12T22:05:48.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:48.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734632+0000", 2024-09-12T22:05:48.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018901700000000001 2024-09-12T22:05:48.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:48.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734736+0000", 2024-09-12T22:05:48.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103997 2024-09-12T22:05:48.772 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.773 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.773 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.773 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4514.0:309550 5.3 e67/65)", 2024-09-12T22:05:48.773 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.734476+0000", 2024-09-12T22:05:48.773 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002336051, 2024-09-12T22:05:48.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028903850000000001, 2024-09-12T22:05:48.773 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.773 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.773 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:48.774 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734476+0000", 2024-09-12T22:05:48.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734476+0000", 2024-09-12T22:05:48.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734476+0000", 2024-09-12T22:05:48.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3399999999999998e-07 2024-09-12T22:05:48.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734480+0000", 2024-09-12T22:05:48.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:05:48.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734488+0000", 2024-09-12T22:05:48.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6120000000000001e-06 2024-09-12T22:05:48.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.776 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734494+0000", 2024-09-12T22:05:48.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:05:48.776 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.776 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.776 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.776 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:309557 5.3 5.9cf37013 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.776 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.734835+0000", 2024-09-12T22:05:48.776 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0019761819999999999, 2024-09-12T22:05:48.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025771409999999998, 2024-09-12T22:05:48.776 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.776 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.776 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 309557 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734835+0000", 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734835+0000", 2024-09-12T22:05:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734836+0000", 2024-09-12T22:05:48.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6799999999999999e-07 2024-09-12T22:05:48.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734840+0000", 2024-09-12T22:05:48.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9580000000000001e-06 2024-09-12T22:05:48.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734850+0000", 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4520000000000003e-06 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734856+0000", 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3640000000000004e-06 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:309558 5.9 5:94ae85f6:::benchmark_data_smithi043_32659_object142320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.734919+0000", 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001892735, 2024-09-12T22:05:48.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025484869999999999, 2024-09-12T22:05:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 309558 2024-09-12T22:05:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734919+0000", 2024-09-12T22:05:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734919+0000", 2024-09-12T22:05:48.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734921+0000", 2024-09-12T22:05:48.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0729999999999999e-06 2024-09-12T22:05:48.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734924+0000", 2024-09-12T22:05:48.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.428e-06 2024-09-12T22:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734933+0000", 2024-09-12T22:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2859999999999999e-06 2024-09-12T22:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734939+0000", 2024-09-12T22:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8850000000000004e-06 2024-09-12T22:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735002+0000", 2024-09-12T22:05:48.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3105e-05 2024-09-12T22:05:48.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:48.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735113+0000", 2024-09-12T22:05:48.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011168299999999999 2024-09-12T22:05:48.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:48.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735209+0000", 2024-09-12T22:05:48.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5488999999999993e-05 2024-09-12T22:05:48.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.737317+0000", 2024-09-12T22:05:48.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021077510000000002 2024-09-12T22:05:48.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:48.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.737377+0000", 2024-09-12T22:05:48.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0729000000000001e-05 2024-09-12T22:05:48.784 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.784 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.784 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.785 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:309559 5.b 5.859875bb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.785 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.734996+0000", 2024-09-12T22:05:48.785 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001815145, 2024-09-12T22:05:48.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002549398, 2024-09-12T22:05:48.785 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.785 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.785 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:48.785 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:48.785 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:48.785 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.785 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 309559 2024-09-12T22:05:48.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.785 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734996+0000", 2024-09-12T22:05:48.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734996+0000", 2024-09-12T22:05:48.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.734997+0000", 2024-09-12T22:05:48.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6799999999999999e-07 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735001+0000", 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4429999999999999e-06 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735008+0000", 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0979999999999996e-06 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735013+0000", 2024-09-12T22:05:48.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:48.788 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.788 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.788 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.788 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:309560 5.6 5:6cd39601:::benchmark_data_smithi043_32659_object142322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.788 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.735138+0000", 2024-09-12T22:05:48.788 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00167322, 2024-09-12T22:05:48.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024599819999999999, 2024-09-12T22:05:48.788 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.788 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.788 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:48.788 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:48.788 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:48.789 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.789 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 309560 2024-09-12T22:05:48.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.789 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735138+0000", 2024-09-12T22:05:48.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735138+0000", 2024-09-12T22:05:48.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735139+0000", 2024-09-12T22:05:48.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4099999999999998e-07 2024-09-12T22:05:48.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735143+0000", 2024-09-12T22:05:48.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6179999999999999e-06 2024-09-12T22:05:48.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735152+0000", 2024-09-12T22:05:48.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1400000000000006e-06 2024-09-12T22:05:48.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735158+0000", 2024-09-12T22:05:48.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2639999999999997e-06 2024-09-12T22:05:48.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:48.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735210+0000", 2024-09-12T22:05:48.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2011000000000001e-05 2024-09-12T22:05:48.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:48.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735335+0000", 2024-09-12T22:05:48.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012529899999999999 2024-09-12T22:05:48.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:48.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735452+0000", 2024-09-12T22:05:48.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116452 2024-09-12T22:05:48.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:48.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.737365+0000", 2024-09-12T22:05:48.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00191315 2024-09-12T22:05:48.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:48.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.737600+0000", 2024-09-12T22:05:48.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000234794 2024-09-12T22:05:48.793 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.793 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.793 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.793 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:309563 5.a 5:515ec860:::benchmark_data_smithi043_32659_object142325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.793 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.735826+0000", 2024-09-12T22:05:48.793 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00098513899999999989, 2024-09-12T22:05:48.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001857229, 2024-09-12T22:05:48.793 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.793 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.793 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 309563 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735826+0000", 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735826+0000", 2024-09-12T22:05:48.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735827+0000", 2024-09-12T22:05:48.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0400000000000005e-07 2024-09-12T22:05:48.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735832+0000", 2024-09-12T22:05:48.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1559999999999997e-06 2024-09-12T22:05:48.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735841+0000", 2024-09-12T22:05:48.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4730000000000006e-06 2024-09-12T22:05:48.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735855+0000", 2024-09-12T22:05:48.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3919e-05 2024-09-12T22:05:48.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:48.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735902+0000", 2024-09-12T22:05:48.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6977000000000001e-05 2024-09-12T22:05:48.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:48.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736055+0000", 2024-09-12T22:05:48.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015330899999999999 2024-09-12T22:05:48.797 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.797 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.797 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.797 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:309564 5.f 5:f1aa2047:::benchmark_data_smithi043_32659_object142326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.797 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.735899+0000", 2024-09-12T22:05:48.797 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00091279900000000005, 2024-09-12T22:05:48.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001857605, 2024-09-12T22:05:48.798 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.798 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.798 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:48.798 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:48.798 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:48.798 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.798 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 309564 2024-09-12T22:05:48.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.798 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735899+0000", 2024-09-12T22:05:48.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735899+0000", 2024-09-12T22:05:48.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735899+0000", 2024-09-12T22:05:48.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2900000000000003e-07 2024-09-12T22:05:48.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735905+0000", 2024-09-12T22:05:48.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:48.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.800 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735913+0000", 2024-09-12T22:05:48.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1790000000000008e-06 2024-09-12T22:05:48.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.800 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735918+0000", 2024-09-12T22:05:48.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:05:48.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:48.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.736009+0000", 2024-09-12T22:05:48.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0092000000000004e-05 2024-09-12T22:05:48.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:48.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.737537+0000", 2024-09-12T22:05:48.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015282799999999999 2024-09-12T22:05:48.801 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.801 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.801 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.801 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDPGPush(5.7 67/40 [PushOp(5:ea81ab14:::benchmark_data_smithi043_32659_object148879:head, version: 45'9323, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:ea81ab14:::benchmark_data_smithi043_32659_object148879:head@45'9323, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T22:05:48.802 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.735854+0000", 2024-09-12T22:05:48.802 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00095747099999999999, 2024-09-12T22:05:48.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001996697, 2024-09-12T22:05:48.802 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.802 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.802 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:48.802 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735854+0000", 2024-09-12T22:05:48.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735854+0000", 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735855+0000", 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2300000000000001e-07 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735937+0000", 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2719999999999994e-05 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735954+0000", 2024-09-12T22:05:48.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6946999999999999e-05 2024-09-12T22:05:48.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735968+0000", 2024-09-12T22:05:48.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.33e-05 2024-09-12T22:05:48.804 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.804 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.804 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.804 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:309565 5.3 5.73d5dd93 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T22:05:48.804 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:48.735942+0000", 2024-09-12T22:05:48.805 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00086914900000000005, 2024-09-12T22:05:48.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019558520000000001, 2024-09-12T22:05:48.805 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:48.805 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:48.805 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:48.805 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:48.805 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:48.805 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:48.805 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 309565 2024-09-12T22:05:48.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.805 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:48.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:48.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735942+0000", 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735942+0000", 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735943+0000", 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:48.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735946+0000", 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4889999999999998e-06 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735955+0000", 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0659999999999993e-06 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:48.735959+0000", 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7829999999999998e-06 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.807 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:48.808 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:48.808 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 18 2024-09-12T22:05:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:48.809 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:48.809 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:48.808+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:48.909 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:48.908+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:49.002 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:49.002 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:49.002 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:49.010 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:49.009+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:49.016 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:49.027 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-09-12T22:05:49.112 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:49.111+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:49.204 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:49.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:49.204 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:49.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.204 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:49.204 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:49.204 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 27.236002707000001, 2024-09-12T22:05:49.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:05:49.204 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.204 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.204 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.204 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.204 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.205 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.205 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:05:49.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.205 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:49.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:49.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:05:49.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:05:49.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:05:49.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:05:49.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:05:49.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:05:49.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:05:49.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:05:49.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:05:49.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:05:49.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:05:49.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:05:49.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:05:49.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 27.233969982000001, 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.211 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.212 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.212 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:05:49.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.212 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:49.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:49.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:05:49.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:05:49.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:05:49.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.217 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.217 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:05:49.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:05:49.217 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.217 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.217 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.217 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:49.217 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:49.217 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 27.230957717999999, 2024-09-12T22:05:49.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:05:49.217 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:49.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:05:49.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:05:49.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:05:49.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:49.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:05:49.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:05:49.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:05:49.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:05:49.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:05:49.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:05:49.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:05:49.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.223 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:49.224 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:49.224 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 27.229971228, 2024-09-12T22:05:49.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:05:49.224 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.224 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.224 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.224 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.224 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.224 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.224 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:05:49.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.224 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.224 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:49.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:49.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:05:49.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:49.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:05:49.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:05:49.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:05:49.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:05:49.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:05:49.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:05:49.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:05:49.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:05:49.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:05:49.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:05:49.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:05:49.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:05:49.230 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.230 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.230 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.230 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:49.230 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:49.230 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 27.224884593999999, 2024-09-12T22:05:49.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:05:49.230 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.230 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.231 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.231 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.231 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.231 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.231 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:05:49.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.231 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.231 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:49.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.231 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:05:49.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:05:49.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:05:49.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:05:49.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:05:49.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:05:49.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.236 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.236 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:05:49.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:05:49.236 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.236 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.236 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.236 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:05:49.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:05:49.236 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.236 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.236 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.236 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.237 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.237 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:49.237 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:49.237 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 27.222129622000001, 2024-09-12T22:05:49.237 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:05:49.237 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.237 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.237 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.237 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.237 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.237 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.237 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:05:49.237 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.237 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:05:49.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.239 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:05:49.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:05:49.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.239 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:05:49.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:05:49.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.239 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:05:49.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:05:49.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:05:49.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:05:49.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:05:49.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:05:49.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.242 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:05:49.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:05:49.243 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.243 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.243 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.243 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.243 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:49.243 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:49.243 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 27.214154737000001, 2024-09-12T22:05:49.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:05:49.243 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.243 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.243 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.243 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.244 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.244 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.244 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:05:49.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.244 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.244 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:49.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.244 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:49.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.245 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.245 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.245 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.245 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:05:49.245 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:05:49.245 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.245 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.245 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.246 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.247 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:05:49.247 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:05:49.247 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.247 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.247 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.247 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:05:49.247 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:05:49.247 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.247 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.247 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.247 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:05:49.247 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:05:49.247 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.247 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.248 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.249 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.249 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:05:49.249 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:05:49.249 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.249 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.249 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.249 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:05:49.249 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:05:49.249 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.249 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.249 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.249 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:05:49.249 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:05:49.249 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 27.206228961000001, 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.250 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:05:49.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:05:49.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:05:49.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:05:49.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:05:49.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:05:49.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.254 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:05:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:05:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 27.204732678999999, 2024-09-12T22:05:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:05:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.257 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.257 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.257 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.257 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:05:49.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.257 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.257 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:49.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.257 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:05:49.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:05:49.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:05:49.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:49.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.259 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:05:49.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:05:49.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.259 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:05:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:05:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:05:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:05:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:05:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:05:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:05:49.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:05:49.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:05:49.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:05:49.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:05:49.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:05:49.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:05:49.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:49.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:05:49.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:05:49.263 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.263 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.263 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.263 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296741 5.3 5:c190c274:::benchmark_data_smithi043_32659_object129503:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:49.263 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:49.263 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.1834250669999999, 2024-09-12T22:05:49.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.051784984, 2024-09-12T22:05:49.263 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.264 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.264 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.264 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.264 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.264 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.264 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296741 2024-09-12T22:05:49.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.265 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:49.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:49.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016859+0000", 2024-09-12T22:05:49.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5600000000000004e-07 2024-09-12T22:05:49.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016863+0000", 2024-09-12T22:05:49.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5510000000000001e-06 2024-09-12T22:05:49.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016873+0000", 2024-09-12T22:05:49.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5319999999999995e-06 2024-09-12T22:05:49.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016879+0000", 2024-09-12T22:05:49.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5100000000000004e-06 2024-09-12T22:05:49.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016934+0000", 2024-09-12T22:05:49.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4734999999999997e-05 2024-09-12T22:05:49.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016941+0000", 2024-09-12T22:05:49.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1319999999999996e-06 2024-09-12T22:05:49.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055352+0000", 2024-09-12T22:05:49.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0384109260000001 2024-09-12T22:05:49.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055496+0000", 2024-09-12T22:05:49.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014437400000000001 2024-09-12T22:05:49.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055835+0000", 2024-09-12T22:05:49.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000338339 2024-09-12T22:05:49.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065163+0000", 2024-09-12T22:05:49.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093287690000000006 2024-09-12T22:05:49.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068506+0000", 2024-09-12T22:05:49.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033423620000000002 2024-09-12T22:05:49.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068557+0000", 2024-09-12T22:05:49.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1057000000000003e-05 2024-09-12T22:05:49.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068643+0000", 2024-09-12T22:05:49.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5741000000000005e-05 2024-09-12T22:05:49.272 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.272 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.272 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.272 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296774 5.3 5:c9ea392f:::benchmark_data_smithi043_32659_object129536:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:49.272 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:49.272 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.1696794449999999, 2024-09-12T22:05:49.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0383883359999999, 2024-09-12T22:05:49.273 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.273 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.273 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.273 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.273 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.273 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.273 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296774 2024-09-12T22:05:49.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.273 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:49.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:49.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030604+0000", 2024-09-12T22:05:49.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:05:49.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030607+0000", 2024-09-12T22:05:49.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0860000000000002e-06 2024-09-12T22:05:49.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030615+0000", 2024-09-12T22:05:49.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8120000000000008e-06 2024-09-12T22:05:49.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030620+0000", 2024-09-12T22:05:49.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6080000000000003e-06 2024-09-12T22:05:49.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030662+0000", 2024-09-12T22:05:49.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1925999999999998e-05 2024-09-12T22:05:49.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030670+0000", 2024-09-12T22:05:49.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2359999999999998e-06 2024-09-12T22:05:49.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065202+0000", 2024-09-12T22:05:49.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0345323989999999 2024-09-12T22:05:49.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065348+0000", 2024-09-12T22:05:49.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145575 2024-09-12T22:05:49.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065476+0000", 2024-09-12T22:05:49.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012800999999999999 2024-09-12T22:05:49.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068690+0000", 2024-09-12T22:05:49.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032143929999999999 2024-09-12T22:05:49.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068869+0000", 2024-09-12T22:05:49.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000179152 2024-09-12T22:05:49.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068914+0000", 2024-09-12T22:05:49.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4629999999999998e-05 2024-09-12T22:05:49.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068992+0000", 2024-09-12T22:05:49.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7885000000000004e-05 2024-09-12T22:05:49.283 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.283 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.284 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.284 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296793 5.3 5:c55bd684:::benchmark_data_smithi043_32659_object129555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:49.284 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:49.284 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.1628627979999999, 2024-09-12T22:05:49.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0317046320000001, 2024-09-12T22:05:49.284 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.284 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.284 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.284 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.284 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.284 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.285 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296793 2024-09-12T22:05:49.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.285 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:49.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:49.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037421+0000", 2024-09-12T22:05:49.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:05:49.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037425+0000", 2024-09-12T22:05:49.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9539999999999998e-06 2024-09-12T22:05:49.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037432+0000", 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037436+0000", 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4320000000000001e-06 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037496+0000", 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9385999999999997e-05 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037503+0000", 2024-09-12T22:05:49.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:05:49.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066427+0000", 2024-09-12T22:05:49.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.028923877 2024-09-12T22:05:49.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066519+0000", 2024-09-12T22:05:49.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1867000000000007e-05 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066598+0000", 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9175e-05 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068804+0000", 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002205664 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069004+0000", 2024-09-12T22:05:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000200769 2024-09-12T22:05:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069050+0000", 2024-09-12T22:05:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5522999999999998e-05 2024-09-12T22:05:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069125+0000", 2024-09-12T22:05:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4530000000000006e-05 2024-09-12T22:05:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296796 5.3 5:cbc9dd25:::benchmark_data_smithi043_32659_object129558:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.1625651689999996, 2024-09-12T22:05:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0315259400000001, 2024-09-12T22:05:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.292 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.292 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.292 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.292 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.292 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.292 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296796 2024-09-12T22:05:49.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.293 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:49.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:49.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037719+0000", 2024-09-12T22:05:49.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1069999999999999e-06 2024-09-12T22:05:49.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037723+0000", 2024-09-12T22:05:49.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1400000000000002e-06 2024-09-12T22:05:49.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037734+0000", 2024-09-12T22:05:49.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0991e-05 2024-09-12T22:05:49.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037741+0000", 2024-09-12T22:05:49.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6059999999999997e-06 2024-09-12T22:05:49.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037790+0000", 2024-09-12T22:05:49.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9112e-05 2024-09-12T22:05:49.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037797+0000", 2024-09-12T22:05:49.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:05:49.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067455+0000", 2024-09-12T22:05:49.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0296586320000001 2024-09-12T22:05:49.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067568+0000", 2024-09-12T22:05:49.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112895 2024-09-12T22:05:49.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067686+0000", 2024-09-12T22:05:49.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117879 2024-09-12T22:05:49.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068856+0000", 2024-09-12T22:05:49.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011693949999999999 2024-09-12T22:05:49.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069132+0000", 2024-09-12T22:05:49.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027629599999999999 2024-09-12T22:05:49.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069171+0000", 2024-09-12T22:05:49.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9536000000000002e-05 2024-09-12T22:05:49.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069243+0000", 2024-09-12T22:05:49.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2033999999999995e-05 2024-09-12T22:05:49.299 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.299 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.299 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.300 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296865 5.3 5:c0e17763:::benchmark_data_smithi043_32659_object129627:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:49.300 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.060875+0000", 2024-09-12T22:05:49.300 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.1394075719999996, 2024-09-12T22:05:49.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0133217349999999, 2024-09-12T22:05:49.300 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.300 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.300 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.300 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.300 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.300 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.300 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296865 2024-09-12T22:05:49.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.300 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060875+0000", 2024-09-12T22:05:49.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060875+0000", 2024-09-12T22:05:49.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060876+0000", 2024-09-12T22:05:49.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6500000000000008e-07 2024-09-12T22:05:49.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060881+0000", 2024-09-12T22:05:49.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:05:49.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060892+0000", 2024-09-12T22:05:49.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1583000000000001e-05 2024-09-12T22:05:49.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060899+0000", 2024-09-12T22:05:49.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.742e-06 2024-09-12T22:05:49.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.061193+0000", 2024-09-12T22:05:49.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00029414099999999999 2024-09-12T22:05:49.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.061201+0000", 2024-09-12T22:05:49.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9200000000000004e-06 2024-09-12T22:05:49.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069278+0000", 2024-09-12T22:05:49.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.008076857 2024-09-12T22:05:49.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069396+0000", 2024-09-12T22:05:49.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118504 2024-09-12T22:05:49.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069510+0000", 2024-09-12T22:05:49.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114079 2024-09-12T22:05:49.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074033+0000", 2024-09-12T22:05:49.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045228459999999996 2024-09-12T22:05:49.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074086+0000", 2024-09-12T22:05:49.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2395999999999998e-05 2024-09-12T22:05:49.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074143+0000", 2024-09-12T22:05:49.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7518000000000001e-05 2024-09-12T22:05:49.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074197+0000", 2024-09-12T22:05:49.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3613999999999999e-05 2024-09-12T22:05:49.307 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.307 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.307 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.307 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296897 5.3 5:c39fcaa1:::benchmark_data_smithi043_32659_object129659:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:49.307 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:49.307 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.1263720020000001, 2024-09-12T22:05:49.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.000488958, 2024-09-12T22:05:49.307 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.307 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.308 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.308 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.308 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.308 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.308 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296897 2024-09-12T22:05:49.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.308 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:49.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:49.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:49.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:05:49.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073913+0000", 2024-09-12T22:05:49.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8789999999999999e-06 2024-09-12T22:05:49.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073918+0000", 2024-09-12T22:05:49.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:05:49.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073923+0000", 2024-09-12T22:05:49.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8450000000000002e-06 2024-09-12T22:05:49.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073989+0000", 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5610000000000004e-05 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073997+0000", 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0830000000000004e-06 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.070494+0000", 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99649657700000005 2024-09-12T22:05:49.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.070622+0000", 2024-09-12T22:05:49.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000128336 2024-09-12T22:05:49.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.070737+0000", 2024-09-12T22:05:49.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115021 2024-09-12T22:05:49.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074248+0000", 2024-09-12T22:05:49.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035110129999999999 2024-09-12T22:05:49.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074261+0000", 2024-09-12T22:05:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3127e-05 2024-09-12T22:05:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074310+0000", 2024-09-12T22:05:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8930000000000001e-05 2024-09-12T22:05:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074400+0000", 2024-09-12T22:05:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9716999999999995e-05 2024-09-12T22:05:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.315 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.315 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.315 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296905 5.3 5:c5d41e92:::benchmark_data_smithi043_32659_object129667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:49.315 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.076778+0000", 2024-09-12T22:05:49.315 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.123504252, 2024-09-12T22:05:49.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.997726954, 2024-09-12T22:05:49.315 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.315 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.316 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.316 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.316 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.316 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.316 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296905 2024-09-12T22:05:49.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.317 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076778+0000", 2024-09-12T22:05:49.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076778+0000", 2024-09-12T22:05:49.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076779+0000", 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3e-07 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076782+0000", 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0790000000000001e-06 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076790+0000", 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0050000000000004e-06 2024-09-12T22:05:49.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076795+0000", 2024-09-12T22:05:49.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4139999999999996e-06 2024-09-12T22:05:49.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076838+0000", 2024-09-12T22:05:49.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591999999999999e-05 2024-09-12T22:05:49.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076844+0000", 2024-09-12T22:05:49.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:49.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.071643+0000", 2024-09-12T22:05:49.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99479885499999998 2024-09-12T22:05:49.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.071749+0000", 2024-09-12T22:05:49.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106165 2024-09-12T22:05:49.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.071864+0000", 2024-09-12T22:05:49.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011547 2024-09-12T22:05:49.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074409+0000", 2024-09-12T22:05:49.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025444550000000002 2024-09-12T22:05:49.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074429+0000", 2024-09-12T22:05:49.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0412e-05 2024-09-12T22:05:49.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074455+0000", 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6318000000000001e-05 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074505+0000", 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0086000000000001e-05 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296917 5.3 5:c2604485:::benchmark_data_smithi043_32659_object129679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:49.322 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.1195421840000002, 2024-09-12T22:05:49.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99672535699999998, 2024-09-12T22:05:49.323 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.323 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.323 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.323 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.323 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.323 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.323 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296917 2024-09-12T22:05:49.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.323 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:49.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7000000000000004e-07 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080744+0000", 2024-09-12T22:05:49.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2320000000000001e-06 2024-09-12T22:05:49.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080752+0000", 2024-09-12T22:05:49.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2980000000000003e-06 2024-09-12T22:05:49.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080758+0000", 2024-09-12T22:05:49.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:05:49.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080802+0000", 2024-09-12T22:05:49.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4607000000000002e-05 2024-09-12T22:05:49.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080811+0000", 2024-09-12T22:05:49.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9020000000000005e-06 2024-09-12T22:05:49.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.072838+0000", 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99202686100000004 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.072952+0000", 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000113606 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.073064+0000", 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0001126 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074554+0000", 2024-09-12T22:05:49.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014899609999999999 2024-09-12T22:05:49.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077381+0000", 2024-09-12T22:05:49.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028265400000000002 2024-09-12T22:05:49.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077408+0000", 2024-09-12T22:05:49.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7508000000000002e-05 2024-09-12T22:05:49.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077466+0000", 2024-09-12T22:05:49.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7707000000000002e-05 2024-09-12T22:05:49.329 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.329 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.329 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.329 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296918 5.3 5:c3e8680d:::benchmark_data_smithi043_32659_object129680:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:49.329 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.081205+0000", 2024-09-12T22:05:49.329 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.1190776759999999, 2024-09-12T22:05:49.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99634571100000002, 2024-09-12T22:05:49.329 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.330 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.330 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.330 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.330 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.330 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.330 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296918 2024-09-12T22:05:49.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.330 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081205+0000", 2024-09-12T22:05:49.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081205+0000", 2024-09-12T22:05:49.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081206+0000", 2024-09-12T22:05:49.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5899999999999995e-07 2024-09-12T22:05:49.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081210+0000", 2024-09-12T22:05:49.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0169999999999998e-06 2024-09-12T22:05:49.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081220+0000", 2024-09-12T22:05:49.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0573e-05 2024-09-12T22:05:49.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081229+0000", 2024-09-12T22:05:49.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8270000000000004e-06 2024-09-12T22:05:49.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081274+0000", 2024-09-12T22:05:49.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5102999999999998e-05 2024-09-12T22:05:49.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081282+0000", 2024-09-12T22:05:49.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3159999999999999e-06 2024-09-12T22:05:49.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074575+0000", 2024-09-12T22:05:49.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99329281599999997 2024-09-12T22:05:49.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074651+0000", 2024-09-12T22:05:49.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6202e-05 2024-09-12T22:05:49.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074715+0000", 2024-09-12T22:05:49.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4115999999999994e-05 2024-09-12T22:05:49.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077371+0000", 2024-09-12T22:05:49.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026562119999999998 2024-09-12T22:05:49.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077474+0000", 2024-09-12T22:05:49.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000102437 2024-09-12T22:05:49.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077498+0000", 2024-09-12T22:05:49.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4445000000000001e-05 2024-09-12T22:05:49.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077551+0000", 2024-09-12T22:05:49.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2787999999999997e-05 2024-09-12T22:05:49.338 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.338 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.338 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.338 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296921 5.3 5:c1fc9263:::benchmark_data_smithi043_32659_object129683:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:49.338 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.084330+0000", 2024-09-12T22:05:49.338 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.1159524669999996, 2024-09-12T22:05:49.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99642918800000002, 2024-09-12T22:05:49.339 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.339 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.339 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.339 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.340 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.340 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.340 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296921 2024-09-12T22:05:49.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.340 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084330+0000", 2024-09-12T22:05:49.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084330+0000", 2024-09-12T22:05:49.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084331+0000", 2024-09-12T22:05:49.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6499999999999999e-07 2024-09-12T22:05:49.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084333+0000", 2024-09-12T22:05:49.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5189999999999999e-06 2024-09-12T22:05:49.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084342+0000", 2024-09-12T22:05:49.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.132e-06 2024-09-12T22:05:49.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084348+0000", 2024-09-12T22:05:49.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:05:49.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084380+0000", 2024-09-12T22:05:49.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2166999999999999e-05 2024-09-12T22:05:49.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084385+0000", 2024-09-12T22:05:49.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2789999999999998e-06 2024-09-12T22:05:49.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.075392+0000", 2024-09-12T22:05:49.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99100684299999997 2024-09-12T22:05:49.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.075503+0000", 2024-09-12T22:05:49.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111119 2024-09-12T22:05:49.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.075609+0000", 2024-09-12T22:05:49.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105516 2024-09-12T22:05:49.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077607+0000", 2024-09-12T22:05:49.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019978349999999999 2024-09-12T22:05:49.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080656+0000", 2024-09-12T22:05:49.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030494860000000001 2024-09-12T22:05:49.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080683+0000", 2024-09-12T22:05:49.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6721999999999999e-05 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080759+0000", 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6631000000000005e-05 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296926 5.3 5:c88c2a98:::benchmark_data_smithi043_32659_object129688:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.087117+0000", 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.1131654209999997, 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99371757999999999, 2024-09-12T22:05:49.346 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:49.347 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:49.347 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:49.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:49.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:49.347 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:49.347 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296926 2024-09-12T22:05:49.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.347 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:49.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:49.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087117+0000", 2024-09-12T22:05:49.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087117+0000", 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087118+0000", 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3200000000000004e-07 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087122+0000", 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087131+0000", 2024-09-12T22:05:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9020000000000005e-06 2024-09-12T22:05:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087138+0000", 2024-09-12T22:05:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.832e-06 2024-09-12T22:05:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087178+0000", 2024-09-12T22:05:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9727000000000001e-05 2024-09-12T22:05:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:49.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087183+0000", 2024-09-12T22:05:49.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9810000000000003e-06 2024-09-12T22:05:49.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:49.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.076485+0000", 2024-09-12T22:05:49.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.98930243299999998 2024-09-12T22:05:49.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:49.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.076572+0000", 2024-09-12T22:05:49.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6493e-05 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.076633+0000", 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1136000000000006e-05 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.079747+0000", 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031138609999999999 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080765+0000", 2024-09-12T22:05:49.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001018232 2024-09-12T22:05:49.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:49.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080790+0000", 2024-09-12T22:05:49.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5099000000000001e-05 2024-09-12T22:05:49.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:49.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:49.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:49.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080835+0000", 2024-09-12T22:05:49.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4903e-05 2024-09-12T22:05:49.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.352 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:49.353 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:49.353 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:05:49.355 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:49.353+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:49.355 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:49.455 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:49.453+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:49.463 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:49.485 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:49.485 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:49.501 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:49.501 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:49.503 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:49.504 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:49.505 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:49.506 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:49.515 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:49.556 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:49.555+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:49.657 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:49.656+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:49.704 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:49.705 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:49.715 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:49.761 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:49.760+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:49.859 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:49.857+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:49.865 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:49.865 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:49.877 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:49.959 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:49.959+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:50.055 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:50.060 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:50.059+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:50.162 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:50.160+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:50.263 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:50.262+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:50.269 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:50.364 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:50.363+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:50.461 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:50.461 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:50.464 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:50.463+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:50.475 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:50.566 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:50.565+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:50.620 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:50.620 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:50.632 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:50.694 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:50.692+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:50.767 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:50.766+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:50.831 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:50.831 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:50.844 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:50.890 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:50.887+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:50.969 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:50.968+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:50.988 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:50.988 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:50.999 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:51.043 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:05:51.074 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:51.072+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:51.168 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:51.172 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:51.171+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:51.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:51.271+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:51.348 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:51.372 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:51.371+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:51.473 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:51.472+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:51.507 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:05:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:51.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:51.588 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:51.573+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:51.616 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:51.635 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:51.635 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:51.656 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:51.656 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:51.658 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:51.658 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:51.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.658 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:317238 5.c 5.915d337c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T22:05:51.658 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:51.655316+0000", 2024-09-12T22:05:51.659 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0019653840000000001, 2024-09-12T22:05:51.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019826940000000001, 2024-09-12T22:05:51.659 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:51.659 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:51.659 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:51.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:51.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:51.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:51.659 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 317238 2024-09-12T22:05:51.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.659 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:51.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.655316+0000", 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.655316+0000", 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.655317+0000", 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.083e-06 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:51.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.655323+0000", 2024-09-12T22:05:51.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1270000000000002e-06 2024-09-12T22:05:51.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:51.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.655332+0000", 2024-09-12T22:05:51.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.465e-06 2024-09-12T22:05:51.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:51.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.655339+0000", 2024-09-12T22:05:51.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-12T22:05:51.661 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.661 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:51.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.662 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:317241 5.1 5:8ef27336:::benchmark_data_smithi043_32659_object150003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T22:05:51.662 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:51.656125+0000", 2024-09-12T22:05:51.662 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0011570790000000001, 2024-09-12T22:05:51.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012119839999999999, 2024-09-12T22:05:51.662 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:51.662 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:51.662 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:51.662 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:51.662 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:51.662 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:51.662 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 317241 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656125+0000", 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656125+0000", 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:51.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656125+0000", 2024-09-12T22:05:51.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:51.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:51.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656129+0000", 2024-09-12T22:05:51.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8580000000000002e-06 2024-09-12T22:05:51.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:51.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656138+0000", 2024-09-12T22:05:51.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3729999999999993e-06 2024-09-12T22:05:51.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656142+0000", 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5669999999999996e-06 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656193+0000", 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0457999999999997e-05 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656338+0000", 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000145193 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:51.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656455+0000", 2024-09-12T22:05:51.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011715899999999999 2024-09-12T22:05:51.666 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.666 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:51.666 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.666 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:317243 5.c 5.c7115eec (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T22:05:51.666 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:51.656391+0000", 2024-09-12T22:05:51.666 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00089034900000000002, 2024-09-12T22:05:51.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00098366600000000001, 2024-09-12T22:05:51.666 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:51.666 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 317243 2024-09-12T22:05:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656391+0000", 2024-09-12T22:05:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656391+0000", 2024-09-12T22:05:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656392+0000", 2024-09-12T22:05:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.61e-07 2024-09-12T22:05:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656396+0000", 2024-09-12T22:05:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6610000000000002e-06 2024-09-12T22:05:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:51.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656405+0000", 2024-09-12T22:05:51.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.183e-06 2024-09-12T22:05:51.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:51.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656412+0000", 2024-09-12T22:05:51.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9859999999999997e-06 2024-09-12T22:05:51.669 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.669 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:51.669 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.669 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:317236 5.d e68/40 5:bc35c85e:::benchmark_data_smithi043_32659_object149998:head v 68'19600, mlcod=68'19596)", 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:51.656469+0000", 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00081289199999999995, 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00095662600000000003, 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656469+0000", 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:51.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656469+0000", 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656469+0000", 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4700000000000002e-07 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656473+0000", 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9670000000000003e-06 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656480+0000", 2024-09-12T22:05:51.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8290000000000002e-06 2024-09-12T22:05:51.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:51.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656486+0000", 2024-09-12T22:05:51.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6019999999999999e-06 2024-09-12T22:05:51.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:51.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656527+0000", 2024-09-12T22:05:51.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1189999999999997e-05 2024-09-12T22:05:51.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:51.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656547+0000", 2024-09-12T22:05:51.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0377000000000002e-05 2024-09-12T22:05:51.673 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.673 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:51.673 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.673 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:317244 5.5 5:a5f9e26e:::benchmark_data_smithi043_32659_object150006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T22:05:51.673 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:51.657340+0000", 2024-09-12T22:05:51.673 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999423, 2024-09-12T22:05:51.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014851099999999999, 2024-09-12T22:05:51.673 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:51.673 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:51.673 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 317244 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657340+0000", 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657340+0000", 2024-09-12T22:05:51.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:51.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657341+0000", 2024-09-12T22:05:51.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.035e-06 2024-09-12T22:05:51.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:51.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657345+0000", 2024-09-12T22:05:51.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.87e-06 2024-09-12T22:05:51.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:51.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657357+0000", 2024-09-12T22:05:51.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1714e-05 2024-09-12T22:05:51.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:51.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657364+0000", 2024-09-12T22:05:51.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.075e-06 2024-09-12T22:05:51.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:51.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657425+0000", 2024-09-12T22:05:51.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0498000000000003e-05 2024-09-12T22:05:51.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.677 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:51.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.677 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:317223 5.c e68/40)", 2024-09-12T22:05:51.677 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:51.657434+0000", 2024-09-12T22:05:51.677 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9998479, 2024-09-12T22:05:51.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010946399999999999, 2024-09-12T22:05:51.677 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:51.677 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:51.677 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:51.677 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657434+0000", 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657434+0000", 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657434+0000", 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5199999999999996e-07 2024-09-12T22:05:51.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:51.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657439+0000", 2024-09-12T22:05:51.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2050000000000004e-06 2024-09-12T22:05:51.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:51.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657447+0000", 2024-09-12T22:05:51.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0039999999999999e-06 2024-09-12T22:05:51.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:51.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657453+0000", 2024-09-12T22:05:51.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2870000000000001e-06 2024-09-12T22:05:51.680 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.680 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:51.680 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.680 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:317223 5.c 5:3ee386af:::benchmark_data_smithi043_32659_object149985:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T22:05:51.680 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:51.649247+0000", 2024-09-12T22:05:51.680 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0080343859999999993, 2024-09-12T22:05:51.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008346539, 2024-09-12T22:05:51.680 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:51.680 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:51.680 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:51.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:51.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:51.681 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:51.681 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 317223 2024-09-12T22:05:51.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.681 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:51.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:51.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.649247+0000", 2024-09-12T22:05:51.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:51.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.649247+0000", 2024-09-12T22:05:51.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.649248+0000", 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0299999999999998e-07 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.649252+0000", 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.092e-06 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.649264+0000", 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2064e-05 2024-09-12T22:05:51.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.649271+0000", 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7150000000000001e-06 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.653547+0000", 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042756809999999999 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.653666+0000", 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119484 2024-09-12T22:05:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:51.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.653743+0000", 2024-09-12T22:05:51.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6274999999999997e-05 2024-09-12T22:05:51.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:51.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657322+0000", 2024-09-12T22:05:51.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035791289999999999 2024-09-12T22:05:51.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.685 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:51.685 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.685 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:317225 5.c 5:3e586614:::benchmark_data_smithi043_32659_object149987:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T22:05:51.685 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:51.650097+0000", 2024-09-12T22:05:51.685 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0071849069999999999, 2024-09-12T22:05:51.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0075775110000000003, 2024-09-12T22:05:51.685 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:51.685 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:51.685 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:51.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:51.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:51.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 317225 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.650097+0000", 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.650097+0000", 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:51.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.650098+0000", 2024-09-12T22:05:51.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4099999999999998e-07 2024-09-12T22:05:51.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:51.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.650102+0000", 2024-09-12T22:05:51.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9809999999999997e-06 2024-09-12T22:05:51.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:51.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.650112+0000", 2024-09-12T22:05:51.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0025e-05 2024-09-12T22:05:51.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:51.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.650120+0000", 2024-09-12T22:05:51.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0180000000000001e-06 2024-09-12T22:05:51.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:51.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.655235+0000", 2024-09-12T22:05:51.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051150149999999997 2024-09-12T22:05:51.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:51.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.655394+0000", 2024-09-12T22:05:51.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015962300000000001 2024-09-12T22:05:51.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:51.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.655538+0000", 2024-09-12T22:05:51.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014358 2024-09-12T22:05:51.689 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.689 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:51.689 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.689 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:317232 5.c 5:3f0d5a12:::benchmark_data_smithi043_32659_object149994:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T22:05:51.689 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:51.652750+0000", 2024-09-12T22:05:51.689 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0045315959999999997, 2024-09-12T22:05:51.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0049994410000000003, 2024-09-12T22:05:51.689 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 317232 2024-09-12T22:05:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.652750+0000", 2024-09-12T22:05:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.652750+0000", 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.652751+0000", 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.652755+0000", 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9369999999999997e-06 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:51.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.652766+0000", 2024-09-12T22:05:51.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0762e-05 2024-09-12T22:05:51.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:51.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.652772+0000", 2024-09-12T22:05:51.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9279999999999998e-06 2024-09-12T22:05:51.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:51.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657344+0000", 2024-09-12T22:05:51.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004572609 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657455+0000", 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035900000000001 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.657537+0000", 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2391000000000004e-05 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.694 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:317235 5.5 5:a1cbb15e:::benchmark_data_smithi043_32659_object149997:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T22:05:51.694 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:51.653421+0000", 2024-09-12T22:05:51.694 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0038609569999999999, 2024-09-12T22:05:51.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044009239999999996, 2024-09-12T22:05:51.694 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:51.694 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:51.694 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:51.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:51.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:51.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:51.694 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 317235 2024-09-12T22:05:51.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.694 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.653421+0000", 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.653421+0000", 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.653421+0000", 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.37e-07 2024-09-12T22:05:51.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.653425+0000", 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9360000000000001e-06 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.653431+0000", 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9569999999999999e-06 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.653436+0000", 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:05:51.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:51.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.653507+0000", 2024-09-12T22:05:51.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1425000000000001e-05 2024-09-12T22:05:51.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:51.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.653672+0000", 2024-09-12T22:05:51.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016458099999999999 2024-09-12T22:05:51.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:51.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.653777+0000", 2024-09-12T22:05:51.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105824 2024-09-12T22:05:51.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:51.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:51.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:51.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:51.656205+0000", 2024-09-12T22:05:51.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00242801 2024-09-12T22:05:51.698 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.698 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:51.698 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.698 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:51.698 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:51.698 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 10 2024-09-12T22:05:51.698 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:51.699 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:51.700 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:51.701 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:51.701 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:51.698+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:51.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~88s 2024-09-12T22:05:51.800 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:51.799+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:51.876 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:51.876 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:51.876 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:51.876 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:51.876 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:51.888 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:51.932 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:51.931+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:51.964 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-09-12T22:05:52.002 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:52.001+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:52.026 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:52.026 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:52.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:52.026 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:52.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.026 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:52.026 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:52.026 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.612223299999997, 2024-09-12T22:05:52.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:52.027 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.027 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.027 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:52.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.027 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:52.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.027 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:52.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:52.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:52.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:52.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:52.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:52.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:52.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:52.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:52.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:52.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:52.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:52.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:52.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:52.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:52.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:52.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:52.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:52.031 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.031 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.031 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.031 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:52.031 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:52.032 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.612043369999995, 2024-09-12T22:05:52.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:52.032 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.032 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.032 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:52.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.032 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:52.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.032 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:52.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:52.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:52.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:52.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:52.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:52.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:52.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:52.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:52.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:52.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.611976928999994, 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.037 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:52.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.037 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:52.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.037 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:52.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:52.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:52.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:52.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:52.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:52.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:52.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:52.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:52.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:52.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:52.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:52.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.041 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.041 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:52.041 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:52.041 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.611920486000002, 2024-09-12T22:05:52.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:52.041 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.041 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.041 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.041 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.042 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:52.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.042 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:52.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:52.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:52.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:52.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:52.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:52.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:52.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:52.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:52.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:52.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:52.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:52.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:52.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:52.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:52.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:52.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:52.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:52.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:52.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:52.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:52.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:52.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:52.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:52.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:52.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:52.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:52.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:52.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.048 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.049 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:52.049 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:52.049 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.611852025999994, 2024-09-12T22:05:52.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:52.049 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.049 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.049 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:52.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:52.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:52.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:52.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:52.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:52.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:52.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:52.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:52.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:52.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:52.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:52.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:52.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:52.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:52.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:52.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:52.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.611794290999995, 2024-09-12T22:05:52.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:52.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:52.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:52.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:52.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:52.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:52.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:52.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:52.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:52.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:52.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:52.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:52.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:52.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:52.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:52.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:52.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:52.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:52.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:52.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:52.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:52.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:52.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:52.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:52.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:52.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.611726598999994, 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.062 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:52.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:52.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:52.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:52.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:52.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:52.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:52.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:52.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:52.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:52.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:52.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:52.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:52.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:52.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:52.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:52.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:52.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:52.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:52.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:52.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:52.068 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.068 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.068 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.069 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:52.069 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:52.069 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.611671537000007, 2024-09-12T22:05:52.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:52.069 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.069 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.069 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.069 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.069 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.069 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.069 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:52.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.069 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:52.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:52.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:52.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:52.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:52.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:52.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:52.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:52.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:52.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:52.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:52.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:52.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:52.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:52.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:52.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:52.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:52.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:52.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:52.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:52.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:52.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:52.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:52.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:52.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:52.075 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.075 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.075 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.076 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:52.076 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:52.076 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.571024016999999, 2024-09-12T22:05:52.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:52.076 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.076 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.076 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.076 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.076 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.076 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.077 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:52.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.077 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:52.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:52.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:52.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:52.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:52.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:52.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:52.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:52.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:52.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:52.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:52.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:52.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:52.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.568410288999999, 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:52.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:52.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:52.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:52.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:52.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:52.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:52.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:52.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:52.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:52.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:52.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:52.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:52.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:52.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:52.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:52.089 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.089 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.089 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.089 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:52.089 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:52.089 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.023196193000004, 2024-09-12T22:05:52.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:52.089 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.089 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.089 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.089 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:52.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:52.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:52.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:52.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:52.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:52.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:52.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:52.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:52.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:52.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.022717705000005, 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.020222404999998, 2024-09-12T22:05:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.019141614000006, 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.017906052000001, 2024-09-12T22:05:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:52.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:52.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:52.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:52.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:52.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:52.119 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.119 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.119 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.119 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:52.119 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:52.119 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.577165563999998, 2024-09-12T22:05:52.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:52.119 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.119 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.119 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.119 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.120 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.120 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.120 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:52.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.120 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:52.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.572635136999999, 2024-09-12T22:05:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.572611107999997, 2024-09-12T22:05:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.572433459000003, 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.570414921999998, 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:52.150 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:52.151 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:52.150+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:52.152 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:52.253 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:52.252+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318153 5.7 5.dea349e7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.997518+0000", 2024-09-12T22:05:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.26317358800000001, 2024-09-12T22:05:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.26319310099999998, 2024-09-12T22:05:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318153 2024-09-12T22:05:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997518+0000", 2024-09-12T22:05:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997518+0000", 2024-09-12T22:05:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997519+0000", 2024-09-12T22:05:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2099999999999996e-07 2024-09-12T22:05:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997522+0000", 2024-09-12T22:05:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2830000000000002e-06 2024-09-12T22:05:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997529+0000", 2024-09-12T22:05:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:05:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997533+0000", 2024-09-12T22:05:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1150000000000004e-06 2024-09-12T22:05:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997569+0000", 2024-09-12T22:05:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5574999999999997e-05 2024-09-12T22:05:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997573+0000", 2024-09-12T22:05:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3850000000000004e-06 2024-09-12T22:05:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318155 5.7 5.3828c887 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.999285+0000", 2024-09-12T22:05:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.26140666099999998, 2024-09-12T22:05:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.26146715599999998, 2024-09-12T22:05:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318155 2024-09-12T22:05:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999285+0000", 2024-09-12T22:05:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999285+0000", 2024-09-12T22:05:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999286+0000", 2024-09-12T22:05:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4600000000000003e-07 2024-09-12T22:05:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999290+0000", 2024-09-12T22:05:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9330000000000003e-06 2024-09-12T22:05:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999299+0000", 2024-09-12T22:05:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6139999999999998e-06 2024-09-12T22:05:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999306+0000", 2024-09-12T22:05:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4649999999999999e-06 2024-09-12T22:05:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999352+0000", 2024-09-12T22:05:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6159999999999999e-05 2024-09-12T22:05:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999362+0000", 2024-09-12T22:05:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0127e-05 2024-09-12T22:05:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318065 5.7 5.dd055b17 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:05:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.29291500300000001, 2024-09-12T22:05:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.293010241, 2024-09-12T22:05:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.273 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318065 2024-09-12T22:05:52.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.273 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:05:52.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:05:52.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:05:52.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:05:52.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967782+0000", 2024-09-12T22:05:52.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0539999999999996e-06 2024-09-12T22:05:52.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968192+0000", 2024-09-12T22:05:52.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000410906 2024-09-12T22:05:52.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968201+0000", 2024-09-12T22:05:52.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7639999999999994e-06 2024-09-12T22:05:52.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971494+0000", 2024-09-12T22:05:52.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032926180000000002 2024-09-12T22:05:52.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971499+0000", 2024-09-12T22:05:52.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0690000000000001e-06 2024-09-12T22:05:52.276 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.276 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.276 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.277 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318069 5.7 5.ba280a57 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.277 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:05:52.277 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.29247742799999998, 2024-09-12T22:05:52.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.29261390700000001, 2024-09-12T22:05:52.277 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.277 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.277 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.277 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.277 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.278 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.278 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318069 2024-09-12T22:05:52.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.278 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:05:52.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:05:52.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968215+0000", 2024-09-12T22:05:52.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:05:52.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968218+0000", 2024-09-12T22:05:52.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9119999999999998e-06 2024-09-12T22:05:52.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968228+0000", 2024-09-12T22:05:52.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9599999999999995e-06 2024-09-12T22:05:52.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968234+0000", 2024-09-12T22:05:52.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6969999999999996e-06 2024-09-12T22:05:52.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971512+0000", 2024-09-12T22:05:52.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032779160000000001 2024-09-12T22:05:52.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971516+0000", 2024-09-12T22:05:52.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:52.281 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.282 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.282 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.282 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318199 5.7 5.ead16067 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.282 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:52.022229+0000", 2024-09-12T22:05:52.282 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.238462913, 2024-09-12T22:05:52.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.23863574000000001, 2024-09-12T22:05:52.282 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.283 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.283 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.283 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.283 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.283 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.283 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318199 2024-09-12T22:05:52.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.283 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.022229+0000", 2024-09-12T22:05:52.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.022229+0000", 2024-09-12T22:05:52.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.022229+0000", 2024-09-12T22:05:52.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9499999999999998e-07 2024-09-12T22:05:52.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.022230+0000", 2024-09-12T22:05:52.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.48e-06 2024-09-12T22:05:52.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.022234+0000", 2024-09-12T22:05:52.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8639999999999998e-06 2024-09-12T22:05:52.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.022237+0000", 2024-09-12T22:05:52.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.101e-06 2024-09-12T22:05:52.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.022268+0000", 2024-09-12T22:05:52.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0417999999999999e-05 2024-09-12T22:05:52.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.022273+0000", 2024-09-12T22:05:52.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1510000000000003e-06 2024-09-12T22:05:52.287 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.287 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.287 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.287 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318078 5.7 5.4db0cda7 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.287 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:05:52.288 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.29244959999999998, 2024-09-12T22:05:52.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.29265698600000001, 2024-09-12T22:05:52.288 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.288 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.288 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.288 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.288 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.288 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.288 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318078 2024-09-12T22:05:52.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.289 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:05:52.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:05:52.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:05:52.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:05:52.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968245+0000", 2024-09-12T22:05:52.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:05:52.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968251+0000", 2024-09-12T22:05:52.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2999999999999998e-06 2024-09-12T22:05:52.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968257+0000", 2024-09-12T22:05:52.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6400000000000002e-06 2024-09-12T22:05:52.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971528+0000", 2024-09-12T22:05:52.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032710619999999999 2024-09-12T22:05:52.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971533+0000", 2024-09-12T22:05:52.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8629999999999999e-06 2024-09-12T22:05:52.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.292 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.292 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318162 5.7 5.cfa27727 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.292 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:05:52.293 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.26106761899999997, 2024-09-12T22:05:52.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.26130790199999998, 2024-09-12T22:05:52.293 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.293 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.293 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.293 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.293 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318162 2024-09-12T22:05:52.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.293 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:05:52.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:05:52.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999625+0000", 2024-09-12T22:05:52.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:05:52.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999627+0000", 2024-09-12T22:05:52.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8260000000000001e-06 2024-09-12T22:05:52.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999634+0000", 2024-09-12T22:05:52.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8730000000000001e-06 2024-09-12T22:05:52.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999639+0000", 2024-09-12T22:05:52.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0710000000000002e-06 2024-09-12T22:05:52.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999681+0000", 2024-09-12T22:05:52.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1488e-05 2024-09-12T22:05:52.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999688+0000", 2024-09-12T22:05:52.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9229999999999996e-06 2024-09-12T22:05:52.297 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.297 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.297 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.298 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318220 5.7 5.b74b70b7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.298 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:52.036954+0000", 2024-09-12T22:05:52.298 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.22373804899999999, 2024-09-12T22:05:52.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.22401226599999999, 2024-09-12T22:05:52.298 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.298 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.298 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.298 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.298 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.298 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.299 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318220 2024-09-12T22:05:52.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.299 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.036954+0000", 2024-09-12T22:05:52.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.036954+0000", 2024-09-12T22:05:52.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.036954+0000", 2024-09-12T22:05:52.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7100000000000011e-07 2024-09-12T22:05:52.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.036959+0000", 2024-09-12T22:05:52.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2930000000000002e-06 2024-09-12T22:05:52.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.036971+0000", 2024-09-12T22:05:52.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2536e-05 2024-09-12T22:05:52.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.301 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.036978+0000", 2024-09-12T22:05:52.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7259999999999996e-06 2024-09-12T22:05:52.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.037017+0000", 2024-09-12T22:05:52.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8556000000000002e-05 2024-09-12T22:05:52.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.037023+0000", 2024-09-12T22:05:52.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0689999999999998e-06 2024-09-12T22:05:52.302 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.303 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.303 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.303 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318093 5.7 5.4568d707 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.303 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:05:52.303 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.29011820900000002, 2024-09-12T22:05:52.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.29042500399999999, 2024-09-12T22:05:52.303 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.303 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.303 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.303 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.303 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.304 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.304 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318093 2024-09-12T22:05:52.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.304 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:05:52.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:05:52.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970575+0000", 2024-09-12T22:05:52.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.159e-06 2024-09-12T22:05:52.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970579+0000", 2024-09-12T22:05:52.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4510000000000002e-06 2024-09-12T22:05:52.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970588+0000", 2024-09-12T22:05:52.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1479999999999995e-06 2024-09-12T22:05:52.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970595+0000", 2024-09-12T22:05:52.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6919999999999996e-06 2024-09-12T22:05:52.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971555+0000", 2024-09-12T22:05:52.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00096029399999999999 2024-09-12T22:05:52.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971561+0000", 2024-09-12T22:05:52.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7230000000000001e-06 2024-09-12T22:05:52.307 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.307 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.307 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.308 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318222 5.7 5.318c8d87 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.308 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:52.039243+0000", 2024-09-12T22:05:52.308 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.22144807799999999, 2024-09-12T22:05:52.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.221787452, 2024-09-12T22:05:52.308 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.308 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.308 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.308 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.308 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.308 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.309 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318222 2024-09-12T22:05:52.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.309 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.039243+0000", 2024-09-12T22:05:52.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.039243+0000", 2024-09-12T22:05:52.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.039244+0000", 2024-09-12T22:05:52.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3900000000000004e-07 2024-09-12T22:05:52.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.039249+0000", 2024-09-12T22:05:52.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6750000000000001e-06 2024-09-12T22:05:52.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.039259+0000", 2024-09-12T22:05:52.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0703999999999999e-05 2024-09-12T22:05:52.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.039266+0000", 2024-09-12T22:05:52.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0850000000000002e-06 2024-09-12T22:05:52.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.039315+0000", 2024-09-12T22:05:52.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9267000000000001e-05 2024-09-12T22:05:52.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.039323+0000", 2024-09-12T22:05:52.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0399999999999993e-06 2024-09-12T22:05:52.312 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.312 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.312 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.312 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318232 5.7 5.84af25a7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.312 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:52.074712+0000", 2024-09-12T22:05:52.312 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.18597989100000001, 2024-09-12T22:05:52.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.18635152699999999, 2024-09-12T22:05:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318232 2024-09-12T22:05:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.074712+0000", 2024-09-12T22:05:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.074712+0000", 2024-09-12T22:05:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.074712+0000", 2024-09-12T22:05:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9999999999999997e-07 2024-09-12T22:05:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.074716+0000", 2024-09-12T22:05:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6090000000000001e-06 2024-09-12T22:05:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.074725+0000", 2024-09-12T22:05:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0699999999999996e-06 2024-09-12T22:05:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.074731+0000", 2024-09-12T22:05:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5280000000000003e-06 2024-09-12T22:05:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.074784+0000", 2024-09-12T22:05:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3582999999999998e-05 2024-09-12T22:05:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.074794+0000", 2024-09-12T22:05:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0156000000000001e-05 2024-09-12T22:05:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318186 5.7 5.5ec66487 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:52.016874+0000", 2024-09-12T22:05:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.243817429, 2024-09-12T22:05:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.244221522, 2024-09-12T22:05:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318186 2024-09-12T22:05:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.016874+0000", 2024-09-12T22:05:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.016874+0000", 2024-09-12T22:05:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.016875+0000", 2024-09-12T22:05:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8899999999999999e-07 2024-09-12T22:05:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.016879+0000", 2024-09-12T22:05:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7249999999999999e-06 2024-09-12T22:05:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.016887+0000", 2024-09-12T22:05:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2369999999999992e-06 2024-09-12T22:05:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.016893+0000", 2024-09-12T22:05:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6610000000000003e-06 2024-09-12T22:05:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.016935+0000", 2024-09-12T22:05:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1680000000000001e-05 2024-09-12T22:05:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.016945+0000", 2024-09-12T22:05:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5910000000000002e-06 2024-09-12T22:05:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318169 5.7 5.2d270d87 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:52.002959+0000", 2024-09-12T22:05:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.25773232299999999, 2024-09-12T22:05:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.25816910500000001, 2024-09-12T22:05:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318169 2024-09-12T22:05:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.002959+0000", 2024-09-12T22:05:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.002959+0000", 2024-09-12T22:05:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.002960+0000", 2024-09-12T22:05:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8800000000000001e-07 2024-09-12T22:05:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.002965+0000", 2024-09-12T22:05:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5190000000000003e-06 2024-09-12T22:05:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.002976+0000", 2024-09-12T22:05:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1321000000000001e-05 2024-09-12T22:05:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.002983+0000", 2024-09-12T22:05:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9399999999999996e-06 2024-09-12T22:05:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.003364+0000", 2024-09-12T22:05:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00038088299999999999 2024-09-12T22:05:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.003371+0000", 2024-09-12T22:05:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8040000000000004e-06 2024-09-12T22:05:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318208 5.7 5.315ccaf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:52.027950+0000", 2024-09-12T22:05:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.23274154, 2024-09-12T22:05:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.233210796, 2024-09-12T22:05:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318208 2024-09-12T22:05:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.027950+0000", 2024-09-12T22:05:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.027950+0000", 2024-09-12T22:05:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.027951+0000", 2024-09-12T22:05:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.78e-07 2024-09-12T22:05:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.027955+0000", 2024-09-12T22:05:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4689999999999999e-06 2024-09-12T22:05:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.027967+0000", 2024-09-12T22:05:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1174e-05 2024-09-12T22:05:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.027973+0000", 2024-09-12T22:05:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9380000000000003e-06 2024-09-12T22:05:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.028023+0000", 2024-09-12T22:05:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9629999999999997e-05 2024-09-12T22:05:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.028031+0000", 2024-09-12T22:05:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3909999999999998e-06 2024-09-12T22:05:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318150 5.7 5.71af3787 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:05:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.26463953499999998, 2024-09-12T22:05:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.26514420100000002, 2024-09-12T22:05:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318150 2024-09-12T22:05:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:05:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:05:52.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996053+0000", 2024-09-12T22:05:52.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.079e-06 2024-09-12T22:05:52.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996057+0000", 2024-09-12T22:05:52.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3069999999999996e-06 2024-09-12T22:05:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996067+0000", 2024-09-12T22:05:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9420000000000007e-06 2024-09-12T22:05:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996081+0000", 2024-09-12T22:05:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3220999999999999e-05 2024-09-12T22:05:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996124+0000", 2024-09-12T22:05:52.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3545999999999999e-05 2024-09-12T22:05:52.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996129+0000", 2024-09-12T22:05:52.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2639999999999999e-06 2024-09-12T22:05:52.335 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.335 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.335 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.335 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318210 5.7 5.943b8f57 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:52.335 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:52.029334+0000", 2024-09-12T22:05:52.336 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.23135803799999999, 2024-09-12T22:05:52.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.231894773, 2024-09-12T22:05:52.336 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.336 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.336 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:52.336 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.336 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.336 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.336 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318210 2024-09-12T22:05:52.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.336 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.029334+0000", 2024-09-12T22:05:52.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.029334+0000", 2024-09-12T22:05:52.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.029334+0000", 2024-09-12T22:05:52.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2699999999999999e-07 2024-09-12T22:05:52.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.029338+0000", 2024-09-12T22:05:52.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7809999999999999e-06 2024-09-12T22:05:52.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.029345+0000", 2024-09-12T22:05:52.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3370000000000002e-06 2024-09-12T22:05:52.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.029350+0000", 2024-09-12T22:05:52.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.741e-06 2024-09-12T22:05:52.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.029384+0000", 2024-09-12T22:05:52.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3948000000000001e-05 2024-09-12T22:05:52.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:52.029389+0000", 2024-09-12T22:05:52.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9139999999999999e-06 2024-09-12T22:05:52.339 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.339 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.339 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.340 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:52.340 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 16 2024-09-12T22:05:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:52.341 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:52.353 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:52.352+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:52.454 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:52.453+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:52.490 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:52.491 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:52.491 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:52.500 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:52.584 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:52.583+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:52.655 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:52.655 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:52.655 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:52.655 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:52.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.656 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:52.656 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:52.656 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 30.688318466999998, 2024-09-12T22:05:52.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:05:52.656 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.656 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.656 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.656 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.656 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.656 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.656 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:05:52.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.657 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:52.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:52.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:05:52.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:05:52.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:05:52.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:05:52.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:05:52.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:05:52.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:05:52.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:05:52.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:05:52.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:05:52.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:05:52.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:05:52.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:05:52.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:05:52.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:05:52.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:05:52.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.662 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 30.686285741999999, 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.663 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.664 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.664 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.664 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:05:52.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.664 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:52.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:52.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:52.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:05:52.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:05:52.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:05:52.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:05:52.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:05:52.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:05:52.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:05:52.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:05:52.669 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.669 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.669 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.669 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 30.683273478, 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:05:52.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:52.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.672 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:05:52.672 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:05:52.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.672 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:05:52.672 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:05:52.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.672 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:05:52.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:05:52.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:05:52.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:05:52.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:05:52.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:05:52.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:05:52.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:05:52.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:05:52.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:05:52.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:05:52.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:05:52.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:05:52.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:05:52.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:05:52.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:05:52.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:05:52.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:05:52.676 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.676 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.676 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.676 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.676 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.676 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:52.676 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:52.676 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 30.682286988000001, 2024-09-12T22:05:52.676 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:05:52.676 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.676 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.676 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.676 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.677 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.677 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.677 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:05:52.677 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.677 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.677 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.677 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.677 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:52.677 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.677 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.677 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.677 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.677 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:52.677 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:05:52.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:52.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:05:52.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:05:52.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:05:52.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:52.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:05:52.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:05:52.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:05:52.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:05:52.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:05:52.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:52.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:05:52.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:05:52.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:05:52.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:05:52.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:05:52.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:05:52.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:05:52.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:05:52.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:05:52.682 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.683 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.683 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.683 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.683 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:52.683 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:52.683 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 30.677200354, 2024-09-12T22:05:52.683 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:05:52.683 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.683 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.683 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.683 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.683 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.684 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.684 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:05:52.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.684 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:52.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.684 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.684 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:52.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:05:52.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:05:52.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:05:52.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:05:52.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:05:52.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:05:52.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:05:52.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:05:52.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:05:52.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.689 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.689 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:05:52.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:05:52.689 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.689 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.689 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.689 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:52.689 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:52.689 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 30.674445382000002, 2024-09-12T22:05:52.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:52.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:05:52.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:05:52.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:05:52.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:05:52.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:05:52.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:05:52.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:05:52.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:05:52.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:05:52.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:05:52.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:05:52.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:05:52.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:05:52.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:05:52.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:05:52.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:05:52.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:05:52.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:05:52.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:05:52.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.695 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.695 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:05:52.695 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:05:52.696 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.696 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.696 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.696 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:52.696 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:52.696 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 30.666470496999999, 2024-09-12T22:05:52.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:05:52.696 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.696 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.696 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.697 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.697 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.697 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.697 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:05:52.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.697 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:52.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:52.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:05:52.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:05:52.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:05:52.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:05:52.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:05:52.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:05:52.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:05:52.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:05:52.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:05:52.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:05:52.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:05:52.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:05:52.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:05:52.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:05:52.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:05:52.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:05:52.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:05:52.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:05:52.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:05:52.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:05:52.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:05:52.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:05:52.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:05:52.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:05:52.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:05:52.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:05:52.703 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.703 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.703 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.703 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:52.703 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:52.703 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 30.658544720999998, 2024-09-12T22:05:52.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:05:52.704 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.704 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.704 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.704 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.704 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.704 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.704 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:05:52.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.704 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:52.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:52.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:05:52.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:05:52.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:05:52.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:05:52.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:05:52.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:05:52.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:05:52.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:05:52.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:05:52.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:05:52.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.707 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.707 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:05:52.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:52.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:05:52.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:05:52.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.708 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:05:52.708 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:05:52.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:05:52.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:05:52.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:05:52.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:05:52.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:05:52.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:05:52.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:05:52.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:05:52.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:05:52.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:05:52.710 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.710 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.710 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.710 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:52.711 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:52.711 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 30.657048439, 2024-09-12T22:05:52.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:05:52.711 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.711 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.711 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.711 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.711 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.711 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.711 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:05:52.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.711 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:52.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:52.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.713 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.713 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:05:52.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:52.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:05:52.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:05:52.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:05:52.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:05:52.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:05:52.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:52.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:05:52.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:05:52.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:05:52.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:05:52.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:05:52.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:05:52.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:05:52.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:05:52.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:05:52.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:05:52.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:05:52.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:05:52.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:05:52.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:05:52.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:05:52.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:52.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:05:52.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:05:52.718 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.718 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.719 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.719 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296741 5.3 5:c190c274:::benchmark_data_smithi043_32659_object129503:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:52.719 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:52.719 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6357408269999993, 2024-09-12T22:05:52.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.051784984, 2024-09-12T22:05:52.719 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.719 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.719 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.719 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.719 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.719 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.719 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296741 2024-09-12T22:05:52.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.720 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:52.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:52.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016859+0000", 2024-09-12T22:05:52.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5600000000000004e-07 2024-09-12T22:05:52.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016863+0000", 2024-09-12T22:05:52.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5510000000000001e-06 2024-09-12T22:05:52.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016873+0000", 2024-09-12T22:05:52.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5319999999999995e-06 2024-09-12T22:05:52.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016879+0000", 2024-09-12T22:05:52.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5100000000000004e-06 2024-09-12T22:05:52.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016934+0000", 2024-09-12T22:05:52.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4734999999999997e-05 2024-09-12T22:05:52.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016941+0000", 2024-09-12T22:05:52.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1319999999999996e-06 2024-09-12T22:05:52.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055352+0000", 2024-09-12T22:05:52.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0384109260000001 2024-09-12T22:05:52.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055496+0000", 2024-09-12T22:05:52.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014437400000000001 2024-09-12T22:05:52.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055835+0000", 2024-09-12T22:05:52.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000338339 2024-09-12T22:05:52.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065163+0000", 2024-09-12T22:05:52.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093287690000000006 2024-09-12T22:05:52.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.725 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068506+0000", 2024-09-12T22:05:52.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033423620000000002 2024-09-12T22:05:52.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068557+0000", 2024-09-12T22:05:52.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1057000000000003e-05 2024-09-12T22:05:52.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068643+0000", 2024-09-12T22:05:52.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5741000000000005e-05 2024-09-12T22:05:52.726 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.726 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.726 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.726 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296774 5.3 5:c9ea392f:::benchmark_data_smithi043_32659_object129536:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:52.727 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:52.727 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6219952049999993, 2024-09-12T22:05:52.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0383883359999999, 2024-09-12T22:05:52.727 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.727 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.727 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.728 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.728 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.728 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.728 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296774 2024-09-12T22:05:52.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.728 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:52.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:52.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.730 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030604+0000", 2024-09-12T22:05:52.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:05:52.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030607+0000", 2024-09-12T22:05:52.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0860000000000002e-06 2024-09-12T22:05:52.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030615+0000", 2024-09-12T22:05:52.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8120000000000008e-06 2024-09-12T22:05:52.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030620+0000", 2024-09-12T22:05:52.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6080000000000003e-06 2024-09-12T22:05:52.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030662+0000", 2024-09-12T22:05:52.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1925999999999998e-05 2024-09-12T22:05:52.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030670+0000", 2024-09-12T22:05:52.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2359999999999998e-06 2024-09-12T22:05:52.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065202+0000", 2024-09-12T22:05:52.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0345323989999999 2024-09-12T22:05:52.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065348+0000", 2024-09-12T22:05:52.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145575 2024-09-12T22:05:52.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065476+0000", 2024-09-12T22:05:52.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012800999999999999 2024-09-12T22:05:52.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068690+0000", 2024-09-12T22:05:52.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032143929999999999 2024-09-12T22:05:52.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068869+0000", 2024-09-12T22:05:52.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000179152 2024-09-12T22:05:52.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068914+0000", 2024-09-12T22:05:52.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4629999999999998e-05 2024-09-12T22:05:52.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068992+0000", 2024-09-12T22:05:52.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7885000000000004e-05 2024-09-12T22:05:52.736 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.736 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.736 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.737 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296793 5.3 5:c55bd684:::benchmark_data_smithi043_32659_object129555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:52.737 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:52.737 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6151785580000002, 2024-09-12T22:05:52.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0317046320000001, 2024-09-12T22:05:52.737 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.737 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296793 2024-09-12T22:05:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:52.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037421+0000", 2024-09-12T22:05:52.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:05:52.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037425+0000", 2024-09-12T22:05:52.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9539999999999998e-06 2024-09-12T22:05:52.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037432+0000", 2024-09-12T22:05:52.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:05:52.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037436+0000", 2024-09-12T22:05:52.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4320000000000001e-06 2024-09-12T22:05:52.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037496+0000", 2024-09-12T22:05:52.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9385999999999997e-05 2024-09-12T22:05:52.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037503+0000", 2024-09-12T22:05:52.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:05:52.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066427+0000", 2024-09-12T22:05:52.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.028923877 2024-09-12T22:05:52.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066519+0000", 2024-09-12T22:05:52.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1867000000000007e-05 2024-09-12T22:05:52.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066598+0000", 2024-09-12T22:05:52.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9175e-05 2024-09-12T22:05:52.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068804+0000", 2024-09-12T22:05:52.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002205664 2024-09-12T22:05:52.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069004+0000", 2024-09-12T22:05:52.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000200769 2024-09-12T22:05:52.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069050+0000", 2024-09-12T22:05:52.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5522999999999998e-05 2024-09-12T22:05:52.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069125+0000", 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4530000000000006e-05 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296796 5.3 5:cbc9dd25:::benchmark_data_smithi043_32659_object129558:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6148809289999999, 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0315259400000001, 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.745 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.746 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.746 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.746 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.746 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296796 2024-09-12T22:05:52.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.746 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:52.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:52.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037719+0000", 2024-09-12T22:05:52.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1069999999999999e-06 2024-09-12T22:05:52.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037723+0000", 2024-09-12T22:05:52.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1400000000000002e-06 2024-09-12T22:05:52.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037734+0000", 2024-09-12T22:05:52.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0991e-05 2024-09-12T22:05:52.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037741+0000", 2024-09-12T22:05:52.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6059999999999997e-06 2024-09-12T22:05:52.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037790+0000", 2024-09-12T22:05:52.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9112e-05 2024-09-12T22:05:52.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037797+0000", 2024-09-12T22:05:52.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:05:52.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067455+0000", 2024-09-12T22:05:52.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0296586320000001 2024-09-12T22:05:52.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067568+0000", 2024-09-12T22:05:52.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112895 2024-09-12T22:05:52.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067686+0000", 2024-09-12T22:05:52.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117879 2024-09-12T22:05:52.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068856+0000", 2024-09-12T22:05:52.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011693949999999999 2024-09-12T22:05:52.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069132+0000", 2024-09-12T22:05:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027629599999999999 2024-09-12T22:05:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069171+0000", 2024-09-12T22:05:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9536000000000002e-05 2024-09-12T22:05:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069243+0000", 2024-09-12T22:05:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2033999999999995e-05 2024-09-12T22:05:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296865 5.3 5:c0e17763:::benchmark_data_smithi043_32659_object129627:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.060875+0000", 2024-09-12T22:05:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.5917233320000008, 2024-09-12T22:05:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0133217349999999, 2024-09-12T22:05:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.754 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.754 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.754 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.754 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.754 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.754 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296865 2024-09-12T22:05:52.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.754 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060875+0000", 2024-09-12T22:05:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060875+0000", 2024-09-12T22:05:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060876+0000", 2024-09-12T22:05:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6500000000000008e-07 2024-09-12T22:05:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060881+0000", 2024-09-12T22:05:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:05:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060892+0000", 2024-09-12T22:05:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1583000000000001e-05 2024-09-12T22:05:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.060899+0000", 2024-09-12T22:05:52.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.742e-06 2024-09-12T22:05:52.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.061193+0000", 2024-09-12T22:05:52.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00029414099999999999 2024-09-12T22:05:52.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.061201+0000", 2024-09-12T22:05:52.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9200000000000004e-06 2024-09-12T22:05:52.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069278+0000", 2024-09-12T22:05:52.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.008076857 2024-09-12T22:05:52.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069396+0000", 2024-09-12T22:05:52.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118504 2024-09-12T22:05:52.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069510+0000", 2024-09-12T22:05:52.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114079 2024-09-12T22:05:52.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074033+0000", 2024-09-12T22:05:52.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045228459999999996 2024-09-12T22:05:52.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074086+0000", 2024-09-12T22:05:52.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2395999999999998e-05 2024-09-12T22:05:52.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074143+0000", 2024-09-12T22:05:52.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7518000000000001e-05 2024-09-12T22:05:52.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074197+0000", 2024-09-12T22:05:52.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3613999999999999e-05 2024-09-12T22:05:52.761 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.761 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.761 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.761 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296897 5.3 5:c39fcaa1:::benchmark_data_smithi043_32659_object129659:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:52.761 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:52.761 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.5786877619999995, 2024-09-12T22:05:52.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.000488958, 2024-09-12T22:05:52.762 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.762 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.762 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.762 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.762 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.762 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.762 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296897 2024-09-12T22:05:52.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.762 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:52.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:52.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.764 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073911+0000", 2024-09-12T22:05:52.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:05:52.765 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.765 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.765 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073913+0000", 2024-09-12T22:05:52.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8789999999999999e-06 2024-09-12T22:05:52.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073918+0000", 2024-09-12T22:05:52.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:05:52.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073923+0000", 2024-09-12T22:05:52.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8450000000000002e-06 2024-09-12T22:05:52.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073989+0000", 2024-09-12T22:05:52.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5610000000000004e-05 2024-09-12T22:05:52.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.073997+0000", 2024-09-12T22:05:52.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0830000000000004e-06 2024-09-12T22:05:52.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.070494+0000", 2024-09-12T22:05:52.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99649657700000005 2024-09-12T22:05:52.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.070622+0000", 2024-09-12T22:05:52.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000128336 2024-09-12T22:05:52.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.070737+0000", 2024-09-12T22:05:52.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115021 2024-09-12T22:05:52.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074248+0000", 2024-09-12T22:05:52.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035110129999999999 2024-09-12T22:05:52.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074261+0000", 2024-09-12T22:05:52.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3127e-05 2024-09-12T22:05:52.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074310+0000", 2024-09-12T22:05:52.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8930000000000001e-05 2024-09-12T22:05:52.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074400+0000", 2024-09-12T22:05:52.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9716999999999995e-05 2024-09-12T22:05:52.774 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.774 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.774 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.774 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296905 5.3 5:c5d41e92:::benchmark_data_smithi043_32659_object129667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:52.774 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.076778+0000", 2024-09-12T22:05:52.775 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.5758200119999994, 2024-09-12T22:05:52.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.997726954, 2024-09-12T22:05:52.775 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.775 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.775 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.775 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.776 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.776 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.776 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296905 2024-09-12T22:05:52.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.776 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.776 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076778+0000", 2024-09-12T22:05:52.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076778+0000", 2024-09-12T22:05:52.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076779+0000", 2024-09-12T22:05:52.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3e-07 2024-09-12T22:05:52.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076782+0000", 2024-09-12T22:05:52.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0790000000000001e-06 2024-09-12T22:05:52.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076790+0000", 2024-09-12T22:05:52.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0050000000000004e-06 2024-09-12T22:05:52.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076795+0000", 2024-09-12T22:05:52.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4139999999999996e-06 2024-09-12T22:05:52.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076838+0000", 2024-09-12T22:05:52.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3591999999999999e-05 2024-09-12T22:05:52.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.076844+0000", 2024-09-12T22:05:52.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:52.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.071643+0000", 2024-09-12T22:05:52.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99479885499999998 2024-09-12T22:05:52.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.071749+0000", 2024-09-12T22:05:52.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106165 2024-09-12T22:05:52.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.071864+0000", 2024-09-12T22:05:52.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011547 2024-09-12T22:05:52.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074409+0000", 2024-09-12T22:05:52.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025444550000000002 2024-09-12T22:05:52.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074429+0000", 2024-09-12T22:05:52.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0412e-05 2024-09-12T22:05:52.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074455+0000", 2024-09-12T22:05:52.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6318000000000001e-05 2024-09-12T22:05:52.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074505+0000", 2024-09-12T22:05:52.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0086000000000001e-05 2024-09-12T22:05:52.785 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.785 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.785 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.785 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296917 5.3 5:c2604485:::benchmark_data_smithi043_32659_object129679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:52.785 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:52.785 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.5718579439999996, 2024-09-12T22:05:52.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99672535699999998, 2024-09-12T22:05:52.785 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.785 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.785 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.786 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.786 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.786 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.786 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296917 2024-09-12T22:05:52.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.786 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:52.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:52.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080741+0000", 2024-09-12T22:05:52.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7000000000000004e-07 2024-09-12T22:05:52.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080744+0000", 2024-09-12T22:05:52.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2320000000000001e-06 2024-09-12T22:05:52.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080752+0000", 2024-09-12T22:05:52.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2980000000000003e-06 2024-09-12T22:05:52.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080758+0000", 2024-09-12T22:05:52.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:05:52.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080802+0000", 2024-09-12T22:05:52.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4607000000000002e-05 2024-09-12T22:05:52.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.080811+0000", 2024-09-12T22:05:52.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9020000000000005e-06 2024-09-12T22:05:52.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.072838+0000", 2024-09-12T22:05:52.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99202686100000004 2024-09-12T22:05:52.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.072952+0000", 2024-09-12T22:05:52.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000113606 2024-09-12T22:05:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.073064+0000", 2024-09-12T22:05:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0001126 2024-09-12T22:05:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074554+0000", 2024-09-12T22:05:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014899609999999999 2024-09-12T22:05:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077381+0000", 2024-09-12T22:05:52.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028265400000000002 2024-09-12T22:05:52.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077408+0000", 2024-09-12T22:05:52.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7508000000000002e-05 2024-09-12T22:05:52.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077466+0000", 2024-09-12T22:05:52.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7707000000000002e-05 2024-09-12T22:05:52.792 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.792 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.792 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.793 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296918 5.3 5:c3e8680d:::benchmark_data_smithi043_32659_object129680:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:52.793 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.081205+0000", 2024-09-12T22:05:52.793 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.5713934359999993, 2024-09-12T22:05:52.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99634571100000002, 2024-09-12T22:05:52.793 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.793 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.793 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.793 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.793 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.794 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.794 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296918 2024-09-12T22:05:52.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.794 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081205+0000", 2024-09-12T22:05:52.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081205+0000", 2024-09-12T22:05:52.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081206+0000", 2024-09-12T22:05:52.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5899999999999995e-07 2024-09-12T22:05:52.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081210+0000", 2024-09-12T22:05:52.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0169999999999998e-06 2024-09-12T22:05:52.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081220+0000", 2024-09-12T22:05:52.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0573e-05 2024-09-12T22:05:52.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081229+0000", 2024-09-12T22:05:52.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8270000000000004e-06 2024-09-12T22:05:52.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081274+0000", 2024-09-12T22:05:52.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5102999999999998e-05 2024-09-12T22:05:52.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.081282+0000", 2024-09-12T22:05:52.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3159999999999999e-06 2024-09-12T22:05:52.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074575+0000", 2024-09-12T22:05:52.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99329281599999997 2024-09-12T22:05:52.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074651+0000", 2024-09-12T22:05:52.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6202e-05 2024-09-12T22:05:52.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.074715+0000", 2024-09-12T22:05:52.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4115999999999994e-05 2024-09-12T22:05:52.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077371+0000", 2024-09-12T22:05:52.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026562119999999998 2024-09-12T22:05:52.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077474+0000", 2024-09-12T22:05:52.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000102437 2024-09-12T22:05:52.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077498+0000", 2024-09-12T22:05:52.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4445000000000001e-05 2024-09-12T22:05:52.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077551+0000", 2024-09-12T22:05:52.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2787999999999997e-05 2024-09-12T22:05:52.800 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.800 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.800 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.800 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296921 5.3 5:c1fc9263:::benchmark_data_smithi043_32659_object129683:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:52.800 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.084330+0000", 2024-09-12T22:05:52.800 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.5682682270000008, 2024-09-12T22:05:52.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99642918800000002, 2024-09-12T22:05:52.800 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.801 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.801 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.801 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.801 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.801 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.801 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296921 2024-09-12T22:05:52.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.801 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084330+0000", 2024-09-12T22:05:52.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084330+0000", 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084331+0000", 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6499999999999999e-07 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084333+0000", 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5189999999999999e-06 2024-09-12T22:05:52.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084342+0000", 2024-09-12T22:05:52.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.132e-06 2024-09-12T22:05:52.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084348+0000", 2024-09-12T22:05:52.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:05:52.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084380+0000", 2024-09-12T22:05:52.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2166999999999999e-05 2024-09-12T22:05:52.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.084385+0000", 2024-09-12T22:05:52.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2789999999999998e-06 2024-09-12T22:05:52.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.075392+0000", 2024-09-12T22:05:52.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99100684299999997 2024-09-12T22:05:52.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.075503+0000", 2024-09-12T22:05:52.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111119 2024-09-12T22:05:52.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.075609+0000", 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105516 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.077607+0000", 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019978349999999999 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080656+0000", 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030494860000000001 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080683+0000", 2024-09-12T22:05:52.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6721999999999999e-05 2024-09-12T22:05:52.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080759+0000", 2024-09-12T22:05:52.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6631000000000005e-05 2024-09-12T22:05:52.807 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.808 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.808 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.808 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296926 5.3 5:c88c2a98:::benchmark_data_smithi043_32659_object129688:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:52.808 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.087117+0000", 2024-09-12T22:05:52.808 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.5654811809999991, 2024-09-12T22:05:52.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.99371757999999999, 2024-09-12T22:05:52.808 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:52.808 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:52.808 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:52.808 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:52.808 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:52.808 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:52.809 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296926 2024-09-12T22:05:52.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.809 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:52.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:52.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087117+0000", 2024-09-12T22:05:52.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:52.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087117+0000", 2024-09-12T22:05:52.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:52.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:52.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087118+0000", 2024-09-12T22:05:52.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3200000000000004e-07 2024-09-12T22:05:52.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:52.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087122+0000", 2024-09-12T22:05:52.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:05:52.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:52.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087131+0000", 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9020000000000005e-06 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087138+0000", 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.832e-06 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087178+0000", 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9727000000000001e-05 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:52.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.087183+0000", 2024-09-12T22:05:52.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9810000000000003e-06 2024-09-12T22:05:52.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:52.812 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.076485+0000", 2024-09-12T22:05:52.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.98930243299999998 2024-09-12T22:05:52.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:52.812 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.076572+0000", 2024-09-12T22:05:52.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6493e-05 2024-09-12T22:05:52.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:52.813 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.076633+0000", 2024-09-12T22:05:52.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1136000000000006e-05 2024-09-12T22:05:52.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:52.813 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.079747+0000", 2024-09-12T22:05:52.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031138609999999999 2024-09-12T22:05:52.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:52.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080765+0000", 2024-09-12T22:05:52.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001018232 2024-09-12T22:05:52.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:52.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080790+0000", 2024-09-12T22:05:52.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5099000000000001e-05 2024-09-12T22:05:52.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:52.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:52.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:52.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.080835+0000", 2024-09-12T22:05:52.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4903e-05 2024-09-12T22:05:52.815 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.815 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.816 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.816 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:52.816 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:52.816 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:52.817 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:52.818 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:52.816+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:52.918 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:52.917+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:52.923 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:52.923 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:52.923 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-12T22:05:52.924 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:52.932 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:53.019 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:53.017+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:53.101 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:53.101 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:53.101 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:53.101 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:53.102 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:53.112 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:53.120 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:53.119+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:53.221 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:53.220+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:53.297 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:53.297 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:53.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:53.298 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:53.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.298 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:53.298 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:53.298 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.883535127000002, 2024-09-12T22:05:53.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:53.298 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.298 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.298 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:53.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.298 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:53.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.299 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:53.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:53.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:53.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:53.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:53.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:53.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:53.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:53.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:53.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:53.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:53.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:53.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:53.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:53.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:53.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:53.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:53.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:53.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:53.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.302 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.303 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:53.303 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:53.303 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.883355197, 2024-09-12T22:05:53.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:53.303 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.303 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.303 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:53.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.303 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:53.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.304 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:53.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:53.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:53.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:53.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:53.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:53.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:53.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:53.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:53.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:53.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:53.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:53.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:53.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:53.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:53.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:53.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:53.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:53.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:53.307 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.307 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.307 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.308 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:53.308 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:53.308 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.883288755999999, 2024-09-12T22:05:53.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:53.308 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.308 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.308 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:53.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.308 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:53.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.309 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:53.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:53.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:53.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:53.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:53.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:53.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:53.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:53.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:53.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:53.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:53.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:53.312 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.312 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.312 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.313 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:53.313 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:53.313 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.883232312999993, 2024-09-12T22:05:53.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:53.313 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.313 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.313 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.313 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.313 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.313 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.313 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:53.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.313 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:53.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:53.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:53.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:53.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:53.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:53.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:53.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:53.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:53.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:53.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:53.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:53.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:53.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:53.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:53.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:53.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:53.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:53.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:53.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:53.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:53.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:53.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:53.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.319 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.319 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:53.319 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:53.319 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.883163852999999, 2024-09-12T22:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:53.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:53.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:53.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:53.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:53.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:53.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:53.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:53.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:53.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:53.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:53.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:53.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:53.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:53.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:53.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:53.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:53.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:53.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:53.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:53.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.883106118000001, 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.327 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:53.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.327 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:53.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:53.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:53.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:53.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:53.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:53.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:53.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:53.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:53.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:53.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:53.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:53.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:53.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:53.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:53.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:53.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:53.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:53.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:53.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:53.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:53.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:53.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:53.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:53.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:53.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:53.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:53.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:53.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:53.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.332 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.333 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:53.333 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:53.333 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.883038425999999, 2024-09-12T22:05:53.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:53.333 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.333 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.333 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.333 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:53.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.333 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:53.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:53.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:53.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:53.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:53.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:53.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:53.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:53.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:53.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:53.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:53.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:53.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:53.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:53.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:53.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:53.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:53.339 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.339 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.339 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.339 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:53.339 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:53.339 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.882983363999998, 2024-09-12T22:05:53.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:53.340 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.340 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.340 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.340 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.340 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.340 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.340 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:53.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.340 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:53.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:53.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:53.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:53.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:53.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:53.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:53.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:53.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:53.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:53.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:53.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:53.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:53.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:53.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:53.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:53.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:53.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:53.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:53.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.346 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.346 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:53.346 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:53.346 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.842335844000004, 2024-09-12T22:05:53.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:53.346 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.346 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.346 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.347 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:53.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.347 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:53.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:53.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:53.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:53.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:53.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:53.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:53.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:53.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:53.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:53.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:53.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:53.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:53.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:53.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:53.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:53.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:53.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:53.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:53.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:53.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:53.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:53.352 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.353 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.353 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.353 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:53.353 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:53.353 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.839722116000004, 2024-09-12T22:05:53.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:53.353 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.353 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.353 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:53.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:53.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:53.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:53.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:53.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:53.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:53.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:53.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:53.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:53.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:53.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:53.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:53.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:53.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:53.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:53.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.359 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.294508019999995, 2024-09-12T22:05:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:53.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:53.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:53.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:53.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.294029531999996, 2024-09-12T22:05:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.291534232000004, 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.290453440999997, 2024-09-12T22:05:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.289217879000006, 2024-09-12T22:05:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.848477391000003, 2024-09-12T22:05:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.843946963999997, 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.843922935000002, 2024-09-12T22:05:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.843745286000001, 2024-09-12T22:05:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.841726749000003, 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:53.419 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:53.421 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:53.421 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:53.419+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:53.521 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:53.520+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:53.585 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:53.585 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:53.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.586 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:319803 5.1 e70/40 5:84fc58e2:::benchmark_data_smithi043_32659_object152565:head v 70'19919, mlcod=70'19917)", 2024-09-12T22:05:53.586 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.578508+0000", 2024-09-12T22:05:53.586 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0047477539999999999, 2024-09-12T22:05:53.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047682860000000001, 2024-09-12T22:05:53.586 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.586 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.586 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:53.586 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578508+0000", 2024-09-12T22:05:53.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578508+0000", 2024-09-12T22:05:53.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578509+0000", 2024-09-12T22:05:53.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7e-07 2024-09-12T22:05:53.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578513+0000", 2024-09-12T22:05:53.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:05:53.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578520+0000", 2024-09-12T22:05:53.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0720000000000002e-06 2024-09-12T22:05:53.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578526+0000", 2024-09-12T22:05:53.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7459999999999997e-06 2024-09-12T22:05:53.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:53.589 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578615+0000", 2024-09-12T22:05:53.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8492000000000006e-05 2024-09-12T22:05:53.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.589 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.589 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:53.589 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578630+0000", 2024-09-12T22:05:53.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5028000000000001e-05 2024-09-12T22:05:53.589 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.589 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.589 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.589 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.589 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:319813 5.9 5.71fd4ea9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T22:05:53.589 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.579504+0000", 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0037524189999999999, 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038402950000000001, 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 319813 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579504+0000", 2024-09-12T22:05:53.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579504+0000", 2024-09-12T22:05:53.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579505+0000", 2024-09-12T22:05:53.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0580000000000001e-06 2024-09-12T22:05:53.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579509+0000", 2024-09-12T22:05:53.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.865e-06 2024-09-12T22:05:53.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.592 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.592 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579522+0000", 2024-09-12T22:05:53.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2116000000000001e-05 2024-09-12T22:05:53.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.592 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.592 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579529+0000", 2024-09-12T22:05:53.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5830000000000001e-06 2024-09-12T22:05:53.592 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.592 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.592 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.593 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:319814 5.b 5:d157872a:::benchmark_data_smithi043_32659_object152576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T22:05:53.593 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.579546+0000", 2024-09-12T22:05:53.593 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0037098980000000001, 2024-09-12T22:05:53.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038586190000000002, 2024-09-12T22:05:53.593 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.593 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.593 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:53.593 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:53.593 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:53.593 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.593 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 319814 2024-09-12T22:05:53.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.594 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.594 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.594 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579546+0000", 2024-09-12T22:05:53.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.594 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.594 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579546+0000", 2024-09-12T22:05:53.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.594 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579547+0000", 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579549+0000", 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.723e-06 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579557+0000", 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6559999999999992e-06 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579563+0000", 2024-09-12T22:05:53.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9900000000000002e-06 2024-09-12T22:05:53.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:53.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581063+0000", 2024-09-12T22:05:53.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014996160000000001 2024-09-12T22:05:53.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:53.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581215+0000", 2024-09-12T22:05:53.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000152411 2024-09-12T22:05:53.596 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.596 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.597 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.597 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.597 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.597 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:319815 5.b 5:d32b39b4:::benchmark_data_smithi043_32659_object152577:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T22:05:53.597 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.579970+0000", 2024-09-12T22:05:53.597 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0032854690000000001, 2024-09-12T22:05:53.597 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034997539999999999, 2024-09-12T22:05:53.597 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.597 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.597 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:53.597 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:53.597 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:53.597 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.597 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 319815 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579970+0000", 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579970+0000", 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579971+0000", 2024-09-12T22:05:53.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.037e-06 2024-09-12T22:05:53.599 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.599 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.599 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579976+0000", 2024-09-12T22:05:53.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4889999999999997e-06 2024-09-12T22:05:53.599 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.599 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.599 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579986+0000", 2024-09-12T22:05:53.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8889999999999997e-06 2024-09-12T22:05:53.599 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.599 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.579992+0000", 2024-09-12T22:05:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:05:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.582663+0000", 2024-09-12T22:05:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026702050000000001 2024-09-12T22:05:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.582833+0000", 2024-09-12T22:05:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000170824 2024-09-12T22:05:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.601 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.601 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.601 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.601 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:319810 5.1 e70/40 5:8ef2949c:::benchmark_data_smithi043_32659_object152572:head v 70'19920, mlcod=70'19917)", 2024-09-12T22:05:53.601 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.580364+0000", 2024-09-12T22:05:53.601 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002892333, 2024-09-12T22:05:53.601 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003186211, 2024-09-12T22:05:53.601 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.601 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.601 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:53.601 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.601 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.601 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.602 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580364+0000", 2024-09-12T22:05:53.602 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.602 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.602 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.602 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.602 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580364+0000", 2024-09-12T22:05:53.602 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.602 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.602 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.602 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.602 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580364+0000", 2024-09-12T22:05:53.602 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6499999999999999e-07 2024-09-12T22:05:53.602 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.602 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580368+0000", 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.98e-06 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580374+0000", 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0399999999999998e-06 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580379+0000", 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4390000000000002e-06 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.603 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.604 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:53.604 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581819+0000", 2024-09-12T22:05:53.604 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014403879999999999 2024-09-12T22:05:53.604 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.604 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.604 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:53.604 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581842+0000", 2024-09-12T22:05:53.604 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3037e-05 2024-09-12T22:05:53.604 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.604 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.604 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.604 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.604 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.604 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:319817 5.4 5:23f7cc0b:::benchmark_data_smithi043_32659_object152579:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T22:05:53.605 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.580471+0000", 2024-09-12T22:05:53.605 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0027847089999999998, 2024-09-12T22:05:53.605 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031426409999999998, 2024-09-12T22:05:53.605 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.605 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.605 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:53.605 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:53.605 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:53.605 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.605 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 319817 2024-09-12T22:05:53.605 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.605 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.605 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.605 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580471+0000", 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580471+0000", 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580472+0000", 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1399999999999996e-07 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580476+0000", 2024-09-12T22:05:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9020000000000001e-06 2024-09-12T22:05:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580485+0000", 2024-09-12T22:05:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7309999999999999e-06 2024-09-12T22:05:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580491+0000", 2024-09-12T22:05:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:05:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580624+0000", 2024-09-12T22:05:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013318499999999999 2024-09-12T22:05:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580775+0000", 2024-09-12T22:05:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015113099999999999 2024-09-12T22:05:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:319818 5.d 5:b986fc9d:::benchmark_data_smithi043_32659_object152580:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T22:05:53.609 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.580900+0000", 2024-09-12T22:05:53.609 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.002356019, 2024-09-12T22:05:53.609 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027907449999999999, 2024-09-12T22:05:53.609 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.609 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.609 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:53.609 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:53.609 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:53.609 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.609 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 319818 2024-09-12T22:05:53.609 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.609 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.609 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580900+0000", 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580900+0000", 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580901+0000", 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7000000000000004e-07 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.610 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.611 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.611 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580904+0000", 2024-09-12T22:05:53.611 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6030000000000001e-06 2024-09-12T22:05:53.611 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.611 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.611 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.611 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580913+0000", 2024-09-12T22:05:53.611 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4509999999999992e-06 2024-09-12T22:05:53.611 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.611 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.611 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.611 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580919+0000", 2024-09-12T22:05:53.612 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:05:53.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:53.612 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.580964+0000", 2024-09-12T22:05:53.612 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4817999999999997e-05 2024-09-12T22:05:53.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:53.612 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581152+0000", 2024-09-12T22:05:53.612 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018728199999999999 2024-09-12T22:05:53.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:53.613 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581270+0000", 2024-09-12T22:05:53.613 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011859299999999999 2024-09-12T22:05:53.613 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.613 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.613 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:53.613 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583151+0000", 2024-09-12T22:05:53.613 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018804780000000001 2024-09-12T22:05:53.613 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.613 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.613 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.613 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.613 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.613 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:319816 5.5 e70/40 5:a860ee5c:::benchmark_data_smithi043_32659_object152578:head v 70'19961, mlcod=70'19958)", 2024-09-12T22:05:53.613 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.581027+0000", 2024-09-12T22:05:53.614 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0022284660000000001, 2024-09-12T22:05:53.614 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027404769999999998, 2024-09-12T22:05:53.614 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.614 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.614 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:53.614 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.614 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.614 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.614 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581027+0000", 2024-09-12T22:05:53.614 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.614 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.614 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.614 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.614 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581027+0000", 2024-09-12T22:05:53.615 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.615 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.615 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.615 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.615 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581028+0000", 2024-09-12T22:05:53.615 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6499999999999999e-07 2024-09-12T22:05:53.615 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.615 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.615 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.615 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581033+0000", 2024-09-12T22:05:53.615 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4789999999999998e-06 2024-09-12T22:05:53.615 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.615 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.615 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.616 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581041+0000", 2024-09-12T22:05:53.616 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.174e-06 2024-09-12T22:05:53.616 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.616 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.616 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.616 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581046+0000", 2024-09-12T22:05:53.616 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6509999999999998e-06 2024-09-12T22:05:53.616 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.616 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.616 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:53.616 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581301+0000", 2024-09-12T22:05:53.616 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025447399999999998 2024-09-12T22:05:53.616 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.617 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.617 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:53.617 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581345+0000", 2024-09-12T22:05:53.617 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4370999999999999e-05 2024-09-12T22:05:53.617 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.617 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.617 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.617 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.617 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.617 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:319820 5.9 5.95105b19 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T22:05:53.617 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.581423+0000", 2024-09-12T22:05:53.617 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001833313, 2024-09-12T22:05:53.617 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002395898, 2024-09-12T22:05:53.618 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.618 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.618 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:05:53.618 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:53.618 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:53.618 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.618 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 319820 2024-09-12T22:05:53.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.618 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.618 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.618 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581423+0000", 2024-09-12T22:05:53.618 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.619 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.619 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.619 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581423+0000", 2024-09-12T22:05:53.619 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.619 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.619 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.619 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581424+0000", 2024-09-12T22:05:53.619 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1699999999999997e-07 2024-09-12T22:05:53.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.619 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.619 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.619 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581427+0000", 2024-09-12T22:05:53.620 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7519999999999998e-06 2024-09-12T22:05:53.620 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.620 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.620 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581437+0000", 2024-09-12T22:05:53.620 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8279999999999998e-06 2024-09-12T22:05:53.620 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.620 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.620 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581443+0000", 2024-09-12T22:05:53.620 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.353e-06 2024-09-12T22:05:53.620 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.621 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.621 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.621 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.621 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.621 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:319821 5.4 5:2dbbb14b:::benchmark_data_smithi043_32659_object152583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T22:05:53.621 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.581455+0000", 2024-09-12T22:05:53.621 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0018011850000000001, 2024-09-12T22:05:53.621 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024197229999999999, 2024-09-12T22:05:53.621 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.621 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.621 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:53.621 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:53.621 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:53.621 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 319821 2024-09-12T22:05:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581455+0000", 2024-09-12T22:05:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581455+0000", 2024-09-12T22:05:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581455+0000", 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4299999999999998e-07 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581458+0000", 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6450000000000001e-06 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581463+0000", 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6690000000000003e-06 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.623 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581468+0000", 2024-09-12T22:05:53.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9540000000000003e-06 2024-09-12T22:05:53.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:53.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583114+0000", 2024-09-12T22:05:53.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001645622 2024-09-12T22:05:53.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:53.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583268+0000", 2024-09-12T22:05:53.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000153793 2024-09-12T22:05:53.624 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.625 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.625 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.625 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:319822 5.0 5:0b7d6ae9:::benchmark_data_smithi043_32659_object152584:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T22:05:53.625 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.581957+0000", 2024-09-12T22:05:53.625 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0012992329999999999, 2024-09-12T22:05:53.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019764589999999999, 2024-09-12T22:05:53.625 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.625 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.625 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:53.625 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:53.625 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:53.625 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 319822 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581957+0000", 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581957+0000", 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.627 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581957+0000", 2024-09-12T22:05:53.627 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3e-07 2024-09-12T22:05:53.627 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.627 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.627 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581961+0000", 2024-09-12T22:05:53.627 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2600000000000001e-06 2024-09-12T22:05:53.627 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.627 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.627 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581971+0000", 2024-09-12T22:05:53.627 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.01e-05 2024-09-12T22:05:53.627 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.581977+0000", 2024-09-12T22:05:53.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.857e-06 2024-09-12T22:05:53.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:53.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.582081+0000", 2024-09-12T22:05:53.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010443 2024-09-12T22:05:53.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:53.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.582252+0000", 2024-09-12T22:05:53.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000170562 2024-09-12T22:05:53.628 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.629 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.629 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.629 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.629 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.629 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop(client.4514.0:319812 5.1 e70/40 5:869c62b6:::benchmark_data_smithi043_32659_object152574:head v 70'19921, mlcod=70'19917)", 2024-09-12T22:05:53.629 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.582129+0000", 2024-09-12T22:05:53.629 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001126534, 2024-09-12T22:05:53.629 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018701259999999999, 2024-09-12T22:05:53.629 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.629 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.629 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:53.629 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.629 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.629 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.582129+0000", 2024-09-12T22:05:53.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.582129+0000", 2024-09-12T22:05:53.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.582130+0000", 2024-09-12T22:05:53.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0200000000000002e-07 2024-09-12T22:05:53.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.582134+0000", 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4939999999999997e-06 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.582144+0000", 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7890000000000006e-06 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.582150+0000", 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3260000000000003e-06 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:53.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583493+0000", 2024-09-12T22:05:53.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001342932 2024-09-12T22:05:53.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:53.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583511+0000", 2024-09-12T22:05:53.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8043e-05 2024-09-12T22:05:53.632 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.632 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.632 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.633 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:319823 5.7 5:e317963e:::benchmark_data_smithi043_32659_object152585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T22:05:53.633 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.583115+0000", 2024-09-12T22:05:53.633 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00014079899999999999, 2024-09-12T22:05:53.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00094371699999999995, 2024-09-12T22:05:53.633 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.633 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.633 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:53.633 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:53.633 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:53.633 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.633 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 319823 2024-09-12T22:05:53.633 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.633 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.633 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583115+0000", 2024-09-12T22:05:53.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583115+0000", 2024-09-12T22:05:53.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583116+0000", 2024-09-12T22:05:53.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3099999999999996e-07 2024-09-12T22:05:53.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583120+0000", 2024-09-12T22:05:53.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2880000000000003e-06 2024-09-12T22:05:53.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583129+0000", 2024-09-12T22:05:53.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7479999999999999e-06 2024-09-12T22:05:53.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583136+0000", 2024-09-12T22:05:53.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7349999999999999e-06 2024-09-12T22:05:53.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:53.636 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583210+0000", 2024-09-12T22:05:53.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4485000000000003e-05 2024-09-12T22:05:53.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:53.636 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583331+0000", 2024-09-12T22:05:53.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000121023 2024-09-12T22:05:53.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:53.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583443+0000", 2024-09-12T22:05:53.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112088 2024-09-12T22:05:53.637 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.637 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.637 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.637 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:319824 5.8 5:1a99b929:::benchmark_data_smithi043_32659_object152586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T22:05:53.637 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.583168+0000", 2024-09-12T22:05:53.637 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.8156000000000001e-05, 2024-09-12T22:05:53.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00095579699999999998, 2024-09-12T22:05:53.637 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.637 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.637 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 319824 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583168+0000", 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583168+0000", 2024-09-12T22:05:53.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583168+0000", 2024-09-12T22:05:53.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8299999999999997e-07 2024-09-12T22:05:53.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583171+0000", 2024-09-12T22:05:53.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.067e-06 2024-09-12T22:05:53.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583179+0000", 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6660000000000008e-06 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583184+0000", 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3669999999999996e-06 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583227+0000", 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3000000000000002e-05 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583372+0000", 2024-09-12T22:05:53.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000144807 2024-09-12T22:05:53.641 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.641 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.641 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.641 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:319825 5.a 5:599481d2:::benchmark_data_smithi043_32659_object152587:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T22:05:53.641 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.583466+0000", 2024-09-12T22:05:53.641 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.9997902, 2024-09-12T22:05:53.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000716912, 2024-09-12T22:05:53.641 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.641 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.641 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:53.641 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:53.642 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:53.642 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.642 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 319825 2024-09-12T22:05:53.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.642 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583466+0000", 2024-09-12T22:05:53.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583466+0000", 2024-09-12T22:05:53.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583467+0000", 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5600000000000004e-07 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583471+0000", 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9550000000000002e-06 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583479+0000", 2024-09-12T22:05:53.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6819999999999992e-06 2024-09-12T22:05:53.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583486+0000", 2024-09-12T22:05:53.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2489999999999998e-06 2024-09-12T22:05:53.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:53.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583532+0000", 2024-09-12T22:05:53.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6828e-05 2024-09-12T22:05:53.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:53.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.583682+0000", 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014956099999999999 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:319805 5.b 5:dba58a95:::benchmark_data_smithi043_32659_object152567:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:53.578268+0000", 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0049876210000000002, 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0059780889999999998, 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 319805 2024-09-12T22:05:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578268+0000", 2024-09-12T22:05:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578268+0000", 2024-09-12T22:05:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:53.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578269+0000", 2024-09-12T22:05:53.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2799999999999995e-07 2024-09-12T22:05:53.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:53.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578293+0000", 2024-09-12T22:05:53.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4139999999999999e-05 2024-09-12T22:05:53.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:53.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578303+0000", 2024-09-12T22:05:53.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8910000000000007e-06 2024-09-12T22:05:53.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:53.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578309+0000", 2024-09-12T22:05:53.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.117e-06 2024-09-12T22:05:53.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:53.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578366+0000", 2024-09-12T22:05:53.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7153e-05 2024-09-12T22:05:53.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:53.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:53.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:53.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.578506+0000", 2024-09-12T22:05:53.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000139398 2024-09-12T22:05:53.649 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.649 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:53.649 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.649 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:53.649 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:53.649 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 16 2024-09-12T22:05:53.649 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:53.650 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:53.651 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:53.649+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:53.701 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:05:53.751 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:53.750+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:53.822 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:53.841 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:53.841 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:53.852 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:53.850+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:53.854 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:53.855 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:53.855 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:53.855 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:53.855 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:53.863 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:53.863 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:53.866 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:53.867 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:53.870 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:53.954 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:53.953+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:53.978 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:05:54.054 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:54.053+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:54.077 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:54.078 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:54.090 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:54.155 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:54.154+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:54.233 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:54.233 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:54.244 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:54.255 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:54.255+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:54.356 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:54.356+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:54.424 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:54.424 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:54.436 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:54.480 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:54.479+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:54.560 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:54.558+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:54.575 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:54.575 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:54.587 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:54.660 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:54.659+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:54.752 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:54.753 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:54.762 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:54.761+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:54.765 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:54.862 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:54.861+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:54.963 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:54.962+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:54.968 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-09-12T22:05:54.968 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:54.968 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:54.982 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:55.064 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:55.063+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:55.137 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:55.137 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:55.149 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:55.193 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:55.192+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:55.265 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:55.264+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:55.292 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:55.293 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:55.304 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:55.388 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:55.387+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:55.467 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:55.465+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:55.489 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:55.489 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:55.499 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:55.583 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:55.582+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:55.668 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:55.667+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:55.679 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:55.679 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:55.690 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:55.769 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:55.768+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:55.852 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:55.852 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:55.865 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:55.868 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:05:55.906 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:55.905+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:55.970 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:55.969+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:55.977 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:55.995 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:55.995 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:56.014 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:56.014 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:56.017 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:56.018 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:56.053 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:56.053 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:56.053 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:56.053 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:56.054 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:56.063 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:56.107 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:56.106+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:56.171 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:56.170+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:56.181 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:56.181 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.214269192000003, 2024-09-12T22:05:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:05:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:05:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:05:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:05:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.183 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:05:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:05:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:05:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:05:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:05:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:05:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:05:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:05:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:05:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:05:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:05:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:05:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:05:56.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:05:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:05:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:05:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:05:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:05:56.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:05:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:05:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:05:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:05:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:05:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:05:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:05:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:05:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:05:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:05:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:05:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.188 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.212236466999997, 2024-09-12T22:05:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:05:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.189 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:05:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:05:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:05:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:05:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:05:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:05:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:05:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:05:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:05:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:05:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:05:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:05:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:05:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:05:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:05:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:05:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:05:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:05:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:05:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:05:56.195 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.209224202999998, 2024-09-12T22:05:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:05:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.196 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:05:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:05:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:05:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:05:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:05:56.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:05:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:05:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:05:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:05:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:05:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.199 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:05:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:05:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:05:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:05:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:05:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:05:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:05:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:05:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:05:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:05:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:05:56.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.208237713000003, 2024-09-12T22:05:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:05:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:05:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:05:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:56.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:05:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:05:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:05:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:05:56.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:05:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:05:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:05:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:05:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:05:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:05:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:05:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:05:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:05:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:05:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:05:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:05:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:05:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:05:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:05:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:05:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:05:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:05:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.203151079000001, 2024-09-12T22:05:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:05:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.209 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:05:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.210 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:05:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:05:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:05:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:05:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:05:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:05:56.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:05:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:05:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:05:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:05:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:05:56.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:05:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:05:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:05:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:05:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:05:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:05:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:05:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.200396107000003, 2024-09-12T22:05:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:05:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.216 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:05:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.217 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:05:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:05:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:05:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:05:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:05:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:05:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:05:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:05:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:05:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:05:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:05:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:05:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:05:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:05:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:05:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:05:56.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:05:56.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:05:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:05:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:05:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:05:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.192421222, 2024-09-12T22:05:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:05:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:05:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:05:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:05:56.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:05:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:05:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:05:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:05:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:05:56.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:05:56.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:05:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:05:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:05:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:05:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:05:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:05:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:05:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:05:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:05:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:05:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:05:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:05:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:05:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.184495446, 2024-09-12T22:05:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:05:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.229 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:05:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:05:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:05:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:05:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:05:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.231 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:05:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:05:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:05:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:05:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:05:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:05:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:05:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:05:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:05:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:05:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:05:56.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:05:56.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:05:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:05:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:05:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:05:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 34.182999164000002, 2024-09-12T22:05:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:05:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:05:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.239 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:05:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:05:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:05:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:05:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:05:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:05:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.242 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:05:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:05:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:05:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:05:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:05:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:05:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:05:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:05:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:05:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:05:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:05:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:56.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:05:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:05:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296741 5.3 5:c190c274:::benchmark_data_smithi043_32659_object129503:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.161691552000001, 2024-09-12T22:05:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.051784984, 2024-09-12T22:05:56.245 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.246 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.246 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.246 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.246 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.246 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.246 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296741 2024-09-12T22:05:56.246 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.246 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.246 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.246 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:56.246 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.246 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.247 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.247 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:56.247 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.247 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.247 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.247 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.247 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016859+0000", 2024-09-12T22:05:56.247 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5600000000000004e-07 2024-09-12T22:05:56.247 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.247 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.247 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.248 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016863+0000", 2024-09-12T22:05:56.248 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5510000000000001e-06 2024-09-12T22:05:56.248 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.248 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.248 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.248 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016873+0000", 2024-09-12T22:05:56.248 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5319999999999995e-06 2024-09-12T22:05:56.248 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.248 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.248 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.248 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016879+0000", 2024-09-12T22:05:56.248 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5100000000000004e-06 2024-09-12T22:05:56.249 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.249 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.249 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.249 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016934+0000", 2024-09-12T22:05:56.249 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4734999999999997e-05 2024-09-12T22:05:56.249 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.249 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.249 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.249 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016941+0000", 2024-09-12T22:05:56.249 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1319999999999996e-06 2024-09-12T22:05:56.249 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.249 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.249 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.249 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055352+0000", 2024-09-12T22:05:56.250 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0384109260000001 2024-09-12T22:05:56.250 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.250 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.250 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.250 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055496+0000", 2024-09-12T22:05:56.250 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014437400000000001 2024-09-12T22:05:56.250 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.250 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.250 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.250 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055835+0000", 2024-09-12T22:05:56.250 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000338339 2024-09-12T22:05:56.250 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.250 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.250 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065163+0000", 2024-09-12T22:05:56.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093287690000000006 2024-09-12T22:05:56.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068506+0000", 2024-09-12T22:05:56.251 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033423620000000002 2024-09-12T22:05:56.251 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.251 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.251 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.251 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068557+0000", 2024-09-12T22:05:56.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1057000000000003e-05 2024-09-12T22:05:56.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.252 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.252 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068643+0000", 2024-09-12T22:05:56.252 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5741000000000005e-05 2024-09-12T22:05:56.252 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.252 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.252 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.252 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.252 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.252 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296774 5.3 5:c9ea392f:::benchmark_data_smithi043_32659_object129536:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:56.252 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:56.252 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.147945930000001, 2024-09-12T22:05:56.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0383883359999999, 2024-09-12T22:05:56.253 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.253 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.253 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.253 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.253 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.253 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.253 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296774 2024-09-12T22:05:56.253 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.253 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.253 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.253 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.253 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:56.253 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030604+0000", 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030607+0000", 2024-09-12T22:05:56.254 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0860000000000002e-06 2024-09-12T22:05:56.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030615+0000", 2024-09-12T22:05:56.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8120000000000008e-06 2024-09-12T22:05:56.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030620+0000", 2024-09-12T22:05:56.255 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6080000000000003e-06 2024-09-12T22:05:56.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.255 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.255 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030662+0000", 2024-09-12T22:05:56.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1925999999999998e-05 2024-09-12T22:05:56.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030670+0000", 2024-09-12T22:05:56.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2359999999999998e-06 2024-09-12T22:05:56.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.256 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.256 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065202+0000", 2024-09-12T22:05:56.256 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0345323989999999 2024-09-12T22:05:56.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065348+0000", 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145575 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065476+0000", 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012800999999999999 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068690+0000", 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032143929999999999 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068869+0000", 2024-09-12T22:05:56.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000179152 2024-09-12T22:05:56.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068914+0000", 2024-09-12T22:05:56.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4629999999999998e-05 2024-09-12T22:05:56.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.258 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.258 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.258 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068992+0000", 2024-09-12T22:05:56.258 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7885000000000004e-05 2024-09-12T22:05:56.259 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.259 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.259 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.259 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296793 5.3 5:c55bd684:::benchmark_data_smithi043_32659_object129555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:56.259 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:56.259 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.141129283, 2024-09-12T22:05:56.259 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0317046320000001, 2024-09-12T22:05:56.259 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.259 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.259 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.259 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.260 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.260 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.260 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296793 2024-09-12T22:05:56.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.260 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:56.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.260 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.260 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:56.260 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037421+0000", 2024-09-12T22:05:56.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:05:56.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037425+0000", 2024-09-12T22:05:56.261 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9539999999999998e-06 2024-09-12T22:05:56.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.261 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.261 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037432+0000", 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037436+0000", 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4320000000000001e-06 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037496+0000", 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9385999999999997e-05 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.262 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037503+0000", 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066427+0000", 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.028923877 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066519+0000", 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1867000000000007e-05 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066598+0000", 2024-09-12T22:05:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9175e-05 2024-09-12T22:05:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068804+0000", 2024-09-12T22:05:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002205664 2024-09-12T22:05:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069004+0000", 2024-09-12T22:05:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000200769 2024-09-12T22:05:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069050+0000", 2024-09-12T22:05:56.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5522999999999998e-05 2024-09-12T22:05:56.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069125+0000", 2024-09-12T22:05:56.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4530000000000006e-05 2024-09-12T22:05:56.265 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.265 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.265 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.265 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296796 5.3 5:cbc9dd25:::benchmark_data_smithi043_32659_object129558:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:56.265 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:56.266 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.140831653999999, 2024-09-12T22:05:56.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0315259400000001, 2024-09-12T22:05:56.266 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.266 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.266 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.266 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.266 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.266 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.266 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296796 2024-09-12T22:05:56.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.266 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:56.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:56.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037719+0000", 2024-09-12T22:05:56.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1069999999999999e-06 2024-09-12T22:05:56.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037723+0000", 2024-09-12T22:05:56.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1400000000000002e-06 2024-09-12T22:05:56.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037734+0000", 2024-09-12T22:05:56.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0991e-05 2024-09-12T22:05:56.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037741+0000", 2024-09-12T22:05:56.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6059999999999997e-06 2024-09-12T22:05:56.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037790+0000", 2024-09-12T22:05:56.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9112e-05 2024-09-12T22:05:56.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037797+0000", 2024-09-12T22:05:56.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:05:56.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067455+0000", 2024-09-12T22:05:56.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0296586320000001 2024-09-12T22:05:56.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067568+0000", 2024-09-12T22:05:56.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112895 2024-09-12T22:05:56.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067686+0000", 2024-09-12T22:05:56.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117879 2024-09-12T22:05:56.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.270 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.270 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068856+0000", 2024-09-12T22:05:56.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011693949999999999 2024-09-12T22:05:56.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069132+0000", 2024-09-12T22:05:56.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027629599999999999 2024-09-12T22:05:56.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069171+0000", 2024-09-12T22:05:56.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9536000000000002e-05 2024-09-12T22:05:56.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069243+0000", 2024-09-12T22:05:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2033999999999995e-05 2024-09-12T22:05:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318065 5.7 5:e8daa0bb:::benchmark_data_smithi043_32659_object150827:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:05:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.2107726420000002, 2024-09-12T22:05:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041842749, 2024-09-12T22:05:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318065 2024-09-12T22:05:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:05:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:05:56.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:05:56.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:05:56.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967782+0000", 2024-09-12T22:05:56.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0539999999999996e-06 2024-09-12T22:05:56.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968192+0000", 2024-09-12T22:05:56.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000410906 2024-09-12T22:05:56.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968201+0000", 2024-09-12T22:05:56.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7639999999999994e-06 2024-09-12T22:05:56.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971494+0000", 2024-09-12T22:05:56.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032926180000000002 2024-09-12T22:05:56.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971499+0000", 2024-09-12T22:05:56.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0690000000000001e-06 2024-09-12T22:05:56.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.276 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.276 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009565+0000", 2024-09-12T22:05:56.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038066221 2024-09-12T22:05:56.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009619+0000", 2024-09-12T22:05:56.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4203000000000003e-05 2024-09-12T22:05:56.277 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.277 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.277 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.277 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318069 5.7 5:ea50145d:::benchmark_data_smithi043_32659_object150831:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:56.277 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:05:56.277 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.2103350669999999, 2024-09-12T22:05:56.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041799116, 2024-09-12T22:05:56.277 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.277 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318069 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:05:56.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968215+0000", 2024-09-12T22:05:56.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:05:56.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968218+0000", 2024-09-12T22:05:56.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9119999999999998e-06 2024-09-12T22:05:56.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968228+0000", 2024-09-12T22:05:56.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9599999999999995e-06 2024-09-12T22:05:56.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968234+0000", 2024-09-12T22:05:56.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6969999999999996e-06 2024-09-12T22:05:56.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971512+0000", 2024-09-12T22:05:56.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032779160000000001 2024-09-12T22:05:56.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971516+0000", 2024-09-12T22:05:56.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:56.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009970+0000", 2024-09-12T22:05:56.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03845421 2024-09-12T22:05:56.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010013+0000", 2024-09-12T22:05:56.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3516000000000001e-05 2024-09-12T22:05:56.282 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.282 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.282 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.282 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318078 5.7 5:e5b30db2:::benchmark_data_smithi043_32659_object150840:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:56.282 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:05:56.282 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.2103072389999996, 2024-09-12T22:05:56.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0418401070000001, 2024-09-12T22:05:56.282 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.282 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.282 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:56.283 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.283 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.283 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.283 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318078 2024-09-12T22:05:56.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.283 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:05:56.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:05:56.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:05:56.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:05:56.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968245+0000", 2024-09-12T22:05:56.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:05:56.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968251+0000", 2024-09-12T22:05:56.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2999999999999998e-06 2024-09-12T22:05:56.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968257+0000", 2024-09-12T22:05:56.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6400000000000002e-06 2024-09-12T22:05:56.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971528+0000", 2024-09-12T22:05:56.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032710619999999999 2024-09-12T22:05:56.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971533+0000", 2024-09-12T22:05:56.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8629999999999999e-06 2024-09-12T22:05:56.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010030+0000", 2024-09-12T22:05:56.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038496683 2024-09-12T22:05:56.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.286 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.286 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010082+0000", 2024-09-12T22:05:56.286 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2478999999999997e-05 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318093 5.7 5:e0eb16a2:::benchmark_data_smithi043_32659_object150855:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.2079758480000002, 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0523587110000001, 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.287 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.288 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318093 2024-09-12T22:05:56.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.288 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:05:56.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:05:56.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970575+0000", 2024-09-12T22:05:56.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.159e-06 2024-09-12T22:05:56.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970579+0000", 2024-09-12T22:05:56.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4510000000000002e-06 2024-09-12T22:05:56.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970588+0000", 2024-09-12T22:05:56.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1479999999999995e-06 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970595+0000", 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6919999999999996e-06 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971555+0000", 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00096029399999999999 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971561+0000", 2024-09-12T22:05:56.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7230000000000001e-06 2024-09-12T22:05:56.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010105+0000", 2024-09-12T22:05:56.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038544361 2024-09-12T22:05:56.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010201+0000", 2024-09-12T22:05:56.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5340000000000005e-05 2024-09-12T22:05:56.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010497+0000", 2024-09-12T22:05:56.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000296273 2024-09-12T22:05:56.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021904+0000", 2024-09-12T22:05:56.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011406928 2024-09-12T22:05:56.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022778+0000", 2024-09-12T22:05:56.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00087414199999999995 2024-09-12T22:05:56.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022844+0000", 2024-09-12T22:05:56.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6097000000000001e-05 2024-09-12T22:05:56.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022932+0000", 2024-09-12T22:05:56.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8103000000000007e-05 2024-09-12T22:05:56.293 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.293 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.293 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.293 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318150 5.7 5:e1ecf58e:::benchmark_data_smithi043_32659_object150912:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:56.293 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:05:56.294 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.1824971739999999, 2024-09-12T22:05:56.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027012142, 2024-09-12T22:05:56.294 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.294 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.294 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.294 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.294 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.294 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.294 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318150 2024-09-12T22:05:56.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.295 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:05:56.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:05:56.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996053+0000", 2024-09-12T22:05:56.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.079e-06 2024-09-12T22:05:56.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996057+0000", 2024-09-12T22:05:56.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3069999999999996e-06 2024-09-12T22:05:56.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996067+0000", 2024-09-12T22:05:56.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9420000000000007e-06 2024-09-12T22:05:56.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996081+0000", 2024-09-12T22:05:56.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3220999999999999e-05 2024-09-12T22:05:56.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996124+0000", 2024-09-12T22:05:56.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3545999999999999e-05 2024-09-12T22:05:56.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996129+0000", 2024-09-12T22:05:56.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2639999999999999e-06 2024-09-12T22:05:56.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017129+0000", 2024-09-12T22:05:56.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.020999384 2024-09-12T22:05:56.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017210+0000", 2024-09-12T22:05:56.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0968000000000001e-05 2024-09-12T22:05:56.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017279+0000", 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9484000000000001e-05 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022949+0000", 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056697259999999999 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022986+0000", 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6610999999999999e-05 2024-09-12T22:05:56.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023016+0000", 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0490000000000001e-05 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023064+0000", 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.812e-05 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.300 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318153 5.7 5:e792c57b:::benchmark_data_smithi043_32659_object150915:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:56.301 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.997518+0000", 2024-09-12T22:05:56.301 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.1810312270000001, 2024-09-12T22:05:56.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0257424909999999, 2024-09-12T22:05:56.301 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.301 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.301 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.301 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.301 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.301 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.301 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318153 2024-09-12T22:05:56.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.301 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.301 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997518+0000", 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997518+0000", 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997519+0000", 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2099999999999996e-07 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997522+0000", 2024-09-12T22:05:56.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2830000000000002e-06 2024-09-12T22:05:56.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997529+0000", 2024-09-12T22:05:56.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:05:56.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997533+0000", 2024-09-12T22:05:56.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1150000000000004e-06 2024-09-12T22:05:56.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997569+0000", 2024-09-12T22:05:56.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5574999999999997e-05 2024-09-12T22:05:56.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.997573+0000", 2024-09-12T22:05:56.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3850000000000004e-06 2024-09-12T22:05:56.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.018467+0000", 2024-09-12T22:05:56.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0208934300000001 2024-09-12T22:05:56.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.018534+0000", 2024-09-12T22:05:56.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7279000000000004e-05 2024-09-12T22:05:56.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.018597+0000", 2024-09-12T22:05:56.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2592e-05 2024-09-12T22:05:56.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022956+0000", 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043591799999999998 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023130+0000", 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017440000000000001 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023180+0000", 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9740999999999997e-05 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023260+0000", 2024-09-12T22:05:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0409999999999998e-05 2024-09-12T22:05:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318162 5.7 5:e4ee45f3:::benchmark_data_smithi043_32659_object150924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:05:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.1789252579999996, 2024-09-12T22:05:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0259081619999999, 2024-09-12T22:05:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318162 2024-09-12T22:05:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:05:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:05:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999625+0000", 2024-09-12T22:05:56.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:05:56.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999627+0000", 2024-09-12T22:05:56.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8260000000000001e-06 2024-09-12T22:05:56.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999634+0000", 2024-09-12T22:05:56.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8730000000000001e-06 2024-09-12T22:05:56.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999639+0000", 2024-09-12T22:05:56.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0710000000000002e-06 2024-09-12T22:05:56.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999681+0000", 2024-09-12T22:05:56.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1488e-05 2024-09-12T22:05:56.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999688+0000", 2024-09-12T22:05:56.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9229999999999996e-06 2024-09-12T22:05:56.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.020983+0000", 2024-09-12T22:05:56.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0212956630000001 2024-09-12T22:05:56.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:56.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021059+0000", 2024-09-12T22:05:56.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5445999999999996e-05 2024-09-12T22:05:56.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:56.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021123+0000", 2024-09-12T22:05:56.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4080999999999999e-05 2024-09-12T22:05:56.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:56.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.024526+0000", 2024-09-12T22:05:56.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003403241 2024-09-12T22:05:56.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025454+0000", 2024-09-12T22:05:56.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00092807600000000001 2024-09-12T22:05:56.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:56.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025486+0000", 2024-09-12T22:05:56.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1430999999999998e-05 2024-09-12T22:05:56.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:56.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025532+0000", 2024-09-12T22:05:56.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6428999999999999e-05 2024-09-12T22:05:56.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.314 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.314 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.314 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:56.315 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:56.314+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:56.316 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:56.416 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:56.415+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:56.428 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:56.428 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:56.428 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-12T22:05:56.428 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:56.438 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:56.517 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:56.516+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:56.583 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:56.583 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:56.584 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:56.584 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:56.584 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:56.592 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:56.636 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:56.635+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:56.701 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.287691800999994, 2024-09-12T22:05:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.287511871000007, 2024-09-12T22:05:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:56.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:56.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.711 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.711 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:56.711 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:56.711 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.287445430000005, 2024-09-12T22:05:56.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:56.711 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.711 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.711 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:56.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.712 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:56.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.712 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:56.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:56.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:56.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:56.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:56.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:56.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:56.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:56.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:56.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:56.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:56.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:56.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:56.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.716 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.716 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:56.716 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:56.716 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.287388987, 2024-09-12T22:05:56.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:56.716 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.716 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.716 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.717 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:56.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.717 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:56.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:56.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:56.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:56.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:56.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:56.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:56.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:56.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:56.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:56.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:56.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:56.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:56.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:56.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:56.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:56.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:56.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:56.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:56.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:56.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:56.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:56.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:56.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:56.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:56.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:56.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:56.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:56.722 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.287320527000006, 2024-09-12T22:05:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.724 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:56.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.724 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:56.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:56.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:56.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:56.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:56.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:56.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:56.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:56.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:56.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:56.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:56.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:56.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:56.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:56.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:56.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:56.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.729 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.730 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:56.730 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:56.730 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.287262792000007, 2024-09-12T22:05:56.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:56.730 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.730 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.730 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.730 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:56.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.730 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:56.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:56.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:56.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:56.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:56.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:56.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:56.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:56.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:56.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:56.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:56.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:56.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:56.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:56.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:56.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:56.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:56.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:56.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:56.736 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.736 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.736 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.736 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:56.736 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:56.736 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.287195100000005, 2024-09-12T22:05:56.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:56.736 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.737 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.737 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.737 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:56.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.737 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:56.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:56.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:56.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:56.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:56.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:56.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:56.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:56.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:56.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:56.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:56.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:56.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:56.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:56.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:56.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:56.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:56.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:56.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:56.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:56.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:56.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:56.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:56.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:56.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:56.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:56.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:56.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:56.742 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.742 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.743 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.743 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:56.743 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:56.743 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.287140038000004, 2024-09-12T22:05:56.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:56.743 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.743 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.743 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.743 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:56.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.744 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:56.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:56.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:56.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:56.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:56.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:56.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:56.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:56.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:56.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:56.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:56.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:56.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:56.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:56.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:56.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:56.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:56.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:56.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:56.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:56.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:56.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:56.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:56.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:56.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:56.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:56.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:56.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:56.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.749 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.749 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:56.749 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:56.750 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.246492517999997, 2024-09-12T22:05:56.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:56.750 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.750 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.750 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.750 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:56.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.750 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:56.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:56.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:56.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:56.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:56.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:56.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:56.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:56.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:56.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:56.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:56.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:56.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:56.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:56.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:56.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:56.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:56.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:56.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:56.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:56.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:56.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:56.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:56.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:56.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:56.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:56.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:56.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:56.756 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.756 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.756 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.756 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:56.756 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:56.756 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.243878789999997, 2024-09-12T22:05:56.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:56.756 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.756 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.757 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.757 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:56.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.757 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:56.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:56.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:56.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:56.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:56.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:56.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.698664694000001, 2024-09-12T22:05:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.698186206000003, 2024-09-12T22:05:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.695690905999996, 2024-09-12T22:05:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.694610115000003, 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.693374552999998, 2024-09-12T22:05:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.252634065000002, 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.248103638000003, 2024-09-12T22:05:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.248079609000001, 2024-09-12T22:05:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.24790196, 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.245883423000002, 2024-09-12T22:05:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:56.821 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:56.823 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:56.823 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:56.821+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:56.923 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:56.922+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:56.933 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:56.933 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:56.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.933 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:326517 5.1 5.a9802281 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T22:05:56.933 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:56.053613+0000", 2024-09-12T22:05:56.933 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.87866319999999998, 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.87867876700000003, 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 326517 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.053613+0000", 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.053613+0000", 2024-09-12T22:05:56.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.053614+0000", 2024-09-12T22:05:56.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.018e-06 2024-09-12T22:05:56.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.935 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.935 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.053619+0000", 2024-09-12T22:05:56.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8599999999999998e-06 2024-09-12T22:05:56.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.053634+0000", 2024-09-12T22:05:56.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.469e-05 2024-09-12T22:05:56.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.053643+0000", 2024-09-12T22:05:56.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8240000000000006e-06 2024-09-12T22:05:56.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.053696+0000", 2024-09-12T22:05:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3044000000000002e-05 2024-09-12T22:05:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.053706+0000", 2024-09-12T22:05:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6709999999999994e-06 2024-09-12T22:05:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:326557 5.1 5.453dddb1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:56.100620+0000", 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.83165551299999996, 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.83171072899999998, 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 326557 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.100620+0000", 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.100620+0000", 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.100621+0000", 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5600000000000005e-07 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.100624+0000", 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4510000000000001e-06 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.100633+0000", 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8279999999999992e-06 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.100639+0000", 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8749999999999997e-06 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.100683+0000", 2024-09-12T22:05:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.426e-05 2024-09-12T22:05:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.100689+0000", 2024-09-12T22:05:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6489999999999996e-06 2024-09-12T22:05:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:326503 5.1 5.fb803d91 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T22:05:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:56.042408+0000", 2024-09-12T22:05:56.942 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.88986727300000001, 2024-09-12T22:05:56.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.88995513699999995, 2024-09-12T22:05:56.942 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.942 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.942 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:56.942 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.942 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.942 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.942 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 326503 2024-09-12T22:05:56.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.942 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.042408+0000", 2024-09-12T22:05:56.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.042408+0000", 2024-09-12T22:05:56.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.042409+0000", 2024-09-12T22:05:56.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9599999999999998e-07 2024-09-12T22:05:56.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.042414+0000", 2024-09-12T22:05:56.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5109999999999997e-06 2024-09-12T22:05:56.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.042423+0000", 2024-09-12T22:05:56.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.183e-06 2024-09-12T22:05:56.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.944 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.944 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.042432+0000", 2024-09-12T22:05:56.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5299999999999996e-06 2024-09-12T22:05:56.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.042476+0000", 2024-09-12T22:05:56.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4434000000000002e-05 2024-09-12T22:05:56.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.042484+0000", 2024-09-12T22:05:56.945 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6459999999999993e-06 2024-09-12T22:05:56.945 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.945 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.945 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.945 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:326544 5.1 5.74025241 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:56.077127+0000", 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.85514894900000005, 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.85526815499999997, 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 326544 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.077127+0000", 2024-09-12T22:05:56.947 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.947 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.947 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.947 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.077127+0000", 2024-09-12T22:05:56.947 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.947 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.947 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.947 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.077128+0000", 2024-09-12T22:05:56.947 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6000000000000003e-07 2024-09-12T22:05:56.947 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.948 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.948 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.077132+0000", 2024-09-12T22:05:56.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4880000000000001e-06 2024-09-12T22:05:56.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.948 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.948 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.077140+0000", 2024-09-12T22:05:56.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2849999999999995e-06 2024-09-12T22:05:56.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.948 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.948 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.077145+0000", 2024-09-12T22:05:56.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8250000000000004e-06 2024-09-12T22:05:56.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.077200+0000", 2024-09-12T22:05:56.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:56.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.077209+0000", 2024-09-12T22:05:56.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4269999999999997e-06 2024-09-12T22:05:56.949 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.949 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.950 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.950 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:326467 5.1 5.d10977e1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T22:05:56.950 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:05:56.950 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.91025880400000003, 2024-09-12T22:05:56.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.910410053, 2024-09-12T22:05:56.950 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.950 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.950 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:56.950 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.950 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.950 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.950 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 326467 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022018+0000", 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5000000000000001e-07 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022022+0000", 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2799999999999997e-06 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022032+0000", 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0035e-05 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022040+0000", 2024-09-12T22:05:56.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5970000000000003e-06 2024-09-12T22:05:56.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022093+0000", 2024-09-12T22:05:56.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3718999999999998e-05 2024-09-12T22:05:56.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022101+0000", 2024-09-12T22:05:56.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3579999999999997e-06 2024-09-12T22:05:56.953 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.953 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.954 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.954 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:326547 5.1 5.ca5f95d1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T22:05:56.954 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:56.078716+0000", 2024-09-12T22:05:56.954 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.85355940299999999, 2024-09-12T22:05:56.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.85375894799999996, 2024-09-12T22:05:56.954 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.954 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.955 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:56.955 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.955 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.955 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.955 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 326547 2024-09-12T22:05:56.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.955 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.078716+0000", 2024-09-12T22:05:56.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.078716+0000", 2024-09-12T22:05:56.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.078717+0000", 2024-09-12T22:05:56.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0299999999999997e-07 2024-09-12T22:05:56.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.078722+0000", 2024-09-12T22:05:56.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3919999999999996e-06 2024-09-12T22:05:56.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.078733+0000", 2024-09-12T22:05:56.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1804000000000001e-05 2024-09-12T22:05:56.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.078740+0000", 2024-09-12T22:05:56.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4060000000000002e-06 2024-09-12T22:05:56.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.078780+0000", 2024-09-12T22:05:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0303999999999999e-05 2024-09-12T22:05:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.078786+0000", 2024-09-12T22:05:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0689999999999998e-06 2024-09-12T22:05:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:326533 5.1 5.b3d809a1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T22:05:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:56.070261+0000", 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.86201514499999998, 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.86224811300000004, 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 326533 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.070261+0000", 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.070261+0000", 2024-09-12T22:05:56.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.070262+0000", 2024-09-12T22:05:56.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7499999999999998e-07 2024-09-12T22:05:56.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.070266+0000", 2024-09-12T22:05:56.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.437e-06 2024-09-12T22:05:56.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.070275+0000", 2024-09-12T22:05:56.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0229999999999998e-06 2024-09-12T22:05:56.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.070281+0000", 2024-09-12T22:05:56.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2870000000000001e-06 2024-09-12T22:05:56.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.070326+0000", 2024-09-12T22:05:56.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4428999999999998e-05 2024-09-12T22:05:56.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.070338+0000", 2024-09-12T22:05:56.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2510000000000001e-05 2024-09-12T22:05:56.962 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.962 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.962 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.963 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:326571 5.1 5.a9e68121 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T22:05:56.963 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:56.142727+0000", 2024-09-12T22:05:56.963 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.78954914899999995, 2024-09-12T22:05:56.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.78981601999999995, 2024-09-12T22:05:56.963 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:56.963 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:56.963 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for peered", 2024-09-12T22:05:56.963 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:56.963 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:56.963 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:56.963 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 326571 2024-09-12T22:05:56.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.963 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:56.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:56.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.142727+0000", 2024-09-12T22:05:56.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:56.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.142727+0000", 2024-09-12T22:05:56.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:56.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:56.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.142728+0000", 2024-09-12T22:05:56.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.855e-06 2024-09-12T22:05:56.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:56.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.142734+0000", 2024-09-12T22:05:56.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3460000000000001e-06 2024-09-12T22:05:56.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:56.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.142747+0000", 2024-09-12T22:05:56.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2794e-05 2024-09-12T22:05:56.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:56.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.142762+0000", 2024-09-12T22:05:56.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5464e-05 2024-09-12T22:05:56.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:56.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.142826+0000", 2024-09-12T22:05:56.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4307000000000006e-05 2024-09-12T22:05:56.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:56.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:56.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:56.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.142842+0000", 2024-09-12T22:05:56.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5899000000000001e-05 2024-09-12T22:05:56.966 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.966 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:56.967 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.967 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:56.967 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:05:56.967 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 8 2024-09-12T22:05:56.967 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:56.968 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:56.983 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:05:57.053 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:57.052+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:57.125 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:57.124+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:57.153 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:57.153 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:05:57.153 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:05:57.153 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:05:57.153 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:57.167 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:57.252 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:57.251+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:57.327 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:57.325+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:57.369 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:05:57.370 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:05:57.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:05:57.370 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:05:57.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.370 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:57.370 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:57.370 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.401834119, 2024-09-12T22:05:57.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:05:57.370 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.370 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.370 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.370 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.371 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.371 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.371 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:05:57.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.371 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:57.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:05:57.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:05:57.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:05:57.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:05:57.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:05:57.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:05:57.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:05:57.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:05:57.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:05:57.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:05:57.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:05:57.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:05:57.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:05:57.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:05:57.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:05:57.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:05:57.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:05:57.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:05:57.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:05:57.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:05:57.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.375 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.375 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:05:57.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:05:57.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:05:57.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:05:57.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:05:57.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:05:57.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:05:57.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:05:57.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:05:57.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:05:57.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:05:57.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:05:57.378 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.378 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.378 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.378 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:57.378 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:57.378 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.399801394000001, 2024-09-12T22:05:57.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:05:57.378 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.378 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.378 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.378 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.379 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.379 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.379 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:05:57.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.379 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:57.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:57.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:05:57.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:05:57.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:05:57.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:05:57.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:05:57.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:05:57.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:05:57.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:05:57.384 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.384 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.384 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.384 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:57.384 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:57.385 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.396789130000002, 2024-09-12T22:05:57.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:05:57.385 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.385 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.385 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.385 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.385 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.385 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.385 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:05:57.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.385 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:57.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:05:57.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:05:57.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:05:57.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:05:57.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:05:57.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:05:57.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:05:57.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:05:57.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:05:57.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:05:57.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:05:57.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:05:57.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:05:57.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:05:57.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:05:57.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:05:57.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:05:57.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:05:57.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:05:57.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:05:57.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:05:57.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:05:57.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:05:57.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:05:57.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:05:57.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:05:57.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:05:57.391 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.391 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.391 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.391 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:57.392 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:57.392 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.395802639999999, 2024-09-12T22:05:57.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:05:57.392 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.392 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.392 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.392 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.392 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.392 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.392 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:05:57.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.392 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:57.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:05:57.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:05:57.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:05:57.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:05:57.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:05:57.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:05:57.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:05:57.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:05:57.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:05:57.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:05:57.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:05:57.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:05:57.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:05:57.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:05:57.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:05:57.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:05:57.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:05:57.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:05:57.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:05:57.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:05:57.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:05:57.399 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.399 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.399 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.399 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:57.399 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:57.399 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.390716005999998, 2024-09-12T22:05:57.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:05:57.399 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.399 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.399 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.399 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.400 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.400 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.400 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:05:57.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.400 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:57.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:05:57.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:05:57.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:05:57.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:05:57.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:05:57.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:05:57.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:05:57.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:05:57.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:05:57.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:05:57.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:05:57.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:05:57.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:05:57.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:05:57.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:05:57.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:05:57.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:05:57.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:05:57.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:05:57.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:05:57.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:05:57.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:05:57.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:05:57.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:05:57.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:05:57.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:05:57.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.387961034, 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:05:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:05:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:05:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:05:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:05:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:05:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:05:57.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:05:57.412 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.412 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.412 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.412 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:57.412 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:57.412 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.379986148999997, 2024-09-12T22:05:57.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:05:57.412 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.412 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.413 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.413 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.413 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.413 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.413 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:05:57.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.413 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:57.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:05:57.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:05:57.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:05:57.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:05:57.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:05:57.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:05:57.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:05:57.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:05:57.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:05:57.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:05:57.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:05:57.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:05:57.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:05:57.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:05:57.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:05:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:05:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:05:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:05:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:05:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:05:57.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:05:57.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:05:57.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:05:57.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:05:57.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:05:57.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:05:57.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:05:57.419 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.419 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.419 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.419 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:57.419 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:57.419 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.372060372999997, 2024-09-12T22:05:57.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:05:57.419 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.419 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.420 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.420 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.420 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.420 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.420 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:05:57.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.420 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:57.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:05:57.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:05:57.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:05:57.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:05:57.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:05:57.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:05:57.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:05:57.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:05:57.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:05:57.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:05:57.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:05:57.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:05:57.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:05:57.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:05:57.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:05:57.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:05:57.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:05:57.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:05:57.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:05:57.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:05:57.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:05:57.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:05:57.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:05:57.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:05:57.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:05:57.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:05:57.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:05:57.425 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.426 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.426 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.426 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:05:57.426 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:57.426 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 35.370564090999999, 2024-09-12T22:05:57.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:05:57.426 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.426 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.426 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.426 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.426 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.427 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.427 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:05:57.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.427 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:57.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:05:57.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:05:57.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:05:57.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:05:57.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:05:57.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:05:57.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:05:57.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:05:57.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:05:57.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:05:57.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:05:57.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:05:57.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:05:57.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:05:57.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:05:57.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:05:57.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:05:57.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.432 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:05:57.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:05:57.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.432 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:05:57.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:05:57.432 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.432 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.432 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.433 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296741 5.3 5:c190c274:::benchmark_data_smithi043_32659_object129503:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:57.433 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:57.433 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 14.349256478999999, 2024-09-12T22:05:57.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.051784984, 2024-09-12T22:05:57.433 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.433 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.433 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.433 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.433 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.433 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.433 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296741 2024-09-12T22:05:57.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.433 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:57.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:05:57.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016859+0000", 2024-09-12T22:05:57.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5600000000000004e-07 2024-09-12T22:05:57.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016863+0000", 2024-09-12T22:05:57.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5510000000000001e-06 2024-09-12T22:05:57.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016873+0000", 2024-09-12T22:05:57.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5319999999999995e-06 2024-09-12T22:05:57.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016879+0000", 2024-09-12T22:05:57.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5100000000000004e-06 2024-09-12T22:05:57.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016934+0000", 2024-09-12T22:05:57.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4734999999999997e-05 2024-09-12T22:05:57.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016941+0000", 2024-09-12T22:05:57.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1319999999999996e-06 2024-09-12T22:05:57.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055352+0000", 2024-09-12T22:05:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0384109260000001 2024-09-12T22:05:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055496+0000", 2024-09-12T22:05:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014437400000000001 2024-09-12T22:05:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055835+0000", 2024-09-12T22:05:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000338339 2024-09-12T22:05:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065163+0000", 2024-09-12T22:05:57.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093287690000000006 2024-09-12T22:05:57.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068506+0000", 2024-09-12T22:05:57.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033423620000000002 2024-09-12T22:05:57.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068557+0000", 2024-09-12T22:05:57.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1057000000000003e-05 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068643+0000", 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5741000000000005e-05 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296774 5.3 5:c9ea392f:::benchmark_data_smithi043_32659_object129536:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 14.335510856999999, 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0383883359999999, 2024-09-12T22:05:57.439 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296774 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:05:57.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030604+0000", 2024-09-12T22:05:57.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:05:57.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030607+0000", 2024-09-12T22:05:57.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0860000000000002e-06 2024-09-12T22:05:57.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.442 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030615+0000", 2024-09-12T22:05:57.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8120000000000008e-06 2024-09-12T22:05:57.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.442 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030620+0000", 2024-09-12T22:05:57.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6080000000000003e-06 2024-09-12T22:05:57.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.442 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030662+0000", 2024-09-12T22:05:57.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1925999999999998e-05 2024-09-12T22:05:57.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.443 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.443 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030670+0000", 2024-09-12T22:05:57.443 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2359999999999998e-06 2024-09-12T22:05:57.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.443 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.443 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065202+0000", 2024-09-12T22:05:57.443 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0345323989999999 2024-09-12T22:05:57.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.443 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.443 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065348+0000", 2024-09-12T22:05:57.444 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145575 2024-09-12T22:05:57.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.444 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.444 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065476+0000", 2024-09-12T22:05:57.444 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012800999999999999 2024-09-12T22:05:57.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.444 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.444 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068690+0000", 2024-09-12T22:05:57.444 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032143929999999999 2024-09-12T22:05:57.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.444 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.445 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068869+0000", 2024-09-12T22:05:57.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000179152 2024-09-12T22:05:57.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.445 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.445 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068914+0000", 2024-09-12T22:05:57.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4629999999999998e-05 2024-09-12T22:05:57.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.445 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.445 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068992+0000", 2024-09-12T22:05:57.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7885000000000004e-05 2024-09-12T22:05:57.445 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296793 5.3 5:c55bd684:::benchmark_data_smithi043_32659_object129555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 14.32869421, 2024-09-12T22:05:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0317046320000001, 2024-09-12T22:05:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.447 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.447 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296793 2024-09-12T22:05:57.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.447 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:57.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:05:57.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037421+0000", 2024-09-12T22:05:57.448 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:05:57.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037425+0000", 2024-09-12T22:05:57.448 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9539999999999998e-06 2024-09-12T22:05:57.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037432+0000", 2024-09-12T22:05:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:05:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037436+0000", 2024-09-12T22:05:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4320000000000001e-06 2024-09-12T22:05:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037496+0000", 2024-09-12T22:05:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9385999999999997e-05 2024-09-12T22:05:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.450 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037503+0000", 2024-09-12T22:05:57.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:05:57.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.450 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066427+0000", 2024-09-12T22:05:57.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.028923877 2024-09-12T22:05:57.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.450 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066519+0000", 2024-09-12T22:05:57.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1867000000000007e-05 2024-09-12T22:05:57.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066598+0000", 2024-09-12T22:05:57.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9175e-05 2024-09-12T22:05:57.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068804+0000", 2024-09-12T22:05:57.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002205664 2024-09-12T22:05:57.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069004+0000", 2024-09-12T22:05:57.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000200769 2024-09-12T22:05:57.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069050+0000", 2024-09-12T22:05:57.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5522999999999998e-05 2024-09-12T22:05:57.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069125+0000", 2024-09-12T22:05:57.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4530000000000006e-05 2024-09-12T22:05:57.452 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.452 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.452 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296796 5.3 5:cbc9dd25:::benchmark_data_smithi043_32659_object129558:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 14.328396581, 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0315259400000001, 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296796 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.453 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:57.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:05:57.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037719+0000", 2024-09-12T22:05:57.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1069999999999999e-06 2024-09-12T22:05:57.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037723+0000", 2024-09-12T22:05:57.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1400000000000002e-06 2024-09-12T22:05:57.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037734+0000", 2024-09-12T22:05:57.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0991e-05 2024-09-12T22:05:57.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037741+0000", 2024-09-12T22:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6059999999999997e-06 2024-09-12T22:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037790+0000", 2024-09-12T22:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9112e-05 2024-09-12T22:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037797+0000", 2024-09-12T22:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067455+0000", 2024-09-12T22:05:57.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0296586320000001 2024-09-12T22:05:57.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067568+0000", 2024-09-12T22:05:57.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112895 2024-09-12T22:05:57.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067686+0000", 2024-09-12T22:05:57.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117879 2024-09-12T22:05:57.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068856+0000", 2024-09-12T22:05:57.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011693949999999999 2024-09-12T22:05:57.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069132+0000", 2024-09-12T22:05:57.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027629599999999999 2024-09-12T22:05:57.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069171+0000", 2024-09-12T22:05:57.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9536000000000002e-05 2024-09-12T22:05:57.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069243+0000", 2024-09-12T22:05:57.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2033999999999995e-05 2024-09-12T22:05:57.459 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.459 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.459 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.460 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318065 5.7 5:e8daa0bb:::benchmark_data_smithi043_32659_object150827:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:57.460 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:05:57.460 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.3983375689999997, 2024-09-12T22:05:57.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041842749, 2024-09-12T22:05:57.460 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.460 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.460 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:57.460 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.460 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.460 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.460 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318065 2024-09-12T22:05:57.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.460 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967782+0000", 2024-09-12T22:05:57.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0539999999999996e-06 2024-09-12T22:05:57.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968192+0000", 2024-09-12T22:05:57.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000410906 2024-09-12T22:05:57.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968201+0000", 2024-09-12T22:05:57.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7639999999999994e-06 2024-09-12T22:05:57.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971494+0000", 2024-09-12T22:05:57.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032926180000000002 2024-09-12T22:05:57.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971499+0000", 2024-09-12T22:05:57.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0690000000000001e-06 2024-09-12T22:05:57.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009565+0000", 2024-09-12T22:05:57.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038066221 2024-09-12T22:05:57.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009619+0000", 2024-09-12T22:05:57.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4203000000000003e-05 2024-09-12T22:05:57.464 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.464 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.464 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.464 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318069 5.7 5:ea50145d:::benchmark_data_smithi043_32659_object150831:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:57.464 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:05:57.465 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.3978999940000003, 2024-09-12T22:05:57.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041799116, 2024-09-12T22:05:57.465 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.465 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.465 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:57.465 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.465 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.465 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.465 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318069 2024-09-12T22:05:57.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.465 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968215+0000", 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968218+0000", 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9119999999999998e-06 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968228+0000", 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9599999999999995e-06 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968234+0000", 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6969999999999996e-06 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971512+0000", 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032779160000000001 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971516+0000", 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009970+0000", 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03845421 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010013+0000", 2024-09-12T22:05:57.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3516000000000001e-05 2024-09-12T22:05:57.469 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.469 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.469 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.469 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318078 5.7 5:e5b30db2:::benchmark_data_smithi043_32659_object150840:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:57.469 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:05:57.469 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.397872166, 2024-09-12T22:05:57.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0418401070000001, 2024-09-12T22:05:57.469 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.469 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.469 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:05:57.469 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318078 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.471 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:05:57.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:05:57.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.471 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968245+0000", 2024-09-12T22:05:57.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:05:57.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.471 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968251+0000", 2024-09-12T22:05:57.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2999999999999998e-06 2024-09-12T22:05:57.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.472 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968257+0000", 2024-09-12T22:05:57.472 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6400000000000002e-06 2024-09-12T22:05:57.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.472 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971528+0000", 2024-09-12T22:05:57.472 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032710619999999999 2024-09-12T22:05:57.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971533+0000", 2024-09-12T22:05:57.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8629999999999999e-06 2024-09-12T22:05:57.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010030+0000", 2024-09-12T22:05:57.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038496683 2024-09-12T22:05:57.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010082+0000", 2024-09-12T22:05:57.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2478999999999997e-05 2024-09-12T22:05:57.473 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.473 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.474 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.474 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318093 5.7 5:e0eb16a2:::benchmark_data_smithi043_32659_object150855:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:57.474 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:05:57.474 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.3955407749999997, 2024-09-12T22:05:57.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0523587110000001, 2024-09-12T22:05:57.474 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.474 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.474 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.474 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.474 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.474 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.474 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318093 2024-09-12T22:05:57.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.475 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:05:57.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:05:57.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970575+0000", 2024-09-12T22:05:57.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.159e-06 2024-09-12T22:05:57.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970579+0000", 2024-09-12T22:05:57.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4510000000000002e-06 2024-09-12T22:05:57.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970588+0000", 2024-09-12T22:05:57.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1479999999999995e-06 2024-09-12T22:05:57.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970595+0000", 2024-09-12T22:05:57.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6919999999999996e-06 2024-09-12T22:05:57.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971555+0000", 2024-09-12T22:05:57.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00096029399999999999 2024-09-12T22:05:57.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971561+0000", 2024-09-12T22:05:57.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7230000000000001e-06 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010105+0000", 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038544361 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010201+0000", 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5340000000000005e-05 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010497+0000", 2024-09-12T22:05:57.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000296273 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021904+0000", 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011406928 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022778+0000", 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00087414199999999995 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022844+0000", 2024-09-12T22:05:57.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6097000000000001e-05 2024-09-12T22:05:57.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.480 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.480 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022932+0000", 2024-09-12T22:05:57.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8103000000000007e-05 2024-09-12T22:05:57.480 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.480 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.480 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.480 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318150 5.7 5:e1ecf58e:::benchmark_data_smithi043_32659_object150912:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:57.480 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:05:57.480 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.3700621010000003, 2024-09-12T22:05:57.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027012142, 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318150 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.481 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996053+0000", 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.079e-06 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996057+0000", 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3069999999999996e-06 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996067+0000", 2024-09-12T22:05:57.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9420000000000007e-06 2024-09-12T22:05:57.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996081+0000", 2024-09-12T22:05:57.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3220999999999999e-05 2024-09-12T22:05:57.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996124+0000", 2024-09-12T22:05:57.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3545999999999999e-05 2024-09-12T22:05:57.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996129+0000", 2024-09-12T22:05:57.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2639999999999999e-06 2024-09-12T22:05:57.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017129+0000", 2024-09-12T22:05:57.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.020999384 2024-09-12T22:05:57.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017210+0000", 2024-09-12T22:05:57.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0968000000000001e-05 2024-09-12T22:05:57.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017279+0000", 2024-09-12T22:05:57.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9484000000000001e-05 2024-09-12T22:05:57.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022949+0000", 2024-09-12T22:05:57.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056697259999999999 2024-09-12T22:05:57.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022986+0000", 2024-09-12T22:05:57.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6610999999999999e-05 2024-09-12T22:05:57.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023016+0000", 2024-09-12T22:05:57.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0490000000000001e-05 2024-09-12T22:05:57.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023064+0000", 2024-09-12T22:05:57.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.812e-05 2024-09-12T22:05:57.486 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.487 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.487 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.487 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318162 5.7 5:e4ee45f3:::benchmark_data_smithi043_32659_object150924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:05:57.487 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:05:57.487 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.366490185, 2024-09-12T22:05:57.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0259081619999999, 2024-09-12T22:05:57.487 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.487 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.487 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.487 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.487 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.488 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.488 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318162 2024-09-12T22:05:57.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.488 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:05:57.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:05:57.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999625+0000", 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999627+0000", 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8260000000000001e-06 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999634+0000", 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8730000000000001e-06 2024-09-12T22:05:57.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999639+0000", 2024-09-12T22:05:57.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0710000000000002e-06 2024-09-12T22:05:57.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999681+0000", 2024-09-12T22:05:57.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1488e-05 2024-09-12T22:05:57.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999688+0000", 2024-09-12T22:05:57.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9229999999999996e-06 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.020983+0000", 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0212956630000001 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021059+0000", 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5445999999999996e-05 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021123+0000", 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4080999999999999e-05 2024-09-12T22:05:57.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.024526+0000", 2024-09-12T22:05:57.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003403241 2024-09-12T22:05:57.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025454+0000", 2024-09-12T22:05:57.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00092807600000000001 2024-09-12T22:05:57.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025486+0000", 2024-09-12T22:05:57.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1430999999999998e-05 2024-09-12T22:05:57.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.493 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.493 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025532+0000", 2024-09-12T22:05:57.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6428999999999999e-05 2024-09-12T22:05:57.493 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.493 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.493 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.493 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:326467 5.1 5:87ee908b:::benchmark_data_smithi043_32659_object159229:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T22:05:57.493 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:05:57.493 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 1.3440971909999999, 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038557899, 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 326467 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:05:57.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:05:57.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:05:57.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:05:57.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022018+0000", 2024-09-12T22:05:57.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5000000000000001e-07 2024-09-12T22:05:57.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:05:57.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022022+0000", 2024-09-12T22:05:57.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2799999999999997e-06 2024-09-12T22:05:57.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:05:57.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022032+0000", 2024-09-12T22:05:57.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0035e-05 2024-09-12T22:05:57.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022040+0000", 2024-09-12T22:05:57.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5970000000000003e-06 2024-09-12T22:05:57.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022093+0000", 2024-09-12T22:05:57.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3718999999999998e-05 2024-09-12T22:05:57.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:05:57.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022101+0000", 2024-09-12T22:05:57.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3579999999999997e-06 2024-09-12T22:05:57.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:05:57.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056468+0000", 2024-09-12T22:05:57.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.034366761 2024-09-12T22:05:57.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.498 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:05:57.498 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056576+0000", 2024-09-12T22:05:57.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000108859 2024-09-12T22:05:57.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.498 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:05:57.498 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056682+0000", 2024-09-12T22:05:57.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105358 2024-09-12T22:05:57.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.057971+0000", 2024-09-12T22:05:57.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012889749999999999 2024-09-12T22:05:57.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:05:57.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060452+0000", 2024-09-12T22:05:57.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024813980000000001 2024-09-12T22:05:57.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:05:57.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060496+0000", 2024-09-12T22:05:57.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3875999999999998e-05 2024-09-12T22:05:57.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:05:57.500 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:05:57.500 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:05:57.500 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060575+0000", 2024-09-12T22:05:57.500 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8832999999999996e-05 2024-09-12T22:05:57.500 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.500 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.500 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.500 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:05:57.500 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:05:57.500 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:05:57.502 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:57.500+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:57.502 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:57.602 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:57.601+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:57.649 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:57.649 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:57.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.649 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:328262 5.5 5:a66c206f:::benchmark_data_smithi043_32659_object161024:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T22:05:57.649 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:57.645008+0000", 2024-09-12T22:05:57.649 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0032762300000000002, 2024-09-12T22:05:57.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032949630000000001, 2024-09-12T22:05:57.649 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:57.649 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:57.650 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:57.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:57.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:57.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.650 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 328262 2024-09-12T22:05:57.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.650 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:57.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:57.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.645008+0000", 2024-09-12T22:05:57.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:57.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:57.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.645008+0000", 2024-09-12T22:05:57.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:57.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:57.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.645009+0000", 2024-09-12T22:05:57.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4399999999999998e-07 2024-09-12T22:05:57.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:57.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.645013+0000", 2024-09-12T22:05:57.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0149999999999997e-06 2024-09-12T22:05:57.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:57.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.645022+0000", 2024-09-12T22:05:57.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2629999999999992e-06 2024-09-12T22:05:57.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.645032+0000", 2024-09-12T22:05:57.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9690000000000006e-06 2024-09-12T22:05:57.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:57.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.645282+0000", 2024-09-12T22:05:57.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024998199999999999 2024-09-12T22:05:57.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:57.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.645420+0000", 2024-09-12T22:05:57.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013796500000000001 2024-09-12T22:05:57.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:57.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.645550+0000", 2024-09-12T22:05:57.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013030299999999999 2024-09-12T22:05:57.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:57.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647365+0000", 2024-09-12T22:05:57.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001815241 2024-09-12T22:05:57.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:57.654 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:57.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:57.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.654 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:328269 5.3 e73/65 5:c90eac37:::benchmark_data_smithi043_32659_object161031:head v 73'20388, mlcod=73'20386)", 2024-09-12T22:05:57.654 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:57.647683+0000", 2024-09-12T22:05:57.654 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00060078900000000001, 2024-09-12T22:05:57.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00066831799999999999, 2024-09-12T22:05:57.654 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:57.654 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:57.655 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:57.655 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:57.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:57.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647683+0000", 2024-09-12T22:05:57.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:57.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:57.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647683+0000", 2024-09-12T22:05:57.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:57.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:57.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647684+0000", 2024-09-12T22:05:57.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:05:57.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:57.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647688+0000", 2024-09-12T22:05:57.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2830000000000003e-06 2024-09-12T22:05:57.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:57.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647695+0000", 2024-09-12T22:05:57.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0990000000000001e-06 2024-09-12T22:05:57.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647700+0000", 2024-09-12T22:05:57.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:05:57.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:57.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647735+0000", 2024-09-12T22:05:57.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4706000000000003e-05 2024-09-12T22:05:57.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:57.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647750+0000", 2024-09-12T22:05:57.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4555999999999999e-05 2024-09-12T22:05:57.658 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:57.658 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:57.658 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:57.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.658 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:328268 5.9 e73/40 5:93e0f4e4:::benchmark_data_smithi043_32659_object161030:head v 73'20691, mlcod=73'20688)", 2024-09-12T22:05:57.658 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:57.647888+0000", 2024-09-12T22:05:57.658 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000396077, 2024-09-12T22:05:57.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00050465700000000004, 2024-09-12T22:05:57.658 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:57.658 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:57.658 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:57.658 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:57.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647888+0000", 2024-09-12T22:05:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647888+0000", 2024-09-12T22:05:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647888+0000", 2024-09-12T22:05:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6899999999999998e-07 2024-09-12T22:05:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:57.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647891+0000", 2024-09-12T22:05:57.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.224e-06 2024-09-12T22:05:57.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:57.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647896+0000", 2024-09-12T22:05:57.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8709999999999996e-06 2024-09-12T22:05:57.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647900+0000", 2024-09-12T22:05:57.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7019999999999999e-06 2024-09-12T22:05:57.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:57.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647934+0000", 2024-09-12T22:05:57.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4505000000000003e-05 2024-09-12T22:05:57.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:57.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647948+0000", 2024-09-12T22:05:57.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3322000000000001e-05 2024-09-12T22:05:57.661 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:57.661 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:57.661 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:57.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.662 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4514.0:328256 5.5 e73/40 ondisk, result = 0)", 2024-09-12T22:05:57.662 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:57.648339+0000", 2024-09-12T22:05:57.662 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999447, 2024-09-12T22:05:57.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7462999999999999e-05, 2024-09-12T22:05:57.662 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:57.662 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:57.662 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:05:57.662 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:57.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:57.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.648339+0000", 2024-09-12T22:05:57.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:57.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:57.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.648339+0000", 2024-09-12T22:05:57.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:57.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:57.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.648340+0000", 2024-09-12T22:05:57.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7300000000000001e-07 2024-09-12T22:05:57.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:57.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.648343+0000", 2024-09-12T22:05:57.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2629999999999999e-06 2024-09-12T22:05:57.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:57.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.648354+0000", 2024-09-12T22:05:57.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0655e-05 2024-09-12T22:05:57.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.648359+0000", 2024-09-12T22:05:57.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4589999999999997e-06 2024-09-12T22:05:57.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:57.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.648406+0000", 2024-09-12T22:05:57.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6479e-05 2024-09-12T22:05:57.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:57.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.648415+0000", 2024-09-12T22:05:57.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4450000000000002e-06 2024-09-12T22:05:57.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:57.665 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:57.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:57.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.666 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:328256 5.5 5:ac1b31cc:::benchmark_data_smithi043_32659_object161018:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T22:05:57.666 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:57.643021+0000", 2024-09-12T22:05:57.666 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0052630910000000001, 2024-09-12T22:05:57.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054399399999999999, 2024-09-12T22:05:57.666 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:57.666 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:57.666 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:05:57.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:57.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:57.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:57.666 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 328256 2024-09-12T22:05:57.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.666 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:57.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:57.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.643021+0000", 2024-09-12T22:05:57.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:57.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:57.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.643021+0000", 2024-09-12T22:05:57.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:57.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:57.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.643022+0000", 2024-09-12T22:05:57.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9599999999999998e-07 2024-09-12T22:05:57.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:57.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.643026+0000", 2024-09-12T22:05:57.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.668e-06 2024-09-12T22:05:57.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:57.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.643036+0000", 2024-09-12T22:05:57.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4029999999999996e-06 2024-09-12T22:05:57.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:57.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.643042+0000", 2024-09-12T22:05:57.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3339999999999998e-06 2024-09-12T22:05:57.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:57.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.643888+0000", 2024-09-12T22:05:57.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000845761 2024-09-12T22:05:57.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:57.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.643972+0000", 2024-09-12T22:05:57.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4207000000000002e-05 2024-09-12T22:05:57.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.644039+0000", 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7201999999999998e-05 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.647211+0000", 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031716090000000001 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:57.648422+0000", 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012115260000000001 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:57.670 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:57.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:57.671 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:05:57.671 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 5 2024-09-12T22:05:57.671 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:57.673 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:57.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~94s 2024-09-12T22:05:57.718 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:57.716+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:57.804 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:57.803+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:57.821 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:57.821 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:05:57.821 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:05:57.821 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:05:57.821 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:57.833 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:57.905 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:57.904+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:57.984 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-09-12T22:05:58.005 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:58.004+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:58.018 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:05:58.022 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:05:58.022 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:05:58.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:05:58.022 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:05:58.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.022 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:58.023 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:58.023 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.608718968000005, 2024-09-12T22:05:58.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:05:58.023 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.023 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.023 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:58.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.023 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:05:58.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.023 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:05:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:05:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:05:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:05:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:05:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:05:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:05:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:05:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:05:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:05:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:05:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:05:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:05:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:05:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:05:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:05:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:05:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.028 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.028 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.028 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:58.028 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:58.028 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.608539038000004, 2024-09-12T22:05:58.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:05:58.028 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.028 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.028 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:58.028 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:05:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:05:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:05:58.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:05:58.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:05:58.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:05:58.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:05:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:05:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:05:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:05:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:05:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:05:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:05:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:05:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:05:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:05:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:05:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:05:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.608472597000002, 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:05:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:05:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:05:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:05:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:05:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:05:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:05:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:05:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:05:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:05:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:05:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.608416153999997, 2024-09-12T22:05:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:05:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:05:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:05:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:05:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:05:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:05:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:05:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:05:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:05:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:05:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:05:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:05:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:05:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.608347694000003, 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:05:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:05:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:05:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:05:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:05:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:05:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:05:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:05:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:05:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:05:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:05:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:05:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:05:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:05:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:05:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:05:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:05:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:05:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.608289959000004, 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:05:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:05:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:05:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:05:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:05:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:05:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:05:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:05:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:05:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:05:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:05:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:05:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:05:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:05:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:05:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:05:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:05:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:05:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:05:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:05:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:05:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.608222267000002, 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:05:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:05:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:05:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:05:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:05:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:05:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:05:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:05:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:05:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:05:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:05:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:05:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:05:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:05:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:05:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.608167205000001, 2024-09-12T22:05:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:05:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:05:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:05:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:05:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:05:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:05:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:05:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:05:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:05:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:05:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:05:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:05:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:05:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:05:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:05:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:05:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:05:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:05:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:05:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:05:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:05:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:05:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:05:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.567519684999994, 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:05:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:05:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:05:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:05:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:05:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:05:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.564905956999993, 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:05:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:05:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:05:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:05:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:05:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:05:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:05:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:05:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:05:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:05:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:05:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:05:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:05:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:05:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:05:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:05:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:05:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:05:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:05:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.019691860999998, 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:05:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:05:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:05:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:05:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:05:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:05:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:05:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:05:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:05:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:05:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:05:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:05:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:05:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:05:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:05:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:05:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:05:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:05:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:05:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:05:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:05:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:05:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:05:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:05:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.019213372999999, 2024-09-12T22:05:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:05:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:05:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:05:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:05:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:05:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:05:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:05:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:05:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.016718073000007, 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:05:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:05:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:05:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:05:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:05:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:05:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:05:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:05:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.015637282, 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:05:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:05:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:05:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:05:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:05:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:05:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:05:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:05:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:05:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:05:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:05:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:05:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:05:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:05:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:05:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:05:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:05:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:05:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.014401719999995, 2024-09-12T22:05:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:05:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:05:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:05:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:05:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:05:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:05:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:05:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:05:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:05:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:05:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:05:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:05:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:05:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:05:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:05:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.573661231999999, 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:05:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:05:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:05:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:05:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:05:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:05:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:05:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:05:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:05:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:05:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:05:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:05:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.569130805, 2024-09-12T22:05:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:05:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:05:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:05:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:05:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:05:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:05:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:05:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:05:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:05:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:05:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:05:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:05:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:05:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:05:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:05:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:05:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:05:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:05:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:05:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:05:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:05:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:05:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:05:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:05:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:05:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.569106775999998, 2024-09-12T22:05:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:05:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:05:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:05:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:05:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:05:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:05:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:05:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:05:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:05:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:05:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:05:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:05:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:05:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:05:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:05:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:05:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:05:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:05:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:05:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:05:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:05:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:05:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:05:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:05:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:05:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.568929126999997, 2024-09-12T22:05:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:05:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:05:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:05:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:05:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:05:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:05:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:05:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:05:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:05:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:05:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:05:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:05:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:05:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:05:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:05:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.566910589999999, 2024-09-12T22:05:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:05:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:05:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:05:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:05:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:05:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:05:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:05:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:05:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:05:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:05:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:05:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:05:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:05:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:05:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:05:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:05:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:05:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:05:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:05:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:05:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:05:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:05:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:05:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:05:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:05:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:05:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:05:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:05:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:05:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:05:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:05:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:05:58.139 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:05:58.140 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:05:58.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:58.141 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:58.139+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:58.143 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:05:58.144 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:05:58.162 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:05:58.163 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:05:58.165 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:05:58.165 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:05:58.241 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:58.240+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:58.267 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:58.268 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:58.278 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:58.342 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:58.340+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:58.425 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:58.425 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:58.433 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:58.478 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:58.477+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:58.536 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:58.536 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:58.543 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:58.542+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:58.544 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:58.645 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:58.643+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:58.647 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:58.647 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:58.656 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:58.746 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:58.745+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:58.798 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:58.798 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:58.807 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:58.851 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:58.850+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:58.910 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:58.910 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:58.918 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:58.959 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:58.958+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:59.027 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:59.027 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:59.036 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:59.048 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:59.047+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:59.149 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:59.148+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:59.164 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:59.164 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:59.174 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:59.250 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:59.249+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:59.317 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:59.318 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:59.326 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:05:59.370 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:59.369+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:59.429 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:59.430 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:59.438 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:05:59.479 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:05:59.478+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:05:59.553 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:59.552+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:59.581 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:59.581 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:59.589 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:05:59.653 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:59.653+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:59.691 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:59.691 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:59.700 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:05:59.754 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:59.753+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:59.805 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:59.805 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:59.814 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:05:59.855 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:59.854+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:59.957 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:05:59.956+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:05:59.959 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:05:59.959 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:05:59.968 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:05:59.998 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:06:00.057 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:00.056+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:00.142 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:00.142 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:00.157 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:06:00.159 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:00.157+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:00.167 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:06:00.259 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:00.258+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:00.277 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:06:00.286 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:00.286 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:00.297 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:06:00.297 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:06:00.298 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:06:00.316 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:06:00.316 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:06:00.318 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:06:00.319 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:06:00.360 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:00.359+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:00.461 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:00.460+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:00.462 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:06:00.462 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:06:00.462 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:06:00.462 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:06:00.462 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:06:00.473 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:06:00.562 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:00.560+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:00.609 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:06:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:06:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:06:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:06:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:06:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.195441157000005, 2024-09-12T22:06:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:06:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:06:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:06:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:06:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:06:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:06:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:06:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:06:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:06:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:06:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:06:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:06:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:06:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:06:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:06:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:06:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:06:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:06:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:06:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:06:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:06:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.616 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.616 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:00.616 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:06:00.616 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.195261227000003, 2024-09-12T22:06:00.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:06:00.616 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.616 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.616 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:06:00.616 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.616 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.617 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.617 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:06:00.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.617 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:06:00.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:06:00.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:06:00.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:06:00.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:06:00.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:06:00.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:06:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:06:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:06:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:06:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:06:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:06:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.195194786000002, 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:06:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:06:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:06:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:06:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:06:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:06:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:06:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:06:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:06:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:06:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:06:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:06:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:06:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:06:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:06:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:06:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.195138342999996, 2024-09-12T22:06:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:06:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:06:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:06:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:06:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:06:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:06:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:06:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:06:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:06:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:06:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:06:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:06:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:06:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:06:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:06:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:06:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:06:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:06:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:06:00.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.632 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.632 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.632 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:00.632 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:06:00.632 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.195069883000002, 2024-09-12T22:06:00.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:06:00.632 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.632 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.632 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:06:00.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:06:00.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:06:00.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:06:00.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:06:00.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:06:00.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:06:00.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:06:00.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:06:00.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:06:00.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:06:00.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:06:00.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:06:00.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:06:00.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:06:00.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:06:00.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:06:00.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:06:00.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:06:00.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:06:00.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:06:00.638 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.638 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.638 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.639 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:00.639 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:06:00.639 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.195012148000004, 2024-09-12T22:06:00.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:06:00.639 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.639 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.639 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.639 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.639 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.639 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.639 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:06:00.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.639 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:06:00.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:06:00.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:06:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:06:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:06:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:06:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:06:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:06:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:06:00.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:06:00.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:06:00.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:06:00.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:00.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:06:00.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:06:00.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:06:00.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:06:00.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:06:00.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:06:00.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:06:00.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:06:00.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:06:00.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:06:00.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:06:00.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:06:00.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:06:00.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:06:00.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:06:00.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:06:00.645 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.645 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.645 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.645 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:00.645 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:06:00.645 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.194944456000002, 2024-09-12T22:06:00.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:06:00.646 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.646 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.646 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.646 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.646 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.646 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.646 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:06:00.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.646 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:06:00.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:06:00.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:06:00.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:06:00.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:06:00.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:06:00.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:06:00.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:06:00.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:06:00.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:06:00.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:06:00.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:06:00.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:06:00.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:06:00.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:06:00.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:06:00.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:06:00.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:06:00.652 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.652 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.652 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.652 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:00.652 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:06:00.652 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.194889394, 2024-09-12T22:06:00.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:06:00.652 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.652 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.653 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.653 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:06:00.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.653 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:06:00.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:06:00.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:06:00.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:06:00.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:06:00.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:06:00.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:06:00.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:06:00.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:06:00.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:06:00.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:06:00.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:06:00.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:00.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:06:00.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:06:00.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:06:00.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:06:00.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:06:00.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:06:00.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:06:00.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:06:00.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:06:00.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:06:00.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:06:00.658 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.659 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.659 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.659 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:06:00.659 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:06:00.659 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.154241873999993, 2024-09-12T22:06:00.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:06:00.659 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.659 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.659 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.660 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:06:00.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.660 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:06:00.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:06:00.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:06:00.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:06:00.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:06:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:06:00.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:06:00.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.665 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.665 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:06:00.665 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:06:00.665 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.151628145999993, 2024-09-12T22:06:00.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:06:00.665 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.665 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:06:00.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:06:00.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:06:00.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:06:00.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:06:00.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:06:00.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:06:00.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:00.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:06:00.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:06:00.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:06:00.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:06:00.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:06:00.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:06:00.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:00.671 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:06:00.672 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.606414049999998, 2024-09-12T22:06:00.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:06:00.672 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.672 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.672 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.672 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:06:00.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.672 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:06:00.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:06:00.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.677 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.677 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:00.677 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:06:00.677 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.605935561999999, 2024-09-12T22:06:00.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:06:00.677 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.677 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.677 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.677 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.678 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.678 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.678 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:06:00.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.678 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:06:00.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:06:00.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:06:00.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:06:00.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:06:00.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:06:00.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:06:00.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:06:00.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:06:00.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:06:00.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:06:00.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:06:00.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:06:00.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:06:00.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.682 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.683 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.683 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:00.683 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:06:00.683 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.603440262000007, 2024-09-12T22:06:00.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:06:00.683 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.683 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.683 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.684 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:06:00.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.684 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:06:00.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:06:00.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:06:00.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:06:00.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:06:00.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:06:00.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:06:00.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:06:00.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:06:00.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:06:00.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:06:00.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:06:00.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:06:00.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:06:00.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:06:00.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:06:00.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:06:00.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:06:00.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:06:00.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:06:00.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:06:00.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:06:00.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:06:00.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:06:00.688 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.689 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.689 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.689 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:00.689 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:06:00.689 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.602359471, 2024-09-12T22:06:00.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:06:00.689 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.689 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.689 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.689 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.689 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.689 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.690 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:06:00.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.690 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:06:00.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:06:00.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:06:00.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:06:00.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:06:00.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:06:00.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:06:00.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:06:00.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:06:00.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:06:00.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:06:00.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:06:00.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:06:00.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:06:00.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:06:00.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:06:00.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:06:00.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:06:00.694 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.694 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.694 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.601123908999995, 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.695 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:06:00.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:06:00.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:06:00.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:06:00.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:06:00.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:06:00.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:06:00.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:06:00.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:06:00.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:06:00.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:06:00.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:06:00.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:06:00.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:06:00.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:06:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:06:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:06:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:06:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:06:00.701 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.160383420999999, 2024-09-12T22:06:00.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:06:00.701 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.701 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.701 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.701 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:06:00.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.701 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:06:00.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:06:00.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:06:00.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:06:00.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:06:00.705 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.705 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.705 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.705 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:00.705 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:06:00.705 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.155852994, 2024-09-12T22:06:00.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:06:00.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:06:00.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:06:00.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:06:00.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:06:00.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:06:00.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:06:00.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:06:00.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:06:00.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:06:00.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:06:00.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:06:00.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:06:00.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:06:00.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:06:00.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:06:00.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.155828964999998, 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:06:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:06:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:06:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:06:00.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:06:00.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:06:00.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:06:00.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:06:00.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:06:00.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:06:00.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:06:00.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:06:00.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:06:00.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:06:00.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:06:00.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:06:00.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:06:00.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:06:00.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:06:00.717 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.717 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.717 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.717 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:00.717 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:06:00.717 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.155651315999997, 2024-09-12T22:06:00.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:06:00.717 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.717 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.717 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.718 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:06:00.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.718 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:06:00.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:06:00.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:06:00.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:06:00.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:06:00.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:06:00.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:06:00.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:06:00.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:06:00.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:06:00.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:06:00.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:06:00.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:06:00.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:06:00.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:06:00.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:06:00.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:06:00.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:06:00.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.153632778999999, 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:00.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:00.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:06:00.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:06:00.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:00.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:06:00.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:06:00.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:00.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:06:00.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:06:00.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:06:00.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:06:00.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:00.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:06:00.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:06:00.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:00.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:06:00.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:06:00.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:06:00.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:00.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:06:00.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:06:00.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:00.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:00.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:00.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:06:00.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:06:00.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.728 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:00.729 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:00.729 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:06:00.730 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:06:00.731 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:00.729+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:00.831 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:00.830+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:00.888 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:06:00.888 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:06:00.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.889 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332170 5.b 5:d214bc2d:::benchmark_data_smithi043_32659_object164932:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.889 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.881055+0000", 2024-09-12T22:06:00.889 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0051582440000000002, 2024-09-12T22:06:00.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0051764480000000002, 2024-09-12T22:06:00.889 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.889 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.889 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:06:00.889 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.889 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332170 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881055+0000", 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881055+0000", 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881056+0000", 2024-09-12T22:06:00.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-12T22:06:00.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881061+0000", 2024-09-12T22:06:00.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5120000000000002e-06 2024-09-12T22:06:00.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881070+0000", 2024-09-12T22:06:00.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:06:00.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881077+0000", 2024-09-12T22:06:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6529999999999997e-06 2024-09-12T22:06:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883205+0000", 2024-09-12T22:06:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021275629999999999 2024-09-12T22:06:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883390+0000", 2024-09-12T22:06:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018593700000000001 2024-09-12T22:06:00.893 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.893 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.893 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.893 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332172 5.5 5:abd362a2:::benchmark_data_smithi043_32659_object164934:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.893 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.881219+0000", 2024-09-12T22:06:00.893 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0049946979999999997, 2024-09-12T22:06:00.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0050696680000000003, 2024-09-12T22:06:00.893 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.893 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.893 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:06:00.893 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.893 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332172 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881219+0000", 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881219+0000", 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881219+0000", 2024-09-12T22:06:00.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:06:00.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881222+0000", 2024-09-12T22:06:00.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9950000000000001e-06 2024-09-12T22:06:00.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881230+0000", 2024-09-12T22:06:00.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.525e-06 2024-09-12T22:06:00.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881235+0000", 2024-09-12T22:06:00.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0640000000000001e-06 2024-09-12T22:06:00.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:00.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882526+0000", 2024-09-12T22:06:00.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001291141 2024-09-12T22:06:00.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:00.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882641+0000", 2024-09-12T22:06:00.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114412 2024-09-12T22:06:00.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:00.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882755+0000", 2024-09-12T22:06:00.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000114156 2024-09-12T22:06:00.898 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.898 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.898 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.898 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332173 5.5 5:ae38ced2:::benchmark_data_smithi043_32659_object164935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.898 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.881595+0000", 2024-09-12T22:06:00.898 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0046188510000000002, 2024-09-12T22:06:00.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047675950000000003, 2024-09-12T22:06:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:06:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332173 2024-09-12T22:06:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881595+0000", 2024-09-12T22:06:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881595+0000", 2024-09-12T22:06:00.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881595+0000", 2024-09-12T22:06:00.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0200000000000001e-07 2024-09-12T22:06:00.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881598+0000", 2024-09-12T22:06:00.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1080000000000001e-06 2024-09-12T22:06:00.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881607+0000", 2024-09-12T22:06:00.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6580000000000008e-06 2024-09-12T22:06:00.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881612+0000", 2024-09-12T22:06:00.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1529999999999996e-06 2024-09-12T22:06:00.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:00.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884365+0000", 2024-09-12T22:06:00.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027527620000000002 2024-09-12T22:06:00.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:00.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884472+0000", 2024-09-12T22:06:00.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106844 2024-09-12T22:06:00.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:00.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884575+0000", 2024-09-12T22:06:00.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010268900000000001 2024-09-12T22:06:00.903 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.903 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.903 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.903 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332174 5.d 5.2c9b828d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.903 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.881845+0000", 2024-09-12T22:06:00.903 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.004368902, 2024-09-12T22:06:00.903 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045884899999999998, 2024-09-12T22:06:00.904 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.904 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.904 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:06:00.904 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.904 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.904 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.904 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332174 2024-09-12T22:06:00.904 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.904 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.904 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.904 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.904 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881845+0000", 2024-09-12T22:06:00.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881845+0000", 2024-09-12T22:06:00.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.905 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.905 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.905 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881845+0000", 2024-09-12T22:06:00.905 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.06e-07 2024-09-12T22:06:00.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881848+0000", 2024-09-12T22:06:00.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.118e-06 2024-09-12T22:06:00.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.906 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881856+0000", 2024-09-12T22:06:00.906 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9820000000000008e-06 2024-09-12T22:06:00.906 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.906 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.906 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.907 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.881861+0000", 2024-09-12T22:06:00.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.972e-06 2024-09-12T22:06:00.907 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.907 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.907 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.907 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.907 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.907 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332176 5.5 5.45965ad5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.907 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.882305+0000", 2024-09-12T22:06:00.907 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0039081919999999996, 2024-09-12T22:06:00.907 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0041773440000000004, 2024-09-12T22:06:00.907 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.907 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.908 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:06:00.908 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.908 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.908 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.908 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332176 2024-09-12T22:06:00.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.908 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.908 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.908 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882305+0000", 2024-09-12T22:06:00.908 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.908 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.908 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882305+0000", 2024-09-12T22:06:00.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882306+0000", 2024-09-12T22:06:00.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4199999999999995e-07 2024-09-12T22:06:00.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.909 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.909 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.909 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882310+0000", 2024-09-12T22:06:00.909 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8210000000000003e-06 2024-09-12T22:06:00.909 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.910 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.910 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.910 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882317+0000", 2024-09-12T22:06:00.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5089999999999996e-06 2024-09-12T22:06:00.910 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.910 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.910 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.910 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882324+0000", 2024-09-12T22:06:00.910 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4280000000000001e-06 2024-09-12T22:06:00.911 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.911 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.911 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.911 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.911 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.911 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332178 5.8 5:19c5c2b9:::benchmark_data_smithi043_32659_object164940:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.911 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.882594+0000", 2024-09-12T22:06:00.911 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0036199959999999999, 2024-09-12T22:06:00.911 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0039409120000000004, 2024-09-12T22:06:00.911 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.911 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.911 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:06:00.911 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.911 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.912 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.912 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332178 2024-09-12T22:06:00.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.912 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882594+0000", 2024-09-12T22:06:00.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.912 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.912 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.912 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.912 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882594+0000", 2024-09-12T22:06:00.912 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882594+0000", 2024-09-12T22:06:00.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1099999999999995e-07 2024-09-12T22:06:00.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882598+0000", 2024-09-12T22:06:00.913 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5279999999999999e-06 2024-09-12T22:06:00.913 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.913 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.913 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.913 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882604+0000", 2024-09-12T22:06:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.003e-06 2024-09-12T22:06:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882608+0000", 2024-09-12T22:06:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2849999999999996e-06 2024-09-12T22:06:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882651+0000", 2024-09-12T22:06:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3102000000000002e-05 2024-09-12T22:06:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:00.915 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882748+0000", 2024-09-12T22:06:00.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7137000000000002e-05 2024-09-12T22:06:00.915 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.915 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.915 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.915 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332180 5.d 5.c1000c7d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.915 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.883132+0000", 2024-09-12T22:06:00.915 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.003081206, 2024-09-12T22:06:00.915 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034629109999999999, 2024-09-12T22:06:00.915 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.915 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.915 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:06:00.916 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.916 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.916 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.916 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332180 2024-09-12T22:06:00.916 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.916 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.916 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.916 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883132+0000", 2024-09-12T22:06:00.916 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.916 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.916 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.916 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.916 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883132+0000", 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883133+0000", 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.54e-07 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883137+0000", 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9509999999999999e-06 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.917 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883146+0000", 2024-09-12T22:06:00.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8990000000000007e-06 2024-09-12T22:06:00.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.918 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.918 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883152+0000", 2024-09-12T22:06:00.918 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9560000000000002e-06 2024-09-12T22:06:00.918 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.918 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.918 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.918 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.918 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.918 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332181 5.0 5:0542c2cc:::benchmark_data_smithi043_32659_object164943:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.918 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.883334+0000", 2024-09-12T22:06:00.918 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0028795299999999999, 2024-09-12T22:06:00.919 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033184899999999999, 2024-09-12T22:06:00.919 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.919 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.919 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:06:00.919 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.919 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.919 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.919 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332181 2024-09-12T22:06:00.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.919 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.919 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.919 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.919 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883334+0000", 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883334+0000", 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883335+0000", 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.920 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883338+0000", 2024-09-12T22:06:00.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2990000000000001e-06 2024-09-12T22:06:00.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.921 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.921 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883346+0000", 2024-09-12T22:06:00.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8509999999999999e-06 2024-09-12T22:06:00.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.921 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.921 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883352+0000", 2024-09-12T22:06:00.921 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7559999999999996e-06 2024-09-12T22:06:00.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.921 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.921 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883394+0000", 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2419000000000002e-05 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.883537+0000", 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014336700000000001 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332182 5.9 5:9f51893b:::benchmark_data_smithi043_32659_object164944:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.884611+0000", 2024-09-12T22:06:00.922 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0016022720000000001, 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021103519999999998, 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332182 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884611+0000", 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.923 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884611+0000", 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884612+0000", 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7699999999999992e-07 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884616+0000", 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.121e-06 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884627+0000", 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0478e-05 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884633+0000", 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5549999999999999e-06 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884688+0000", 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4333999999999999e-05 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.925 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:00.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884828+0000", 2024-09-12T22:06:00.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013994300000000001 2024-09-12T22:06:00.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.926 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:00.926 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884930+0000", 2024-09-12T22:06:00.926 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010278899999999999 2024-09-12T22:06:00.926 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.926 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.926 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.926 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.926 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.926 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332183 5.0 5:0e350da9:::benchmark_data_smithi043_32659_object164945:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.927 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.884656+0000", 2024-09-12T22:06:00.927 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001557197, 2024-09-12T22:06:00.927 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021359320000000001, 2024-09-12T22:06:00.927 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.927 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.927 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:06:00.927 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.927 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.927 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.927 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332183 2024-09-12T22:06:00.927 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.927 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.927 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.927 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.928 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884656+0000", 2024-09-12T22:06:00.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.928 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.928 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.928 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.928 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884656+0000", 2024-09-12T22:06:00.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.928 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.928 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.928 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.928 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884657+0000", 2024-09-12T22:06:00.928 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4000000000000002e-07 2024-09-12T22:06:00.928 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.928 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884659+0000", 2024-09-12T22:06:00.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6220000000000001e-06 2024-09-12T22:06:00.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884666+0000", 2024-09-12T22:06:00.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:06:00.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.929 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.929 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884671+0000", 2024-09-12T22:06:00.929 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8520000000000003e-06 2024-09-12T22:06:00.929 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885104+0000", 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000432755 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885254+0000", 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015004600000000001 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.930 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332184 5.8 5:1bdb3acc:::benchmark_data_smithi043_32659_object164946:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.931 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.884694+0000", 2024-09-12T22:06:00.931 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.001519926, 2024-09-12T22:06:00.931 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002172443, 2024-09-12T22:06:00.931 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.931 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.931 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:06:00.931 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.931 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.931 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.931 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332184 2024-09-12T22:06:00.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.931 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.932 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884694+0000", 2024-09-12T22:06:00.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.932 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884694+0000", 2024-09-12T22:06:00.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.932 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.932 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884694+0000", 2024-09-12T22:06:00.932 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4299999999999998e-07 2024-09-12T22:06:00.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.933 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884697+0000", 2024-09-12T22:06:00.933 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4899999999999999e-06 2024-09-12T22:06:00.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.933 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884704+0000", 2024-09-12T22:06:00.933 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3499999999999999e-06 2024-09-12T22:06:00.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.933 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884709+0000", 2024-09-12T22:06:00.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:06:00.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.934 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:00.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885225+0000", 2024-09-12T22:06:00.934 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00051665499999999998 2024-09-12T22:06:00.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.934 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:00.934 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.886265+0000", 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0010391140000000001 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332185 5.4 5:209a74af:::benchmark_data_smithi043_32659_object164947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.884715+0000", 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0014980530000000001, 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022162950000000001, 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.935 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.936 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.936 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332185 2024-09-12T22:06:00.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.936 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884715+0000", 2024-09-12T22:06:00.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.936 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.936 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884715+0000", 2024-09-12T22:06:00.936 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884716+0000", 2024-09-12T22:06:00.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6600000000000002e-07 2024-09-12T22:06:00.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884717+0000", 2024-09-12T22:06:00.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.649e-06 2024-09-12T22:06:00.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.937 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.937 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884723+0000", 2024-09-12T22:06:00.937 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3530000000000002e-06 2024-09-12T22:06:00.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884728+0000", 2024-09-12T22:06:00.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6659999999999999e-06 2024-09-12T22:06:00.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:00.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884768+0000", 2024-09-12T22:06:00.938 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0451000000000003e-05 2024-09-12T22:06:00.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.938 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:00.938 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884878+0000", 2024-09-12T22:06:00.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011001300000000001 2024-09-12T22:06:00.939 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.939 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.939 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.939 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332162 5.d 5:b74b10cb:::benchmark_data_smithi043_32659_object164924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.939 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.878047+0000", 2024-09-12T22:06:00.939 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.0081660499999999994, 2024-09-12T22:06:00.939 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0089525119999999993, 2024-09-12T22:06:00.939 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.939 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.939 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:06:00.939 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.940 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.940 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.940 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332162 2024-09-12T22:06:00.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.940 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.878047+0000", 2024-09-12T22:06:00.940 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.940 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.940 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.878047+0000", 2024-09-12T22:06:00.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.941 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.878048+0000", 2024-09-12T22:06:00.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7800000000000002e-07 2024-09-12T22:06:00.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.941 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.941 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.878050+0000", 2024-09-12T22:06:00.941 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4109999999999999e-06 2024-09-12T22:06:00.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.878058+0000", 2024-09-12T22:06:00.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9680000000000006e-06 2024-09-12T22:06:00.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.878064+0000", 2024-09-12T22:06:00.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:06:00.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.942 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:00.942 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.880315+0000", 2024-09-12T22:06:00.942 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022514119999999999 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.880449+0000", 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013433299999999999 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.880550+0000", 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000100127 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.882422+0000", 2024-09-12T22:06:00.943 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018726000000000001 2024-09-12T22:06:00.944 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.944 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.944 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.944 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332186 5.f 5:fc7e8ae9:::benchmark_data_smithi043_32659_object164948:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.944 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.884861+0000", 2024-09-12T22:06:00.944 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00135275, 2024-09-12T22:06:00.944 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022254929999999998, 2024-09-12T22:06:00.944 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.944 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.944 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:06:00.944 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.944 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.945 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.945 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332186 2024-09-12T22:06:00.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.945 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.945 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.945 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884861+0000", 2024-09-12T22:06:00.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884861+0000", 2024-09-12T22:06:00.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884861+0000", 2024-09-12T22:06:00.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:06:00.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884865+0000", 2024-09-12T22:06:00.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5930000000000002e-06 2024-09-12T22:06:00.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884872+0000", 2024-09-12T22:06:00.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1219999999999997e-06 2024-09-12T22:06:00.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.884877+0000", 2024-09-12T22:06:00.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2549999999999997e-06 2024-09-12T22:06:00.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:00.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885198+0000", 2024-09-12T22:06:00.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00032079899999999998 2024-09-12T22:06:00.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:00.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885339+0000", 2024-09-12T22:06:00.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014076900000000001 2024-09-12T22:06:00.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:00.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885441+0000", 2024-09-12T22:06:00.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000102409 2024-09-12T22:06:00.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:00.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.886935+0000", 2024-09-12T22:06:00.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001493755 2024-09-12T22:06:00.952 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.952 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.952 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.952 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332187 5.0 5:0b28970b:::benchmark_data_smithi043_32659_object164949:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.952 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.885373+0000", 2024-09-12T22:06:00.952 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.000840728, 2024-09-12T22:06:00.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017979770000000001, 2024-09-12T22:06:00.952 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.952 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332187 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885373+0000", 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885373+0000", 2024-09-12T22:06:00.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885374+0000", 2024-09-12T22:06:00.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9999999999999996e-07 2024-09-12T22:06:00.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885379+0000", 2024-09-12T22:06:00.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1120000000000004e-06 2024-09-12T22:06:00.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885389+0000", 2024-09-12T22:06:00.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0462000000000001e-05 2024-09-12T22:06:00.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885396+0000", 2024-09-12T22:06:00.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:06:00.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:00.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.886452+0000", 2024-09-12T22:06:00.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0010556299999999999 2024-09-12T22:06:00.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:00.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.886582+0000", 2024-09-12T22:06:00.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012976200000000001 2024-09-12T22:06:00.956 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.956 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.956 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.956 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332188 5.d 5.21f468ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.956 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.885799+0000", 2024-09-12T22:06:00.956 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 0.00041415000000000001, 2024-09-12T22:06:00.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001430057, 2024-09-12T22:06:00.956 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.956 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:06:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332188 2024-09-12T22:06:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885799+0000", 2024-09-12T22:06:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885799+0000", 2024-09-12T22:06:00.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885800+0000", 2024-09-12T22:06:00.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5600000000000005e-07 2024-09-12T22:06:00.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885804+0000", 2024-09-12T22:06:00.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1540000000000004e-06 2024-09-12T22:06:00.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885815+0000", 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0380999999999999e-05 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.885827+0000", 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1834000000000001e-05 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:332189 5.0 5.2ed6f600 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T22:06:00.959 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:06:00.886809+0000", 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4294967295.999404, 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00047063200000000002, 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "queued for pg", 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 332189 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.886809+0000", 2024-09-12T22:06:00.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.886809+0000", 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.886810+0000", 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1999999999999998e-07 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.886815+0000", 2024-09-12T22:06:00.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5569999999999997e-06 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.886836+0000", 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1444999999999999e-05 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:06:00.886844+0000", 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2230000000000001e-06 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:00.962 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-12T22:06:00.963 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 17 2024-09-12T22:06:00.963 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:06:00.964 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:00.962+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:00.965 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:06:00.999 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-09-12T22:06:01.068 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:01.066+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:01.115 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:06:01.116 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:06:01.116 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:06:01.116 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:06:01.116 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:06:01.129 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:06:01.166 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:01.164+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:01.266 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:01.265+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:01.293 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:06:01.293 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:06:01.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:06:01.293 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:06:01.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.293 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:01.293 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:06:01.293 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.325065516999999, 2024-09-12T22:06:01.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:06:01.294 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.294 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.294 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.294 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.294 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.294 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.294 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:06:01.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.294 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:06:01.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:06:01.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:06:01.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:06:01.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:06:01.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:06:01.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:06:01.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:06:01.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:06:01.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:06:01.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:06:01.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:06:01.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:06:01.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:06:01.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:06:01.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:06:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:06:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:06:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:06:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:06:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:06:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:06:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:06:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:06:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:06:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:06:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:06:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.323032791999999, 2024-09-12T22:06:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:06:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:06:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:06:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:06:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:06:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:06:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:06:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:06:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:06:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:06:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:06:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:06:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:06:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:06:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:06:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:06:01.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:06:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:06:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:06:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:06:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:06:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:06:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:06:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:06:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:06:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:06:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:06:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:06:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.320020528000001, 2024-09-12T22:06:01.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:06:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:06:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:06:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:06:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:06:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:06:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:06:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:06:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:06:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:06:01.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:06:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:06:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:06:01.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:06:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:06:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:06:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:06:01.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:06:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:06:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:06:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:06:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:06:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:06:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:06:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.315 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:06:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:06:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:06:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:06:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:06:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:06:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:01.317 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:06:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.319034037999998, 2024-09-12T22:06:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:06:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:06:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:06:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:06:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:06:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:06:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:06:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:06:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:06:01.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:06:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:06:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:06:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:06:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:06:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:06:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:06:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:06:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:06:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:06:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:06:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:06:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:06:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:06:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:06:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:06:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:06:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:06:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:06:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:06:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:06:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.324 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:06:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.313947403999997, 2024-09-12T22:06:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:06:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.325 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:06:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:06:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:06:01.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:06:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:06:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:06:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:06:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:06:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:06:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:06:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:06:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:06:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:06:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:06:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:06:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:06:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:06:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:06:01.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:06:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:06:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:06:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:06:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:06:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:06:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:06:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:06:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:06:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:06:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:06:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.331 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:06:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.311192431999999, 2024-09-12T22:06:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:06:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.332 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:06:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:06:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:06:01.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:06:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:06:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:06:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:06:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:06:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:06:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:06:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:06:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:06:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:06:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:06:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:06:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:06:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:06:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:06:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:06:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.303217547000003, 2024-09-12T22:06:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:06:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:06:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:06:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:06:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:06:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:06:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:06:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:06:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:06:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:06:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:06:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:06:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:06:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:06:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:06:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:06:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:06:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:06:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:06:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:06:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:06:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:06:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:06:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:06:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:06:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:06:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:06:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:06:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:06:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:06:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:06:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.295291771000002, 2024-09-12T22:06:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:06:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:06:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:06:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:06:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:06:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:06:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:06:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:06:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:06:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:06:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:06:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:06:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:06:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:06:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:06:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:06:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:06:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:06:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:06:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:06:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:06:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:06:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:06:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:06:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:06:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:06:01.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:06:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:06:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:06:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:06:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:06:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.293795488999997, 2024-09-12T22:06:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:06:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:06:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:06:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:06:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:06:01.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:06:01.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:06:01.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:06:01.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:06:01.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:06:01.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:06:01.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:06:01.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:06:01.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:06:01.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:06:01.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:06:01.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:06:01.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:06:01.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:06:01.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:06:01.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:06:01.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:06:01.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:06:01.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:06:01.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:06:01.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:06:01.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:06:01.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:06:01.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:06:01.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:06:01.361 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.361 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.361 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.361 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296741 5.3 5:c190c274:::benchmark_data_smithi043_32659_object129503:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:01.361 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:06:01.361 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.272487877, 2024-09-12T22:06:01.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.051784984, 2024-09-12T22:06:01.361 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.361 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.361 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.362 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.362 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.362 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.362 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296741 2024-09-12T22:06:01.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.362 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:06:01.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:06:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016859+0000", 2024-09-12T22:06:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5600000000000004e-07 2024-09-12T22:06:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016863+0000", 2024-09-12T22:06:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5510000000000001e-06 2024-09-12T22:06:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016873+0000", 2024-09-12T22:06:01.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5319999999999995e-06 2024-09-12T22:06:01.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016879+0000", 2024-09-12T22:06:01.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5100000000000004e-06 2024-09-12T22:06:01.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016934+0000", 2024-09-12T22:06:01.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4734999999999997e-05 2024-09-12T22:06:01.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016941+0000", 2024-09-12T22:06:01.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1319999999999996e-06 2024-09-12T22:06:01.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055352+0000", 2024-09-12T22:06:01.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0384109260000001 2024-09-12T22:06:01.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055496+0000", 2024-09-12T22:06:01.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014437400000000001 2024-09-12T22:06:01.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055835+0000", 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000338339 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065163+0000", 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093287690000000006 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068506+0000", 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033423620000000002 2024-09-12T22:06:01.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068557+0000", 2024-09-12T22:06:01.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1057000000000003e-05 2024-09-12T22:06:01.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068643+0000", 2024-09-12T22:06:01.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5741000000000005e-05 2024-09-12T22:06:01.367 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.367 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.367 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.368 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296774 5.3 5:c9ea392f:::benchmark_data_smithi043_32659_object129536:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:01.368 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:06:01.368 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.258742255000001, 2024-09-12T22:06:01.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0383883359999999, 2024-09-12T22:06:01.368 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.368 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.368 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.368 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.368 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.368 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.369 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296774 2024-09-12T22:06:01.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.369 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:06:01.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:06:01.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030604+0000", 2024-09-12T22:06:01.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:06:01.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030607+0000", 2024-09-12T22:06:01.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0860000000000002e-06 2024-09-12T22:06:01.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.370 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.370 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030615+0000", 2024-09-12T22:06:01.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8120000000000008e-06 2024-09-12T22:06:01.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030620+0000", 2024-09-12T22:06:01.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6080000000000003e-06 2024-09-12T22:06:01.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030662+0000", 2024-09-12T22:06:01.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1925999999999998e-05 2024-09-12T22:06:01.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030670+0000", 2024-09-12T22:06:01.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2359999999999998e-06 2024-09-12T22:06:01.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065202+0000", 2024-09-12T22:06:01.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0345323989999999 2024-09-12T22:06:01.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065348+0000", 2024-09-12T22:06:01.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145575 2024-09-12T22:06:01.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065476+0000", 2024-09-12T22:06:01.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012800999999999999 2024-09-12T22:06:01.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068690+0000", 2024-09-12T22:06:01.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032143929999999999 2024-09-12T22:06:01.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.373 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068869+0000", 2024-09-12T22:06:01.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000179152 2024-09-12T22:06:01.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068914+0000", 2024-09-12T22:06:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4629999999999998e-05 2024-09-12T22:06:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068992+0000", 2024-09-12T22:06:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7885000000000004e-05 2024-09-12T22:06:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.375 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296793 5.3 5:c55bd684:::benchmark_data_smithi043_32659_object129555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:01.375 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:06:01.375 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.251925608000001, 2024-09-12T22:06:01.375 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0317046320000001, 2024-09-12T22:06:01.375 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.375 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.375 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.375 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.375 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.375 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.375 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296793 2024-09-12T22:06:01.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.375 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:06:01.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:06:01.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.376 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.376 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037421+0000", 2024-09-12T22:06:01.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:06:01.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037425+0000", 2024-09-12T22:06:01.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9539999999999998e-06 2024-09-12T22:06:01.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037432+0000", 2024-09-12T22:06:01.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:06:01.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037436+0000", 2024-09-12T22:06:01.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4320000000000001e-06 2024-09-12T22:06:01.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037496+0000", 2024-09-12T22:06:01.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9385999999999997e-05 2024-09-12T22:06:01.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037503+0000", 2024-09-12T22:06:01.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:06:01.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066427+0000", 2024-09-12T22:06:01.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.028923877 2024-09-12T22:06:01.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066519+0000", 2024-09-12T22:06:01.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1867000000000007e-05 2024-09-12T22:06:01.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066598+0000", 2024-09-12T22:06:01.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9175e-05 2024-09-12T22:06:01.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068804+0000", 2024-09-12T22:06:01.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002205664 2024-09-12T22:06:01.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069004+0000", 2024-09-12T22:06:01.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000200769 2024-09-12T22:06:01.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069050+0000", 2024-09-12T22:06:01.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5522999999999998e-05 2024-09-12T22:06:01.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.381 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069125+0000", 2024-09-12T22:06:01.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4530000000000006e-05 2024-09-12T22:06:01.381 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.381 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.381 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296796 5.3 5:cbc9dd25:::benchmark_data_smithi043_32659_object129558:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:06:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 18.251627978999998, 2024-09-12T22:06:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0315259400000001, 2024-09-12T22:06:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296796 2024-09-12T22:06:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:06:01.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:06:01.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037719+0000", 2024-09-12T22:06:01.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1069999999999999e-06 2024-09-12T22:06:01.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037723+0000", 2024-09-12T22:06:01.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1400000000000002e-06 2024-09-12T22:06:01.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037734+0000", 2024-09-12T22:06:01.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0991e-05 2024-09-12T22:06:01.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037741+0000", 2024-09-12T22:06:01.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6059999999999997e-06 2024-09-12T22:06:01.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037790+0000", 2024-09-12T22:06:01.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9112e-05 2024-09-12T22:06:01.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037797+0000", 2024-09-12T22:06:01.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:06:01.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067455+0000", 2024-09-12T22:06:01.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0296586320000001 2024-09-12T22:06:01.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067568+0000", 2024-09-12T22:06:01.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112895 2024-09-12T22:06:01.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067686+0000", 2024-09-12T22:06:01.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117879 2024-09-12T22:06:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068856+0000", 2024-09-12T22:06:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011693949999999999 2024-09-12T22:06:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069132+0000", 2024-09-12T22:06:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027629599999999999 2024-09-12T22:06:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069171+0000", 2024-09-12T22:06:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9536000000000002e-05 2024-09-12T22:06:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069243+0000", 2024-09-12T22:06:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2033999999999995e-05 2024-09-12T22:06:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318065 5.7 5:e8daa0bb:::benchmark_data_smithi043_32659_object150827:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3215689669999993, 2024-09-12T22:06:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041842749, 2024-09-12T22:06:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:06:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318065 2024-09-12T22:06:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:01.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:01.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:01.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:06:01.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967782+0000", 2024-09-12T22:06:01.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0539999999999996e-06 2024-09-12T22:06:01.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968192+0000", 2024-09-12T22:06:01.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000410906 2024-09-12T22:06:01.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968201+0000", 2024-09-12T22:06:01.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7639999999999994e-06 2024-09-12T22:06:01.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971494+0000", 2024-09-12T22:06:01.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032926180000000002 2024-09-12T22:06:01.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971499+0000", 2024-09-12T22:06:01.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0690000000000001e-06 2024-09-12T22:06:01.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009565+0000", 2024-09-12T22:06:01.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038066221 2024-09-12T22:06:01.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009619+0000", 2024-09-12T22:06:01.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4203000000000003e-05 2024-09-12T22:06:01.393 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.393 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.393 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.393 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318069 5.7 5:ea50145d:::benchmark_data_smithi043_32659_object150831:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:01.393 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3211313919999998, 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041799116, 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318069 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:06:01.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:06:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968215+0000", 2024-09-12T22:06:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:06:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968218+0000", 2024-09-12T22:06:01.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9119999999999998e-06 2024-09-12T22:06:01.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968228+0000", 2024-09-12T22:06:01.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9599999999999995e-06 2024-09-12T22:06:01.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968234+0000", 2024-09-12T22:06:01.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6969999999999996e-06 2024-09-12T22:06:01.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971512+0000", 2024-09-12T22:06:01.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032779160000000001 2024-09-12T22:06:01.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971516+0000", 2024-09-12T22:06:01.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:06:01.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009970+0000", 2024-09-12T22:06:01.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03845421 2024-09-12T22:06:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010013+0000", 2024-09-12T22:06:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3516000000000001e-05 2024-09-12T22:06:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318078 5.7 5:e5b30db2:::benchmark_data_smithi043_32659_object150840:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3211035639999995, 2024-09-12T22:06:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0418401070000001, 2024-09-12T22:06:01.399 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.399 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.399 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:06:01.399 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.399 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.399 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.399 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318078 2024-09-12T22:06:01.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.399 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:01.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:01.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:01.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:06:01.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.400 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.400 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968245+0000", 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968251+0000", 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2999999999999998e-06 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968257+0000", 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6400000000000002e-06 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971528+0000", 2024-09-12T22:06:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032710619999999999 2024-09-12T22:06:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971533+0000", 2024-09-12T22:06:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8629999999999999e-06 2024-09-12T22:06:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010030+0000", 2024-09-12T22:06:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038496683 2024-09-12T22:06:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010082+0000", 2024-09-12T22:06:01.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2478999999999997e-05 2024-09-12T22:06:01.403 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.403 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.403 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.403 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318093 5.7 5:e0eb16a2:::benchmark_data_smithi043_32659_object150855:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:01.403 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:06:01.403 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.3187721729999993, 2024-09-12T22:06:01.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0523587110000001, 2024-09-12T22:06:01.403 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.403 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.404 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.404 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.404 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.404 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.404 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318093 2024-09-12T22:06:01.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.404 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:06:01.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:06:01.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970575+0000", 2024-09-12T22:06:01.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.159e-06 2024-09-12T22:06:01.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970579+0000", 2024-09-12T22:06:01.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4510000000000002e-06 2024-09-12T22:06:01.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970588+0000", 2024-09-12T22:06:01.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1479999999999995e-06 2024-09-12T22:06:01.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970595+0000", 2024-09-12T22:06:01.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6919999999999996e-06 2024-09-12T22:06:01.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971555+0000", 2024-09-12T22:06:01.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00096029399999999999 2024-09-12T22:06:01.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971561+0000", 2024-09-12T22:06:01.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7230000000000001e-06 2024-09-12T22:06:01.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.407 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010105+0000", 2024-09-12T22:06:01.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038544361 2024-09-12T22:06:01.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.407 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010201+0000", 2024-09-12T22:06:01.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5340000000000005e-05 2024-09-12T22:06:01.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010497+0000", 2024-09-12T22:06:01.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000296273 2024-09-12T22:06:01.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021904+0000", 2024-09-12T22:06:01.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011406928 2024-09-12T22:06:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022778+0000", 2024-09-12T22:06:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00087414199999999995 2024-09-12T22:06:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022844+0000", 2024-09-12T22:06:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6097000000000001e-05 2024-09-12T22:06:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022932+0000", 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8103000000000007e-05 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318150 5.7 5:e1ecf58e:::benchmark_data_smithi043_32659_object150912:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.2932934990000007, 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027012142, 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318150 2024-09-12T22:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.413 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:01.411+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:01.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996053+0000", 2024-09-12T22:06:01.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.079e-06 2024-09-12T22:06:01.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996057+0000", 2024-09-12T22:06:01.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3069999999999996e-06 2024-09-12T22:06:01.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996067+0000", 2024-09-12T22:06:01.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9420000000000007e-06 2024-09-12T22:06:01.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996081+0000", 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3220999999999999e-05 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996124+0000", 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3545999999999999e-05 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996129+0000", 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2639999999999999e-06 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017129+0000", 2024-09-12T22:06:01.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.020999384 2024-09-12T22:06:01.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017210+0000", 2024-09-12T22:06:01.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0968000000000001e-05 2024-09-12T22:06:01.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017279+0000", 2024-09-12T22:06:01.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9484000000000001e-05 2024-09-12T22:06:01.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022949+0000", 2024-09-12T22:06:01.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056697259999999999 2024-09-12T22:06:01.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022986+0000", 2024-09-12T22:06:01.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6610999999999999e-05 2024-09-12T22:06:01.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023016+0000", 2024-09-12T22:06:01.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0490000000000001e-05 2024-09-12T22:06:01.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023064+0000", 2024-09-12T22:06:01.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.812e-05 2024-09-12T22:06:01.418 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.418 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.418 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.418 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318162 5.7 5:e4ee45f3:::benchmark_data_smithi043_32659_object150924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:01.418 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:06:01.418 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.2897215830000004, 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0259081619999999, 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318162 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:06:01.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999625+0000", 2024-09-12T22:06:01.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:06:01.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999627+0000", 2024-09-12T22:06:01.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8260000000000001e-06 2024-09-12T22:06:01.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999634+0000", 2024-09-12T22:06:01.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8730000000000001e-06 2024-09-12T22:06:01.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999639+0000", 2024-09-12T22:06:01.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0710000000000002e-06 2024-09-12T22:06:01.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999681+0000", 2024-09-12T22:06:01.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1488e-05 2024-09-12T22:06:01.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999688+0000", 2024-09-12T22:06:01.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9229999999999996e-06 2024-09-12T22:06:01.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.020983+0000", 2024-09-12T22:06:01.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0212956630000001 2024-09-12T22:06:01.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021059+0000", 2024-09-12T22:06:01.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5445999999999996e-05 2024-09-12T22:06:01.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021123+0000", 2024-09-12T22:06:01.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4080999999999999e-05 2024-09-12T22:06:01.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.024526+0000", 2024-09-12T22:06:01.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003403241 2024-09-12T22:06:01.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025454+0000", 2024-09-12T22:06:01.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00092807600000000001 2024-09-12T22:06:01.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025486+0000", 2024-09-12T22:06:01.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1430999999999998e-05 2024-09-12T22:06:01.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025532+0000", 2024-09-12T22:06:01.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6428999999999999e-05 2024-09-12T22:06:01.425 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.425 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.425 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.425 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:326467 5.1 5:87ee908b:::benchmark_data_smithi043_32659_object159229:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T22:06:01.425 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:06:01.425 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.2673285889999999, 2024-09-12T22:06:01.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038557899, 2024-09-12T22:06:01.425 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:01.425 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:01.425 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.425 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:01.425 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:01.426 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.426 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 326467 2024-09-12T22:06:01.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.426 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:01.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:01.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:06:01.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:01.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:06:01.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:01.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:01.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022018+0000", 2024-09-12T22:06:01.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5000000000000001e-07 2024-09-12T22:06:01.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:01.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022022+0000", 2024-09-12T22:06:01.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2799999999999997e-06 2024-09-12T22:06:01.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:01.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022032+0000", 2024-09-12T22:06:01.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0035e-05 2024-09-12T22:06:01.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022040+0000", 2024-09-12T22:06:01.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5970000000000003e-06 2024-09-12T22:06:01.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022093+0000", 2024-09-12T22:06:01.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3718999999999998e-05 2024-09-12T22:06:01.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022101+0000", 2024-09-12T22:06:01.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3579999999999997e-06 2024-09-12T22:06:01.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:01.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056468+0000", 2024-09-12T22:06:01.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.034366761 2024-09-12T22:06:01.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:01.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056576+0000", 2024-09-12T22:06:01.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000108859 2024-09-12T22:06:01.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:01.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056682+0000", 2024-09-12T22:06:01.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105358 2024-09-12T22:06:01.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.057971+0000", 2024-09-12T22:06:01.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012889749999999999 2024-09-12T22:06:01.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:01.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060452+0000", 2024-09-12T22:06:01.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024813980000000001 2024-09-12T22:06:01.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060496+0000", 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3875999999999998e-05 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060575+0000", 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8832999999999996e-05 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:01.431 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:06:01.432 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:06:01.513 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:01.512+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:01.565 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:06:01.565 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:06:01.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.565 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:334015 5.c e77/75 5:3d14bd65:::benchmark_data_smithi043_32659_object166777:head v 77'20895, mlcod=77'20893)", 2024-09-12T22:06:01.565 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:06:01.562776+0000", 2024-09-12T22:06:01.565 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001278083, 2024-09-12T22:06:01.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001298961, 2024-09-12T22:06:01.565 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.565 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.565 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:06:01.566 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.562776+0000", 2024-09-12T22:06:01.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.562776+0000", 2024-09-12T22:06:01.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.562776+0000", 2024-09-12T22:06:01.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:06:01.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.562784+0000", 2024-09-12T22:06:01.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:06:01.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.562796+0000", 2024-09-12T22:06:01.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2004999999999999e-05 2024-09-12T22:06:01.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.562801+0000", 2024-09-12T22:06:01.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6699999999999999e-06 2024-09-12T22:06:01.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.562841+0000", 2024-09-12T22:06:01.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9563000000000001e-05 2024-09-12T22:06:01.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.562853+0000", 2024-09-12T22:06:01.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2588999999999999e-05 2024-09-12T22:06:01.569 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.569 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.569 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.569 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:334017 5.1 e77/72 5:8799ec66:::benchmark_data_smithi043_32659_object166779:head v 77'20820, mlcod=77'20818)", 2024-09-12T22:06:01.569 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:06:01.563279+0000", 2024-09-12T22:06:01.569 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00077475099999999996, 2024-09-12T22:06:01.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00085745099999999996, 2024-09-12T22:06:01.569 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.569 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.569 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:06:01.570 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563279+0000", 2024-09-12T22:06:01.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563279+0000", 2024-09-12T22:06:01.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563279+0000", 2024-09-12T22:06:01.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7e-07 2024-09-12T22:06:01.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563282+0000", 2024-09-12T22:06:01.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.92e-06 2024-09-12T22:06:01.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563290+0000", 2024-09-12T22:06:01.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6210000000000004e-06 2024-09-12T22:06:01.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563294+0000", 2024-09-12T22:06:01.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4340000000000002e-06 2024-09-12T22:06:01.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563335+0000", 2024-09-12T22:06:01.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1115000000000002e-05 2024-09-12T22:06:01.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563356+0000", 2024-09-12T22:06:01.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0234e-05 2024-09-12T22:06:01.572 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.573 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.573 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.573 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:334019 5.2 5:488d6cc9:::benchmark_data_smithi043_32659_object166781:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T22:06:01.573 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:06:01.563417+0000", 2024-09-12T22:06:01.573 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00063713300000000001, 2024-09-12T22:06:01.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00077685999999999999, 2024-09-12T22:06:01.573 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.573 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.573 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:06:01.573 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.573 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.573 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.574 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 334019 2024-09-12T22:06:01.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.574 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563417+0000", 2024-09-12T22:06:01.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563417+0000", 2024-09-12T22:06:01.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563418+0000", 2024-09-12T22:06:01.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0550000000000001e-06 2024-09-12T22:06:01.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563422+0000", 2024-09-12T22:06:01.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4649999999999996e-06 2024-09-12T22:06:01.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563430+0000", 2024-09-12T22:06:01.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6499999999999996e-06 2024-09-12T22:06:01.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563434+0000", 2024-09-12T22:06:01.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3599999999999998e-06 2024-09-12T22:06:01.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563485+0000", 2024-09-12T22:06:01.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0890000000000002e-05 2024-09-12T22:06:01.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563672+0000", 2024-09-12T22:06:01.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000186632 2024-09-12T22:06:01.577 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.577 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.577 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.577 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4514.0:334021 5.7 e77/69 5:e9b09e67:::benchmark_data_smithi043_32659_object166783:head v 77'20987, mlcod=77'20985)", 2024-09-12T22:06:01.577 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:06:01.563901+0000", 2024-09-12T22:06:01.577 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00015245499999999999, 2024-09-12T22:06:01.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000353918, 2024-09-12T22:06:01.577 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.577 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.577 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-12T22:06:01.577 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563901+0000", 2024-09-12T22:06:01.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563901+0000", 2024-09-12T22:06:01.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563902+0000", 2024-09-12T22:06:01.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:06:01.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563907+0000", 2024-09-12T22:06:01.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2820000000000004e-06 2024-09-12T22:06:01.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563917+0000", 2024-09-12T22:06:01.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.013e-05 2024-09-12T22:06:01.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563923+0000", 2024-09-12T22:06:01.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:06:01.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563961+0000", 2024-09-12T22:06:01.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8390999999999999e-05 2024-09-12T22:06:01.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:06:01.563979+0000", 2024-09-12T22:06:01.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7456999999999999e-05 2024-09-12T22:06:01.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.580 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.581 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T22:06:01.581 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 4 2024-09-12T22:06:01.581 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:06:01.582 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:06:01.614 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:01.613+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:01.715 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:01.714+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:01.716 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:06:01.716 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:06:01.716 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:06:01.716 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:06:01.716 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:06:01.720 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Removed 167235 objects 2024-09-12T22:06:01.720 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Clean up completed and total clean up time :66.5194 2024-09-12T22:06:01.726 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:06:01.816 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:01.815+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:01.830 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:06:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:06:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:06:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:06:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:06:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.417454468000003, 2024-09-12T22:06:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:06:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:06:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:06:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:06:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:06:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:06:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:06:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:06:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:06:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:06:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:06:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:06:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:06:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:06:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:06:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:06:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.417274538000001, 2024-09-12T22:06:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:06:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:06:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:06:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:06:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:06:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:06:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:06:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:06:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:06:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:06:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:06:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:06:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:06:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:06:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:06:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:06:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:06:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:06:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:06:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.417208097, 2024-09-12T22:06:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:06:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:06:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:06:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:06:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:06:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:06:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:06:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:06:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:06:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:06:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:06:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:06:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:06:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:06:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:06:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:06:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:06:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.417151653999994, 2024-09-12T22:06:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:06:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:06:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:06:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:06:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:06:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:06:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:06:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:06:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:06:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:06:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:06:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:06:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:06:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:06:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:06:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.417083194, 2024-09-12T22:06:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:06:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:06:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:06:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:06:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:06:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:06:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:06:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:06:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:06:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:06:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:06:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:06:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:06:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:06:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:06:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:06:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:06:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:06:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:06:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:06:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:06:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.417025459000001, 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:06:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:06:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:06:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:06:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:06:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:06:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:06:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:06:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:06:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:06:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:06:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:06:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:06:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:06:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:06:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:06:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:06:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:06:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:06:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:06:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.416957767, 2024-09-12T22:06:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:06:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:06:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:06:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:06:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:06:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:06:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:06:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:06:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:06:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:06:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:06:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:06:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:06:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:06:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:06:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:06:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:06:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:06:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:06:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:06:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:06:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:06:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:06:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:06:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:06:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.416902704999998, 2024-09-12T22:06:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:06:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:06:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:06:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:06:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:06:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:06:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:06:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:06:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:06:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:06:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:06:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:06:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:06:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:06:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:06:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:06:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:06:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:06:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:06:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:06:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:06:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:06:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:06:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:06:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:06:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:06:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:06:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.376255185000005, 2024-09-12T22:06:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:06:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:06:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:06:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:06:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:06:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:06:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:06:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:06:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:06:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:06:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:06:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:06:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:06:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:06:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:06:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:06:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:06:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:06:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:06:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:06:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.373641457000005, 2024-09-12T22:06:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:06:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:06:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:06:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:06:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:06:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:06:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:06:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:06:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:06:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:06:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:06:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:06:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:06:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:06:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:06:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:06:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:06:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:06:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:06:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:06:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:06:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:06:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:06:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:06:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:06:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:06:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:06:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:06:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:06:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.828427360999996, 2024-09-12T22:06:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:06:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:06:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:06:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:06:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:06:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:06:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:06:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:06:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:06:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:06:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:06:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:06:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:06:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:06:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:06:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.827948872999997, 2024-09-12T22:06:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:06:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:06:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:06:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:06:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:06:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:06:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:06:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:06:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:06:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:06:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:06:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:06:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:06:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:06:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:06:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:06:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:06:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.825453573000004, 2024-09-12T22:06:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:06:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:06:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:06:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:06:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:06:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:06:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:06:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:06:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:06:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:06:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:06:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:06:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:06:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:06:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:06:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:06:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:06:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:06:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.824372781999998, 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:06:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:06:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:06:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:06:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:06:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:06:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:06:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:06:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:06:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:06:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:06:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:06:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:06:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:06:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:06:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.823137220000007, 2024-09-12T22:06:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:06:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:06:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:06:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:06:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:06:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:06:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:06:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:06:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:06:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:06:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:06:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:06:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:06:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:06:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:06:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:06:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:06:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:06:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:06:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:06:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:06:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:06:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:06:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:06:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:06:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:06:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:06:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.382396731999997, 2024-09-12T22:06:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:06:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:06:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:06:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:06:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:06:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:06:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:06:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:06:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:06:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:06:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:06:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.377866304999998, 2024-09-12T22:06:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:06:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:06:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:06:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:06:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:06:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:06:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:06:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:06:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:06:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:06:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:06:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:06:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:06:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:06:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:06:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:06:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:06:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:06:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:06:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:06:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.377842276000003, 2024-09-12T22:06:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:06:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:06:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:06:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:06:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:06:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:06:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:06:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:06:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:06:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:06:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:06:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:06:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:06:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:06:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:06:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:06:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:06:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:06:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:06:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:06:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:06:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:06:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.377664627000001, 2024-09-12T22:06:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:06:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:06:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:06:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:06:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:06:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:06:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:06:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:06:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:06:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:06:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:06:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:06:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:06:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:06:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:06:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:06:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:06:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:06:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:06:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:06:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:06:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:06:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:06:01.942 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.375646089999996, 2024-09-12T22:06:01.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:06:01.943 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:01.943 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:01.943 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:01.943 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:01.943 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:01.943 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:01.943 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:06:01.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.943 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:01.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:01.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:06:01.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:01.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:06:01.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:01.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:01.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:06:01.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:06:01.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:01.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:06:01.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:06:01.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:01.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:06:01.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:06:01.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:01.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:06:01.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:06:01.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:01.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:01.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:06:01.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:06:01.948 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.948 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.948 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.948 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:01.948 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:01.948 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:06:01.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:06:01.950 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:01.949+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:02.050 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:02.049+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:02.065 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:06:02.065 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:06:02.065 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-12T22:06:02.065 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:06:02.074 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:06:02.151 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:02.150+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:02.179 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:06:02.179 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:06:02.179 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:06:02.179 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:06:02.179 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:06:02.187 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:06:02.271 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:02.270+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:02.319 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:06:02.333 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:06:02.333 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:06:02.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:06:02.333 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:06:02.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.334 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:02.334 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:06:02.334 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 40.366587817000003, 2024-09-12T22:06:02.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:06:02.334 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.334 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.334 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.334 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.334 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.334 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.334 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:06:02.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.334 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:06:02.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:06:02.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:06:02.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:06:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:06:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:06:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:06:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:06:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:06:02.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:06:02.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:06:02.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:06:02.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:06:02.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:06:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:06:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:06:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:06:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:06:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:06:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:06:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:06:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:06:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:06:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:06:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:06:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:06:02.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:06:02.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:06:02.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:06:02.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:06:02.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:06:02.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 40.364555092000003, 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.341 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.342 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.342 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.342 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.342 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.342 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:06:02.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.342 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:02.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:06:02.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:06:02.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:06:02.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:06:02.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.345 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:06:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:06:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:06:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:06:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:06:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:06:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:06:02.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:06:02.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:06:02.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:06:02.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:06:02.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:06:02.347 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.348 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.348 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.348 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:02.348 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:06:02.348 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 40.361542827999997, 2024-09-12T22:06:02.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:06:02.348 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.348 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.348 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.348 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.349 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.349 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.349 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:06:02.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.349 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:06:02.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:06:02.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:06:02.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:06:02.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:06:02.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:06:02.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:06:02.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:06:02.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:06:02.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:06:02.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:06:02.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:06:02.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:06:02.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:06:02.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:06:02.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:06:02.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:06:02.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:06:02.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:06:02.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:06:02.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:06:02.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:06:02.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:06:02.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:06:02.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:06:02.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:06:02.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:06:02.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:06:02.354 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.354 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.355 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.355 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:02.355 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:06:02.355 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 40.360556338000002, 2024-09-12T22:06:02.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:06:02.355 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.355 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.355 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.355 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.355 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.355 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.355 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:06:02.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.356 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:06:02.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:06:02.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:06:02.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:06:02.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:06:02.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:06:02.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:06:02.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:06:02.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:06:02.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:06:02.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:06:02.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:06:02.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:06:02.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:06:02.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:06:02.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:06:02.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.360 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:06:02.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:06:02.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.360 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:06:02.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:06:02.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:06:02.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:06:02.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:06:02.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:06:02.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:06:02.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:06:02.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:06:02.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:06:02.362 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.362 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.362 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.362 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:02.363 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:06:02.363 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 40.355469704000001, 2024-09-12T22:06:02.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:06:02.363 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.363 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.363 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.363 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.363 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.363 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.363 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:06:02.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.363 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:06:02.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:06:02.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:06:02.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:06:02.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:06:02.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:06:02.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.365 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.365 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:06:02.365 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:06:02.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:06:02.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:06:02.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:06:02.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:06:02.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.366 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.366 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:06:02.366 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:06:02.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:06:02.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:06:02.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:06:02.367 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:06:02.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.367 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.367 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:06:02.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:06:02.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:06:02.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:06:02.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.368 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:06:02.368 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:06:02.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.368 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:06:02.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:06:02.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.369 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.369 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:06:02.369 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:06:02.369 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.369 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.369 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.369 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:02.370 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:06:02.370 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 40.352714732000003, 2024-09-12T22:06:02.370 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:06:02.370 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.370 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.370 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.370 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.370 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.370 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.371 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:06:02.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.371 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:06:02.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.371 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.371 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:06:02.371 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.371 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:06:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:06:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:06:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:06:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:06:02.373 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:06:02.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.373 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.373 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.376 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:06:02.376 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:06:02.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:06:02.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:06:02.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:06:02.377 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:06:02.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.377 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.377 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.377 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:06:02.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:06:02.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:06:02.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:06:02.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.378 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.378 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:06:02.378 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:06:02.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:06:02.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:06:02.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:06:02.379 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:06:02.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.379 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.379 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:06:02.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:06:02.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.380 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.380 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:06:02.380 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:06:02.380 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.380 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.380 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.380 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.380 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:02.380 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:06:02.381 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 40.344739847, 2024-09-12T22:06:02.381 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:06:02.381 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.381 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.381 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.381 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.381 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.381 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.381 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:06:02.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.381 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.381 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.381 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:06:02.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:06:02.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.382 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.382 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.382 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:06:02.382 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:06:02.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:06:02.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:06:02.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:06:02.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:06:02.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.383 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.383 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.383 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:06:02.383 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:06:02.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:06:02.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:06:02.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:06:02.384 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:06:02.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.384 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.384 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.384 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:06:02.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:06:02.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:06:02.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:06:02.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.385 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:06:02.385 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:06:02.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.385 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.385 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:06:02.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:06:02.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:06:02.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:06:02.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.386 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.386 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.386 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:06:02.386 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:06:02.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.387 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.387 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:06:02.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:06:02.387 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.387 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.387 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.387 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.387 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:02.387 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:06:02.387 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 40.336814070999999, 2024-09-12T22:06:02.387 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:06:02.387 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.388 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.388 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.388 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.388 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.388 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.388 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:06:02.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.388 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.388 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.388 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:06:02.388 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.388 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:06:02.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:06:02.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:06:02.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.389 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.389 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:06:02.389 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:06:02.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:06:02.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:06:02.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.390 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:06:02.390 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:06:02.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.390 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.390 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.391 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.392 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.393 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:06:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 40.335317789000001, 2024-09-12T22:06:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:06:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:06:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:06:02.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:06:02.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:06:02.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:06:02.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:06:02.396 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.396 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.396 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.396 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:06:02.396 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:06:02.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:06:02.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:06:02.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:06:02.397 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:06:02.397 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.397 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.397 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.397 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.398 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.399 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:06:02.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:06:02.400 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.400 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.400 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.400 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.400 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296741 5.3 5:c190c274:::benchmark_data_smithi043_32659_object129503:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:02.400 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:06:02.400 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 19.314010177, 2024-09-12T22:06:02.400 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.051784984, 2024-09-12T22:06:02.400 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.400 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.400 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.400 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296741 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016859+0000", 2024-09-12T22:06:02.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5600000000000004e-07 2024-09-12T22:06:02.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016863+0000", 2024-09-12T22:06:02.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5510000000000001e-06 2024-09-12T22:06:02.402 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.402 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.402 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.402 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016873+0000", 2024-09-12T22:06:02.402 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5319999999999995e-06 2024-09-12T22:06:02.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016879+0000", 2024-09-12T22:06:02.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5100000000000004e-06 2024-09-12T22:06:02.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016934+0000", 2024-09-12T22:06:02.403 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4734999999999997e-05 2024-09-12T22:06:02.403 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.403 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.403 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.403 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016941+0000", 2024-09-12T22:06:02.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1319999999999996e-06 2024-09-12T22:06:02.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055352+0000", 2024-09-12T22:06:02.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0384109260000001 2024-09-12T22:06:02.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.404 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.404 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.404 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055496+0000", 2024-09-12T22:06:02.404 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014437400000000001 2024-09-12T22:06:02.404 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055835+0000", 2024-09-12T22:06:02.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000338339 2024-09-12T22:06:02.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065163+0000", 2024-09-12T22:06:02.405 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093287690000000006 2024-09-12T22:06:02.405 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.405 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.405 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.405 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068506+0000", 2024-09-12T22:06:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033423620000000002 2024-09-12T22:06:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068557+0000", 2024-09-12T22:06:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1057000000000003e-05 2024-09-12T22:06:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068643+0000", 2024-09-12T22:06:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5741000000000005e-05 2024-09-12T22:06:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296774 5.3 5:c9ea392f:::benchmark_data_smithi043_32659_object129536:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:06:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 19.300264554999998, 2024-09-12T22:06:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0383883359999999, 2024-09-12T22:06:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296774 2024-09-12T22:06:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.408 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:06:02.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.408 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:06:02.408 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.408 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.408 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030604+0000", 2024-09-12T22:06:02.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:06:02.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030607+0000", 2024-09-12T22:06:02.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0860000000000002e-06 2024-09-12T22:06:02.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.409 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.409 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030615+0000", 2024-09-12T22:06:02.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8120000000000008e-06 2024-09-12T22:06:02.409 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030620+0000", 2024-09-12T22:06:02.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6080000000000003e-06 2024-09-12T22:06:02.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030662+0000", 2024-09-12T22:06:02.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1925999999999998e-05 2024-09-12T22:06:02.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030670+0000", 2024-09-12T22:06:02.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2359999999999998e-06 2024-09-12T22:06:02.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065202+0000", 2024-09-12T22:06:02.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0345323989999999 2024-09-12T22:06:02.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065348+0000", 2024-09-12T22:06:02.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145575 2024-09-12T22:06:02.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065476+0000", 2024-09-12T22:06:02.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012800999999999999 2024-09-12T22:06:02.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068690+0000", 2024-09-12T22:06:02.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032143929999999999 2024-09-12T22:06:02.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068869+0000", 2024-09-12T22:06:02.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000179152 2024-09-12T22:06:02.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068914+0000", 2024-09-12T22:06:02.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4629999999999998e-05 2024-09-12T22:06:02.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068992+0000", 2024-09-12T22:06:02.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7885000000000004e-05 2024-09-12T22:06:02.413 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.413 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.413 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.413 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296793 5.3 5:c55bd684:::benchmark_data_smithi043_32659_object129555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:02.414 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:06:02.414 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 19.293447908000001, 2024-09-12T22:06:02.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0317046320000001, 2024-09-12T22:06:02.414 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.414 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.414 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.414 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.414 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.414 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.414 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296793 2024-09-12T22:06:02.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.414 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:06:02.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:06:02.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037421+0000", 2024-09-12T22:06:02.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:06:02.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037425+0000", 2024-09-12T22:06:02.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9539999999999998e-06 2024-09-12T22:06:02.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037432+0000", 2024-09-12T22:06:02.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:06:02.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037436+0000", 2024-09-12T22:06:02.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4320000000000001e-06 2024-09-12T22:06:02.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037496+0000", 2024-09-12T22:06:02.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9385999999999997e-05 2024-09-12T22:06:02.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037503+0000", 2024-09-12T22:06:02.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:06:02.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066427+0000", 2024-09-12T22:06:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.028923877 2024-09-12T22:06:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066519+0000", 2024-09-12T22:06:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1867000000000007e-05 2024-09-12T22:06:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066598+0000", 2024-09-12T22:06:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9175e-05 2024-09-12T22:06:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068804+0000", 2024-09-12T22:06:02.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002205664 2024-09-12T22:06:02.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069004+0000", 2024-09-12T22:06:02.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000200769 2024-09-12T22:06:02.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069050+0000", 2024-09-12T22:06:02.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5522999999999998e-05 2024-09-12T22:06:02.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069125+0000", 2024-09-12T22:06:02.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4530000000000006e-05 2024-09-12T22:06:02.420 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.420 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.420 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.420 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296796 5.3 5:cbc9dd25:::benchmark_data_smithi043_32659_object129558:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:02.420 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:06:02.420 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 19.293150278999999, 2024-09-12T22:06:02.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0315259400000001, 2024-09-12T22:06:02.421 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.421 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.421 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.421 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.421 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.421 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.421 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296796 2024-09-12T22:06:02.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.421 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:06:02.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:06:02.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037719+0000", 2024-09-12T22:06:02.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1069999999999999e-06 2024-09-12T22:06:02.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037723+0000", 2024-09-12T22:06:02.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1400000000000002e-06 2024-09-12T22:06:02.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.423 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037734+0000", 2024-09-12T22:06:02.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0991e-05 2024-09-12T22:06:02.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.423 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.423 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037741+0000", 2024-09-12T22:06:02.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6059999999999997e-06 2024-09-12T22:06:02.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037790+0000", 2024-09-12T22:06:02.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9112e-05 2024-09-12T22:06:02.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037797+0000", 2024-09-12T22:06:02.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:06:02.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067455+0000", 2024-09-12T22:06:02.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0296586320000001 2024-09-12T22:06:02.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067568+0000", 2024-09-12T22:06:02.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112895 2024-09-12T22:06:02.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067686+0000", 2024-09-12T22:06:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117879 2024-09-12T22:06:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068856+0000", 2024-09-12T22:06:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011693949999999999 2024-09-12T22:06:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069132+0000", 2024-09-12T22:06:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027629599999999999 2024-09-12T22:06:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069171+0000", 2024-09-12T22:06:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9536000000000002e-05 2024-09-12T22:06:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069243+0000", 2024-09-12T22:06:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2033999999999995e-05 2024-09-12T22:06:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318065 5.7 5:e8daa0bb:::benchmark_data_smithi043_32659_object150827:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:02.428 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:02.428 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.363091267, 2024-09-12T22:06:02.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041842749, 2024-09-12T22:06:02.428 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.428 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.428 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:06:02.428 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.428 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.428 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.428 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318065 2024-09-12T22:06:02.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.428 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:02.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:02.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.429 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.429 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:02.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:06:02.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967782+0000", 2024-09-12T22:06:02.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0539999999999996e-06 2024-09-12T22:06:02.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968192+0000", 2024-09-12T22:06:02.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000410906 2024-09-12T22:06:02.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968201+0000", 2024-09-12T22:06:02.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7639999999999994e-06 2024-09-12T22:06:02.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971494+0000", 2024-09-12T22:06:02.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032926180000000002 2024-09-12T22:06:02.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971499+0000", 2024-09-12T22:06:02.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0690000000000001e-06 2024-09-12T22:06:02.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009565+0000", 2024-09-12T22:06:02.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038066221 2024-09-12T22:06:02.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.432 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009619+0000", 2024-09-12T22:06:02.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4203000000000003e-05 2024-09-12T22:06:02.432 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.432 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.432 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.432 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318069 5.7 5:ea50145d:::benchmark_data_smithi043_32659_object150831:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:02.432 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:06:02.433 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.362653692, 2024-09-12T22:06:02.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041799116, 2024-09-12T22:06:02.433 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.433 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.433 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:06:02.433 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.433 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.433 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.433 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318069 2024-09-12T22:06:02.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.433 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.433 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.433 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:06:02.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:06:02.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968215+0000", 2024-09-12T22:06:02.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:06:02.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968218+0000", 2024-09-12T22:06:02.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9119999999999998e-06 2024-09-12T22:06:02.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968228+0000", 2024-09-12T22:06:02.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9599999999999995e-06 2024-09-12T22:06:02.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968234+0000", 2024-09-12T22:06:02.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6969999999999996e-06 2024-09-12T22:06:02.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971512+0000", 2024-09-12T22:06:02.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032779160000000001 2024-09-12T22:06:02.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971516+0000", 2024-09-12T22:06:02.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:06:02.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.436 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.436 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009970+0000", 2024-09-12T22:06:02.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03845421 2024-09-12T22:06:02.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010013+0000", 2024-09-12T22:06:02.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3516000000000001e-05 2024-09-12T22:06:02.437 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.437 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.437 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.437 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318078 5.7 5:e5b30db2:::benchmark_data_smithi043_32659_object150840:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:02.437 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:02.437 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.362625864, 2024-09-12T22:06:02.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0418401070000001, 2024-09-12T22:06:02.438 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.438 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.438 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:06:02.438 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.438 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.438 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.438 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318078 2024-09-12T22:06:02.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.438 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:02.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.439 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.439 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:02.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.439 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.439 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:02.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:06:02.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.439 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.439 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968245+0000", 2024-09-12T22:06:02.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:06:02.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.440 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968251+0000", 2024-09-12T22:06:02.440 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2999999999999998e-06 2024-09-12T22:06:02.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.440 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968257+0000", 2024-09-12T22:06:02.440 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6400000000000002e-06 2024-09-12T22:06:02.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.440 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971528+0000", 2024-09-12T22:06:02.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032710619999999999 2024-09-12T22:06:02.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971533+0000", 2024-09-12T22:06:02.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8629999999999999e-06 2024-09-12T22:06:02.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010030+0000", 2024-09-12T22:06:02.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038496683 2024-09-12T22:06:02.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010082+0000", 2024-09-12T22:06:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2478999999999997e-05 2024-09-12T22:06:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318093 5.7 5:e0eb16a2:::benchmark_data_smithi043_32659_object150855:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:06:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.360294473, 2024-09-12T22:06:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0523587110000001, 2024-09-12T22:06:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.442 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318093 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:06:02.443 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.444 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.444 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970575+0000", 2024-09-12T22:06:02.444 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.159e-06 2024-09-12T22:06:02.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.444 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.444 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970579+0000", 2024-09-12T22:06:02.444 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4510000000000002e-06 2024-09-12T22:06:02.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.444 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.445 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970588+0000", 2024-09-12T22:06:02.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1479999999999995e-06 2024-09-12T22:06:02.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.445 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.445 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970595+0000", 2024-09-12T22:06:02.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6919999999999996e-06 2024-09-12T22:06:02.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.445 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.445 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971555+0000", 2024-09-12T22:06:02.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00096029399999999999 2024-09-12T22:06:02.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.446 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971561+0000", 2024-09-12T22:06:02.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7230000000000001e-06 2024-09-12T22:06:02.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.446 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010105+0000", 2024-09-12T22:06:02.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038544361 2024-09-12T22:06:02.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010201+0000", 2024-09-12T22:06:02.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5340000000000005e-05 2024-09-12T22:06:02.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010497+0000", 2024-09-12T22:06:02.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000296273 2024-09-12T22:06:02.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021904+0000", 2024-09-12T22:06:02.448 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011406928 2024-09-12T22:06:02.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022778+0000", 2024-09-12T22:06:02.448 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00087414199999999995 2024-09-12T22:06:02.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022844+0000", 2024-09-12T22:06:02.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6097000000000001e-05 2024-09-12T22:06:02.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.449 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.449 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022932+0000", 2024-09-12T22:06:02.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8103000000000007e-05 2024-09-12T22:06:02.449 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.449 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.449 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.449 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318150 5.7 5:e1ecf58e:::benchmark_data_smithi043_32659_object150912:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:02.450 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:06:02.450 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.334815798999999, 2024-09-12T22:06:02.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027012142, 2024-09-12T22:06:02.450 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.450 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.450 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.450 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.450 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.450 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.450 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318150 2024-09-12T22:06:02.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.450 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.450 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:06:02.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:06:02.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996053+0000", 2024-09-12T22:06:02.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.079e-06 2024-09-12T22:06:02.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996057+0000", 2024-09-12T22:06:02.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3069999999999996e-06 2024-09-12T22:06:02.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996067+0000", 2024-09-12T22:06:02.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9420000000000007e-06 2024-09-12T22:06:02.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996081+0000", 2024-09-12T22:06:02.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3220999999999999e-05 2024-09-12T22:06:02.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.453 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.453 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996124+0000", 2024-09-12T22:06:02.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3545999999999999e-05 2024-09-12T22:06:02.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.453 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.453 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996129+0000", 2024-09-12T22:06:02.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2639999999999999e-06 2024-09-12T22:06:02.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017129+0000", 2024-09-12T22:06:02.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.020999384 2024-09-12T22:06:02.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017210+0000", 2024-09-12T22:06:02.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0968000000000001e-05 2024-09-12T22:06:02.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017279+0000", 2024-09-12T22:06:02.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9484000000000001e-05 2024-09-12T22:06:02.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022949+0000", 2024-09-12T22:06:02.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056697259999999999 2024-09-12T22:06:02.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022986+0000", 2024-09-12T22:06:02.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6610999999999999e-05 2024-09-12T22:06:02.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.455 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.455 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023016+0000", 2024-09-12T22:06:02.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0490000000000001e-05 2024-09-12T22:06:02.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023064+0000", 2024-09-12T22:06:02.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.812e-05 2024-09-12T22:06:02.456 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.456 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.456 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.456 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318162 5.7 5:e4ee45f3:::benchmark_data_smithi043_32659_object150924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:02.457 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:06:02.457 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.331243883000001, 2024-09-12T22:06:02.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0259081619999999, 2024-09-12T22:06:02.457 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.457 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.457 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.457 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.457 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.457 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.457 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318162 2024-09-12T22:06:02.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.457 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:06:02.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:06:02.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999625+0000", 2024-09-12T22:06:02.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:06:02.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999627+0000", 2024-09-12T22:06:02.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8260000000000001e-06 2024-09-12T22:06:02.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999634+0000", 2024-09-12T22:06:02.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8730000000000001e-06 2024-09-12T22:06:02.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999639+0000", 2024-09-12T22:06:02.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0710000000000002e-06 2024-09-12T22:06:02.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999681+0000", 2024-09-12T22:06:02.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1488e-05 2024-09-12T22:06:02.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999688+0000", 2024-09-12T22:06:02.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9229999999999996e-06 2024-09-12T22:06:02.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.020983+0000", 2024-09-12T22:06:02.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0212956630000001 2024-09-12T22:06:02.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021059+0000", 2024-09-12T22:06:02.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5445999999999996e-05 2024-09-12T22:06:02.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021123+0000", 2024-09-12T22:06:02.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4080999999999999e-05 2024-09-12T22:06:02.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.024526+0000", 2024-09-12T22:06:02.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003403241 2024-09-12T22:06:02.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025454+0000", 2024-09-12T22:06:02.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00092807600000000001 2024-09-12T22:06:02.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025486+0000", 2024-09-12T22:06:02.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1430999999999998e-05 2024-09-12T22:06:02.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025532+0000", 2024-09-12T22:06:02.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6428999999999999e-05 2024-09-12T22:06:02.463 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.463 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.463 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.463 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:326467 5.1 5:87ee908b:::benchmark_data_smithi043_32659_object159229:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T22:06:02.464 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:06:02.464 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.3088508890000004, 2024-09-12T22:06:02.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038557899, 2024-09-12T22:06:02.464 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:02.464 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:02.464 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:02.464 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:02.464 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:02.464 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:02.464 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 326467 2024-09-12T22:06:02.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.464 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:02.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:02.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:06:02.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:02.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:06:02.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:02.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:02.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022018+0000", 2024-09-12T22:06:02.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5000000000000001e-07 2024-09-12T22:06:02.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:02.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022022+0000", 2024-09-12T22:06:02.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2799999999999997e-06 2024-09-12T22:06:02.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:02.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022032+0000", 2024-09-12T22:06:02.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0035e-05 2024-09-12T22:06:02.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:02.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022040+0000", 2024-09-12T22:06:02.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5970000000000003e-06 2024-09-12T22:06:02.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022093+0000", 2024-09-12T22:06:02.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3718999999999998e-05 2024-09-12T22:06:02.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:02.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022101+0000", 2024-09-12T22:06:02.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3579999999999997e-06 2024-09-12T22:06:02.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:02.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056468+0000", 2024-09-12T22:06:02.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.034366761 2024-09-12T22:06:02.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:02.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056576+0000", 2024-09-12T22:06:02.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000108859 2024-09-12T22:06:02.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:02.468 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056682+0000", 2024-09-12T22:06:02.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105358 2024-09-12T22:06:02.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:02.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.057971+0000", 2024-09-12T22:06:02.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012889749999999999 2024-09-12T22:06:02.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:02.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060452+0000", 2024-09-12T22:06:02.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024813980000000001 2024-09-12T22:06:02.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:02.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060496+0000", 2024-09-12T22:06:02.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3875999999999998e-05 2024-09-12T22:06:02.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:02.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:02.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:02.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060575+0000", 2024-09-12T22:06:02.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8832999999999996e-05 2024-09-12T22:06:02.470 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.470 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.470 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.470 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:02.470 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:02.470 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:06:02.471 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:06:02.472 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:06:02.472 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:06:02.472 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:06:02.473 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:02.471+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:02.474 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:06:02.474 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:06:02.478 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:06:02.478 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:06:02.572 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:02.571+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:02.584 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:02.584 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:02.593 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:06:02.672 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:02.671+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:02.695 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:02.695 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:02.705 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:06:02.773 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:02.773+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:02.847 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:02.847 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:02.856 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:06:02.900 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:02.899+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:02.963 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:02.963 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:02.972 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:06:02.974 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:02.973+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:03.013 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:06:03.075 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:03.075+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:03.116 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:03.117 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:03.126 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:06:03.209 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:03.208+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:03.267 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:03.268 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:03.276 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:06:03.277 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:03.276+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:03.378 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:03.377+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:03.379 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:03.379 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:03.388 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:06:03.479 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:03.478+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:03.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~100s 2024-09-12T22:06:03.530 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:03.530 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:03.538 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:06:03.580 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:03.579+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:03.680 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:03.680 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:03.681 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:03.679+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:03.688 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:06:03.781 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:03.780+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:03.794 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:03.794 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:03.803 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:06:03.883 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:03.882+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:03.946 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:03.946 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:03.954 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:06:03.998 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:03.997+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:04.006 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-09-12T22:06:04.058 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:04.059 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:04.067 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:06:04.109 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:04.108+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:04.172 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:04.172 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:04.180 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:06:04.224 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:04.223+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:04.282 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:04.282 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:04.285 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:04.285+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:04.290 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:06:04.354 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-12T22:06:04.354 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-12T22:06:04.387 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:04.386+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:04.432 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:04.432 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:04.441 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:06:04.479 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:06:04.487 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:04.486+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:04.546 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-12T22:06:04.547 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:06:04.555 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:06:04.588 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:04.587+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:06:04.607 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-09-12T22:06:04.607 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:06:04.624 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-09-12T22:06:04.624 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:06:04.628 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:06:04.629 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:06:04.657 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:06:04.657 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:06:04.657 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:06:04.657 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:06:04.657 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:06:04.666 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:06:04.709 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:04.708+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:04.770 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:06:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:06:04.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:06:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:06:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:06:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.803683012, 2024-09-12T22:06:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:06:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:06:04.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:06:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:06:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:06:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:06:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:06:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:06:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:06:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:06:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:06:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:06:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:06:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:06:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:06:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:06:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:06:04.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:06:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:06:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:06:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:06:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:06:04.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:06:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:06:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:06:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:06:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:06:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.776 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:06:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:06:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:06:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:06:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:06:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:06:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:06:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:06:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.801650287000001, 2024-09-12T22:06:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:06:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:06:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:06:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:06:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:06:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:06:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:06:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:06:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:06:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:06:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:06:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:06:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:06:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:06:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:06:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:06:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:06:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:06:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:06:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:06:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:06:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:06:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.798638023000002, 2024-09-12T22:06:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:06:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:06:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:06:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:06:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:06:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:06:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:06:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:06:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:06:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:06:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:06:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:06:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:06:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:06:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:06:04.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:06:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:06:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:06:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:06:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:06:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:06:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:06:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:06:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:06:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:06:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:06:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:06:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:06:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:06:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:06:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:06:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.797651533, 2024-09-12T22:06:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:06:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:06:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:06:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:06:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:06:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:06:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:06:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:06:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:06:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:06:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:06:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:06:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:06:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:06:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:06:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:06:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:06:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:06:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:06:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:06:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:06:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:06:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:06:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:06:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:06:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:06:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:06:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:06:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:06:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:06:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:06:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.792564898999998, 2024-09-12T22:06:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:06:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:06:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:06:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:06:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:06:04.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:06:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:06:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:06:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:06:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:06:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:06:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:06:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:06:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:06:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:06:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:06:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:06:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:06:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:06:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:06:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:06:04.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:06:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:06:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:06:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:06:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:06:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:06:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:06:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:06:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:06:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.789809927, 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:06:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:06:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:06:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:06:04.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:06:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:06:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:06:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:06:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:06:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:06:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:06:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:06:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:06:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:06:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:06:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:06:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:06:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:06:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:06:04.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:06:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:06:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:06:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:06:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:06:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:06:04.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:06:04.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.812 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:06:04.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:06:04.812 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.812 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.812 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.812 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:04.812 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:06:04.812 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.781835041999997, 2024-09-12T22:06:04.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:06:04.813 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.813 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.813 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.813 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.813 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.813 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.813 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:06:04.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.813 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.813 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:06:04.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:06:04.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:06:04.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:06:04.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:06:04.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:06:04.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:06:04.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:06:04.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:06:04.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.816 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:06:04.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:06:04.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.816 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:06:04.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:06:04.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.818 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.773909265999997, 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.819 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:06:04.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:06:04.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:06:04.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:06:04.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:06:04.821 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:06:04.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:06:04.821 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:06:04.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:06:04.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:06:04.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.822 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:06:04.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:06:04.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.822 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:06:04.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:06:04.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:06:04.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:06:04.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.823 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:06:04.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:06:04.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.823 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:06:04.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:06:04.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:06:04.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:06:04.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:06:04.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:06:04.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:06:04.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:06:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:06:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:06:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:06:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.772412983999999, 2024-09-12T22:06:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:06:04.826 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.826 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.826 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.826 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.826 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.826 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.826 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:06:04.826 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.826 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.826 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.826 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.826 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:06:04.826 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:06:04.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:06:04.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:06:04.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:06:04.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:06:04.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:06:04.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:06:04.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:06:04.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:06:04.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:06:04.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:06:04.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:06:04.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:06:04.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.830 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:06:04.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:06:04.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.832 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.832 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:06:04.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:06:04.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:06:04.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:06:04.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:06:04.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:06:04.834 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.834 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.835 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.835 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.835 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296741 5.3 5:c190c274:::benchmark_data_smithi043_32659_object129503:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:04.835 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:06:04.835 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.751105372000001, 2024-09-12T22:06:04.835 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.051784984, 2024-09-12T22:06:04.835 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.835 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.835 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.835 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.836 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.836 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.836 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296741 2024-09-12T22:06:04.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.836 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.836 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.836 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.836 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:06:04.836 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.836 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.837 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:06:04.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.837 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016859+0000", 2024-09-12T22:06:04.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5600000000000004e-07 2024-09-12T22:06:04.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.837 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016863+0000", 2024-09-12T22:06:04.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5510000000000001e-06 2024-09-12T22:06:04.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016873+0000", 2024-09-12T22:06:04.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5319999999999995e-06 2024-09-12T22:06:04.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016879+0000", 2024-09-12T22:06:04.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5100000000000004e-06 2024-09-12T22:06:04.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016934+0000", 2024-09-12T22:06:04.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4734999999999997e-05 2024-09-12T22:06:04.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.839 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.839 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016941+0000", 2024-09-12T22:06:04.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1319999999999996e-06 2024-09-12T22:06:04.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.839 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.839 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055352+0000", 2024-09-12T22:06:04.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0384109260000001 2024-09-12T22:06:04.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055496+0000", 2024-09-12T22:06:04.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014437400000000001 2024-09-12T22:06:04.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055835+0000", 2024-09-12T22:06:04.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000338339 2024-09-12T22:06:04.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065163+0000", 2024-09-12T22:06:04.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093287690000000006 2024-09-12T22:06:04.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068506+0000", 2024-09-12T22:06:04.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033423620000000002 2024-09-12T22:06:04.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068557+0000", 2024-09-12T22:06:04.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1057000000000003e-05 2024-09-12T22:06:04.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.842 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.842 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068643+0000", 2024-09-12T22:06:04.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5741000000000005e-05 2024-09-12T22:06:04.842 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.842 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.842 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.842 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296774 5.3 5:c9ea392f:::benchmark_data_smithi043_32659_object129536:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:04.842 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:06:04.842 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.73735975, 2024-09-12T22:06:04.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0383883359999999, 2024-09-12T22:06:04.842 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.842 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.843 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.843 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.843 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.843 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.843 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296774 2024-09-12T22:06:04.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.843 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:06:04.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:06:04.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030604+0000", 2024-09-12T22:06:04.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:06:04.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030607+0000", 2024-09-12T22:06:04.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0860000000000002e-06 2024-09-12T22:06:04.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030615+0000", 2024-09-12T22:06:04.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8120000000000008e-06 2024-09-12T22:06:04.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030620+0000", 2024-09-12T22:06:04.846 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6080000000000003e-06 2024-09-12T22:06:04.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.846 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030662+0000", 2024-09-12T22:06:04.846 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1925999999999998e-05 2024-09-12T22:06:04.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.846 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030670+0000", 2024-09-12T22:06:04.846 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2359999999999998e-06 2024-09-12T22:06:04.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065202+0000", 2024-09-12T22:06:04.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0345323989999999 2024-09-12T22:06:04.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.847 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065348+0000", 2024-09-12T22:06:04.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145575 2024-09-12T22:06:04.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.847 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065476+0000", 2024-09-12T22:06:04.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012800999999999999 2024-09-12T22:06:04.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068690+0000", 2024-09-12T22:06:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032143929999999999 2024-09-12T22:06:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068869+0000", 2024-09-12T22:06:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000179152 2024-09-12T22:06:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068914+0000", 2024-09-12T22:06:04.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4629999999999998e-05 2024-09-12T22:06:04.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068992+0000", 2024-09-12T22:06:04.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7885000000000004e-05 2024-09-12T22:06:04.849 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.849 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.849 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.849 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296793 5.3 5:c55bd684:::benchmark_data_smithi043_32659_object129555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:04.849 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:06:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.730543102999999, 2024-09-12T22:06:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0317046320000001, 2024-09-12T22:06:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296793 2024-09-12T22:06:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:06:04.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.851 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.851 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:06:04.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.851 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.851 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037421+0000", 2024-09-12T22:06:04.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:06:04.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037425+0000", 2024-09-12T22:06:04.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9539999999999998e-06 2024-09-12T22:06:04.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037432+0000", 2024-09-12T22:06:04.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:06:04.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037436+0000", 2024-09-12T22:06:04.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4320000000000001e-06 2024-09-12T22:06:04.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037496+0000", 2024-09-12T22:06:04.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9385999999999997e-05 2024-09-12T22:06:04.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037503+0000", 2024-09-12T22:06:04.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:06:04.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066427+0000", 2024-09-12T22:06:04.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.028923877 2024-09-12T22:06:04.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.854 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066519+0000", 2024-09-12T22:06:04.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1867000000000007e-05 2024-09-12T22:06:04.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.854 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066598+0000", 2024-09-12T22:06:04.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9175e-05 2024-09-12T22:06:04.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068804+0000", 2024-09-12T22:06:04.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002205664 2024-09-12T22:06:04.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069004+0000", 2024-09-12T22:06:04.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000200769 2024-09-12T22:06:04.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069050+0000", 2024-09-12T22:06:04.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5522999999999998e-05 2024-09-12T22:06:04.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069125+0000", 2024-09-12T22:06:04.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4530000000000006e-05 2024-09-12T22:06:04.856 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.856 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.856 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.856 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296796 5.3 5:cbc9dd25:::benchmark_data_smithi043_32659_object129558:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:04.856 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:06:04.856 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.730245474, 2024-09-12T22:06:04.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0315259400000001, 2024-09-12T22:06:04.857 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.857 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.857 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.857 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.857 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.857 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.857 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296796 2024-09-12T22:06:04.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.857 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:06:04.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.858 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.858 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.858 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:06:04.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.858 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.858 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.858 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037719+0000", 2024-09-12T22:06:04.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1069999999999999e-06 2024-09-12T22:06:04.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.858 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.858 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.858 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037723+0000", 2024-09-12T22:06:04.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1400000000000002e-06 2024-09-12T22:06:04.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.859 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037734+0000", 2024-09-12T22:06:04.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0991e-05 2024-09-12T22:06:04.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.859 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037741+0000", 2024-09-12T22:06:04.859 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6059999999999997e-06 2024-09-12T22:06:04.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.859 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037790+0000", 2024-09-12T22:06:04.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9112e-05 2024-09-12T22:06:04.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037797+0000", 2024-09-12T22:06:04.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:06:04.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.860 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.860 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067455+0000", 2024-09-12T22:06:04.860 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0296586320000001 2024-09-12T22:06:04.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067568+0000", 2024-09-12T22:06:04.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112895 2024-09-12T22:06:04.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067686+0000", 2024-09-12T22:06:04.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117879 2024-09-12T22:06:04.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068856+0000", 2024-09-12T22:06:04.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011693949999999999 2024-09-12T22:06:04.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069132+0000", 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027629599999999999 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069171+0000", 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9536000000000002e-05 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069243+0000", 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2033999999999995e-05 2024-09-12T22:06:04.862 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318065 5.7 5:e8daa0bb:::benchmark_data_smithi043_32659_object150827:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.800186461999999, 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041842749, 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.863 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318065 2024-09-12T22:06:04.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.864 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:04.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:04.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967782+0000", 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0539999999999996e-06 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968192+0000", 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000410906 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968201+0000", 2024-09-12T22:06:04.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7639999999999994e-06 2024-09-12T22:06:04.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971494+0000", 2024-09-12T22:06:04.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032926180000000002 2024-09-12T22:06:04.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971499+0000", 2024-09-12T22:06:04.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0690000000000001e-06 2024-09-12T22:06:04.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009565+0000", 2024-09-12T22:06:04.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038066221 2024-09-12T22:06:04.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009619+0000", 2024-09-12T22:06:04.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4203000000000003e-05 2024-09-12T22:06:04.867 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.867 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.867 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.868 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318069 5.7 5:ea50145d:::benchmark_data_smithi043_32659_object150831:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:04.868 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:06:04.868 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.799748887, 2024-09-12T22:06:04.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041799116, 2024-09-12T22:06:04.868 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.868 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.868 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:06:04.868 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.868 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.868 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.868 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318069 2024-09-12T22:06:04.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.868 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:06:04.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:06:04.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968215+0000", 2024-09-12T22:06:04.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:06:04.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968218+0000", 2024-09-12T22:06:04.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9119999999999998e-06 2024-09-12T22:06:04.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968228+0000", 2024-09-12T22:06:04.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9599999999999995e-06 2024-09-12T22:06:04.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968234+0000", 2024-09-12T22:06:04.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6969999999999996e-06 2024-09-12T22:06:04.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.871 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.871 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971512+0000", 2024-09-12T22:06:04.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032779160000000001 2024-09-12T22:06:04.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.871 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.871 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971516+0000", 2024-09-12T22:06:04.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:06:04.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.871 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.872 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009970+0000", 2024-09-12T22:06:04.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03845421 2024-09-12T22:06:04.872 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.872 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010013+0000", 2024-09-12T22:06:04.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3516000000000001e-05 2024-09-12T22:06:04.872 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.872 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.872 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318078 5.7 5:e5b30db2:::benchmark_data_smithi043_32659_object150840:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.799721058999999, 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0418401070000001, 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318078 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.873 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:04.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:04.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:04.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:06:04.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968245+0000", 2024-09-12T22:06:04.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:06:04.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968251+0000", 2024-09-12T22:06:04.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2999999999999998e-06 2024-09-12T22:06:04.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968257+0000", 2024-09-12T22:06:04.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6400000000000002e-06 2024-09-12T22:06:04.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971528+0000", 2024-09-12T22:06:04.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032710619999999999 2024-09-12T22:06:04.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971533+0000", 2024-09-12T22:06:04.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8629999999999999e-06 2024-09-12T22:06:04.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010030+0000", 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038496683 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010082+0000", 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2478999999999997e-05 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318093 5.7 5:e0eb16a2:::benchmark_data_smithi043_32659_object150855:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:06:04.877 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.797389667999999, 2024-09-12T22:06:04.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0523587110000001, 2024-09-12T22:06:04.878 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.878 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.878 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.878 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.878 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.878 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.878 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318093 2024-09-12T22:06:04.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.878 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:06:04.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970575+0000", 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.159e-06 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970579+0000", 2024-09-12T22:06:04.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4510000000000002e-06 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970588+0000", 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1479999999999995e-06 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970595+0000", 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6919999999999996e-06 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971555+0000", 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00096029399999999999 2024-09-12T22:06:04.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971561+0000", 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7230000000000001e-06 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010105+0000", 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038544361 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010201+0000", 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5340000000000005e-05 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010497+0000", 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000296273 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021904+0000", 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011406928 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022778+0000", 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00087414199999999995 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022844+0000", 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6097000000000001e-05 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022932+0000", 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8103000000000007e-05 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318150 5.7 5:e1ecf58e:::benchmark_data_smithi043_32659_object150912:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.771910994000001, 2024-09-12T22:06:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027012142, 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318150 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:06:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996053+0000", 2024-09-12T22:06:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.079e-06 2024-09-12T22:06:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996057+0000", 2024-09-12T22:06:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3069999999999996e-06 2024-09-12T22:06:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996067+0000", 2024-09-12T22:06:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9420000000000007e-06 2024-09-12T22:06:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996081+0000", 2024-09-12T22:06:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3220999999999999e-05 2024-09-12T22:06:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996124+0000", 2024-09-12T22:06:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3545999999999999e-05 2024-09-12T22:06:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996129+0000", 2024-09-12T22:06:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2639999999999999e-06 2024-09-12T22:06:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017129+0000", 2024-09-12T22:06:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.020999384 2024-09-12T22:06:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017210+0000", 2024-09-12T22:06:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0968000000000001e-05 2024-09-12T22:06:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017279+0000", 2024-09-12T22:06:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9484000000000001e-05 2024-09-12T22:06:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022949+0000", 2024-09-12T22:06:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056697259999999999 2024-09-12T22:06:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022986+0000", 2024-09-12T22:06:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6610999999999999e-05 2024-09-12T22:06:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023016+0000", 2024-09-12T22:06:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0490000000000001e-05 2024-09-12T22:06:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023064+0000", 2024-09-12T22:06:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.812e-05 2024-09-12T22:06:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318162 5.7 5:e4ee45f3:::benchmark_data_smithi043_32659_object150924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:06:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 12.768339078, 2024-09-12T22:06:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0259081619999999, 2024-09-12T22:06:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318162 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:06:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999625+0000", 2024-09-12T22:06:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:06:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999627+0000", 2024-09-12T22:06:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8260000000000001e-06 2024-09-12T22:06:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999634+0000", 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8730000000000001e-06 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999639+0000", 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0710000000000002e-06 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999681+0000", 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1488e-05 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999688+0000", 2024-09-12T22:06:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9229999999999996e-06 2024-09-12T22:06:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.020983+0000", 2024-09-12T22:06:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0212956630000001 2024-09-12T22:06:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021059+0000", 2024-09-12T22:06:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5445999999999996e-05 2024-09-12T22:06:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021123+0000", 2024-09-12T22:06:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4080999999999999e-05 2024-09-12T22:06:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.024526+0000", 2024-09-12T22:06:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003403241 2024-09-12T22:06:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025454+0000", 2024-09-12T22:06:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00092807600000000001 2024-09-12T22:06:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025486+0000", 2024-09-12T22:06:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1430999999999998e-05 2024-09-12T22:06:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025532+0000", 2024-09-12T22:06:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6428999999999999e-05 2024-09-12T22:06:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:326467 5.1 5:87ee908b:::benchmark_data_smithi043_32659_object159229:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T22:06:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:06:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 8.7459460839999998, 2024-09-12T22:06:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038557899, 2024-09-12T22:06:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 326467 2024-09-12T22:06:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022018+0000", 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5000000000000001e-07 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:04.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022022+0000", 2024-09-12T22:06:04.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2799999999999997e-06 2024-09-12T22:06:04.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:04.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022032+0000", 2024-09-12T22:06:04.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0035e-05 2024-09-12T22:06:04.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.899 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:04.899 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022040+0000", 2024-09-12T22:06:04.899 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5970000000000003e-06 2024-09-12T22:06:04.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022093+0000", 2024-09-12T22:06:04.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3718999999999998e-05 2024-09-12T22:06:04.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:04.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022101+0000", 2024-09-12T22:06:04.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3579999999999997e-06 2024-09-12T22:06:04.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.900 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:04.900 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056468+0000", 2024-09-12T22:06:04.900 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.034366761 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056576+0000", 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000108859 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056682+0000", 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105358 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.057971+0000", 2024-09-12T22:06:04.901 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012889749999999999 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060452+0000", 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024813980000000001 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060496+0000", 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3875999999999998e-05 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060575+0000", 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8832999999999996e-05 2024-09-12T22:06:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.903 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.903 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.903 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:04.903 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:04.903 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:06:04.904 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-12T22:06:04.903+0000 7f75a353b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30467) UID: 0 2024-09-12T22:06:04.904 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:06:05.005 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-09-12T22:06:05.004+0000 7f8b75f5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30775) UID: 0 2024-09-12T22:06:05.008 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:06:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:06:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-12T22:06:05.009 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:06:05.009 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'unique_pool_0' removed 2024-09-12T22:06:05.021 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:06:05.025 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-12T22:06:05.033 INFO:tasks.thrashosds:joining thrashosds 2024-09-12T22:06:05.177 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:06:05.177 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-12T22:06:05.177 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-12T22:06:05.177 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-12T22:06:05.177 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:06:05.185 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T22:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-12T22:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-12T22:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-12T22:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117366 5.1 5:863705a0:::benchmark_data_smithi043_32659_object117365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.876132287000004, 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.123200975, 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117366 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410604+0000", 2024-09-12T22:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410605+0000", 2024-09-12T22:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.55e-06 2024-09-12T22:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410732+0000", 2024-09-12T22:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126122 2024-09-12T22:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410752+0000", 2024-09-12T22:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0177e-05 2024-09-12T22:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410762+0000", 2024-09-12T22:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0723000000000001e-05 2024-09-12T22:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410810+0000", 2024-09-12T22:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7477e-05 2024-09-12T22:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410817+0000", 2024-09-12T22:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6760000000000001e-06 2024-09-12T22:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533720+0000", 2024-09-12T22:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1229037799999999 2024-09-12T22:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533805+0000", 2024-09-12T22:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4469999999999996e-05 2024-09-12T22:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117375 5.c 5:361c4603:::benchmark_data_smithi043_32659_object117374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.875952357000003, 2024-09-12T22:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125526555, 2024-09-12T22:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117375 2024-09-12T22:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410784+0000", 2024-09-12T22:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410785+0000", 2024-09-12T22:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410824+0000", 2024-09-12T22:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9860000000000001e-05 2024-09-12T22:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410833+0000", 2024-09-12T22:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8389999999999996e-06 2024-09-12T22:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410839+0000", 2024-09-12T22:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7710000000000003e-06 2024-09-12T22:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410867+0000", 2024-09-12T22:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8421000000000001e-05 2024-09-12T22:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410871+0000", 2024-09-12T22:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8600000000000003e-06 2024-09-12T22:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536261+0000", 2024-09-12T22:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.125389915 2024-09-12T22:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536310+0000", 2024-09-12T22:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9129999999999999e-05 2024-09-12T22:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117379 5.5 5:a3a07f93:::benchmark_data_smithi043_32659_object117378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.875885916000001, 2024-09-12T22:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.12349561, 2024-09-12T22:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-12T22:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117379 2024-09-12T22:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410850+0000", 2024-09-12T22:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410851+0000", 2024-09-12T22:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410884+0000", 2024-09-12T22:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3138e-05 2024-09-12T22:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410892+0000", 2024-09-12T22:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410897+0000", 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1340000000000003e-06 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410930+0000", 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3064000000000001e-05 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410936+0000", 2024-09-12T22:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6210000000000001e-06 2024-09-12T22:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534250+0000", 2024-09-12T22:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1233139860000001 2024-09-12T22:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534346+0000", 2024-09-12T22:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6225999999999997e-05 2024-09-12T22:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117382 5.c 5:36091087:::benchmark_data_smithi043_32659_object117381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.875829472999996, 2024-09-12T22:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.139255599, 2024-09-12T22:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117382 2024-09-12T22:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410907+0000", 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410950+0000", 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2168e-05 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410958+0000", 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2190000000000004e-06 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410965+0000", 2024-09-12T22:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5209999999999997e-06 2024-09-12T22:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410991+0000", 2024-09-12T22:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5554999999999998e-05 2024-09-12T22:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410994+0000", 2024-09-12T22:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536476+0000", 2024-09-12T22:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1254820290000001 2024-09-12T22:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536608+0000", 2024-09-12T22:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013159700000000001 2024-09-12T22:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536926+0000", 2024-09-12T22:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031815599999999999 2024-09-12T22:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548087+0000", 2024-09-12T22:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011160676 2024-09-12T22:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550054+0000", 2024-09-12T22:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019677599999999998 2024-09-12T22:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550109+0000", 2024-09-12T22:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4639999999999999e-05 2024-09-12T22:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.550162+0000", 2024-09-12T22:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3266999999999997e-05 2024-09-12T22:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117390 5.1 5:833025e8:::benchmark_data_smithi043_32659_object117389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.875761013000002, 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.128001145, 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117390 2024-09-12T22:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410975+0000", 2024-09-12T22:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.410976+0000", 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9999999999999998e-07 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411009+0000", 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3803000000000001e-05 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411018+0000", 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2519999999999999e-06 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411023+0000", 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411062+0000", 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9854999999999997e-05 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411067+0000", 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2729999999999996e-06 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.533976+0000", 2024-09-12T22:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.122909632 2024-09-12T22:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534130+0000", 2024-09-12T22:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153881 2024-09-12T22:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534303+0000", 2024-09-12T22:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017327299999999999 2024-09-12T22:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538794+0000", 2024-09-12T22:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044906360000000001 2024-09-12T22:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538811+0000", 2024-09-12T22:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6943e-05 2024-09-12T22:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538889+0000", 2024-09-12T22:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8308999999999999e-05 2024-09-12T22:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538976+0000", 2024-09-12T22:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6949999999999999e-05 2024-09-12T22:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117391 5.3 5:c8a1fbd3:::benchmark_data_smithi043_32659_object117390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.875703278000003, 2024-09-12T22:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1076124489999999, 2024-09-12T22:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117391 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411033+0000", 2024-09-12T22:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3700000000000001e-07 2024-09-12T22:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411076+0000", 2024-09-12T22:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3095e-05 2024-09-12T22:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411085+0000", 2024-09-12T22:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5869999999999993e-06 2024-09-12T22:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411090+0000", 2024-09-12T22:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411136+0000", 2024-09-12T22:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6421999999999997e-05 2024-09-12T22:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411145+0000", 2024-09-12T22:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0110000000000006e-06 2024-09-12T22:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511018+0000", 2024-09-12T22:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.099872916 2024-09-12T22:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511181+0000", 2024-09-12T22:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016342400000000001 2024-09-12T22:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.511371+0000", 2024-09-12T22:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189132 2024-09-12T22:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518421+0000", 2024-09-12T22:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070502129999999996 2024-09-12T22:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518476+0000", 2024-09-12T22:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5241999999999997e-05 2024-09-12T22:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518548+0000", 2024-09-12T22:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2175999999999995e-05 2024-09-12T22:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.518645+0000", 2024-09-12T22:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-05 2024-09-12T22:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117392 5.5 5:a612e338:::benchmark_data_smithi043_32659_object117391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.875635586000001, 2024-09-12T22:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.126295847, 2024-09-12T22:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117392 2024-09-12T22:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411101+0000", 2024-09-12T22:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5299999999999999e-07 2024-09-12T22:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411135+0000", 2024-09-12T22:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4017000000000003e-05 2024-09-12T22:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411142+0000", 2024-09-12T22:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4790000000000001e-06 2024-09-12T22:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411147+0000", 2024-09-12T22:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9170000000000003e-06 2024-09-12T22:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411176+0000", 2024-09-12T22:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411182+0000", 2024-09-12T22:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6200000000000001e-06 2024-09-12T22:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534420+0000", 2024-09-12T22:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1232374899999999 2024-09-12T22:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534563+0000", 2024-09-12T22:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319699999999999 2024-09-12T22:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.534733+0000", 2024-09-12T22:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016948000000000001 2024-09-12T22:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536974+0000", 2024-09-12T22:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022418289999999999 2024-09-12T22:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537244+0000", 2024-09-12T22:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026902399999999998 2024-09-12T22:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537304+0000", 2024-09-12T22:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0519000000000001e-05 2024-09-12T22:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.537396+0000", 2024-09-12T22:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2429000000000006e-05 2024-09-12T22:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117393 5.1 5:89c030d3:::benchmark_data_smithi043_32659_object117392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T22:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.875580524, 2024-09-12T22:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.133633865, 2024-09-12T22:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117393 2024-09-12T22:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411156+0000", 2024-09-12T22:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411192+0000", 2024-09-12T22:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5515000000000001e-05 2024-09-12T22:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411200+0000", 2024-09-12T22:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9929999999999995e-06 2024-09-12T22:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411205+0000", 2024-09-12T22:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7089999999999999e-06 2024-09-12T22:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411236+0000", 2024-09-12T22:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0827999999999997e-05 2024-09-12T22:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:33.411240+0000", 2024-09-12T22:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536375+0000", 2024-09-12T22:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1251350410000001 2024-09-12T22:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536492+0000", 2024-09-12T22:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011634200000000001 2024-09-12T22:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.536640+0000", 2024-09-12T22:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148331 2024-09-12T22:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540431+0000", 2024-09-12T22:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003790608 2024-09-12T22:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544687+0000", 2024-09-12T22:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042565420000000003 2024-09-12T22:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544719+0000", 2024-09-12T22:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2342000000000003e-05 2024-09-12T22:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.544790+0000", 2024-09-12T22:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0117999999999995e-05 2024-09-12T22:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117394 5.c 5:349f832b:::benchmark_data_smithi043_32659_object117393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.834933004000007, 2024-09-12T22:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100505898, 2024-09-12T22:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117394 2024-09-12T22:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451803+0000", 2024-09-12T22:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451806+0000", 2024-09-12T22:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.565e-06 2024-09-12T22:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451896+0000", 2024-09-12T22:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0631999999999996e-05 2024-09-12T22:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451917+0000", 2024-09-12T22:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0285999999999999e-05 2024-09-12T22:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.451928+0000", 2024-09-12T22:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1759999999999999e-05 2024-09-12T22:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452014+0000", 2024-09-12T22:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.452026+0000", 2024-09-12T22:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2272e-05 2024-09-12T22:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538841+0000", 2024-09-12T22:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086814700999999994 2024-09-12T22:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.538954+0000", 2024-09-12T22:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011354900000000001 2024-09-12T22:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.539116+0000", 2024-09-12T22:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016205200000000001 2024-09-12T22:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548090+0000", 2024-09-12T22:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0089735739999999998 2024-09-12T22:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552177+0000", 2024-09-12T22:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040875269999999997 2024-09-12T22:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552232+0000", 2024-09-12T22:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4530000000000001e-05 2024-09-12T22:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552309+0000", 2024-09-12T22:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7198000000000002e-05 2024-09-12T22:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:117395 5.c 5:388aac11:::benchmark_data_smithi043_32659_object117394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T22:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.832319276000007, 2024-09-12T22:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.098564521000000002, 2024-09-12T22:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117395 2024-09-12T22:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454417+0000", 2024-09-12T22:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454418+0000", 2024-09-12T22:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.161e-06 2024-09-12T22:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454477+0000", 2024-09-12T22:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9246999999999997e-05 2024-09-12T22:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454493+0000", 2024-09-12T22:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5710999999999999e-05 2024-09-12T22:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454502+0000", 2024-09-12T22:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.585e-06 2024-09-12T22:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454551+0000", 2024-09-12T22:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9762999999999998e-05 2024-09-12T22:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.454558+0000", 2024-09-12T22:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8789999999999997e-06 2024-09-12T22:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540864+0000", 2024-09-12T22:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.086306233999999996 2024-09-12T22:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.540944+0000", 2024-09-12T22:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9306000000000003e-05 2024-09-12T22:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.541061+0000", 2024-09-12T22:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011670799999999999 2024-09-12T22:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.548093+0000", 2024-09-12T22:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070324020000000001 2024-09-12T22:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552874+0000", 2024-09-12T22:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047806869999999996 2024-09-12T22:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552908+0000", 2024-09-12T22:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4186000000000001e-05 2024-09-12T22:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:34.552981+0000", 2024-09-12T22:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3652000000000006e-05 2024-09-12T22:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128881 5.c 5:377bf234:::benchmark_data_smithi043_32659_object128880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.287105179999998, 2024-09-12T22:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097752713000000005, 2024-09-12T22:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128881 2024-09-12T22:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999631+0000", 2024-09-12T22:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999632+0000", 2024-09-12T22:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999751+0000", 2024-09-12T22:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011955600000000001 2024-09-12T22:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999768+0000", 2024-09-12T22:06:05.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6816999999999998e-05 2024-09-12T22:06:05.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999775+0000", 2024-09-12T22:06:05.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4470000000000003e-06 2024-09-12T22:06:05.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999826+0000", 2024-09-12T22:06:05.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1449000000000002e-05 2024-09-12T22:06:05.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:38.999959+0000", 2024-09-12T22:06:05.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000133368 2024-09-12T22:06:05.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000080+0000", 2024-09-12T22:06:05.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120259 2024-09-12T22:06:05.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002102+0000", 2024-09-12T22:06:05.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020219090000000001 2024-09-12T22:06:05.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097104+0000", 2024-09-12T22:06:05.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095002642999999998 2024-09-12T22:06:05.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097271+0000", 2024-09-12T22:06:05.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016677099999999999 2024-09-12T22:06:05.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.097384+0000", 2024-09-12T22:06:05.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011268399999999999 2024-09-12T22:06:05.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.361 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.362 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.362 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128885 5.6 5:68317e68:::benchmark_data_smithi043_32659_object128884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:05.362 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:06:05.362 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.286626691999999, 2024-09-12T22:06:05.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.09916875, 2024-09-12T22:06:05.362 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.362 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.362 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.363 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128885 2024-09-12T22:06:05.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.363 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:06:05.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:06:05.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000110+0000", 2024-09-12T22:06:05.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:06:05.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000197+0000", 2024-09-12T22:06:05.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6664999999999998e-05 2024-09-12T22:06:05.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000205+0000", 2024-09-12T22:06:05.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6529999999999994e-06 2024-09-12T22:06:05.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000209+0000", 2024-09-12T22:06:05.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3050000000000003e-06 2024-09-12T22:06:05.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.000993+0000", 2024-09-12T22:06:05.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078361999999999995 2024-09-12T22:06:05.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001124+0000", 2024-09-12T22:06:05.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131025 2024-09-12T22:06:05.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.001240+0000", 2024-09-12T22:06:05.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116084 2024-09-12T22:06:05.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003327+0000", 2024-09-12T22:06:05.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020871710000000001 2024-09-12T22:06:05.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099179+0000", 2024-09-12T22:06:05.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095852320000000005 2024-09-12T22:06:05.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099224+0000", 2024-09-12T22:06:05.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4968e-05 2024-09-12T22:06:05.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099278+0000", 2024-09-12T22:06:05.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4008999999999997e-05 2024-09-12T22:06:05.368 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.368 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.368 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.368 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128890 5.c 5:3ed1e918:::benchmark_data_smithi043_32659_object128889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:05.368 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:06:05.369 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.284131392000006, 2024-09-12T22:06:05.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097469765999999999, 2024-09-12T22:06:05.369 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.369 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.369 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.369 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128890 2024-09-12T22:06:05.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.369 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:06:05.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002605+0000", 2024-09-12T22:06:05.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002606+0000", 2024-09-12T22:06:05.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:06:05.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002668+0000", 2024-09-12T22:06:05.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2279999999999993e-05 2024-09-12T22:06:05.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002675+0000", 2024-09-12T22:06:05.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:06:05.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002679+0000", 2024-09-12T22:06:05.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9709999999999998e-06 2024-09-12T22:06:05.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002715+0000", 2024-09-12T22:06:05.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5156e-05 2024-09-12T22:06:05.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002797+0000", 2024-09-12T22:06:05.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2503000000000006e-05 2024-09-12T22:06:05.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.002890+0000", 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2898000000000004e-05 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004524+0000", 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016338290000000001 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099927+0000", 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095402742999999998 2024-09-12T22:06:05.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099984+0000", 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7012999999999998e-05 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100075+0000", 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1036e-05 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.374 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128891 5.6 5:6e76fdd9:::benchmark_data_smithi043_32659_object128890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.283050600999999, 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096406028000000005, 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128891 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003686+0000", 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7899999999999997e-07 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003756+0000", 2024-09-12T22:06:05.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9511999999999994e-05 2024-09-12T22:06:05.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003766+0000", 2024-09-12T22:06:05.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417999999999999e-05 2024-09-12T22:06:05.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003773+0000", 2024-09-12T22:06:05.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:06:05.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003815+0000", 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1894999999999998e-05 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.003904+0000", 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9047000000000003e-05 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004001+0000", 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6725000000000007e-05 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006428+0000", 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002426756 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.099951+0000", 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093522754 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100000+0000", 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9533000000000002e-05 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.100092+0000", 2024-09-12T22:06:05.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1488000000000002e-05 2024-09-12T22:06:05.380 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.380 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.380 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.380 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:128896 5.6 5:6bdcf6c2:::benchmark_data_smithi043_32659_object128895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T22:06:05.380 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:06:05.380 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.281815038999994, 2024-09-12T22:06:05.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097884008999999994, 2024-09-12T22:06:05.381 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.381 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.381 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.381 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 128896 2024-09-12T22:06:05.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.381 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:06:05.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004921+0000", 2024-09-12T22:06:05.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.004922+0000", 2024-09-12T22:06:05.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:06:05.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005062+0000", 2024-09-12T22:06:05.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014049099999999999 2024-09-12T22:06:05.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005071+0000", 2024-09-12T22:06:05.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.507e-06 2024-09-12T22:06:05.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005076+0000", 2024-09-12T22:06:05.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9099999999999996e-06 2024-09-12T22:06:05.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005254+0000", 2024-09-12T22:06:05.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017809100000000001 2024-09-12T22:06:05.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005346+0000", 2024-09-12T22:06:05.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1702999999999999e-05 2024-09-12T22:06:05.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.005452+0000", 2024-09-12T22:06:05.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010681200000000001 2024-09-12T22:06:05.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.006811+0000", 2024-09-12T22:06:05.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001358468 2024-09-12T22:06:05.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102714+0000", 2024-09-12T22:06:05.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095903632000000003 2024-09-12T22:06:05.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102749+0000", 2024-09-12T22:06:05.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4835000000000001e-05 2024-09-12T22:06:05.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:04:39.102805+0000", 2024-09-12T22:06:05.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5884000000000002e-05 2024-09-12T22:06:05.386 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.386 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.387 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207309 5.2 5:4a85d321:::benchmark_data_smithi043_32659_object40071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:05.387 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:06:05.387 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.841074550999998, 2024-09-12T22:06:05.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094642343000000004, 2024-09-12T22:06:05.387 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.387 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.387 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.387 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.387 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.387 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.388 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207309 2024-09-12T22:06:05.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.388 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:06:05.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:06:05.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445662+0000", 2024-09-12T22:06:05.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-09-12T22:06:05.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445667+0000", 2024-09-12T22:06:05.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.481e-06 2024-09-12T22:06:05.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445678+0000", 2024-09-12T22:06:05.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0969e-05 2024-09-12T22:06:05.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.445684+0000", 2024-09-12T22:06:05.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4099999999999996e-06 2024-09-12T22:06:05.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446611+0000", 2024-09-12T22:06:05.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092646500000000001 2024-09-12T22:06:05.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.446771+0000", 2024-09-12T22:06:05.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016026899999999999 2024-09-12T22:06:05.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540207+0000", 2024-09-12T22:06:05.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.093435491999999995 2024-09-12T22:06:05.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540244+0000", 2024-09-12T22:06:05.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7718e-05 2024-09-12T22:06:05.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540304+0000", 2024-09-12T22:06:05.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9682000000000002e-05 2024-09-12T22:06:05.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.392 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.393 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207326 5.3 5:c8e1e787:::benchmark_data_smithi043_32659_object40088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:05.393 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:06:05.393 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.836544124, 2024-09-12T22:06:05.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095969250000000006, 2024-09-12T22:06:05.393 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.393 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.393 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.393 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207326 2024-09-12T22:06:05.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.394 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:06:05.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450192+0000", 2024-09-12T22:06:05.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450193+0000", 2024-09-12T22:06:05.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:06:05.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450195+0000", 2024-09-12T22:06:05.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-09-12T22:06:05.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450202+0000", 2024-09-12T22:06:05.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5529999999999998e-06 2024-09-12T22:06:05.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450207+0000", 2024-09-12T22:06:05.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3120000000000001e-06 2024-09-12T22:06:05.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452135+0000", 2024-09-12T22:06:05.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019283740000000001 2024-09-12T22:06:05.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452237+0000", 2024-09-12T22:06:05.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101859 2024-09-12T22:06:05.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537935+0000", 2024-09-12T22:06:05.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085698184999999996 2024-09-12T22:06:05.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545943+0000", 2024-09-12T22:06:05.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080077859999999994 2024-09-12T22:06:05.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545998+0000", 2024-09-12T22:06:05.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4774000000000001e-05 2024-09-12T22:06:05.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546073+0000", 2024-09-12T22:06:05.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5339999999999994e-05 2024-09-12T22:06:05.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546161+0000", 2024-09-12T22:06:05.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8120000000000003e-05 2024-09-12T22:06:05.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.399 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.399 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207327 5.3 5:cffc1446:::benchmark_data_smithi043_32659_object40089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:05.399 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:06:05.399 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.836520094999997, 2024-09-12T22:06:05.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096130613000000004, 2024-09-12T22:06:05.400 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.400 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.400 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.400 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207327 2024-09-12T22:06:05.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.400 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:06:05.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450216+0000", 2024-09-12T22:06:05.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450217+0000", 2024-09-12T22:06:05.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-09-12T22:06:05.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450219+0000", 2024-09-12T22:06:05.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-12T22:06:05.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450225+0000", 2024-09-12T22:06:05.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:06:05.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450231+0000", 2024-09-12T22:06:05.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5790000000000003e-06 2024-09-12T22:06:05.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540123+0000", 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.089892122000000005 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540289+0000", 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016631 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.540407+0000", 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011773900000000001 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.545950+0000", 2024-09-12T22:06:05.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055425400000000003 2024-09-12T22:06:05.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546217+0000", 2024-09-12T22:06:05.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026678900000000002 2024-09-12T22:06:05.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546266+0000", 2024-09-12T22:06:05.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9845999999999997e-05 2024-09-12T22:06:05.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546347+0000", 2024-09-12T22:06:05.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0334999999999996e-05 2024-09-12T22:06:05.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.405 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.405 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207329 5.3 5:cbef824d:::benchmark_data_smithi043_32659_object40091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:05.406 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:06:05.406 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.836342446000003, 2024-09-12T22:06:05.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10009380900000001, 2024-09-12T22:06:05.406 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.406 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.406 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.406 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207329 2024-09-12T22:06:05.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.406 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:06:05.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450394+0000", 2024-09-12T22:06:05.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450395+0000", 2024-09-12T22:06:05.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4600000000000003e-07 2024-09-12T22:06:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450399+0000", 2024-09-12T22:06:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:06:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450410+0000", 2024-09-12T22:06:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0463e-05 2024-09-12T22:06:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.450416+0000", 2024-09-12T22:06:05.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:06:05.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542257+0000", 2024-09-12T22:06:05.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.091841238000000006 2024-09-12T22:06:05.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542454+0000", 2024-09-12T22:06:05.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196832 2024-09-12T22:06:05.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.542599+0000", 2024-09-12T22:06:05.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000144695 2024-09-12T22:06:05.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.546358+0000", 2024-09-12T22:06:05.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037585499999999998 2024-09-12T22:06:05.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550324+0000", 2024-09-12T22:06:05.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039663119999999996 2024-09-12T22:06:05.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550379+0000", 2024-09-12T22:06:05.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5538999999999998e-05 2024-09-12T22:06:05.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.550488+0000", 2024-09-12T22:06:05.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010813499999999999 2024-09-12T22:06:05.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.412 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.412 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4514.0:207332 5.3 5:cc9f07d6:::benchmark_data_smithi043_32659_object40094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:06:05.412 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:06:05.412 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.834323908999998, 2024-09-12T22:06:05.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.100541776, 2024-09-12T22:06:05.412 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-12T22:06:05.412 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-12T22:06:05.412 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.412 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-12T22:06:05.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4514", 2024-09-12T22:06:05.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.413 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 207332 2024-09-12T22:06:05.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.413 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-12T22:06:05.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-12T22:06:05.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:06:05.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-12T22:06:05.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452412+0000", 2024-09-12T22:06:05.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-12T22:06:05.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-12T22:06:05.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452413+0000", 2024-09-12T22:06:05.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000005e-07 2024-09-12T22:06:05.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-12T22:06:05.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.452417+0000", 2024-09-12T22:06:05.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8330000000000004e-06 2024-09-12T22:06:05.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-12T22:06:05.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537793+0000", 2024-09-12T22:06:05.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.085375759999999995 2024-09-12T22:06:05.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.537813+0000", 2024-09-12T22:06:05.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0418e-05 2024-09-12T22:06:05.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-12T22:06:05.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544160+0000", 2024-09-12T22:06:05.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063467990000000002 2024-09-12T22:06:05.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-12T22:06:05.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544335+0000", 2024-09-12T22:06:05.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017482700000000001 2024-09-12T22:06:05.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-12T22:06:05.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.544453+0000", 2024-09-12T22:06:05.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011824600000000001 2024-09-12T22:06:05.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-12T22:06:05.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.549279+0000", 2024-09-12T22:06:05.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048261880000000004 2024-09-12T22:06:05.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552785+0000", 2024-09-12T22:06:05.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003505752 2024-09-12T22:06:05.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-12T22:06:05.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552859+0000", 2024-09-12T22:06:05.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4649999999999998e-05 2024-09-12T22:06:05.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T22:06:05.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T22:06:05.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-12T22:06:05.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-12T22:05:09.552954+0000", 2024-09-12T22:06:05.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:06:05.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.418 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T22:06:05.418 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T22:06:05.418 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T22:06:05.420 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:06:05.528 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:06:05.529 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:06:05.529 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-12T22:06:05.529 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:06:05.537 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:06:05.639 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:06:05.639 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-12T22:06:05.639 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-12T22:06:05.639 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-12T22:06:05.639 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:06:05.648 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:06:05.764 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-12T22:06:05.765 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-12T22:06:05.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-12T22:06:05.765 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-12T22:06:05.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.765 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241752 5.6 5:6fd9bcd9:::benchmark_data_smithi043_32659_object74514:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:05.765 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:06:05.765 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.797033067000001, 2024-09-12T22:06:05.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.050887124, 2024-09-12T22:06:05.765 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.765 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.765 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.766 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.766 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.766 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.766 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241752 2024-09-12T22:06:05.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.766 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:06:05.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964280+0000", 2024-09-12T22:06:05.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964281+0000", 2024-09-12T22:06:05.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-12T22:06:05.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964289+0000", 2024-09-12T22:06:05.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7589999999999997e-06 2024-09-12T22:06:05.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964298+0000", 2024-09-12T22:06:05.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2399999999999996e-06 2024-09-12T22:06:05.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964305+0000", 2024-09-12T22:06:05.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8020000000000003e-06 2024-09-12T22:06:05.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964361+0000", 2024-09-12T22:06:05.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6848000000000002e-05 2024-09-12T22:06:05.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-12T22:06:05.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.964368+0000", 2024-09-12T22:06:05.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7700000000000004e-06 2024-09-12T22:06:05.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968716+0000", 2024-09-12T22:06:05.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043480419999999999 2024-09-12T22:06:05.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.769 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.769 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968724+0000", 2024-09-12T22:06:05.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8290000000000008e-06 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004158+0000", 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.035434038 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004248+0000", 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0074000000000005e-05 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.004528+0000", 2024-09-12T22:06:05.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027931599999999999 2024-09-12T22:06:05.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014924+0000", 2024-09-12T22:06:05.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010396522 2024-09-12T22:06:05.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015020+0000", 2024-09-12T22:06:05.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6393999999999999e-05 2024-09-12T22:06:05.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015077+0000", 2024-09-12T22:06:05.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6907000000000003e-05 2024-09-12T22:06:05.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015167+0000", 2024-09-12T22:06:05.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9742999999999998e-05 2024-09-12T22:06:05.772 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.772 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.772 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.772 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241760 5.6 5:6b64f472:::benchmark_data_smithi043_32659_object74522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:05.772 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:05.772 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.795000342000002, 2024-09-12T22:06:05.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0489733489999999, 2024-09-12T22:06:05.773 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.773 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.773 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.773 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.773 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.773 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.773 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241760 2024-09-12T22:06:05.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.773 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:05.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966313+0000", 2024-09-12T22:06:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:06:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966316+0000", 2024-09-12T22:06:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9100000000000001e-06 2024-09-12T22:06:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966323+0000", 2024-09-12T22:06:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0180000000000004e-06 2024-09-12T22:06:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.966329+0000", 2024-09-12T22:06:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2859999999999999e-06 2024-09-12T22:06:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968844+0000", 2024-09-12T22:06:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025157719999999999 2024-09-12T22:06:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.968851+0000", 2024-09-12T22:06:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8120000000000002e-06 2024-09-12T22:06:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011589+0000", 2024-09-12T22:06:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0427381149999999 2024-09-12T22:06:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011670+0000", 2024-09-12T22:06:05.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0716000000000004e-05 2024-09-12T22:06:05.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.011742+0000", 2024-09-12T22:06:05.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2152999999999998e-05 2024-09-12T22:06:05.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015208+0000", 2024-09-12T22:06:05.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003465409 2024-09-12T22:06:05.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015215+0000", 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3590000000000002e-06 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015242+0000", 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7095000000000001e-05 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015286+0000", 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4098999999999999e-05 2024-09-12T22:06:05.778 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.779 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.779 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.779 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241764 5.6 5:62d62176:::benchmark_data_smithi043_32659_object74526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:05.779 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:06:05.779 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.791988078000003, 2024-09-12T22:06:05.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0461627870000001, 2024-09-12T22:06:05.779 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.779 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.779 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.779 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.779 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.779 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241764 2024-09-12T22:06:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:06:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969325+0000", 2024-09-12T22:06:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969326+0000", 2024-09-12T22:06:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:06:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969331+0000", 2024-09-12T22:06:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:06:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969340+0000", 2024-09-12T22:06:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:06:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969347+0000", 2024-09-12T22:06:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6640000000000001e-06 2024-09-12T22:06:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969395+0000", 2024-09-12T22:06:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8523000000000003e-05 2024-09-12T22:06:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.969404+0000", 2024-09-12T22:06:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5110000000000003e-06 2024-09-12T22:06:05.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012772+0000", 2024-09-12T22:06:05.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0433679730000001 2024-09-12T22:06:05.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.012946+0000", 2024-09-12T22:06:05.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000174246 2024-09-12T22:06:05.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.783 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013068+0000", 2024-09-12T22:06:05.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012187400000000001 2024-09-12T22:06:05.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015291+0000", 2024-09-12T22:06:05.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022237390000000002 2024-09-12T22:06:05.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015344+0000", 2024-09-12T22:06:05.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2472000000000002e-05 2024-09-12T22:06:05.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015406+0000", 2024-09-12T22:06:05.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2225999999999997e-05 2024-09-12T22:06:05.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015488+0000", 2024-09-12T22:06:05.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1689999999999999e-05 2024-09-12T22:06:05.785 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.785 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.785 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.785 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241768 5.6 5:64eedce4:::benchmark_data_smithi043_32659_object74530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:05.785 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:06:05.786 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.791001588, 2024-09-12T22:06:05.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0463601, 2024-09-12T22:06:05.786 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.786 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.786 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.786 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.786 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.786 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.786 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241768 2024-09-12T22:06:05.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.786 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970311+0000", 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970312+0000", 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0900000000000002e-07 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970314+0000", 2024-09-12T22:06:05.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-12T22:06:05.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970321+0000", 2024-09-12T22:06:05.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:06:05.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970326+0000", 2024-09-12T22:06:05.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.994e-06 2024-09-12T22:06:05.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970358+0000", 2024-09-12T22:06:05.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2719000000000003e-05 2024-09-12T22:06:05.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.970365+0000", 2024-09-12T22:06:05.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6579999999999996e-06 2024-09-12T22:06:05.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.013902+0000", 2024-09-12T22:06:05.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.043537114 2024-09-12T22:06:05.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014088+0000", 2024-09-12T22:06:05.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185897 2024-09-12T22:06:05.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.014238+0000", 2024-09-12T22:06:05.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015002 2024-09-12T22:06:05.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016532+0000", 2024-09-12T22:06:05.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0022938279999999999 2024-09-12T22:06:05.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016571+0000", 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9477999999999997e-05 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016611+0000", 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9431999999999998e-05 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016672+0000", 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0754999999999997e-05 2024-09-12T22:06:05.791 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.792 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.792 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.792 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241776 5.6 5:604d8504:::benchmark_data_smithi043_32659_object74538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:05.792 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:06:05.792 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.785914953999999, 2024-09-12T22:06:05.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.044230886, 2024-09-12T22:06:05.792 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.792 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.792 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.792 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.792 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.792 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.793 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241776 2024-09-12T22:06:05.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.793 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:06:05.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975398+0000", 2024-09-12T22:06:05.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975399+0000", 2024-09-12T22:06:05.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6199999999999998e-07 2024-09-12T22:06:05.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975401+0000", 2024-09-12T22:06:05.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5689999999999999e-06 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975408+0000", 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2250000000000003e-06 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975412+0000", 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5549999999999998e-06 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975443+0000", 2024-09-12T22:06:05.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1347999999999999e-05 2024-09-12T22:06:05.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.975448+0000", 2024-09-12T22:06:05.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0760000000000002e-06 2024-09-12T22:06:05.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015520+0000", 2024-09-12T22:06:05.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.040071972 2024-09-12T22:06:05.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015633+0000", 2024-09-12T22:06:05.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011267799999999999 2024-09-12T22:06:05.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.015705+0000", 2024-09-12T22:06:05.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2136000000000002e-05 2024-09-12T22:06:05.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019478+0000", 2024-09-12T22:06:05.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037726270000000002 2024-09-12T22:06:05.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019524+0000", 2024-09-12T22:06:05.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6405e-05 2024-09-12T22:06:05.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019550+0000", 2024-09-12T22:06:05.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5863e-05 2024-09-12T22:06:05.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019629+0000", 2024-09-12T22:06:05.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8969999999999998e-05 2024-09-12T22:06:05.798 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.799 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.799 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.799 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241783 5.6 5:65f527dd:::benchmark_data_smithi043_32659_object74545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:05.799 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:06:05.799 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.783159982000001, 2024-09-12T22:06:05.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041589211, 2024-09-12T22:06:05.799 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.799 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.799 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.799 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.799 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.800 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.800 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241783 2024-09-12T22:06:05.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.800 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.800 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:06:05.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.800 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978153+0000", 2024-09-12T22:06:05.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978154+0000", 2024-09-12T22:06:05.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3900000000000003e-07 2024-09-12T22:06:05.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978159+0000", 2024-09-12T22:06:05.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2100000000000001e-06 2024-09-12T22:06:05.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978169+0000", 2024-09-12T22:06:05.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6129999999999993e-06 2024-09-12T22:06:05.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978176+0000", 2024-09-12T22:06:05.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:06:05.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.802 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978221+0000", 2024-09-12T22:06:05.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.473e-05 2024-09-12T22:06:05.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.802 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.978226+0000", 2024-09-12T22:06:05.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6899999999999997e-06 2024-09-12T22:06:05.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016703+0000", 2024-09-12T22:06:05.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038476156 2024-09-12T22:06:05.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016792+0000", 2024-09-12T22:06:05.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9648999999999995e-05 2024-09-12T22:06:05.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.016863+0000", 2024-09-12T22:06:05.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0358999999999995e-05 2024-09-12T22:06:05.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019516+0000", 2024-09-12T22:06:05.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026535420000000001 2024-09-12T22:06:05.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019634+0000", 2024-09-12T22:06:05.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117638 2024-09-12T22:06:05.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019665+0000", 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1649999999999997e-05 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019742+0000", 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6933000000000004e-05 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.805 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241802 5.6 5:6cd10f16:::benchmark_data_smithi043_32659_object74564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:05.806 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:06:05.806 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.775185096999998, 2024-09-12T22:06:05.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03581949, 2024-09-12T22:06:05.806 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.806 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.806 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.806 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.806 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.806 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.806 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241802 2024-09-12T22:06:05.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.806 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:06:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986128+0000", 2024-09-12T22:06:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986129+0000", 2024-09-12T22:06:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6800000000000009e-07 2024-09-12T22:06:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986133+0000", 2024-09-12T22:06:05.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.33e-06 2024-09-12T22:06:05.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986145+0000", 2024-09-12T22:06:05.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:06:05.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986151+0000", 2024-09-12T22:06:05.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:06:05.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986204+0000", 2024-09-12T22:06:05.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2757000000000003e-05 2024-09-12T22:06:05.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.986213+0000", 2024-09-12T22:06:05.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7129999999999994e-06 2024-09-12T22:06:05.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017602+0000", 2024-09-12T22:06:05.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.031388714 2024-09-12T22:06:05.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017719+0000", 2024-09-12T22:06:05.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117756 2024-09-12T22:06:05.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.017785+0000", 2024-09-12T22:06:05.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5247999999999996e-05 2024-09-12T22:06:05.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019803+0000", 2024-09-12T22:06:05.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002018457 2024-09-12T22:06:05.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021855+0000", 2024-09-12T22:06:05.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020515770000000002 2024-09-12T22:06:05.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021901+0000", 2024-09-12T22:06:05.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.583e-05 2024-09-12T22:06:05.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.812 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021947+0000", 2024-09-12T22:06:05.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6943000000000001e-05 2024-09-12T22:06:05.812 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.812 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.812 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.812 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241821 5.6 5:68148cd8:::benchmark_data_smithi043_32659_object74583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:05.812 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:06:05.812 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.767259320999997, 2024-09-12T22:06:05.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027962343, 2024-09-12T22:06:05.813 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.813 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.813 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.813 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.813 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.813 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.813 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241821 2024-09-12T22:06:05.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.813 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.813 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:06:05.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994054+0000", 2024-09-12T22:06:05.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994055+0000", 2024-09-12T22:06:05.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:06:05.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994061+0000", 2024-09-12T22:06:05.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994071+0000", 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7410000000000004e-06 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.994078+0000", 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995095+0000", 2024-09-12T22:06:05.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001017029 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995103+0000", 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6340000000000007e-06 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018554+0000", 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0234504870000001 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018631+0000", 2024-09-12T22:06:05.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7360000000000005e-05 2024-09-12T22:06:05.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.018696+0000", 2024-09-12T22:06:05.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4498000000000005e-05 2024-09-12T22:06:05.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021838+0000", 2024-09-12T22:06:05.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031421040000000002 2024-09-12T22:06:05.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021954+0000", 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000115999 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.021978+0000", 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4269000000000001e-05 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.022016+0000", 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8031999999999998e-05 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.818 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:241824 5.6 5:69dc3494:::benchmark_data_smithi043_32659_object74586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.765763038999999, 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0286962719999999, 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 241824 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:06:05.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995550+0000", 2024-09-12T22:06:05.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995551+0000", 2024-09-12T22:06:05.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2699999999999999e-07 2024-09-12T22:06:05.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995554+0000", 2024-09-12T22:06:05.821 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:06:05.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995561+0000", 2024-09-12T22:06:05.821 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:06:05.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995566+0000", 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4729999999999999e-06 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995612+0000", 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5488999999999998e-05 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:21.995619+0000", 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019855+0000", 2024-09-12T22:06:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0242357179999999 2024-09-12T22:06:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.019955+0000", 2024-09-12T22:06:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9538999999999997e-05 2024-09-12T22:06:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.020051+0000", 2024-09-12T22:06:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6201999999999998e-05 2024-09-12T22:06:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024057+0000", 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040063750000000004 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024121+0000", 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3431999999999998e-05 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024163+0000", 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1888999999999998e-05 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.825 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.825 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:23.024246+0000", 2024-09-12T22:06:05.825 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3769000000000004e-05 2024-09-12T22:06:05.825 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.825 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.825 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.825 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296741 5.3 5:c190c274:::benchmark_data_smithi043_32659_object129503:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:05.825 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:06:05.825 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.744455426999998, 2024-09-12T22:06:05.825 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.051784984, 2024-09-12T22:06:05.825 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.825 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.826 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.826 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.826 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.826 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.826 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296741 2024-09-12T22:06:05.826 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.826 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.826 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.826 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.826 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:06:05.826 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.826 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.826 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.826 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016858+0000", 2024-09-12T22:06:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016859+0000", 2024-09-12T22:06:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5600000000000004e-07 2024-09-12T22:06:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016863+0000", 2024-09-12T22:06:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5510000000000001e-06 2024-09-12T22:06:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016873+0000", 2024-09-12T22:06:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5319999999999995e-06 2024-09-12T22:06:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016879+0000", 2024-09-12T22:06:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5100000000000004e-06 2024-09-12T22:06:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016934+0000", 2024-09-12T22:06:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4734999999999997e-05 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.016941+0000", 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1319999999999996e-06 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055352+0000", 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0384109260000001 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055496+0000", 2024-09-12T22:06:05.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014437400000000001 2024-09-12T22:06:05.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.830 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.055835+0000", 2024-09-12T22:06:05.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000338339 2024-09-12T22:06:05.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.830 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065163+0000", 2024-09-12T22:06:05.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093287690000000006 2024-09-12T22:06:05.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068506+0000", 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033423620000000002 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068557+0000", 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1057000000000003e-05 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068643+0000", 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5741000000000005e-05 2024-09-12T22:06:05.831 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.832 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.832 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.832 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296774 5.3 5:c9ea392f:::benchmark_data_smithi043_32659_object129536:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:05.832 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:06:05.832 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.730709805, 2024-09-12T22:06:05.832 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0383883359999999, 2024-09-12T22:06:05.832 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.832 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.832 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.832 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.832 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.832 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.833 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296774 2024-09-12T22:06:05.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.833 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:06:05.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030603+0000", 2024-09-12T22:06:05.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030604+0000", 2024-09-12T22:06:05.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:06:05.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030607+0000", 2024-09-12T22:06:05.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0860000000000002e-06 2024-09-12T22:06:05.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030615+0000", 2024-09-12T22:06:05.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8120000000000008e-06 2024-09-12T22:06:05.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.835 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.835 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.835 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030620+0000", 2024-09-12T22:06:05.835 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6080000000000003e-06 2024-09-12T22:06:05.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.835 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.835 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.835 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030662+0000", 2024-09-12T22:06:05.835 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1925999999999998e-05 2024-09-12T22:06:05.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.030670+0000", 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2359999999999998e-06 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065202+0000", 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0345323989999999 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065348+0000", 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000145575 2024-09-12T22:06:05.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.837 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.065476+0000", 2024-09-12T22:06:05.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012800999999999999 2024-09-12T22:06:05.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.837 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.837 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068690+0000", 2024-09-12T22:06:05.837 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032143929999999999 2024-09-12T22:06:05.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068869+0000", 2024-09-12T22:06:05.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000179152 2024-09-12T22:06:05.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068914+0000", 2024-09-12T22:06:05.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4629999999999998e-05 2024-09-12T22:06:05.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.838 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.838 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.838 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068992+0000", 2024-09-12T22:06:05.838 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7885000000000004e-05 2024-09-12T22:06:05.839 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.839 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.839 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.839 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.839 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296793 5.3 5:c55bd684:::benchmark_data_smithi043_32659_object129555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:05.839 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:06:05.839 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.723893157999999, 2024-09-12T22:06:05.839 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0317046320000001, 2024-09-12T22:06:05.839 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.839 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.839 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.839 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.839 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.840 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.840 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296793 2024-09-12T22:06:05.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.840 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:06:05.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.840 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.840 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037420+0000", 2024-09-12T22:06:05.840 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037421+0000", 2024-09-12T22:06:05.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:06:05.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037425+0000", 2024-09-12T22:06:05.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9539999999999998e-06 2024-09-12T22:06:05.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.841 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.841 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037432+0000", 2024-09-12T22:06:05.841 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:06:05.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.842 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.842 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037436+0000", 2024-09-12T22:06:05.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4320000000000001e-06 2024-09-12T22:06:05.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.842 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.842 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037496+0000", 2024-09-12T22:06:05.842 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9385999999999997e-05 2024-09-12T22:06:05.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.842 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.842 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037503+0000", 2024-09-12T22:06:05.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2690000000000002e-06 2024-09-12T22:06:05.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066427+0000", 2024-09-12T22:06:05.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.028923877 2024-09-12T22:06:05.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.843 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066519+0000", 2024-09-12T22:06:05.843 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1867000000000007e-05 2024-09-12T22:06:05.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.843 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.066598+0000", 2024-09-12T22:06:05.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9175e-05 2024-09-12T22:06:05.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068804+0000", 2024-09-12T22:06:05.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002205664 2024-09-12T22:06:05.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.844 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.844 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069004+0000", 2024-09-12T22:06:05.844 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000200769 2024-09-12T22:06:05.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069050+0000", 2024-09-12T22:06:05.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5522999999999998e-05 2024-09-12T22:06:05.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.845 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.845 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069125+0000", 2024-09-12T22:06:05.845 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4530000000000006e-05 2024-09-12T22:06:05.845 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.845 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.845 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.845 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:296796 5.3 5:cbc9dd25:::benchmark_data_smithi043_32659_object129558:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T22:06:05.846 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:06:05.846 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.723595529000001, 2024-09-12T22:06:05.846 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0315259400000001, 2024-09-12T22:06:05.846 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.846 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.846 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.846 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.846 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.846 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.846 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 296796 2024-09-12T22:06:05.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.846 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.846 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:06:05.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.847 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037718+0000", 2024-09-12T22:06:05.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.847 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.847 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037719+0000", 2024-09-12T22:06:05.847 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1069999999999999e-06 2024-09-12T22:06:05.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037723+0000", 2024-09-12T22:06:05.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1400000000000002e-06 2024-09-12T22:06:05.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037734+0000", 2024-09-12T22:06:05.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0991e-05 2024-09-12T22:06:05.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.848 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.848 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037741+0000", 2024-09-12T22:06:05.848 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6059999999999997e-06 2024-09-12T22:06:05.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037790+0000", 2024-09-12T22:06:05.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9112e-05 2024-09-12T22:06:05.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.849 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.849 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:43.037797+0000", 2024-09-12T22:06:05.849 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:06:05.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.850 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.850 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067455+0000", 2024-09-12T22:06:05.850 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0296586320000001 2024-09-12T22:06:05.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.850 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.850 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067568+0000", 2024-09-12T22:06:05.850 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112895 2024-09-12T22:06:05.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.850 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.850 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.067686+0000", 2024-09-12T22:06:05.850 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000117879 2024-09-12T22:06:05.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.851 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.851 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.068856+0000", 2024-09-12T22:06:05.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011693949999999999 2024-09-12T22:06:05.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.851 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.851 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069132+0000", 2024-09-12T22:06:05.851 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027629599999999999 2024-09-12T22:06:05.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.851 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.851 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069171+0000", 2024-09-12T22:06:05.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9536000000000002e-05 2024-09-12T22:06:05.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.852 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.852 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:44.069243+0000", 2024-09-12T22:06:05.852 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2033999999999995e-05 2024-09-12T22:06:05.852 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.852 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.852 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.852 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318065 5.7 5:e8daa0bb:::benchmark_data_smithi043_32659_object150827:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:05.852 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:05.853 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.793536517, 2024-09-12T22:06:05.853 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041842749, 2024-09-12T22:06:05.853 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.853 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.853 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:06:05.853 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.853 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.853 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.853 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318065 2024-09-12T22:06:05.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.853 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.853 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.853 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:05.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.854 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:05.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.854 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.854 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967777+0000", 2024-09-12T22:06:05.854 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:06:05.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.854 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.967782+0000", 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0539999999999996e-06 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968192+0000", 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000410906 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968201+0000", 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7639999999999994e-06 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971494+0000", 2024-09-12T22:06:05.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032926180000000002 2024-09-12T22:06:05.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971499+0000", 2024-09-12T22:06:05.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0690000000000001e-06 2024-09-12T22:06:05.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.856 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.856 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009565+0000", 2024-09-12T22:06:05.856 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038066221 2024-09-12T22:06:05.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.857 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.857 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009619+0000", 2024-09-12T22:06:05.857 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4203000000000003e-05 2024-09-12T22:06:05.857 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.857 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.857 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.857 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318069 5.7 5:ea50145d:::benchmark_data_smithi043_32659_object150831:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:05.858 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:06:05.858 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.793098942, 2024-09-12T22:06:05.858 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.041799116, 2024-09-12T22:06:05.858 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.858 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.858 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:06:05.858 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.860 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.860 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.861 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318069 2024-09-12T22:06:05.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.861 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:06:05.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.861 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.861 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968214+0000", 2024-09-12T22:06:05.861 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.862 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968215+0000", 2024-09-12T22:06:05.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:06:05.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.862 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.862 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968218+0000", 2024-09-12T22:06:05.862 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9119999999999998e-06 2024-09-12T22:06:05.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.862 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968228+0000", 2024-09-12T22:06:05.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9599999999999995e-06 2024-09-12T22:06:05.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968234+0000", 2024-09-12T22:06:05.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6969999999999996e-06 2024-09-12T22:06:05.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.863 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.863 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971512+0000", 2024-09-12T22:06:05.863 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032779160000000001 2024-09-12T22:06:05.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971516+0000", 2024-09-12T22:06:05.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3349999999999998e-06 2024-09-12T22:06:05.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.864 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.009970+0000", 2024-09-12T22:06:05.864 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.03845421 2024-09-12T22:06:05.864 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.864 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.864 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.865 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010013+0000", 2024-09-12T22:06:05.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3516000000000001e-05 2024-09-12T22:06:05.865 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.865 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.865 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.865 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.865 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.865 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318078 5.7 5:e5b30db2:::benchmark_data_smithi043_32659_object150840:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:05.865 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:05.865 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.793071114, 2024-09-12T22:06:05.865 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0418401070000001, 2024-09-12T22:06:05.865 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.866 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.866 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-12T22:06:05.866 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.866 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.866 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.866 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318078 2024-09-12T22:06:05.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.866 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.866 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.866 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.866 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:05.866 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:05.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.867 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968242+0000", 2024-09-12T22:06:05.867 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4999999999999998e-07 2024-09-12T22:06:05.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.867 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.867 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968245+0000", 2024-09-12T22:06:05.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:06:05.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968251+0000", 2024-09-12T22:06:05.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2999999999999998e-06 2024-09-12T22:06:05.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.868 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.868 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.868 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.968257+0000", 2024-09-12T22:06:05.868 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6400000000000002e-06 2024-09-12T22:06:05.868 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971528+0000", 2024-09-12T22:06:05.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0032710619999999999 2024-09-12T22:06:05.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.869 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971533+0000", 2024-09-12T22:06:05.869 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8629999999999999e-06 2024-09-12T22:06:05.869 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.869 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.869 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010030+0000", 2024-09-12T22:06:05.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038496683 2024-09-12T22:06:05.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.870 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.870 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010082+0000", 2024-09-12T22:06:05.870 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2478999999999997e-05 2024-09-12T22:06:05.870 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.870 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.870 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.870 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.870 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.870 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318093 5.7 5:e0eb16a2:::benchmark_data_smithi043_32659_object150855:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:05.871 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:06:05.871 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.790739723, 2024-09-12T22:06:05.871 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0523587110000001, 2024-09-12T22:06:05.871 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.871 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.871 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.871 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.871 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.871 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.871 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318093 2024-09-12T22:06:05.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.871 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.872 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:06:05.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.872 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.872 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.872 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970573+0000", 2024-09-12T22:06:05.872 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.872 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.872 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970575+0000", 2024-09-12T22:06:05.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.159e-06 2024-09-12T22:06:05.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970579+0000", 2024-09-12T22:06:05.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4510000000000002e-06 2024-09-12T22:06:05.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.873 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.873 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.873 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970588+0000", 2024-09-12T22:06:05.873 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1479999999999995e-06 2024-09-12T22:06:05.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.970595+0000", 2024-09-12T22:06:05.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6919999999999996e-06 2024-09-12T22:06:05.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971555+0000", 2024-09-12T22:06:05.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00096029399999999999 2024-09-12T22:06:05.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.874 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.874 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.874 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.971561+0000", 2024-09-12T22:06:05.874 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7230000000000001e-06 2024-09-12T22:06:05.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010105+0000", 2024-09-12T22:06:05.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038544361 2024-09-12T22:06:05.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.875 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010201+0000", 2024-09-12T22:06:05.875 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5340000000000005e-05 2024-09-12T22:06:05.875 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.875 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.875 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.010497+0000", 2024-09-12T22:06:05.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000296273 2024-09-12T22:06:05.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021904+0000", 2024-09-12T22:06:05.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011406928 2024-09-12T22:06:05.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.876 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.876 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022778+0000", 2024-09-12T22:06:05.876 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00087414199999999995 2024-09-12T22:06:05.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.876 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022844+0000", 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6097000000000001e-05 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022932+0000", 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8103000000000007e-05 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318150 5.7 5:e1ecf58e:::benchmark_data_smithi043_32659_object150912:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:05.877 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:06:05.878 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.765261048999999, 2024-09-12T22:06:05.878 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.027012142, 2024-09-12T22:06:05.878 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.878 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.878 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.878 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.878 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.878 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.878 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318150 2024-09-12T22:06:05.878 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.878 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.878 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.878 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.878 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:06:05.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.879 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.879 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996052+0000", 2024-09-12T22:06:05.879 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.879 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.880 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.880 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996053+0000", 2024-09-12T22:06:05.880 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.079e-06 2024-09-12T22:06:05.880 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996057+0000", 2024-09-12T22:06:05.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3069999999999996e-06 2024-09-12T22:06:05.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996067+0000", 2024-09-12T22:06:05.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9420000000000007e-06 2024-09-12T22:06:05.881 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.881 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.881 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.881 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996081+0000", 2024-09-12T22:06:05.881 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3220999999999999e-05 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996124+0000", 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3545999999999999e-05 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.996129+0000", 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2639999999999999e-06 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017129+0000", 2024-09-12T22:06:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.020999384 2024-09-12T22:06:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017210+0000", 2024-09-12T22:06:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0968000000000001e-05 2024-09-12T22:06:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.017279+0000", 2024-09-12T22:06:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9484000000000001e-05 2024-09-12T22:06:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022949+0000", 2024-09-12T22:06:05.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056697259999999999 2024-09-12T22:06:05.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.022986+0000", 2024-09-12T22:06:05.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6610999999999999e-05 2024-09-12T22:06:05.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.884 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.884 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023016+0000", 2024-09-12T22:06:05.884 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0490000000000001e-05 2024-09-12T22:06:05.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.885 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.885 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.023064+0000", 2024-09-12T22:06:05.885 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.812e-05 2024-09-12T22:06:05.885 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.885 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.885 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.885 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:318162 5.7 5:e4ee45f3:::benchmark_data_smithi043_32659_object150924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T22:06:05.885 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:06:05.885 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.761689133000001, 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0259081619999999, 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 318162 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999624+0000", 2024-09-12T22:06:05.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999625+0000", 2024-09-12T22:06:05.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:06:05.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.887 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.887 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999627+0000", 2024-09-12T22:06:05.887 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8260000000000001e-06 2024-09-12T22:06:05.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999634+0000", 2024-09-12T22:06:05.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8730000000000001e-06 2024-09-12T22:06:05.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999639+0000", 2024-09-12T22:06:05.888 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0710000000000002e-06 2024-09-12T22:06:05.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.888 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.888 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999681+0000", 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1488e-05 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:51.999688+0000", 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9229999999999996e-06 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.020983+0000", 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0212956630000001 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.889 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021059+0000", 2024-09-12T22:06:05.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5445999999999996e-05 2024-09-12T22:06:05.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.021123+0000", 2024-09-12T22:06:05.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4080999999999999e-05 2024-09-12T22:06:05.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.890 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.024526+0000", 2024-09-12T22:06:05.890 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003403241 2024-09-12T22:06:05.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.890 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025454+0000", 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00092807600000000001 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025486+0000", 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1430999999999998e-05 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:53.025532+0000", 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6428999999999999e-05 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.892 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4514.0:326467 5.1 5:87ee908b:::benchmark_data_smithi043_32659_object159229:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T22:06:05.892 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:06:05.892 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7392961390000004, 2024-09-12T22:06:05.892 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.038557899, 2024-09-12T22:06:05.892 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-12T22:06:05.892 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-12T22:06:05.892 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:06:05.892 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-12T22:06:05.892 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4514", 2024-09-12T22:06:05.892 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.43:0/2401796729", 2024-09-12T22:06:05.892 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 326467 2024-09-12T22:06:05.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.892 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022017+0000", 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022018+0000", 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5000000000000001e-07 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-12T22:06:05.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022022+0000", 2024-09-12T22:06:05.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2799999999999997e-06 2024-09-12T22:06:05.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-12T22:06:05.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022032+0000", 2024-09-12T22:06:05.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0035e-05 2024-09-12T22:06:05.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.894 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-12T22:06:05.894 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022040+0000", 2024-09-12T22:06:05.894 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5970000000000003e-06 2024-09-12T22:06:05.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022093+0000", 2024-09-12T22:06:05.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3718999999999998e-05 2024-09-12T22:06:05.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-12T22:06:05.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:56.022101+0000", 2024-09-12T22:06:05.895 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3579999999999997e-06 2024-09-12T22:06:05.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.895 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-12T22:06:05.895 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056468+0000", 2024-09-12T22:06:05.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.034366761 2024-09-12T22:06:05.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-12T22:06:05.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056576+0000", 2024-09-12T22:06:05.896 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000108859 2024-09-12T22:06:05.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.896 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 1", 2024-09-12T22:06:05.896 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.056682+0000", 2024-09-12T22:06:05.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105358 2024-09-12T22:06:05.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:06:05.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.057971+0000", 2024-09-12T22:06:05.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012889749999999999 2024-09-12T22:06:05.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-12T22:06:05.897 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060452+0000", 2024-09-12T22:06:05.897 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0024813980000000001 2024-09-12T22:06:05.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.897 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-12T22:06:05.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060496+0000", 2024-09-12T22:06:05.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3875999999999998e-05 2024-09-12T22:06:05.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-12T22:06:05.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-12T22:06:05.898 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-12T22:06:05.898 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-12T22:05:57.060575+0000", 2024-09-12T22:06:05.898 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8832999999999996e-05 2024-09-12T22:06:05.898 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.898 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.898 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.898 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-12T22:06:05.898 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-12T22:06:05.898 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-12T22:06:06.023 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:06:07.012 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-09-12T22:06:07.028 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:06:08.014 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-09-12T22:06:09.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~106s 2024-09-12T22:06:15.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~111s 2024-09-12T22:06:20.927 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~117s 2024-09-12T22:06:26.735 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~123s 2024-09-12T22:06:30.930 DEBUG:teuthology.orchestra.console.smithi047:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80  e t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..    \x80   PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..    \x80   PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..    \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A BD 14 8E GUID: 00000000 0000 0000 0000 0CC47A6BFF78 DHCP.\                    DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP.../ DHCP...- DHCP...\ DHCP...| DHCP.../ DHCP...- DHCP...\ DHCP...| DHCP.../ DHCP...- DHCP...\ DHCP...| DHCP.../ DHCP...- DHCP...\ DHCP...| DHCP.../ DHCP...-  21.15.47 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 01:00.0, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.47 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:bd:14:8e)... Configuring (net0 0c:c4:7a:bd:14:8e).... Configuring (net0 0c:c4:7a:bd:14:8e)..... Configuring (net0 0c:c4:7a:bd:14:8e)...... Configuring (net0 0c:c4:7a:bd:14:8e)....... Configuring (net0 0c:c4:7a:bd:14:8e)........ Configuring (net0 0c:c4:7a:bd:14:8e)......... Configuring (net0 0c:c4:7a:bd:14:8e).......... ok .    [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-505.el9.x86_64) 9  CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9              CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9  The selected entry will be started automatically in 5s.            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-505.el9.x86_64) 9   CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-505.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-2), GNU ld version 2.35.2-54.el9) #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000079230fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000079234000-0x0000000079849fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007984a000-0x000000007996afff] usable [ 0.000000] BIOS-e820: [mem 0x000000007996b000-0x0000000079e00fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079e01000-0x000000007bd4cfff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007bd4d000-0x000000007bd4dfff] usable [ 0.000000] BIOS-e820: [mem 0x000000007bd4e000-0x000000007bdd3fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007bdd4000-0x000000007bf50fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000080000000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 1.0c 09/07/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.008 MHz processor [ 0.000413] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000417] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000419] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000757] last_pfn = 0x7bf51 max_arch_pfn = 0x400000000 [ 0.006538] found SMP MP-table at [mem 0x000fd910-0x000fd91f] [ 0.006549] Using GB pages for direct mapping [ 0.006801] RAMDISK: [mem 0x341ea000-0x360ecfff] [ 0.006804] ACPI: Early table checksum verification disabled [ 0.006807] ACPI: RSDP 0x00000000000F0530 000024 (v02 SUPERM) [ 0.006811] ACPI: XSDT 0x0000000079A7F0A0 0000C4 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006815] ACPI: FACP 0x0000000079AAC298 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006819] ACPI: DSDT 0x0000000079A7F200 02D091 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006822] ACPI: FACS 0x0000000079DFEF80 000040 [ 0.006824] ACPI: APIC 0x0000000079AAC3A8 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006826] ACPI: FPDT 0x0000000079AAC470 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006828] ACPI: FIDT 0x0000000079AAC4B8 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006830] ACPI: SPMI 0x0000000079AAC558 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006833] ACPI: MCFG 0x0000000079AAC598 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006835] ACPI: UEFI 0x0000000079AAC5D8 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006837] ACPI: BDAT 0x0000000079AAC620 000030 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006839] ACPI: HPET 0x0000000079AAC650 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006842] ACPI: PMCT 0x0000000079AAC688 000064 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006844] ACPI: WDDT 0x0000000079AAC6F0 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006846] ACPI: SSDT 0x0000000079AAC730 00EDE7 (v01 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006848] ACPI: SSDT 0x0000000079ABB518 002117 (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006851] ACPI: SSDT 0x0000000079ABD630 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006853] ACPI: PRAD 0x0000000079ABD698 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006855] ACPI: DMAR 0x0000000079ABD7A0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006857] ACPI: HEST 0x0000000079ABD860 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006859] ACPI: BERT 0x0000000079ABDAE0 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006861] ACPI: ERST 0x0000000079ABDB10 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006864] ACPI: EINJ 0x0000000079ABDD40 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006865] ACPI: Reserving FACP table memory at [mem 0x79aac298-0x79aac3a3] [ 0.006867] ACPI: Reserving DSDT table memory at [mem 0x79a7f200-0x79aac290] [ 0.006867] ACPI: Reserving FACS table memory at [mem 0x79dfef80-0x79dfefbf] [ 0.006868] ACPI: Reserving APIC table memory at [mem 0x79aac3a8-0x79aac46f] [ 0.006869] ACPI: Reserving FPDT table memory at [mem 0x79aac470-0x79aac4b3] [ 0.006869] ACPI: Reserving FIDT table memory at [mem 0x79aac4b8-0x79aac553] [ 0.006870] ACPI: Reserving SPMI table memory at [mem 0x79aac558-0x79aac597] [ 0.006870] ACPI: Reserving MCFG table memory at [mem 0x79aac598-0x79aac5d3] [ 0.006871] ACPI: Reserving UEFI table memory at [mem 0x79aac5d8-0x79aac619] [ 0.006872] ACPI: Reserving BDAT table memory at [mem 0x79aac620-0x79aac64f] [ 0.006872] ACPI: Reserving HPET table memory at [mem 0x79aac650-0x79aac687] [ 0.006873] ACPI: Reserving PMCT table memory at [mem 0x79aac688-0x79aac6eb] [ 0.006873] ACPI: Reserving WDDT table memory at [mem 0x79aac6f0-0x79aac72f] [ 0.006874] ACPI: Reserving SSDT table memory at [mem 0x79aac730-0x79abb516] [ 0.006874] ACPI: Reserving SSDT table memory at [mem 0x79abb518-0x79abd62e] [ 0.006875] ACPI: Reserving SSDT table memory at [mem 0x79abd630-0x79abd693] [ 0.006876] ACPI: Reserving PRAD table memory at [mem 0x79abd698-0x79abd799] [ 0.006876] ACPI: Reserving DMAR table memory at [mem 0x79abd7a0-0x79abd85b] [ 0.006877] ACPI: Reserving HEST table memory at [mem 0x79abd860-0x79abdadb] [ 0.006877] ACPI: Reserving BERT table memory at [mem 0x79abdae0-0x79abdb0f] [ 0.006878] ACPI: Reserving ERST table memory at [mem 0x79abdb10-0x79abdd3f] [ 0.006879] ACPI: Reserving EINJ table memory at [mem 0x79abdd40-0x79abde6f] [ 0.006930] No NUMA configuration found [ 0.006930] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006940] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.007127] Reserving 256MB of memory at 1680MB for crashkernel (System RAM: 32660MB) [ 0.007165] Zone ranges: [ 0.007165] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.007166] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.007168] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.007169] Device empty [ 0.007169] Movable zone start for each node [ 0.007172] Early memory node ranges [ 0.007172] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.007173] node 0: [mem 0x0000000000100000-0x0000000079230fff] [ 0.007174] node 0: [mem 0x000000007984a000-0x000000007996afff] [ 0.007175] node 0: [mem 0x000000007bd4d000-0x000000007bd4dfff] [ 0.007175] node 0: [mem 0x000000007bdd4000-0x000000007bf50fff] [ 0.007176] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.007179] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.007184] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007223] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.011675] On node 0, zone DMA32: 1561 pages in unavailable ranges [ 0.011779] On node 0, zone DMA32: 9186 pages in unavailable ranges [ 0.011785] On node 0, zone DMA32: 134 pages in unavailable ranges [ 0.012282] On node 0, zone Normal: 16559 pages in unavailable ranges [ 0.012398] ACPI: PM-Timer IO Port: 0x408 [ 0.012407] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.012409] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012409] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012410] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012410] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012411] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012412] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012412] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012421] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23 [ 0.012426] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47 [ 0.012427] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012429] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012432] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012434] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012437] TSC deadline timer available [ 0.012442] CPU topo: Max. logical packages: 1 [ 0.012443] CPU topo: Max. logical dies: 1 [ 0.012443] CPU topo: Max. dies per package: 1 [ 0.012448] CPU topo: Max. threads per core: 2 [ 0.012449] CPU topo: Num. cores per package: 4 [ 0.012449] CPU topo: Num. threads per package: 8 [ 0.012450] CPU topo: Allowing 8 present CPUs plus 0 hotplug CPUs [ 0.012461] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012462] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.012463] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012464] PM: hibernation: Registered nosave memory: [mem 0x79231000-0x79233fff] [ 0.012465] PM: hibernation: Registered nosave memory: [mem 0x79234000-0x79849fff] [ 0.012466] PM: hibernation: Registered nosave memory: [mem 0x7996b000-0x79e00fff] [ 0.012467] PM: hibernation: Registered nosave memory: [mem 0x79e01000-0x7bd4cfff] [ 0.012468] PM: hibernation: Registered nosave memory: [mem 0x7bd4e000-0x7bdd3fff] [ 0.012469] PM: hibernation: Registered nosave memory: [mem 0x7bf51000-0x7fffffff] [ 0.012469] PM: hibernation: Registered nosave memory: [mem 0x80000000-0x8fffffff] [ 0.012470] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012471] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff] [ 0.012471] PM: hibernation: Registered nosave memory: [mem 0xfed20000-0xfeffffff] [ 0.012472] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012473] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012474] Booting paravirtualized kernel on bare hardware [ 0.012477] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016877] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.017131] percpu: Embedded 64 pages/cpu s225280 r8192 d28672 u262144 [ 0.017156] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.017210] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64", will be passed to user space. [ 0.017227] random: crng init done [ 0.019815] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.021172] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.021277] Fallback order for Node 0: 0 [ 0.021281] Built 1 zonelists, mobility grouping on. Total pages: 8230268 [ 0.021282] Policy zone: Normal [ 0.021451] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.021459] software IO TLB: area num 8. [ 0.043257] Memory: 1757744K/33444200K available (16384K kernel code, 5657K rwdata, 12972K rodata, 3980K init, 5696K bss, 989880K reserved, 0K cma-reserved) [ 0.043363] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.043372] Kernel/User page tables isolation: enabled [ 0.043396] ftrace: allocating 48134 entries in 189 pages [ 0.050672] ftrace: allocated 189 pages with 6 groups [ 0.051237] Dynamic Preempt: voluntary [ 0.051282] rcu: Preemptible hierarchical RCU implementation. [ 0.051283] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.051284] Trampoline variant of Tasks RCU enabled. [ 0.051285] Rude variant of Tasks RCU enabled. [ 0.051285] Tracing variant of Tasks RCU enabled. [ 0.051286] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.051286] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.054714] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.054877] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.054984] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.060309] Console: colour VGA+ 80x25 [ 0.060327] printk: console [ttyS1] enabled [ 1.233688] ACPI: Core revision 20230331 [ 1.237760] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.246892] APIC: Switch to symmetric I/O mode setup [ 1.251861] DMAR: Host address width 46 [ 1.255705] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.261019] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap d2078c106f0466 ecap f020de [ 1.268929] DMAR: RMRR base: 0x0000007bac6000 end: 0x0000007bad4fff [ 1.275194] DMAR: ATSR flags: 0x0 [ 1.278514] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.284781] DMAR-IR: IOAPIC id 8 under DRHD base 0xfbffc000 IOMMU 0 [ 1.291133] DMAR-IR: IOAPIC id 9 under DRHD base 0xfbffc000 IOMMU 0 [ 1.297486] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.302885] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.302886] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.317915] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.323218] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.329439] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.339891] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327358ef10f, max_idle_ns: 440795330581 ns [ 1.350402] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.01 BogoMIPS (lpj=3500008) [ 1.351422] CPU0: Thermal monitoring enabled (TM1) [ 1.352473] process: using mwait in idle threads [ 1.353402] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024 [ 1.354400] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4 [ 1.355402] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.356401] Spectre V2 : Mitigation: Retpolines [ 1.357400] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.358400] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.359400] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.360401] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.361400] Spectre V2 : User space: Mitigation: STIBP via prctl [ 1.362401] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl [ 1.363405] MDS: Mitigation: Clear CPU buffers [ 1.364400] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.365404] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.366400] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.367400] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.368401] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.369400] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.382368] Freeing SMP alternatives memory: 40K [ 1.382401] pid_max: default: 32768 minimum: 301 [ 1.383420] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.384405] Yama: becoming mindful. [ 1.385406] SELinux: Initializing. [ 1.386418] LSM support for eBPF active [ 1.387466] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.388445] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.389723] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz (family: 0x6, model: 0x3f, stepping: 0x2) [ 1.390524] RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.391414] RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.392410] RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.393410] Performance Events: PEBS fmt2+, Haswell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.394401] ... version: 3 [ 1.395400] ... bit width: 48 [ 1.396400] ... generic registers: 4 [ 1.397400] ... value mask: 0000ffffffffffff [ 1.398400] ... max period: 00007fffffffffff [ 1.399400] ... fixed-purpose events: 3 [ 1.400400] ... event mask: 000000070000000f [ 1.401494] signal: max sigframe size: 1776 [ 1.402413] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.403443] rcu: Hierarchical SRCU implementation. [ 1.403444] rcu: Max phase no-delay instances is 400. [ 1.406039] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.406477] smp: Bringing up secondary CPUs ... [ 1.407473] smpboot: x86: Booting SMP configuration: [ 1.407475] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.412776] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.412776] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.415453] smp: Brought up 1 node, 8 CPUs [ 1.415453] smpboot: Total of 8 processors activated (56000.12 BogoMIPS) [ 1.457931] node 0 deferred pages initialised in 39ms [ 1.459441] devtmpfs: initialized [ 1.459441] x86/mm: Memory block size: 128MB [ 1.460400] ACPI: PM: Registering ACPI NVS region [mem 0x7996b000-0x79e00fff] (4808704 bytes) [ 1.460400] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.460400] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.460400] pinctrl core: initialized pinctrl subsystem [ 1.464400] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.464400] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.464400] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.464400] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.464400] audit: initializing netlink subsys (disabled) [ 1.464410] audit: type=2000 audit(1726178760.134:1): state=initialized audit_enabled=0 res=1 [ 1.464473] thermal_sys: Registered thermal governor 'fair_share' [ 1.464475] thermal_sys: Registered thermal governor 'step_wise' [ 1.464475] thermal_sys: Registered thermal governor 'user_space' [ 1.465403] cpuidle: using governor menu [ 1.465438] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.465439] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.465498] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.465501] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.465511] PCI: Using configuration type 1 for base access [ 1.465541] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 1.468430] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.468435] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.468435] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.468435] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.468435] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.469431] cryptd: max_cpu_qlen set to 1000 [ 1.469476] ACPI: Added _OSI(Module Device) [ 1.469477] ACPI: Added _OSI(Processor Device) [ 1.469478] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.469478] ACPI: Added _OSI(Processor Aggregator Device) [ 1.469479] ACPI: Added _OSI(Linux-Dell-Video) [ 1.469480] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.469480] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.471400] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.471400] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.472518] ACPI: Dynamic OEM Table Load: [ 1.481400] ACPI: _OSC evaluated successfully for all CPUs [ 1.481400] ACPI: Interpreter enabled [ 1.481400] ACPI: PM: (supports S0 S4 S5) [ 1.481400] ACPI: Using IOAPIC for interrupt routing [ 1.481400] HEST: Enabling Firmware First mode for corrected errors. [ 1.526380] HEST: Table parsing has been initialized. [ 1.526506] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.526508] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.526509] PCI: Using E820 reservations for host bridge windows [ 1.526913] ACPI: Enabled 6 GPEs in block 00 to 3F [ 1.543049] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.543054] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.544243] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.544928] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.544930] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.544957] PCI host bridge to bus 0000:ff [ 1.544958] pci_bus 0000:ff: root bus resource [bus ff] [ 1.544970] pci 0000:ff:0b.0: [8086:2f81] type 00 class 0x088000 conventional PCI endpoint [ 1.545038] pci 0000:ff:0b.1: [8086:2f36] type 00 class 0x110100 conventional PCI endpoint [ 1.545092] pci 0000:ff:0b.2: [8086:2f37] type 00 class 0x110100 conventional PCI endpoint [ 1.545148] pci 0000:ff:0c.0: [8086:2fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.545200] pci 0000:ff:0c.1: [8086:2fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.545251] pci 0000:ff:0c.2: [8086:2fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.545302] pci 0000:ff:0c.3: [8086:2fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.545355] pci 0000:ff:0f.0: [8086:2ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.545407] pci 0000:ff:0f.1: [8086:2ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.545460] pci 0000:ff:0f.4: [8086:2ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.545511] pci 0000:ff:0f.5: [8086:2ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.545563] pci 0000:ff:0f.6: [8086:2ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.545614] pci 0000:ff:10.0: [8086:2f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.545666] pci 0000:ff:10.1: [8086:2f34] type 00 class 0x110100 conventional PCI endpoint [ 1.545718] pci 0000:ff:10.5: [8086:2f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.545768] pci 0000:ff:10.6: [8086:2f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.545819] pci 0000:ff:10.7: [8086:2f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.545870] pci 0000:ff:12.0: [8086:2fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.545923] pci 0000:ff:12.1: [8086:2f30] type 00 class 0x110100 conventional PCI endpoint [ 1.545979] pci 0000:ff:13.0: [8086:2fa8] type 00 class 0x088000 conventional PCI endpoint [ 1.546034] pci 0000:ff:13.1: [8086:2f71] type 00 class 0x088000 conventional PCI endpoint [ 1.546090] pci 0000:ff:13.2: [8086:2faa] type 00 class 0x088000 conventional PCI endpoint [ 1.546146] pci 0000:ff:13.3: [8086:2fab] type 00 class 0x088000 conventional PCI endpoint [ 1.546201] pci 0000:ff:13.4: [8086:2fac] type 00 class 0x088000 conventional PCI endpoint [ 1.546256] pci 0000:ff:13.5: [8086:2fad] type 00 class 0x088000 conventional PCI endpoint [ 1.546311] pci 0000:ff:13.6: [8086:2fae] type 00 class 0x088000 conventional PCI endpoint [ 1.546363] pci 0000:ff:13.7: [8086:2faf] type 00 class 0x088000 conventional PCI endpoint [ 1.546419] pci 0000:ff:14.0: [8086:2fb0] type 00 class 0x088000 conventional PCI endpoint [ 1.546475] pci 0000:ff:14.1: [8086:2fb1] type 00 class 0x088000 conventional PCI endpoint [ 1.546530] pci 0000:ff:14.2: [8086:2fb2] type 00 class 0x088000 conventional PCI endpoint [ 1.546587] pci 0000:ff:14.3: [8086:2fb3] type 00 class 0x088000 conventional PCI endpoint [ 1.546641] pci 0000:ff:14.4: [8086:2fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.546694] pci 0000:ff:14.5: [8086:2fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.546748] pci 0000:ff:14.6: [8086:2fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.546801] pci 0000:ff:14.7: [8086:2fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.546854] pci 0000:ff:15.0: [8086:2fb4] type 00 class 0x088000 conventional PCI endpoint [ 1.546909] pci 0000:ff:15.1: [8086:2fb5] type 00 class 0x088000 conventional PCI endpoint [ 1.546965] pci 0000:ff:15.2: [8086:2fb6] type 00 class 0x088000 conventional PCI endpoint [ 1.547021] pci 0000:ff:15.3: [8086:2fb7] type 00 class 0x088000 conventional PCI endpoint [ 1.547079] pci 0000:ff:16.0: [8086:2f68] type 00 class 0x088000 conventional PCI endpoint [ 1.547134] pci 0000:ff:16.6: [8086:2f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.547188] pci 0000:ff:16.7: [8086:2f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.547241] pci 0000:ff:17.0: [8086:2fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.547297] pci 0000:ff:17.4: [8086:2fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.547350] pci 0000:ff:17.5: [8086:2fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.547406] pci 0000:ff:17.6: [8086:2fba] type 00 class 0x088000 conventional PCI endpoint [ 1.547461] pci 0000:ff:17.7: [8086:2fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.547517] pci 0000:ff:1e.0: [8086:2f98] type 00 class 0x088000 conventional PCI endpoint [ 1.547569] pci 0000:ff:1e.1: [8086:2f99] type 00 class 0x088000 conventional PCI endpoint [ 1.547621] pci 0000:ff:1e.2: [8086:2f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.547674] pci 0000:ff:1e.3: [8086:2fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.547701] pci 0000:ff:1e.4: [8086:2f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.547755] pci 0000:ff:1f.0: [8086:2f88] type 00 class 0x088000 conventional PCI endpoint [ 1.547809] pci 0000:ff:1f.2: [8086:2f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.548013] acpi LNXCPU:08: Entry not well-defined, consider updating BIOS [ 1.548856] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.548860] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.549219] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.549921] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.549922] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.550496] PCI host bridge to bus 0000:00 [ 1.550498] pci_bus 0000:00: root bus resource [io 0x0000-0x03af window] [ 1.550499] pci_bus 0000:00: root bus resource [io 0x03e0-0x0cf7 window] [ 1.550500] pci_bus 0000:00: root bus resource [io 0x03b0-0x03df window] [ 1.550501] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.550502] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.550503] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.550504] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.550504] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.550505] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.550526] pci 0000:00:00.0: [8086:2f00] type 00 class 0x060000 PCIe Root Port [ 1.550659] pci 0000:00:01.0: [8086:2f02] type 01 class 0x060400 PCIe Root Port [ 1.550689] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.550692] pci 0000:00:01.0: bridge window [io 0xe000-0xefff] [ 1.550694] pci 0000:00:01.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.550701] pci 0000:00:01.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.550736] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.550836] pci 0000:00:02.0: [8086:2f04] type 01 class 0x060400 PCIe Root Port [ 1.550866] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.550869] pci 0000:00:02.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.550909] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.551006] pci 0000:00:03.0: [8086:2f08] type 01s 0x060400 PCIe Root Port [ 1.551036] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.551078] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.551179] pci 0000:00:04.0: [8086:2f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.551198] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.551307] pci 0000:00:04.1: [8086:2f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.551325] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.551435] pci 0000:00:04.2: [8086:2f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.551453] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.551562] pci 0000:00:04.3: [8086:2f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.551580] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.551686] pci 0000:00:04.4: [8086:2f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.551705] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.551809] pci 0000:00:04.5: [8086:2f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.551827] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.551931] pci 0000:00:04.6: [8086:2f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.551949] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.552053] pci 0000:00:04.7: [8086:2f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.552071] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.552173] pci 0000:00:05.0: [8086:2f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.552260] pci 0000:00:05.1: [8086:2f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.552371] pci 0000:00:05.2: [8086:2f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.552456] pci 0000:00:05.4: [8086:2f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.552470] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.552585] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.552883] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.552916] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.552934] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.552953] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.552970] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.552989] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.553008] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.553075] pci 0000:00:11.4: PME# supported from D3hot [ 1.553158] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.553200] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.553325] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.553413] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.553455] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.553588] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.553660] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.553702] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.553835] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.553924] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.553956] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.554118] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.554202] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.554271] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.554373] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.554479] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.554548] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.554554] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.554557] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.554654] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.554761] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.554830] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.554835] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.554839] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.554936] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.555049] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.555081] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.555243] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.555327] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.555581] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.555613] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.555631] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.555650] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.555669] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.555687] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.555706] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.555773] pci 0000:00:1f.2: PME# supported from D3hot [ 1.555841] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.555884] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.555938] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.556044] pci 0000:00:1f.6: [8086:8d24] type 00 class 0x118000 conventional PCI endpoint [ 1.556087] pci 0000:00:1f.6: BAR 0 [mem 0xfb430000-0xfb430fff 64bit] [ 1.556361] acpiphp: Slot [1] registered [ 1.556388] pci 0000:01:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.556409] pci 0000:01:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.556419] pci 0000:01:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.556442] pci 0000:01:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.556451] pci 0000:01:00.0: ROM [mem 0xfb380000-0xfb3fffff pref] [ 1.556496] pci 0000:01:00.0: PME# supported from D0 D3hot [ 1.556518] pci 0000:01:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.556519] pci 0000:01:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.556533] pci 0000:01:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.556534] pci 0000:01:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.556700] pci 0000:01:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.556721] pci 0000:01:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.556731] pci 0000:01:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.556754] pci 0000:01:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.556764] pci 0000:01:00.1: ROM [mem 0xfb300000-0xfb37ffff pref] [ 1.556806] pci 0000:01:00.1: PME# supported from D0 D3hot [ 1.556825] pci 0000:01:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.556826] pci 0000:01:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.556840] pci 0000:01:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.556840] pci 0000:01:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.556988] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.557104] pci 0000:02:00.0: [8086:2700] type 00 class 0x010802 PCIe Endpoint [ 1.557124] pci 0000:02:00.0: BAR 0 [mem 0xfb210000-0xfb213fff 64bit] [ 1.557166] pci 0000:02:00.0: ROM [mem 0xfb200000-0xfb20ffff pref] [ 1.557170] pci 0000:02:00.0: enabling Extended Tags [ 1.557287] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.557389] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.557441] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.557544] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.557616] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.557630] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.557635] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.557689] pci 0000:05:00.0: enabling Extended Tags [ 1.557814] pci 0000:05:00.0: supports D1 D2 [ 1.557814] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.557954] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.558042] pci_bus 0000:06: extended config space not accessible [ 1.558076] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.558115] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.558135] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.558155] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.558255] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.558326] pci 0000:06:00.0: supports D1 D2 [ 1.558327] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.558477] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.558632] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.558667] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.558704] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.558722] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.558961] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.559024] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.559026] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.559064] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.559064] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.559412] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.559447] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.559484] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.559502] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.559731] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.559793] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.559794] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.559834] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.559834] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.560150] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.560163] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.560847] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.560881] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.560916] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.560949] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.560982] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.560983] ACPI: PCI: Interrupt link LNKE disabled [ 1.561017] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.561017] ACPI: PCI: Interrupt link LNKF disabled [ 1.561050] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.561050] ACPI: PCI: Interrupt link LNKG disabled [ 1.561084] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.561085] ACPI: PCI: Interrupt link LNKH disabled [ 1.561250] iommu: Default domain type: Translated [ 1.561250] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.561250] SCSI subsystem initialized [ 1.561250] ACPI: bus type USB registered [ 1.561250] usbcore: registered new interface driver usbfs [ 1.561250] usbcore: registered new interface driver hub [ 1.561250] usbcore: registered new device driver usb [ 1.561420] pps_core: LinuxPPS API ver. 1 registered [ 1.561421] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.561424] PTP clock support registered [ 1.561439] EDAC MC: Ver: 3.0.0 [ 1.561567] NetLabel: Initializing [ 1.561568] NetLabel: domain hash size = 128 [ 1.561569] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.561582] NetLabel: unlabeled traffic allowed by default [ 1.561582] PCI: Using ACPI for IRQ routing [ 1.572554] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.572554] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.572554] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.572554] vgaarb: loaded [ 1.572554] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.572554] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.576967] clocksource: Switched to clocksource tsc-early [ 1.584673] VFS: Disk quotas dquot_6.6.0 [ 1.584683] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.584736] pnp: PnP ACPI init [ 1.585026] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.585028] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.585030] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.585031] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.585031] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.585033] system 00:01: [mem 0xfed1c000-0xfed3ffff] could not be reserved [ 1.585034] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.585035] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.585036] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.585037] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.585038] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.585039] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.585193] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.585195] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.585196] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.585197] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.585198] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.585887] pnp: PnP ACPI: found 5 devices [ 1.591572] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.591625] NET: Registered PF_INET protocol family [ 1.591815] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.594147] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.594178] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.594190] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.594399] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.594514] TCP: Hash tables configured (established 262144 bind 65536) [ 1.594657] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.594747] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.594803] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.594883] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.594888] NET: Registered PF_XDP protocol family [ 1.594910] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.594921] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.594925] pci 0000:01:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.594927] pci 0000:01:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.594928] pci 0000:01:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.594929] pci 0000:01:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.594931] pci 0000:01:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.594931] pci 0000:01:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.594933] pci 0000:01:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.594933] pci 0000:01:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.594935] pci 0000:01:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ [mem size 0x00 [ 1.594937] pci 0000:01:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.594938] pci 0000:01:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.594939] pci 0000:01:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.594940] pci 0000:01:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.594941] pci 0000:01:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.594942] pci 0000:01:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.594944] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.594945] pci 0000:00:01.0: bridge window [io 0xe000-0xefff] [ 1.594951] pci 0000:00:01.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.594956] pci 0000:00:01.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.594964] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.594970] pci 0000:00:02.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.594981] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.594997] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.595021] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.595024] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1ge window [mem 0xfa000000-0xfb0fffff] [ e to [bus 05-0 bridge window [io 0xd000-0xdfff] [ 1.595060] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.595076] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.595084] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.595090] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.595096] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.595103] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.595104] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.595113] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.595118] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.595130] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.595130] pci_bus 0000:00: resource 4 [io 0x0000-0x03af window] [ 1.595132] pci_bus 0000:00: resource 5 [io 0x03e0-0x0cf7 window] [ 1.595133] pci_bus 0000:00: resource 6 [io 0x03b0-0x03df window] [ 1.595133] pci_bus 0000:00: resource 7 [io 0x1000-0xffff window] [ 1.595134] pci_bus 0000:00: resource 8 [mem 0x000a0000-0x000bffff window] [ 1.595135] pci_bus 0000:00: resource 9 [mem 0xfedb0000-0xfedb000f window] [ 1.595136] pci_bus 0000:00: resource 10 [mem 0xfedc0000-0xfedc000f window] [ 1.595137] pci_bus 0000:00: resource 11 [mem 0x90000000-0xfbffbfff window] [ 1.595138]e 0 [io 0xe000-0xefff] [ 1.595139] pci_bus 0000:01: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.595140] pci_bus 0000:01: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.595141] pci_bus 0000:02: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.595142] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.595142] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.595143] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.595144] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.595145] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.595146] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.595147] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.595318] pci 0000:00:05.0: disabled boot interrupts on device [8086:2f28] [ 1.611560] p00:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 15669 usecs [ 1.627554] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 15603 usecs [ 1.627570] pci 0000:01:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.627606] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.627606] software IO TLB: mapped [mem 0x0000000065000000-0x0000000069000000] (64MB) [ 1.627613] ACPI: bus type thunderbolt registered [ 1.627616] Trying to unpack rootfs image as initramfs... [ 1.723162] Initialise system trusted keyrings [ 1.723173] Key type blacklist registered [ 1.723224] set: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.723238] zbud: loaded [ 1.821964] integrity: Platform Keyring initialized [ 1.821970] integrity: Machine keyring initialized [ 1.829936] NET: Registered PF_ALG protocol family [ 1.829939] xor: automatically using best checksumming function avx [ 1.829940] Key type asymmetric registered [ 1.829942] Asymmetric key parser 'x509' registered [ 1.829942] Running certificate verification selftests [ 1.831217] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.831726] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.831804] io scheduler mq-deadline registered [ 1.831806] io scheduler kyber registered [ 1.831822] io scheduler bfq registered [ 1.888116] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.888603] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.888867] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.889133] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.889375] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.889614] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.889839] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.890062] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.890149] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.890174] ACPI: \_SB_.SCK0.CP01: Found 2 idle states [ 1.890196] ACPI: \_SB_.SCK0.CP02: Found 2 idle states [ 1.890220] ACPI: \_SB_.SCK0.CP03: Found 2 idle states [ 1.890242] ACPI: \_SB_.SCK0.CP04: Found 2 idle states [ 1.890263] ACPI: \_SB_.SCK0.CP05: Found 2 idle states [ 1.890284] ACPI: \_SB_.SCK0.CP06: Found 2 idle states [ 1.890304] ACPI: \_SB_.SCK0.CP07: Found 2 idle states [ 1.937807] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.937833] ACPI: button: Power Button [PWRB] [ 1.937856] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.937965] ACPI: button: Power Button [PWRF] [ 1.957860] Freeing initrd memory: 31756K [ 1.971128] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.971131] pstore: Registered erst as persistent store backend [ 1.971264] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.971372] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.978825] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.987498] Non-volatile memory driver v1.3 [ 2.036729] rdac: device handler registered [ 2.036760] hp_sw: device handler registered [ 2.036761] emc: device handler registered [ 2.036779] alua: device handler registered [ 2.037067] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.037111] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 2.037125] ehci-pci 0000:00:1d.0: debug port 2 [ 2.041046] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.047523] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.047559] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.047561] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.047562] usb usb1: Product: EHCI Host Controller [ 2.047563] usb usb1: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.047564] usb usb1: SerialNumber: 0000:00:1d.0 [ 2.047659] hub 1-0:1.0: USB hub found [ 2.047664] hub 1-0:1.0: 2 ports detected [ 2.047773] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.047835] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 2.048924] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.049111] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.049116] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.049184] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 2.049187] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.049189] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 2.049204] ehci-pci 0000:00:1a.0: debug port 2 [ 2.049217] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.049219] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.049220] usb usb2: Product: xHCI Host Controller [ 2.049220] usb usb2: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.049221] usb usb2: SerialNumber: 0000:00:14.0 [ 2.049315] hub 2-0:1.0: USB hub found [ 2.049348] hub 2-0:1.0: 15 ports detected [ 2.051782] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 2.051784] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.051785] usb usb4: Product: xHCI Host Controller [ 2.051786] usb usb4: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.051787] usb usb4: SerialNumber: 0000:00:14.0 [ 2.051876] hub 4-0:1.0: USB hub found [ 2.051893] hub 4-0:1.0: 6 ports detected [ 2.053121] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.053154] usbcore: registered new interface driver usbserial_generic [ 2.053158] usbserial: USB Serial support registered for generic [ 2.053194] i8042: PNP: No PS/2 controller found. [ 2.053241] mousedev: PS/2 mouse device common for all mice [ 2.053306] rtc_cmos 00:00: RTC can wake from S4 [ 2.053590] rtc_cmos 00:00: registered as rtc0 [ 2.053635] rtc_cmos 00:00: setting system clock to 2024-09-12T22:06:03 UTC (1726178763) [ 2.053660] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 2.059524] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.059555] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.059557] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.059559] usb usb3: Product: EHCI Host Controller [ 2.059559] usb usb3: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.059560] usb usb3: SerialNumber: 0000:00:1a.0 [ 2.059643] hub 3-0:1.0: USB hub found [ 2.059647] hub 3-0:1.0: 2 ports detected [ 2.086233] intel_pstate: Intel P-state driver initializing [ 2.158913] hid: raw HID events driver (C) Jiri Kosina [ 2.158948] usbcore: registered new interface driver usbhid [ 2.158949] usbhid: USB HID core driver [ 2.158971] drop_monitor: Initializing network drop monitor service [ 2.168893] Initializing XFRM netlink socket [ 2.168910] NET: Registered PF_INET6 protocol family [ 2.174600] Segment Routing with IPv6 [ 2.174618] NET: Registered PF_PACKET protocol family [ 2.174646] mpls_gso: MPLS GSO support [ 2.220650] microcode: Current revision: 0x00000049 [ 2.220653] microcode: Updated early from: 0x00000036 [ 2.235641] resctrl: L3 monitoring detected [ 2.235662] IPI shorthand broadcast: enabled [ 2.235667] AVX2 version of gcm_enc/dec engaged. [ 2.283524] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.288720] AES CTR mode by8 optimization enabled [ 2.288763] sched_clock: Marking stable (1013000650, 1275493645)->(2810216910, -521722615) [ 2.302215] registered taskstats version 1 [ 2.307499] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 2.314059] Loading compiled-in X.509 certificates [ 2.314589] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.314895] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.315193] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.315346] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.315355] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.317142] page_owner is disabled [ 2.317368] pstore: Using crash dump compression: deflate [ 2.317378] Key type big_key registered [ 2.319980] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.416839] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.416842] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.417001] hub 1-1:1.0: USB hub found [ 2.417089] hub 1-1:1.0: 8 ports detected [ 2.434904] Key type encrypted registered [ 2.434911] ima: No TPM chip found, activating TPM-bypass! [ 2.434914] Loading compiled-in module X.509 certificates [ 2.435224] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.435227] ima: Allocated hash algorithm: sha256 [ 2.435236] ima: No architecture policies found [ 2.435243] evm: Initialising EVM extended attributes: [ 2.435244] evm: security.selinux [ 2.435244] evm: security.SMACK64 (disabled) [ 2.435245] evm: security.SMACK64EXEC (disabled) [ 2.435246] evm: security.SMACK64TRANSMUTE (disabled) [ 2.435246] evm: security.SMACK64MMAP (disabled) [ 2.435246] evm: security.apparmor (disabled) [ 2.435247] evm: security.ima [ 2.435247] evm: security.capability [ 2.435248] evm: HMAC attrs: 0x1 [ 2.442838] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.442841] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.443116] hub 3-1:1.0: USB hub found [ 2.443211] hub 3-1:1.0: 6 ports detected [ 2.446699] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.446703] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.447237] hub 2-12:1.0: USB hub found [ 2.447326] hub 2-12:1.0: 4 ports detected [ 2.641522] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 2.641528] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 2.644279] clocksource: Switched to clocksource tsc [ 3.873704] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 4.042613] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.042614] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.098872] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 4.162002] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 4.171822] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 4.187774] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.177664] clk: Disabling unused clocks [ 5.182459] Freeing unused decrypted memory: 2028K [ 5.187660] Freeing unused kernel image (initmem) memory: 3980K [ 5.193575] Write protecting the kernel read-only data: 30720k [ 5.199728] Freeing unused kernel image (rodata/data gap) memory: 1364K [ 5.241082] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.241084] x86/mm: Checking user space page tables [ 5.274474] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.274482] Run /init as init process [ 5.287543] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.287659] systemd[1]: Detected architecture x86-64. [ 5.287661] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-70.git20240819.el9 (Initramfs)! [ 5.338634] systemd[1]: Hostname set to . [ 5.399046] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.399162] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ 5.420648] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 5.434664] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 5.446598] systemd[1]: Reached target Swaps. [ OK ] Reached target Swaps. [ 5.457606] systemd[1]: Reached target Timer Units. [ OK ] Reached target Timer Units. [ 5.469643] systemd[1]: Listening on D-Bus System Message Bus Socket. [ OK ] Listening on D-Bus System Message Bus Socket. [ 5.484739] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 5.498787] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 5.510644] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 5.524689] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 5.538578] systemd[1]: Reached target Socket Units. [ OK ] Reached target Socket Units. [ 5.557439] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 5.573611] systemd[1]: Starting Journal Service... Starting Journal Service... [ 5.586240] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 5.599141] systemd[1]: Starting Create System Users... Starting Creat[ 5.606152] fuse: init (API version 7.36) e System Users... [ 5.615157] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 5.628270] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Setup Virtual Console. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... [ 6.025622] dca service started, version 1.12.1 Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymouth Directory Watch. [ [ 6.061587] nvme nvme0: pci function 0000:02:00.0 OK ] Reached target Path Units. [ OK ] Reached target Basic System. [ 6.085710] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.085717] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 6.086917] nvme nvme0: 8/0/0 default/read/poll queues [ 6.093234] igb: Intel(R) Gigabit Ethernet Network Driver [ 6.093237] igb: Copyright (c) 2007-2014 Intel Corporation. [ 6.133315] ACPI: bus type drm_connector registered [ 6.138948] ahci 0000:00:11.4: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 6.138957] ahci 0000:00:11.4: 4/4 ports implemented (port mask 0xf) [ 6.138959] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.151580] igb 0000:07:00.0: added PHC on eth0 [ 6.151610] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.151612] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:6b:ff:78 [ 6.151689] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.151691] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.153733] scsi host0: ahci [ 6.153837] scsi host1: ahci [ 6.153914] scsi host2: ahci [ 6.154005] scsi host3: ahci [ 6.154055] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 51 lpm-pol 0 [ 6.154058] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 51 lpm-pol 0 [ 6.154061] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 51 lpm-pol 0 [ 6.154063] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 51 lpm-pol 0 [ 6.154512] ahci 0000:00:1f.2: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 6.154516] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) [ 6.154518] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.169827] scsi host4: ahci [ 6.169916] scsi host5: ahci [ 6.170001] scsi host6: ahci [ 6.170081] scsi host7: ahci [ 6.170170] scsi host8: ahci [ 6.170260] scsi host9: ahci [ 6.170290] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 61 lpm-pol 0 [ 6.170293] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 61 lpm-pol 0 [ 6.170294] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 61 lpm-pol 0 [ 6.170296] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 61 lpm-pol 0 [ 6.170299] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 61 lpm-pol 0 [ 6.170301] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 61 lpm-pol 0 [ 6.207729] igb 0000:07:00.1: added PHC on eth1 [ 6.207774] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.207775] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:6b:ff:79 [ 6.207867] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.207868] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.252715] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.253004] ixgbe 0000:01:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.253086] ixgbe 0000:01:00.0: MAC: 2, PHY: 14, SFP+: 3, PBA No: 400900-000 [ 6.253088] ixgbe 0000:01:00.0: 0c:c4:7a:bd:14:8e [ 6.254075] ixgbe 0000:01:00.0: Intel(R) 10 Gigabit Network Connection [ 6.463577] ata2: SATA link down (SStatus 0 SControl 300) [ 6.463605] ata1: SATA link down (SStatus 0 SControl 300) [ 6.463645] ata3: SATA link down (SStatus 0 SControl 300) [ 6.463682] ata4: SATA link down (SStatus 0 SControl 300) [ 6.479011] ata9: SATA link down (SStatus 0 SControl 300) [ 6.479036] ata8: SATA link down (SStatus 0 SControl 300) [ 6.479059] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.479083] ata10: SATA link down (SStatus 0 SControl 300) [ 6.479123] ata7: SATA link down (SStatus 0 SControl 300) [ 6.479169] ata6: SATA link down (SStatus 0 SControl 300) [ 6.480201] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN04, max UDMA/133 [ 6.480382] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.481492] ata5.00: configured for UDMA/133 [ 6.481630] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN04 PQ: 0 ANSI: 5 [ 6.492065] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.538738] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.554162] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.560048] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.566601] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.566624] sd 4:0:0:0: [sda] Write Protect is off [ 6.566645] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.566666] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.571033] Console: switching to colour dummy device 80x25 [ 6.571186] ast 0000:06:00.0: Using P2A bridge for configuration [ 6.571188] ast 0000:06:00.0: AST 2400 detected [ 6.571236] ast 0000:06:00.0: [drm] Using analog VGA [ 6.571245] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.571599] sda: sda1 [ 6.571658] sd 4:0:0:0: [sda] Attached SCSI removable disk [ 6.574445] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.580238] fbcon: astdrmfb (fb0) is primary device [ 6.610368] Console: switching to colour frame buffer device 128x48 [ 6.627912] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.398805] ixgbe 0000:01:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.399099] ixgbe 0000:01:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.399181] ixgbe 0000:01:00.1: MAC: 2, PHY: 1, PBA No: 400900-000 [ 7.399182] ixgbe 0000:01:00.1: 0c:c4:7a:bd:14:8f [ 7.400240] ixgbe 0000:01:00.1: Intel(R) 10 Gigabit Network Connection [ 7.418501] ixgbe 0000:01:00.1 ens1f1: renamed from eth0 [ 7.435614] ixgbe 0000:01:00.0 ens1f0: renamed from eth2 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check on /dev…2923-554d-41e2-ac4a-c752ff079ceb... [ OK ] Finished File System Check on /dev…8d2923-554d-41e2-ac4a-c752ff079ceb. Mounting /sysroot... [ 7.669379] EXT4-fs (sda1): mounted filesystem fa8d2923-554d-41e2-ac4a-c752ff079ceb ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manager for Device Events and Files... [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root... [ 7.996817] systemd-journald[279]: Received SIGTERM from PID 1 (systemd). [ 8.493197] SELinux: policy capability network_peer_controls=1 [ 8.493205] SELinux: policy capability open_perms=1 [ 8.493206] SELinux: policy capability extended_socket_class=1 [ 8.493207] SELinux: policy capability always_check_network=0 [ 8.493208] SELinux: policy capability cgroup_seclabel=1 [ 8.493209] SELinux: policy capability nnp_nosuid_transition=1 [ 8.493210] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.535725] audit: type=1403 audit(1726178769.981:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.543778] systemd[1]: Successfully loaded SELinux policy in 113.457ms. [ 8.624488] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 27.703ms. [ 8.645665] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.645802] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.520808] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.520906] systemd[1]: Stopped Switch Root. [ 9.528191] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.528471] systemd[1]: Created slice Slice /system/getty. [ 9.532493] systemd[1]: Created slice Slice /system/modprobe. [ 9.541352] systemd[1]: Created slice Slice /system/serial-getty. [ 9.546839] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.552614] systemd[1]: Created slice User and Session Slice. [ OK [[ 9.558431] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.559568] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.564748] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. 0m] Stopped [0;[ 9.570227] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.586493] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.594040] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.603445] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.615138] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.625474] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.635801] systemd[1]: Reached target Local Encrypted Volumes. [ 9.646136] systemd[1]: Stopped target Switch Root. [ 9.656806] systemd[1]: Stopped target Initrd File Systems. [ 9.667734] systemd[1]: Stopped target Initrd Root File System. [ 9.673649] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.678540] systemd[1]: Reached target Path Units. [ 9.684097] systemd[1]: Reached target Slice Units. [ 9.690001] systemd[1]: Reached target Swaps. [ 9.696776] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.701927] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.707348] systemd[1]: Listening on LVM2 poll daemon socket. 1;39mSwitch Root. [ OK ] Created slice [0;1;[ 9.734770] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.734821] systemd[1]: Reached target RPC Port Mapper. 39mSlice /system/getty. [ OK ] Created slice [ 9.752136] systemd[1]: Listening on Process Core Dump Socket. [ 9.752264] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.758895] systemd[1]: Listening on udev Control Socket. [ 9.764970] systemd[1]: Listening on udev Kernel Socket. [ 9.771021] systemd[1]: Mounting Huge Pages File System... [ 9.776343] systemd[1]: Mounting POSIX Message Queue File System... [ 9.781768] systemd[1]: Mounting Kernel Debug File System... [ 9.788009] systemd[1]: Mounting Kernel Trace File System... [ 9.792904] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). Slice /system/modprobe. [ OK ] Created slice [0;1;3[ 9.817560] systemd[1]: Starting Create List of Static Device Nodes... 9mSlice /system/[ 9.825976] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 9.826895] systemd[1]: Starting Load Kernel Module configfs... [ 9.837680] systemd[1]: Starting Load Kernel Module drm... [ 9.843531] systemd[1]: Starting Load Kernel Module fuse... [ 9.849887] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 9.853797] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 9.853843] systemd[1]: Stopped Plymouth switch root service. [ 9.862266] systemd[1]: Stopped Journal Service. serial-getty[ 9.880345] systemd[1]: Starting Journal Service... [ 9.882906] systemd[1]: Starting Load Kernel Modules... . [ OK[ 9.887173] systemd[1]: Starting Generate network units from Kernel command line... [ 9.891305] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). [ 9.892187] systemd[1]: Starting Remount Root and Kernel File Systems... [ 9.900328] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 9.901222] systemd[1]: Starting Coldplug All udev Devices... [ 9.920073] systemd[1]: Mounted Huge Pages File System. [ 9.925634] systemd[1]: Mounted POSIX Message Queue File System. [ 9.935013] systemd[1]: Mounted Kernel Debug File System. [ 9.940725] systemd[1]: Mounted Kernel Trace File System. [ 9.945981] systemd[1]: Started Journal Service. [ 9.960152] EXT4-fs (sda1): re-mounted fa8d2923-554d-41e2-ac4a-c752ff079ceb r/w. Quota mode: none. ] Created slice Slice /system/sshd-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Set up automount Arbitrary Executa…ormats File System Automount Point. [ OK ] Reached target ceph target allowin…eph-mon@.service instances at once. [ OK ] Reached target ceph target allowin…eph-mds@.service instances at once. [ OK ] Reached target ceph target allowin…eph-mgr@.service instances at once. [ OK ] Reached target ceph target allowin…eph-osd@.service instances at once. [ OK ] Reached target ceph target allowin…radosgw@.service instances at once. [ OK ] Reached target ceph target allowin…-mirror@.service instances at once. [ OK ] Reached target [[ 10.064665] systemd-journald[577]: Received client request to flush runtime journal. 0;1;39mLocal Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM2 mirror…ing dmeventd or progress polling... Starting Load Kernel Module configfs[ 10.215523] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.215545] device-mapper: uevent: version 1.0.3 [ 10.215643] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com ... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network units from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Apply Kernel Variables... Starting Create Static Device Nodes in /dev... [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Monitoring of LVM2 mirror…using dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Automatic Boot Loader Update. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 10.624693] IPMI message handler: version 39.2 [ 10.633030] ipmi device interface [ 10.647322] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.655010] ipmi_si: IPMI System Interface driver [ 10.655036] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.655044] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.655329] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.655546] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.655643] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.657556] igb 0000:07:00.0: DCA enabled [ 10.657574] igb 0000:07:00.1: DCA enabled [ 10.661078] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.661082] ipmi_si: Adding ACPI-specified kcs state machine [ 10.661165] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.710192] power_meter ACPI000D:00: Found ACPI power meter. [ OK [[ 10.712958] power_meter ACPI000D:00: Ignoring unsafe software power cap! 0m] Finished [0[ 10.713009] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). ;1;39mCreate Volatile Files and Directories. Starting Security Auditing Service... Starting RPC B[ 10.766316] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. ind... [ 10.777369] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 10.798339] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ OK ] Started /usr/sbin/lvm vgchange -aay --autoactivation event vg_nvme. [ 10.823844] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.836344] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.837094] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 10.857419] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 10.857426] RAPL PMU: hw unit of domain package 2^-14 Joules [ 10.857429] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 10.890554] iTCO_vendor_support: vendor-support=0 [ 10.897308] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 10.897687] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ 10.931678] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 10.942062] ipmi_ssif: IPMI SSIF Interface driver Mounting RPC Pipe File System... [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Started RPC Bind. Mounting /var/lib/ceph... [ 11.117672] RPC: Registered named UNIX socket transport module. [ 11.117679] RPC: Registered udp transport module. [ 11.117684] RPC: Registered tcp transport module. [ 11.117685] RPC: Registered tcp-with-tls transport module. [ 11.117687] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ 11.369564] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.378441] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported beginning with RHEL10 [ 11.378484] XFS (dm-4): Mounting V4 Filesystem 71e8133a-e78d-422a-b187-7a66274eedbb [ 11.381285] XFS (dm-4): Ending clean mount [ 11.381327] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) [ OK [[ 11.408671] EDAC MC0: Giving out device to module sb_edac controller Haswell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) 0m] Mounted [0;[ 11.408674] EDAC sbridge: Ver: 1.1.2 1;39m/var/lib/ceph. [ OK ] Finished Record System Boot/Shutdown in UTMP. [[0;[ 11.434568] intel_rapl_common: Found RAPL domain package [ 11.434579] intel_rapl_common: Found RAPL domain dram 32m OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowin…l ceph*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. Starting Hostname Service... [ OK ] Started Hostname Service. [* ] A start job is running for Network Manager (5s / no limit) M [ OK ] Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.  Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.593008] ixgbe 0000:01:00.0: registered PHC device on ens1f0 [ 15.749355] ixgbe 0000:01:00.1: registered PHC device on ens1f1 [ 15.762647] ixgbe 0000:01:00.0 ens1f0: detected SFP+: 3 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 16.065807] ixgbe 0000:01:00.0 ens1f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 16.065919] IPv6: ADDRCONF(NETDEV_CHANGE): ens1f0: link becomes ready [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [** ] A start job is running for Network Manager Wait Online (8s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ ***] A start job is running for Network …nager Wait Online (11s / no limit) M [ **] A start job is running for Network …nager Wait Online (11s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.47 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot daemon for…ocessing new SELinux denial logs... [ 23.007683] block sda: the capability attribute has been deprecated. + '[' 172.21.15.47 '!=' '' ']' + set -e + '[' -n 172.21.15.47 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.47 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.47 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi047.front.sepia.ceph.com + '[' -n smithi047.front.sepia.ceph.com ']' + hostname smithi047.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi047 + echo smithi047 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.47 smithi047.front.sepia.ceph.com smithi047/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-505.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-09-12T22:06:30.931 DEBUG:teuthology.orchestra.console.smithi047:expect after: smithi047 login: 2024-09-12T22:06:30.985 DEBUG:teuthology.orchestra.console.smithi047:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80  e t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..    \x80   PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..    \x80   PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..    \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A BD 14 8E GUID: 00000000 0000 0000 0000 0CC47A6BFF78 DHCP.\                    DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP../ DHCP..- DHCP..\ DHCP..| DHCP.../ DHCP...- DHCP...\ DHCP...| DHCP.../ DHCP...- DHCP...\ DHCP...| DHCP.../ DHCP...- DHCP...\ DHCP...| DHCP.../ DHCP...- DHCP...\ DHCP...| DHCP.../ DHCP...-  21.15.47 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 01:00.0, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.47 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:bd:14:8e)... Configuring (net0 0c:c4:7a:bd:14:8e).... Configuring (net0 0c:c4:7a:bd:14:8e)..... Configuring (net0 0c:c4:7a:bd:14:8e)...... Configuring (net0 0c:c4:7a:bd:14:8e)....... Configuring (net0 0c:c4:7a:bd:14:8e)........ Configuring (net0 0c:c4:7a:bd:14:8e)......... Configuring (net0 0c:c4:7a:bd:14:8e).......... ok .    [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-505.el9.x86_64) 9  CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9              CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9  The selected entry will be started automatically in 5s.            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-505.el9.x86_64) 9   CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-505.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-2), GNU ld version 2.35.2-54.el9) #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000079230fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000079234000-0x0000000079849fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007984a000-0x000000007996afff] usable [ 0.000000] BIOS-e820: [mem 0x000000007996b000-0x0000000079e00fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079e01000-0x000000007bd4cfff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007bd4d000-0x000000007bd4dfff] usable [ 0.000000] BIOS-e820: [mem 0x000000007bd4e000-0x000000007bdd3fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007bdd4000-0x000000007bf50fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000080000000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 1.0c 09/07/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.008 MHz processor [ 0.000413] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000417] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000419] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000757] last_pfn = 0x7bf51 max_arch_pfn = 0x400000000 [ 0.006538] found SMP MP-table at [mem 0x000fd910-0x000fd91f] [ 0.006549] Using GB pages for direct mapping [ 0.006801] RAMDISK: [mem 0x341ea000-0x360ecfff] [ 0.006804] ACPI: Early table checksum verification disabled [ 0.006807] ACPI: RSDP 0x00000000000F0530 000024 (v02 SUPERM) [ 0.006811] ACPI: XSDT 0x0000000079A7F0A0 0000C4 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006815] ACPI: FACP 0x0000000079AAC298 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006819] ACPI: DSDT 0x0000000079A7F200 02D091 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006822] ACPI: FACS 0x0000000079DFEF80 000040 [ 0.006824] ACPI: APIC 0x0000000079AAC3A8 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006826] ACPI: FPDT 0x0000000079AAC470 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006828] ACPI: FIDT 0x0000000079AAC4B8 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006830] ACPI: SPMI 0x0000000079AAC558 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006833] ACPI: MCFG 0x0000000079AAC598 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006835] ACPI: UEFI 0x0000000079AAC5D8 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006837] ACPI: BDAT 0x0000000079AAC620 000030 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006839] ACPI: HPET 0x0000000079AAC650 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006842] ACPI: PMCT 0x0000000079AAC688 000064 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006844] ACPI: WDDT 0x0000000079AAC6F0 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006846] ACPI: SSDT 0x0000000079AAC730 00EDE7 (v01 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006848] ACPI: SSDT 0x0000000079ABB518 002117 (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006851] ACPI: SSDT 0x0000000079ABD630 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006853] ACPI: PRAD 0x0000000079ABD698 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006855] ACPI: DMAR 0x0000000079ABD7A0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006857] ACPI: HEST 0x0000000079ABD860 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006859] ACPI: BERT 0x0000000079ABDAE0 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006861] ACPI: ERST 0x0000000079ABDB10 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006864] ACPI: EINJ 0x0000000079ABDD40 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006865] ACPI: Reserving FACP table memory at [mem 0x79aac298-0x79aac3a3] [ 0.006867] ACPI: Reserving DSDT table memory at [mem 0x79a7f200-0x79aac290] [ 0.006867] ACPI: Reserving FACS table memory at [mem 0x79dfef80-0x79dfefbf] [ 0.006868] ACPI: Reserving APIC table memory at [mem 0x79aac3a8-0x79aac46f] [ 0.006869] ACPI: Reserving FPDT table memory at [mem 0x79aac470-0x79aac4b3] [ 0.006869] ACPI: Reserving FIDT table memory at [mem 0x79aac4b8-0x79aac553] [ 0.006870] ACPI: Reserving SPMI table memory at [mem 0x79aac558-0x79aac597] [ 0.006870] ACPI: Reserving MCFG table memory at [mem 0x79aac598-0x79aac5d3] [ 0.006871] ACPI: Reserving UEFI table memory at [mem 0x79aac5d8-0x79aac619] [ 0.006872] ACPI: Reserving BDAT table memory at [mem 0x79aac620-0x79aac64f] [ 0.006872] ACPI: Reserving HPET table memory at [mem 0x79aac650-0x79aac687] [ 0.006873] ACPI: Reserving PMCT table memory at [mem 0x79aac688-0x79aac6eb] [ 0.006873] ACPI: Reserving WDDT table memory at [mem 0x79aac6f0-0x79aac72f] [ 0.006874] ACPI: Reserving SSDT table memory at [mem 0x79aac730-0x79abb516] [ 0.006874] ACPI: Reserving SSDT table memory at [mem 0x79abb518-0x79abd62e] [ 0.006875] ACPI: Reserving SSDT table memory at [mem 0x79abd630-0x79abd693] [ 0.006876] ACPI: Reserving PRAD table memory at [mem 0x79abd698-0x79abd799] [ 0.006876] ACPI: Reserving DMAR table memory at [mem 0x79abd7a0-0x79abd85b] [ 0.006877] ACPI: Reserving HEST table memory at [mem 0x79abd860-0x79abdadb] [ 0.006877] ACPI: Reserving BERT table memory at [mem 0x79abdae0-0x79abdb0f] [ 0.006878] ACPI: Reserving ERST table memory at [mem 0x79abdb10-0x79abdd3f] [ 0.006879] ACPI: Reserving EINJ table memory at [mem 0x79abdd40-0x79abde6f] [ 0.006930] No NUMA configuration found [ 0.006930] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006940] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.007127] Reserving 256MB of memory at 1680MB for crashkernel (System RAM: 32660MB) [ 0.007165] Zone ranges: [ 0.007165] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.007166] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.007168] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.007169] Device empty [ 0.007169] Movable zone start for each node [ 0.007172] Early memory node ranges [ 0.007172] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.007173] node 0: [mem 0x0000000000100000-0x0000000079230fff] [ 0.007174] node 0: [mem 0x000000007984a000-0x000000007996afff] [ 0.007175] node 0: [mem 0x000000007bd4d000-0x000000007bd4dfff] [ 0.007175] node 0: [mem 0x000000007bdd4000-0x000000007bf50fff] [ 0.007176] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.007179] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.007184] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007223] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.011675] On node 0, zone DMA32: 1561 pages in unavailable ranges [ 0.011779] On node 0, zone DMA32: 9186 pages in unavailable ranges [ 0.011785] On node 0, zone DMA32: 134 pages in unavailable ranges [ 0.012282] On node 0, zone Normal: 16559 pages in unavailable ranges [ 0.012398] ACPI: PM-Timer IO Port: 0x408 [ 0.012407] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.012409] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012409] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012410] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012410] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012411] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012412] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012412] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012421] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23 [ 0.012426] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47 [ 0.012427] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012429] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012432] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012434] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012437] TSC deadline timer available [ 0.012442] CPU topo: Max. logical packages: 1 [ 0.012443] CPU topo: Max. logical dies: 1 [ 0.012443] CPU topo: Max. dies per package: 1 [ 0.012448] CPU topo: Max. threads per core: 2 [ 0.012449] CPU topo: Num. cores per package: 4 [ 0.012449] CPU topo: Num. threads per package: 8 [ 0.012450] CPU topo: Allowing 8 present CPUs plus 0 hotplug CPUs [ 0.012461] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012462] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.012463] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012464] PM: hibernation: Registered nosave memory: [mem 0x79231000-0x79233fff] [ 0.012465] PM: hibernation: Registered nosave memory: [mem 0x79234000-0x79849fff] [ 0.012466] PM: hibernation: Registered nosave memory: [mem 0x7996b000-0x79e00fff] [ 0.012467] PM: hibernation: Registered nosave memory: [mem 0x79e01000-0x7bd4cfff] [ 0.012468] PM: hibernation: Registered nosave memory: [mem 0x7bd4e000-0x7bdd3fff] [ 0.012469] PM: hibernation: Registered nosave memory: [mem 0x7bf51000-0x7fffffff] [ 0.012469] PM: hibernation: Registered nosave memory: [mem 0x80000000-0x8fffffff] [ 0.012470] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012471] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff] [ 0.012471] PM: hibernation: Registered nosave memory: [mem 0xfed20000-0xfeffffff] [ 0.012472] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012473] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012474] Booting paravirtualized kernel on bare hardware [ 0.012477] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016877] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.017131] percpu: Embedded 64 pages/cpu s225280 r8192 d28672 u262144 [ 0.017156] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.017210] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64", will be passed to user space. [ 0.017227] random: crng init done [ 0.019815] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.021172] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.021277] Fallback order for Node 0: 0 [ 0.021281] Built 1 zonelists, mobility grouping on. Total pages: 8230268 [ 0.021282] Policy zone: Normal [ 0.021451] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.021459] software IO TLB: area num 8. [ 0.043257] Memory: 1757744K/33444200K available (16384K kernel code, 5657K rwdata, 12972K rodata, 3980K init, 5696K bss, 989880K reserved, 0K cma-reserved) [ 0.043363] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.043372] Kernel/User page tables isolation: enabled [ 0.043396] ftrace: allocating 48134 entries in 189 pages [ 0.050672] ftrace: allocated 189 pages with 6 groups [ 0.051237] Dynamic Preempt: voluntary [ 0.051282] rcu: Preemptible hierarchical RCU implementation. [ 0.051283] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.051284] Trampoline variant of Tasks RCU enabled. [ 0.051285] Rude variant of Tasks RCU enabled. [ 0.051285] Tracing variant of Tasks RCU enabled. [ 0.051286] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.051286] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.054714] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.054877] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.054984] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.060309] Console: colour VGA+ 80x25 [ 0.060327] printk: console [ttyS1] enabled [ 1.233688] ACPI: Core revision 20230331 [ 1.237760] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.246892] APIC: Switch to symmetric I/O mode setup [ 1.251861] DMAR: Host address width 46 [ 1.255705] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.261019] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap d2078c106f0466 ecap f020de [ 1.268929] DMAR: RMRR base: 0x0000007bac6000 end: 0x0000007bad4fff [ 1.275194] DMAR: ATSR flags: 0x0 [ 1.278514] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.284781] DMAR-IR: IOAPIC id 8 under DRHD base 0xfbffc000 IOMMU 0 [ 1.291133] DMAR-IR: IOAPIC id 9 under DRHD base 0xfbffc000 IOMMU 0 [ 1.297486] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.302885] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.302886] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.317915] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.323218] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.329439] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.339891] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327358ef10f, max_idle_ns: 440795330581 ns [ 1.350402] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.01 BogoMIPS (lpj=3500008) [ 1.351422] CPU0: Thermal monitoring enabled (TM1) [ 1.352473] process: using mwait in idle threads [ 1.353402] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024 [ 1.354400] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4 [ 1.355402] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.356401] Spectre V2 : Mitigation: Retpolines [ 1.357400] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.358400] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.359400] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.360401] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.361400] Spectre V2 : User space: Mitigation: STIBP via prctl [ 1.362401] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl [ 1.363405] MDS: Mitigation: Clear CPU buffers [ 1.364400] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.365404] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.366400] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.367400] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.368401] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.369400] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.382368] Freeing SMP alternatives memory: 40K [ 1.382401] pid_max: default: 32768 minimum: 301 [ 1.383420] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.384405] Yama: becoming mindful. [ 1.385406] SELinux: Initializing. [ 1.386418] LSM support for eBPF active [ 1.387466] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.388445] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.389723] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz (family: 0x6, model: 0x3f, stepping: 0x2) [ 1.390524] RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.391414] RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.392410] RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.393410] Performance Events: PEBS fmt2+, Haswell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.394401] ... version: 3 [ 1.395400] ... bit width: 48 [ 1.396400] ... generic registers: 4 [ 1.397400] ... value mask: 0000ffffffffffff [ 1.398400] ... max period: 00007fffffffffff [ 1.399400] ... fixed-purpose events: 3 [ 1.400400] ... event mask: 000000070000000f [ 1.401494] signal: max sigframe size: 1776 [ 1.402413] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.403443] rcu: Hierarchical SRCU implementation. [ 1.403444] rcu: Max phase no-delay instances is 400. [ 1.406039] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.406477] smp: Bringing up secondary CPUs ... [ 1.407473] smpboot: x86: Booting SMP configuration: [ 1.407475] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.412776] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.412776] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.415453] smp: Brought up 1 node, 8 CPUs [ 1.415453] smpboot: Total of 8 processors activated (56000.12 BogoMIPS) [ 1.457931] node 0 deferred pages initialised in 39ms [ 1.459441] devtmpfs: initialized [ 1.459441] x86/mm: Memory block size: 128MB [ 1.460400] ACPI: PM: Registering ACPI NVS region [mem 0x7996b000-0x79e00fff] (4808704 bytes) [ 1.460400] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.460400] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.460400] pinctrl core: initialized pinctrl subsystem [ 1.464400] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.464400] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.464400] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.464400] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.464400] audit: initializing netlink subsys (disabled) [ 1.464410] audit: type=2000 audit(1726178760.134:1): state=initialized audit_enabled=0 res=1 [ 1.464473] thermal_sys: Registered thermal governor 'fair_share' [ 1.464475] thermal_sys: Registered thermal governor 'step_wise' [ 1.464475] thermal_sys: Registered thermal governor 'user_space' [ 1.465403] cpuidle: using governor menu [ 1.465438] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.465439] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.465498] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.465501] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.465511] PCI: Using configuration type 1 for base access [ 1.465541] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 1.468430] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.468435] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.468435] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.468435] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.468435] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.469431] cryptd: max_cpu_qlen set to 1000 [ 1.469476] ACPI: Added _OSI(Module Device) [ 1.469477] ACPI: Added _OSI(Processor Device) [ 1.469478] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.469478] ACPI: Added _OSI(Processor Aggregator Device) [ 1.469479] ACPI: Added _OSI(Linux-Dell-Video) [ 1.469480] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.469480] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.471400] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.471400] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.472518] ACPI: Dynamic OEM Table Load: [ 1.481400] ACPI: _OSC evaluated successfully for all CPUs [ 1.481400] ACPI: Interpreter enabled [ 1.481400] ACPI: PM: (supports S0 S4 S5) [ 1.481400] ACPI: Using IOAPIC for interrupt routing [ 1.481400] HEST: Enabling Firmware First mode for corrected errors. [ 1.526380] HEST: Table parsing has been initialized. [ 1.526506] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.526508] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.526509] PCI: Using E820 reservations for host bridge windows [ 1.526913] ACPI: Enabled 6 GPEs in block 00 to 3F [ 1.543049] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.543054] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.544243] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.544928] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.544930] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.544957] PCI host bridge to bus 0000:ff [ 1.544958] pci_bus 0000:ff: root bus resource [bus ff] [ 1.544970] pci 0000:ff:0b.0: [8086:2f81] type 00 class 0x088000 conventional PCI endpoint [ 1.545038] pci 0000:ff:0b.1: [8086:2f36] type 00 class 0x110100 conventional PCI endpoint [ 1.545092] pci 0000:ff:0b.2: [8086:2f37] type 00 class 0x110100 conventional PCI endpoint [ 1.545148] pci 0000:ff:0c.0: [8086:2fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.545200] pci 0000:ff:0c.1: [8086:2fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.545251] pci 0000:ff:0c.2: [8086:2fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.545302] pci 0000:ff:0c.3: [8086:2fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.545355] pci 0000:ff:0f.0: [8086:2ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.545407] pci 0000:ff:0f.1: [8086:2ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.545460] pci 0000:ff:0f.4: [8086:2ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.545511] pci 0000:ff:0f.5: [8086:2ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.545563] pci 0000:ff:0f.6: [8086:2ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.545614] pci 0000:ff:10.0: [8086:2f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.545666] pci 0000:ff:10.1: [8086:2f34] type 00 class 0x110100 conventional PCI endpoint [ 1.545718] pci 0000:ff:10.5: [8086:2f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.545768] pci 0000:ff:10.6: [8086:2f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.545819] pci 0000:ff:10.7: [8086:2f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.545870] pci 0000:ff:12.0: [8086:2fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.545923] pci 0000:ff:12.1: [8086:2f30] type 00 class 0x110100 conventional PCI endpoint [ 1.545979] pci 0000:ff:13.0: [8086:2fa8] type 00 class 0x088000 conventional PCI endpoint [ 1.546034] pci 0000:ff:13.1: [8086:2f71] type 00 class 0x088000 conventional PCI endpoint [ 1.546090] pci 0000:ff:13.2: [8086:2faa] type 00 class 0x088000 conventional PCI endpoint [ 1.546146] pci 0000:ff:13.3: [8086:2fab] type 00 class 0x088000 conventional PCI endpoint [ 1.546201] pci 0000:ff:13.4: [8086:2fac] type 00 class 0x088000 conventional PCI endpoint [ 1.546256] pci 0000:ff:13.5: [8086:2fad] type 00 class 0x088000 conventional PCI endpoint [ 1.546311] pci 0000:ff:13.6: [8086:2fae] type 00 class 0x088000 conventional PCI endpoint [ 1.546363] pci 0000:ff:13.7: [8086:2faf] type 00 class 0x088000 conventional PCI endpoint [ 1.546419] pci 0000:ff:14.0: [8086:2fb0] type 00 class 0x088000 conventional PCI endpoint [ 1.546475] pci 0000:ff:14.1: [8086:2fb1] type 00 class 0x088000 conventional PCI endpoint [ 1.546530] pci 0000:ff:14.2: [8086:2fb2] type 00 class 0x088000 conventional PCI endpoint [ 1.546587] pci 0000:ff:14.3: [8086:2fb3] type 00 class 0x088000 conventional PCI endpoint [ 1.546641] pci 0000:ff:14.4: [8086:2fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.546694] pci 0000:ff:14.5: [8086:2fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.546748] pci 0000:ff:14.6: [8086:2fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.546801] pci 0000:ff:14.7: [8086:2fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.546854] pci 0000:ff:15.0: [8086:2fb4] type 00 class 0x088000 conventional PCI endpoint [ 1.546909] pci 0000:ff:15.1: [8086:2fb5] type 00 class 0x088000 conventional PCI endpoint [ 1.546965] pci 0000:ff:15.2: [8086:2fb6] type 00 class 0x088000 conventional PCI endpoint [ 1.547021] pci 0000:ff:15.3: [8086:2fb7] type 00 class 0x088000 conventional PCI endpoint [ 1.547079] pci 0000:ff:16.0: [8086:2f68] type 00 class 0x088000 conventional PCI endpoint [ 1.547134] pci 0000:ff:16.6: [8086:2f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.547188] pci 0000:ff:16.7: [8086:2f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.547241] pci 0000:ff:17.0: [8086:2fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.547297] pci 0000:ff:17.4: [8086:2fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.547350] pci 0000:ff:17.5: [8086:2fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.547406] pci 0000:ff:17.6: [8086:2fba] type 00 class 0x088000 conventional PCI endpoint [ 1.547461] pci 0000:ff:17.7: [8086:2fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.547517] pci 0000:ff:1e.0: [8086:2f98] type 00 class 0x088000 conventional PCI endpoint [ 1.547569] pci 0000:ff:1e.1: [8086:2f99] type 00 class 0x088000 conventional PCI endpoint [ 1.547621] pci 0000:ff:1e.2: [8086:2f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.547674] pci 0000:ff:1e.3: [8086:2fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.547701] pci 0000:ff:1e.4: [8086:2f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.547755] pci 0000:ff:1f.0: [8086:2f88] type 00 class 0x088000 conventional PCI endpoint [ 1.547809] pci 0000:ff:1f.2: [8086:2f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.548013] acpi LNXCPU:08: Entry not well-defined, consider updating BIOS [ 1.548856] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.548860] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.549219] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.549921] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.549922] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.550496] PCI host bridge to bus 0000:00 [ 1.550498] pci_bus 0000:00: root bus resource [io 0x0000-0x03af window] [ 1.550499] pci_bus 0000:00: root bus resource [io 0x03e0-0x0cf7 window] [ 1.550500] pci_bus 0000:00: root bus resource [io 0x03b0-0x03df window] [ 1.550501] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.550502] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.550503] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.550504] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.550504] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.550505] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.550526] pci 0000:00:00.0: [8086:2f00] type 00 class 0x060000 PCIe Root Port [ 1.550659] pci 0000:00:01.0: [8086:2f02] type 01 class 0x060400 PCIe Root Port [ 1.550689] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.550692] pci 0000:00:01.0: bridge window [io 0xe000-0xefff] [ 1.550694] pci 0000:00:01.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.550701] pci 0000:00:01.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.550736] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.550836] pci 0000:00:02.0: [8086:2f04] type 01 class 0x060400 PCIe Root Port [ 1.550866] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.550869] pci 0000:00:02.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.550909] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.551006] pci 0000:00:03.0: [8086:2f08] type 01s 0x060400 PCIe Root Port [ 1.551036] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.551078] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.551179] pci 0000:00:04.0: [8086:2f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.551198] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.551307] pci 0000:00:04.1: [8086:2f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.551325] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.551435] pci 0000:00:04.2: [8086:2f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.551453] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.551562] pci 0000:00:04.3: [8086:2f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.551580] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.551686] pci 0000:00:04.4: [8086:2f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.551705] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.551809] pci 0000:00:04.5: [8086:2f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.551827] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.551931] pci 0000:00:04.6: [8086:2f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.551949] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.552053] pci 0000:00:04.7: [8086:2f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.552071] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.552173] pci 0000:00:05.0: [8086:2f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.552260] pci 0000:00:05.1: [8086:2f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.552371] pci 0000:00:05.2: [8086:2f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.552456] pci 0000:00:05.4: [8086:2f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.552470] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.552585] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.552883] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.552916] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.552934] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.552953] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.552970] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.552989] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.553008] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.553075] pci 0000:00:11.4: PME# supported from D3hot [ 1.553158] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.553200] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.553325] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.553413] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.553455] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.553588] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.553660] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.553702] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.553835] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.553924] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.553956] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.554118] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.554202] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.554271] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.554373] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.554479] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.554548] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.554554] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.554557] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.554654] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.554761] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.554830] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.554835] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.554839] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.554936] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.555049] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.555081] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.555243] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.555327] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.555581] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.555613] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.555631] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.555650] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.555669] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.555687] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.555706] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.555773] pci 0000:00:1f.2: PME# supported from D3hot [ 1.555841] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.555884] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.555938] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.556044] pci 0000:00:1f.6: [8086:8d24] type 00 class 0x118000 conventional PCI endpoint [ 1.556087] pci 0000:00:1f.6: BAR 0 [mem 0xfb430000-0xfb430fff 64bit] [ 1.556361] acpiphp: Slot [1] registered [ 1.556388] pci 0000:01:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.556409] pci 0000:01:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.556419] pci 0000:01:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.556442] pci 0000:01:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.556451] pci 0000:01:00.0: ROM [mem 0xfb380000-0xfb3fffff pref] [ 1.556496] pci 0000:01:00.0: PME# supported from D0 D3hot [ 1.556518] pci 0000:01:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.556519] pci 0000:01:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.556533] pci 0000:01:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.556534] pci 0000:01:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.556700] pci 0000:01:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.556721] pci 0000:01:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.556731] pci 0000:01:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.556754] pci 0000:01:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.556764] pci 0000:01:00.1: ROM [mem 0xfb300000-0xfb37ffff pref] [ 1.556806] pci 0000:01:00.1: PME# supported from D0 D3hot [ 1.556825] pci 0000:01:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.556826] pci 0000:01:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.556840] pci 0000:01:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.556840] pci 0000:01:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.556988] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.557104] pci 0000:02:00.0: [8086:2700] type 00 class 0x010802 PCIe Endpoint [ 1.557124] pci 0000:02:00.0: BAR 0 [mem 0xfb210000-0xfb213fff 64bit] [ 1.557166] pci 0000:02:00.0: ROM [mem 0xfb200000-0xfb20ffff pref] [ 1.557170] pci 0000:02:00.0: enabling Extended Tags [ 1.557287] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.557389] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.557441] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.557544] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.557616] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.557630] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.557635] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.557689] pci 0000:05:00.0: enabling Extended Tags [ 1.557814] pci 0000:05:00.0: supports D1 D2 [ 1.557814] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.557954] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.558042] pci_bus 0000:06: extended config space not accessible [ 1.558076] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.558115] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.558135] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.558155] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.558255] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.558326] pci 0000:06:00.0: supports D1 D2 [ 1.558327] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.558477] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.558632] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.558667] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.558704] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.558722] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.558961] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.559024] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.559026] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.559064] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.559064] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.559412] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.559447] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.559484] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.559502] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.559731] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.559793] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.559794] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.559834] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.559834] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.560150] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.560163] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.560847] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.560881] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.560916] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.560949] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.560982] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.560983] ACPI: PCI: Interrupt link LNKE disabled [ 1.561017] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.561017] ACPI: PCI: Interrupt link LNKF disabled [ 1.561050] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.561050] ACPI: PCI: Interrupt link LNKG disabled [ 1.561084] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.561085] ACPI: PCI: Interrupt link LNKH disabled [ 1.561250] iommu: Default domain type: Translated [ 1.561250] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.561250] SCSI subsystem initialized [ 1.561250] ACPI: bus type USB registered [ 1.561250] usbcore: registered new interface driver usbfs [ 1.561250] usbcore: registered new interface driver hub [ 1.561250] usbcore: registered new device driver usb [ 1.561420] pps_core: LinuxPPS API ver. 1 registered [ 1.561421] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.561424] PTP clock support registered [ 1.561439] EDAC MC: Ver: 3.0.0 [ 1.561567] NetLabel: Initializing [ 1.561568] NetLabel: domain hash size = 128 [ 1.561569] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.561582] NetLabel: unlabeled traffic allowed by default [ 1.561582] PCI: Using ACPI for IRQ routing [ 1.572554] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.572554] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.572554] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.572554] vgaarb: loaded [ 1.572554] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.572554] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.576967] clocksource: Switched to clocksource tsc-early [ 1.584673] VFS: Disk quotas dquot_6.6.0 [ 1.584683] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.584736] pnp: PnP ACPI init [ 1.585026] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.585028] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.585030] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.585031] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.585031] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.585033] system 00:01: [mem 0xfed1c000-0xfed3ffff] could not be reserved [ 1.585034] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.585035] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.585036] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.585037] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.585038] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.585039] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.585193] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.585195] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.585196] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.585197] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.585198] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.585887] pnp: PnP ACPI: found 5 devices [ 1.591572] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.591625] NET: Registered PF_INET protocol family [ 1.591815] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.594147] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.594178] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.594190] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.594399] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.594514] TCP: Hash tables configured (established 262144 bind 65536) [ 1.594657] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.594747] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.594803] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.594883] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.594888] NET: Registered PF_XDP protocol family [ 1.594910] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.594921] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.594925] pci 0000:01:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.594927] pci 0000:01:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.594928] pci 0000:01:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.594929] pci 0000:01:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.594931] pci 0000:01:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.594931] pci 0000:01:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.594933] pci 0000:01:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.594933] pci 0000:01:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.594935] pci 0000:01:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ [mem size 0x00 [ 1.594937] pci 0000:01:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.594938] pci 0000:01:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.594939] pci 0000:01:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.594940] pci 0000:01:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.594941] pci 0000:01:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.594942] pci 0000:01:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.594944] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.594945] pci 0000:00:01.0: bridge window [io 0xe000-0xefff] [ 1.594951] pci 0000:00:01.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.594956] pci 0000:00:01.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.594964] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.594970] pci 0000:00:02.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.594981] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.594997] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.595021] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.595024] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1ge window [mem 0xfa000000-0xfb0fffff] [ e to [bus 05-0 bridge window [io 0xd000-0xdfff] [ 1.595060] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.595076] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.595084] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.595090] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.595096] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.595103] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.595104] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.595113] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.595118] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.595130] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.595130] pci_bus 0000:00: resource 4 [io 0x0000-0x03af window] [ 1.595132] pci_bus 0000:00: resource 5 [io 0x03e0-0x0cf7 window] [ 1.595133] pci_bus 0000:00: resource 6 [io 0x03b0-0x03df window] [ 1.595133] pci_bus 0000:00: resource 7 [io 0x1000-0xffff window] [ 1.595134] pci_bus 0000:00: resource 8 [mem 0x000a0000-0x000bffff window] [ 1.595135] pci_bus 0000:00: resource 9 [mem 0xfedb0000-0xfedb000f window] [ 1.595136] pci_bus 0000:00: resource 10 [mem 0xfedc0000-0xfedc000f window] [ 1.595137] pci_bus 0000:00: resource 11 [mem 0x90000000-0xfbffbfff window] [ 1.595138]e 0 [io 0xe000-0xefff] [ 1.595139] pci_bus 0000:01: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.595140] pci_bus 0000:01: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.595141] pci_bus 0000:02: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.595142] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.595142] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.595143] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.595144] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.595145] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.595146] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.595147] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.595318] pci 0000:00:05.0: disabled boot interrupts on device [8086:2f28] [ 1.611560] p00:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 15669 usecs [ 1.627554] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 15603 usecs [ 1.627570] pci 0000:01:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.627606] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.627606] software IO TLB: mapped [mem 0x0000000065000000-0x0000000069000000] (64MB) [ 1.627613] ACPI: bus type thunderbolt registered [ 1.627616] Trying to unpack rootfs image as initramfs... [ 1.723162] Initialise system trusted keyrings [ 1.723173] Key type blacklist registered [ 1.723224] set: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.723238] zbud: loaded [ 1.821964] integrity: Platform Keyring initialized [ 1.821970] integrity: Machine keyring initialized [ 1.829936] NET: Registered PF_ALG protocol family [ 1.829939] xor: automatically using best checksumming function avx [ 1.829940] Key type asymmetric registered [ 1.829942] Asymmetric key parser 'x509' registered [ 1.829942] Running certificate verification selftests [ 1.831217] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.831726] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.831804] io scheduler mq-deadline registered [ 1.831806] io scheduler kyber registered [ 1.831822] io scheduler bfq registered [ 1.888116] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.888603] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.888867] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.889133] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.889375] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.889614] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.889839] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.890062] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.890149] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.890174] ACPI: \_SB_.SCK0.CP01: Found 2 idle states [ 1.890196] ACPI: \_SB_.SCK0.CP02: Found 2 idle states [ 1.890220] ACPI: \_SB_.SCK0.CP03: Found 2 idle states [ 1.890242] ACPI: \_SB_.SCK0.CP04: Found 2 idle states [ 1.890263] ACPI: \_SB_.SCK0.CP05: Found 2 idle states [ 1.890284] ACPI: \_SB_.SCK0.CP06: Found 2 idle states [ 1.890304] ACPI: \_SB_.SCK0.CP07: Found 2 idle states [ 1.937807] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.937833] ACPI: button: Power Button [PWRB] [ 1.937856] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.937965] ACPI: button: Power Button [PWRF] [ 1.957860] Freeing initrd memory: 31756K [ 1.971128] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.971131] pstore: Registered erst as persistent store backend [ 1.971264] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.971372] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.978825] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.987498] Non-volatile memory driver v1.3 [ 2.036729] rdac: device handler registered [ 2.036760] hp_sw: device handler registered [ 2.036761] emc: device handler registered [ 2.036779] alua: device handler registered [ 2.037067] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.037111] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 2.037125] ehci-pci 0000:00:1d.0: debug port 2 [ 2.041046] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.047523] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.047559] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.047561] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.047562] usb usb1: Product: EHCI Host Controller [ 2.047563] usb usb1: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.047564] usb usb1: SerialNumber: 0000:00:1d.0 [ 2.047659] hub 1-0:1.0: USB hub found [ 2.047664] hub 1-0:1.0: 2 ports detected [ 2.047773] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.047835] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 2.048924] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.049111] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.049116] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.049184] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 2.049187] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.049189] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 2.049204] ehci-pci 0000:00:1a.0: debug port 2 [ 2.049217] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.049219] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.049220] usb usb2: Product: xHCI Host Controller [ 2.049220] usb usb2: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.049221] usb usb2: SerialNumber: 0000:00:14.0 [ 2.049315] hub 2-0:1.0: USB hub found [ 2.049348] hub 2-0:1.0: 15 ports detected [ 2.051782] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 2.051784] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.051785] usb usb4: Product: xHCI Host Controller [ 2.051786] usb usb4: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.051787] usb usb4: SerialNumber: 0000:00:14.0 [ 2.051876] hub 4-0:1.0: USB hub found [ 2.051893] hub 4-0:1.0: 6 ports detected [ 2.053121] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.053154] usbcore: registered new interface driver usbserial_generic [ 2.053158] usbserial: USB Serial support registered for generic [ 2.053194] i8042: PNP: No PS/2 controller found. [ 2.053241] mousedev: PS/2 mouse device common for all mice [ 2.053306] rtc_cmos 00:00: RTC can wake from S4 [ 2.053590] rtc_cmos 00:00: registered as rtc0 [ 2.053635] rtc_cmos 00:00: setting system clock to 2024-09-12T22:06:03 UTC (1726178763) [ 2.053660] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 2.059524] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.059555] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.059557] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.059559] usb usb3: Product: EHCI Host Controller [ 2.059559] usb usb3: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.059560] usb usb3: SerialNumber: 0000:00:1a.0 [ 2.059643] hub 3-0:1.0: USB hub found [ 2.059647] hub 3-0:1.0: 2 ports detected [ 2.086233] intel_pstate: Intel P-state driver initializing [ 2.158913] hid: raw HID events driver (C) Jiri Kosina [ 2.158948] usbcore: registered new interface driver usbhid [ 2.158949] usbhid: USB HID core driver [ 2.158971] drop_monitor: Initializing network drop monitor service [ 2.168893] Initializing XFRM netlink socket [ 2.168910] NET: Registered PF_INET6 protocol family [ 2.174600] Segment Routing with IPv6 [ 2.174618] NET: Registered PF_PACKET protocol family [ 2.174646] mpls_gso: MPLS GSO support [ 2.220650] microcode: Current revision: 0x00000049 [ 2.220653] microcode: Updated early from: 0x00000036 [ 2.235641] resctrl: L3 monitoring detected [ 2.235662] IPI shorthand broadcast: enabled [ 2.235667] AVX2 version of gcm_enc/dec engaged. [ 2.283524] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.288720] AES CTR mode by8 optimization enabled [ 2.288763] sched_clock: Marking stable (1013000650, 1275493645)->(2810216910, -521722615) [ 2.302215] registered taskstats version 1 [ 2.307499] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 2.314059] Loading compiled-in X.509 certificates [ 2.314589] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.314895] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.315193] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.315346] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.315355] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.317142] page_owner is disabled [ 2.317368] pstore: Using crash dump compression: deflate [ 2.317378] Key type big_key registered [ 2.319980] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.416839] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.416842] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.417001] hub 1-1:1.0: USB hub found [ 2.417089] hub 1-1:1.0: 8 ports detected [ 2.434904] Key type encrypted registered [ 2.434911] ima: No TPM chip found, activating TPM-bypass! [ 2.434914] Loading compiled-in module X.509 certificates [ 2.435224] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.435227] ima: Allocated hash algorithm: sha256 [ 2.435236] ima: No architecture policies found [ 2.435243] evm: Initialising EVM extended attributes: [ 2.435244] evm: security.selinux [ 2.435244] evm: security.SMACK64 (disabled) [ 2.435245] evm: security.SMACK64EXEC (disabled) [ 2.435246] evm: security.SMACK64TRANSMUTE (disabled) [ 2.435246] evm: security.SMACK64MMAP (disabled) [ 2.435246] evm: security.apparmor (disabled) [ 2.435247] evm: security.ima [ 2.435247] evm: security.capability [ 2.435248] evm: HMAC attrs: 0x1 [ 2.442838] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.442841] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.443116] hub 3-1:1.0: USB hub found [ 2.443211] hub 3-1:1.0: 6 ports detected [ 2.446699] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.446703] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.447237] hub 2-12:1.0: USB hub found [ 2.447326] hub 2-12:1.0: 4 ports detected [ 2.641522] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 2.641528] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 2.644279] clocksource: Switched to clocksource tsc [ 3.873704] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 4.042613] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.042614] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.098872] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 4.162002] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 4.171822] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 4.187774] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.177664] clk: Disabling unused clocks [ 5.182459] Freeing unused decrypted memory: 2028K [ 5.187660] Freeing unused kernel image (initmem) memory: 3980K [ 5.193575] Write protecting the kernel read-only data: 30720k [ 5.199728] Freeing unused kernel image (rodata/data gap) memory: 1364K [ 5.241082] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.241084] x86/mm: Checking user space page tables [ 5.274474] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.274482] Run /init as init process [ 5.287543] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.287659] systemd[1]: Detected architecture x86-64. [ 5.287661] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-70.git20240819.el9 (Initramfs)! [ 5.338634] systemd[1]: Hostname set to . [ 5.399046] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.399162] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ 5.420648] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 5.434664] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 5.446598] systemd[1]: Reached target Swaps. [ OK ] Reached target Swaps. [ 5.457606] systemd[1]: Reached target Timer Units. [ OK ] Reached target Timer Units. [ 5.469643] systemd[1]: Listening on D-Bus System Message Bus Socket. [ OK ] Listening on D-Bus System Message Bus Socket. [ 5.484739] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 5.498787] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 5.510644] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 5.524689] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 5.538578] systemd[1]: Reached target Socket Units. [ OK ] Reached target Socket Units. [ 5.557439] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 5.573611] systemd[1]: Starting Journal Service... Starting Journal Service... [ 5.586240] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 5.599141] systemd[1]: Starting Create System Users... Starting Creat[ 5.606152] fuse: init (API version 7.36) e System Users... [ 5.615157] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 5.628270] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Setup Virtual Console. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... [ 6.025622] dca service started, version 1.12.1 Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymouth Directory Watch. [ [ 6.061587] nvme nvme0: pci function 0000:02:00.0 OK ] Reached target Path Units. [ OK ] Reached target Basic System. [ 6.085710] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.085717] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 6.086917] nvme nvme0: 8/0/0 default/read/poll queues [ 6.093234] igb: Intel(R) Gigabit Ethernet Network Driver [ 6.093237] igb: Copyright (c) 2007-2014 Intel Corporation. [ 6.133315] ACPI: bus type drm_connector registered [ 6.138948] ahci 0000:00:11.4: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 6.138957] ahci 0000:00:11.4: 4/4 ports implemented (port mask 0xf) [ 6.138959] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.151580] igb 0000:07:00.0: added PHC on eth0 [ 6.151610] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.151612] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:6b:ff:78 [ 6.151689] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.151691] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.153733] scsi host0: ahci [ 6.153837] scsi host1: ahci [ 6.153914] scsi host2: ahci [ 6.154005] scsi host3: ahci [ 6.154055] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 51 lpm-pol 0 [ 6.154058] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 51 lpm-pol 0 [ 6.154061] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 51 lpm-pol 0 [ 6.154063] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 51 lpm-pol 0 [ 6.154512] ahci 0000:00:1f.2: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 6.154516] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) [ 6.154518] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.169827] scsi host4: ahci [ 6.169916] scsi host5: ahci [ 6.170001] scsi host6: ahci [ 6.170081] scsi host7: ahci [ 6.170170] scsi host8: ahci [ 6.170260] scsi host9: ahci [ 6.170290] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 61 lpm-pol 0 [ 6.170293] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 61 lpm-pol 0 [ 6.170294] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 61 lpm-pol 0 [ 6.170296] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 61 lpm-pol 0 [ 6.170299] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 61 lpm-pol 0 [ 6.170301] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 61 lpm-pol 0 [ 6.207729] igb 0000:07:00.1: added PHC on eth1 [ 6.207774] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.207775] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:6b:ff:79 [ 6.207867] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.207868] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.252715] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.253004] ixgbe 0000:01:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.253086] ixgbe 0000:01:00.0: MAC: 2, PHY: 14, SFP+: 3, PBA No: 400900-000 [ 6.253088] ixgbe 0000:01:00.0: 0c:c4:7a:bd:14:8e [ 6.254075] ixgbe 0000:01:00.0: Intel(R) 10 Gigabit Network Connection [ 6.463577] ata2: SATA link down (SStatus 0 SControl 300) [ 6.463605] ata1: SATA link down (SStatus 0 SControl 300) [ 6.463645] ata3: SATA link down (SStatus 0 SControl 300) [ 6.463682] ata4: SATA link down (SStatus 0 SControl 300) [ 6.479011] ata9: SATA link down (SStatus 0 SControl 300) [ 6.479036] ata8: SATA link down (SStatus 0 SControl 300) [ 6.479059] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.479083] ata10: SATA link down (SStatus 0 SControl 300) [ 6.479123] ata7: SATA link down (SStatus 0 SControl 300) [ 6.479169] ata6: SATA link down (SStatus 0 SControl 300) [ 6.480201] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN04, max UDMA/133 [ 6.480382] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.481492] ata5.00: configured for UDMA/133 [ 6.481630] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN04 PQ: 0 ANSI: 5 [ 6.492065] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.538738] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.554162] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.560048] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.566601] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.566624] sd 4:0:0:0: [sda] Write Protect is off [ 6.566645] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.566666] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.571033] Console: switching to colour dummy device 80x25 [ 6.571186] ast 0000:06:00.0: Using P2A bridge for configuration [ 6.571188] ast 0000:06:00.0: AST 2400 detected [ 6.571236] ast 0000:06:00.0: [drm] Using analog VGA [ 6.571245] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.571599] sda: sda1 [ 6.571658] sd 4:0:0:0: [sda] Attached SCSI removable disk [ 6.574445] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.580238] fbcon: astdrmfb (fb0) is primary device [ 6.610368] Console: switching to colour frame buffer device 128x48 [ 6.627912] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.398805] ixgbe 0000:01:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.399099] ixgbe 0000:01:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.399181] ixgbe 0000:01:00.1: MAC: 2, PHY: 1, PBA No: 400900-000 [ 7.399182] ixgbe 0000:01:00.1: 0c:c4:7a:bd:14:8f [ 7.400240] ixgbe 0000:01:00.1: Intel(R) 10 Gigabit Network Connection [ 7.418501] ixgbe 0000:01:00.1 ens1f1: renamed from eth0 [ 7.435614] ixgbe 0000:01:00.0 ens1f0: renamed from eth2 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check on /dev…2923-554d-41e2-ac4a-c752ff079ceb... [ OK ] Finished File System Check on /dev…8d2923-554d-41e2-ac4a-c752ff079ceb. Mounting /sysroot... [ 7.669379] EXT4-fs (sda1): mounted filesystem fa8d2923-554d-41e2-ac4a-c752ff079ceb ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manager for Device Events and Files... [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root... [ 7.996817] systemd-journald[279]: Received SIGTERM from PID 1 (systemd). [ 8.493197] SELinux: policy capability network_peer_controls=1 [ 8.493205] SELinux: policy capability open_perms=1 [ 8.493206] SELinux: policy capability extended_socket_class=1 [ 8.493207] SELinux: policy capability always_check_network=0 [ 8.493208] SELinux: policy capability cgroup_seclabel=1 [ 8.493209] SELinux: policy capability nnp_nosuid_transition=1 [ 8.493210] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.535725] audit: type=1403 audit(1726178769.981:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.543778] systemd[1]: Successfully loaded SELinux policy in 113.457ms. [ 8.624488] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 27.703ms. [ 8.645665] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.645802] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.520808] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.520906] systemd[1]: Stopped Switch Root. [ 9.528191] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.528471] systemd[1]: Created slice Slice /system/getty. [ 9.532493] systemd[1]: Created slice Slice /system/modprobe. [ 9.541352] systemd[1]: Created slice Slice /system/serial-getty. [ 9.546839] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.552614] systemd[1]: Created slice User and Session Slice. [ OK [[ 9.558431] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.559568] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.564748] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. 0m] Stopped [0;[ 9.570227] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.586493] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.594040] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.603445] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.615138] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.625474] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.635801] systemd[1]: Reached target Local Encrypted Volumes. [ 9.646136] systemd[1]: Stopped target Switch Root. [ 9.656806] systemd[1]: Stopped target Initrd File Systems. [ 9.667734] systemd[1]: Stopped target Initrd Root File System. [ 9.673649] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.678540] systemd[1]: Reached target Path Units. [ 9.684097] systemd[1]: Reached target Slice Units. [ 9.690001] systemd[1]: Reached target Swaps. [ 9.696776] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.701927] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.707348] systemd[1]: Listening on LVM2 poll daemon socket. 1;39mSwitch Root. [ OK ] Created slice [0;1;[ 9.734770] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.734821] systemd[1]: Reached target RPC Port Mapper. 39mSlice /system/getty. [ OK ] Created slice [ 9.752136] systemd[1]: Listening on Process Core Dump Socket. [ 9.752264] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.758895] systemd[1]: Listening on udev Control Socket. [ 9.764970] systemd[1]: Listening on udev Kernel Socket. [ 9.771021] systemd[1]: Mounting Huge Pages File System... [ 9.776343] systemd[1]: Mounting POSIX Message Queue File System... [ 9.781768] systemd[1]: Mounting Kernel Debug File System... [ 9.788009] systemd[1]: Mounting Kernel Trace File System... [ 9.792904] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). Slice /system/modprobe. [ OK ] Created slice [0;1;3[ 9.817560] systemd[1]: Starting Create List of Static Device Nodes... 9mSlice /system/[ 9.825976] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 9.826895] systemd[1]: Starting Load Kernel Module configfs... [ 9.837680] systemd[1]: Starting Load Kernel Module drm... [ 9.843531] systemd[1]: Starting Load Kernel Module fuse... [ 9.849887] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 9.853797] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 9.853843] systemd[1]: Stopped Plymouth switch root service. [ 9.862266] systemd[1]: Stopped Journal Service. serial-getty[ 9.880345] systemd[1]: Starting Journal Service... [ 9.882906] systemd[1]: Starting Load Kernel Modules... . [ OK[ 9.887173] systemd[1]: Starting Generate network units from Kernel command line... [ 9.891305] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). [ 9.892187] systemd[1]: Starting Remount Root and Kernel File Systems... [ 9.900328] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 9.901222] systemd[1]: Starting Coldplug All udev Devices... [ 9.920073] systemd[1]: Mounted Huge Pages File System. [ 9.925634] systemd[1]: Mounted POSIX Message Queue File System. [ 9.935013] systemd[1]: Mounted Kernel Debug File System. [ 9.940725] systemd[1]: Mounted Kernel Trace File System. [ 9.945981] systemd[1]: Started Journal Service. [ 9.960152] EXT4-fs (sda1): re-mounted fa8d2923-554d-41e2-ac4a-c752ff079ceb r/w. Quota mode: none. ] Created slice Slice /system/sshd-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Set up automount Arbitrary Executa…ormats File System Automount Point. [ OK ] Reached target ceph target allowin…eph-mon@.service instances at once. [ OK ] Reached target ceph target allowin…eph-mds@.service instances at once. [ OK ] Reached target ceph target allowin…eph-mgr@.service instances at once. [ OK ] Reached target ceph target allowin…eph-osd@.service instances at once. [ OK ] Reached target ceph target allowin…radosgw@.service instances at once. [ OK ] Reached target ceph target allowin…-mirror@.service instances at once. [ OK ] Reached target [[ 10.064665] systemd-journald[577]: Received client request to flush runtime journal. 0;1;39mLocal Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM2 mirror…ing dmeventd or progress polling... Starting Load Kernel Module configfs[ 10.215523] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.215545] device-mapper: uevent: version 1.0.3 [ 10.215643] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com ... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network units from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Apply Kernel Variables... Starting Create Static Device Nodes in /dev... [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Monitoring of LVM2 mirror…using dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Automatic Boot Loader Update. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 10.624693] IPMI message handler: version 39.2 [ 10.633030] ipmi device interface [ 10.647322] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.655010] ipmi_si: IPMI System Interface driver [ 10.655036] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.655044] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.655329] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.655546] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.655643] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.657556] igb 0000:07:00.0: DCA enabled [ 10.657574] igb 0000:07:00.1: DCA enabled [ 10.661078] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.661082] ipmi_si: Adding ACPI-specified kcs state machine [ 10.661165] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.710192] power_meter ACPI000D:00: Found ACPI power meter. [ OK [[ 10.712958] power_meter ACPI000D:00: Ignoring unsafe software power cap! 0m] Finished [0[ 10.713009] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). ;1;39mCreate Volatile Files and Directories. Starting Security Auditing Service... Starting RPC B[ 10.766316] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. ind... [ 10.777369] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 10.798339] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ OK ] Started /usr/sbin/lvm vgchange -aay --autoactivation event vg_nvme. [ 10.823844] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.836344] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.837094] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 10.857419] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 10.857426] RAPL PMU: hw unit of domain package 2^-14 Joules [ 10.857429] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 10.890554] iTCO_vendor_support: vendor-support=0 [ 10.897308] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 10.897687] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ 10.931678] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 10.942062] ipmi_ssif: IPMI SSIF Interface driver Mounting RPC Pipe File System... [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Started RPC Bind. Mounting /var/lib/ceph... [ 11.117672] RPC: Registered named UNIX socket transport module. [ 11.117679] RPC: Registered udp transport module. [ 11.117684] RPC: Registered tcp transport module. [ 11.117685] RPC: Registered tcp-with-tls transport module. [ 11.117687] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ 11.369564] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.378441] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported beginning with RHEL10 [ 11.378484] XFS (dm-4): Mounting V4 Filesystem 71e8133a-e78d-422a-b187-7a66274eedbb [ 11.381285] XFS (dm-4): Ending clean mount [ 11.381327] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) [ OK [[ 11.408671] EDAC MC0: Giving out device to module sb_edac controller Haswell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) 0m] Mounted [0;[ 11.408674] EDAC sbridge: Ver: 1.1.2 1;39m/var/lib/ceph. [ OK ] Finished Record System Boot/Shutdown in UTMP. [[0;[ 11.434568] intel_rapl_common: Found RAPL domain package [ 11.434579] intel_rapl_common: Found RAPL domain dram 32m OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowin…l ceph*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. Starting Hostname Service... [ OK ] Started Hostname Service. [* ] A start job is running for Network Manager (5s / no limit) M [ OK ] Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.  Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.593008] ixgbe 0000:01:00.0: registered PHC device on ens1f0 [ 15.749355] ixgbe 0000:01:00.1: registered PHC device on ens1f1 [ 15.762647] ixgbe 0000:01:00.0 ens1f0: detected SFP+: 3 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 16.065807] ixgbe 0000:01:00.0 ens1f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 16.065919] IPv6: ADDRCONF(NETDEV_CHANGE): ens1f0: link becomes ready [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [** ] A start job is running for Network Manager Wait Online (8s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ ***] A start job is running for Network …nager Wait Online (11s / no limit) M [ **] A start job is running for Network …nager Wait Online (11s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.47 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot daemon for…ocessing new SELinux denial logs... [ 23.007683] block sda: the capability attribute has been deprecated. + '[' 172.21.15.47 '!=' '' ']' + set -e + '[' -n 172.21.15.47 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.47 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.47 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi047.front.sepia.ceph.com + '[' -n smithi047.front.sepia.ceph.com ']' + hostname smithi047.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi047 + echo smithi047 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.47 smithi047.front.sepia.ceph.com smithi047/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-505.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi047 login: [disconnect] 2024-09-12T22:06:31.086 INFO:teuthology.misc:Re-opening connections... 2024-09-12T22:06:31.086 INFO:teuthology.misc:trying to connect to ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T22:06:31.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T22:06:31.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:06:31.367 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-12T22:06:31.950 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T22:06:31.950 DEBUG:teuthology.misc:waited 0.8639340400695801 2024-09-12T22:06:32.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~129s 2024-09-12T22:06:32.952 DEBUG:tasks.ceph_manager:Mounting data for osd.0 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T22:06:32.952 INFO:tasks.ceph_manager:Mounting osd.0: dev: ubuntu@smithi047.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-0, type: xfs, options: ['noatime'] 2024-09-12T22:06:32.952 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T22:06:33.251 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:06:33.417 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T22:06:33.417 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T22:06:33.419 INFO:tasks.ceph.osd.0:Started 2024-09-12T22:06:33.420 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:06:33.636 INFO:teuthology.orchestra.run.smithi047.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-09-12T22:06:33.638 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T22:06:33.639 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-12T22:06:35.421 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:06:35.419+0000 7f8851351640 -1 Falling back to public interface 2024-09-12T22:06:38.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-12T22:06:38.640 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:06:38.757 INFO:teuthology.orchestra.run.smithi047.stderr:no valid command found; 10 closest matches: 2024-09-12T22:06:38.757 INFO:teuthology.orchestra.run.smithi047.stderr:0 2024-09-12T22:06:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:1 2024-09-12T22:06:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:2 2024-09-12T22:06:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:abort 2024-09-12T22:06:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:assert 2024-09-12T22:06:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:bluefs debug_inject_read_zeros 2024-09-12T22:06:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:bluefs files list 2024-09-12T22:06:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:bluefs stats 2024-09-12T22:06:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:bluestore bluefs device info [] 2024-09-12T22:06:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:config diff 2024-09-12T22:06:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:admin_socket: invalid command 2024-09-12T22:06:38.760 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T22:06:38.760 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-12T22:06:41.921 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:06:41.920+0000 7f8851351640 -1 osd.0 32 log_to_monitors true 2024-09-12T22:06:42.452 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T22:06:42.450+0000 7f88450ef640 -1 osd.0 82 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:06:43.761 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:06:43.868 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T22:06:43.868 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T22:06:43.868 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T22:06:43.868 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T22:06:48.877 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-12T22:06:49.007 INFO:teuthology.orchestra.run.smithi043.stdout:mon.a: {} 2024-09-12T22:06:49.007 INFO:teuthology.orchestra.run.smithi043.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:06:49.016 INFO:teuthology.orchestra.run.smithi043.stdout:mon.b: {} 2024-09-12T22:06:49.016 INFO:teuthology.orchestra.run.smithi043.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:06:49.025 INFO:teuthology.orchestra.run.smithi043.stdout:mon.c: {} 2024-09-12T22:06:49.025 INFO:teuthology.orchestra.run.smithi043.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:06:49.036 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T22:06:49.402 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T22:06:49.416 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-12T22:06:50.407 INFO:teuthology.orchestra.run.smithi043.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-12T22:06:50.425 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T22:06:51.413 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T22:06:51.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T22:06:51.973 INFO:teuthology.orchestra.run.smithi043.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T22:06:51.987 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T22:06:52.976 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T22:06:52.993 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-12T22:06:53.978 INFO:teuthology.orchestra.run.smithi043.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-12T22:06:53.994 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-12T22:06:53.994 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-12T22:06:53.994 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-12T22:06:53.994 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-12T22:06:53.995 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T22:06:53.995 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:06:54.293 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:06:54.293 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":93,"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","created":"2024-09-12T22:03:11.964028+0000","modified":"2024-09-12T22:06:53.975728+0000","last_up_change":"2024-09-12T22:06:43.370158+0000","last_in_change":"2024-09-12T22:03:12.758606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:03:22.281699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:03:26.987767+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:03:31.328134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:03:31.777050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb292153-0043-4981-8743-115f848d2064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":32,"up_from":83,"up_thru":90,"down_at":33,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6801","nonce":4154318214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6803","nonce":4154318214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6807","nonce":4154318214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6805","nonce":4154318214}]},"public_addr":"172.21.15.47:6801/4154318214","cluster_addr":"172.21.15.47:6803/4154318214","heartbeat_back_addr":"172.21.15.47:6807/4154318214","heartbeat_front_addr":"172.21.15.47:6805/4154318214","state":["exists","up"]},{"osd":1,"uuid":"5f0330a2-15ce-4ffb-a697-da1f930db079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6801","nonce":1334802479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6803","nonce":1334802479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6807","nonce":1334802479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6805","nonce":1334802479}]},"public_addr":"172.21.15.110:6801/1334802479","cluster_addr":"172.21.15.110:6803/1334802479","heartbeat_back_addr":"172.21.15.110:6807/1334802479","heartbeat_front_addr":"172.21.15.110:6805/1334802479","state":["exists","up"]},{"osd":2,"uuid":"ae0b014f-768c-4f57-82c6-3edf9aa9f856","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6801","nonce":3565874056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6803","nonce":3565874056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6807","nonce":3565874056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6805","nonce":3565874056}]},"public_addr":"172.21.15.146:6801/3565874056","cluster_addr":"172.21.15.146:6803/3565874056","heartbeat_back_addr":"172.21.15.146:6807/3565874056","heartbeat_front_addr":"172.21.15.146:6805/3565874056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:18.927187+0000","dead_epoch":32},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.386650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.957366+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.12","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:06:54.306 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T22:06:54.307 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:06:54.597 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:06:54.597 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":93,"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","created":"2024-09-12T22:03:11.964028+0000","modified":"2024-09-12T22:06:53.975728+0000","last_up_change":"2024-09-12T22:06:43.370158+0000","last_in_change":"2024-09-12T22:03:12.758606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:03:22.281699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:03:26.987767+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:03:31.328134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:03:31.777050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb292153-0043-4981-8743-115f848d2064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":32,"up_from":83,"up_thru":90,"down_at":33,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6801","nonce":4154318214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6803","nonce":4154318214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6807","nonce":4154318214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6805","nonce":4154318214}]},"public_addr":"172.21.15.47:6801/4154318214","cluster_addr":"172.21.15.47:6803/4154318214","heartbeat_back_addr":"172.21.15.47:6807/4154318214","heartbeat_front_addr":"172.21.15.47:6805/4154318214","state":["exists","up"]},{"osd":1,"uuid":"5f0330a2-15ce-4ffb-a697-da1f930db079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6801","nonce":1334802479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6803","nonce":1334802479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6807","nonce":1334802479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6805","nonce":1334802479}]},"public_addr":"172.21.15.110:6801/1334802479","cluster_addr":"172.21.15.110:6803/1334802479","heartbeat_back_addr":"172.21.15.110:6807/1334802479","heartbeat_front_addr":"172.21.15.110:6805/1334802479","state":["exists","up"]},{"osd":2,"uuid":"ae0b014f-768c-4f57-82c6-3edf9aa9f856","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6801","nonce":3565874056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6803","nonce":3565874056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6807","nonce":3565874056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6805","nonce":3565874056}]},"public_addr":"172.21.15.146:6801/3565874056","cluster_addr":"172.21.15.146:6803/3565874056","heartbeat_back_addr":"172.21.15.146:6807/3565874056","heartbeat_front_addr":"172.21.15.146:6805/3565874056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:18.927187+0000","dead_epoch":32},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.386650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.957366+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.12","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:06:54.610 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T22:06:54.611 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T22:06:54.611 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T22:06:54.755 INFO:teuthology.orchestra.run.smithi043.stdout:356482285572 2024-09-12T22:06:54.756 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:06:54.756 INFO:teuthology.orchestra.run.smithi043.stdout:38654705711 2024-09-12T22:06:54.757 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:06:54.757 INFO:teuthology.orchestra.run.smithi043.stdout:38654705711 2024-09-12T22:06:54.758 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:06:55.097 INFO:teuthology.orchestra.run.smithi043.stdout:38654705710 2024-09-12T22:06:55.104 INFO:teuthology.orchestra.run.smithi043.stdout:38654705710 2024-09-12T22:06:55.104 INFO:teuthology.orchestra.run.smithi043.stdout:356482285571 2024-09-12T22:06:55.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705711 got 38654705710 for osd.1 2024-09-12T22:06:55.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705711 got 38654705710 for osd.2 2024-09-12T22:06:55.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 356482285572 got 356482285571 for osd.0 2024-09-12T22:06:56.114 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:06:56.119 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:06:56.120 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:06:56.440 INFO:teuthology.orchestra.run.smithi043.stdout:38654705710 2024-09-12T22:06:56.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705711 got 38654705710 for osd.1 2024-09-12T22:06:56.464 INFO:teuthology.orchestra.run.smithi043.stdout:356482285571 2024-09-12T22:06:56.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 356482285572 got 356482285571 for osd.0 2024-09-12T22:06:56.477 INFO:teuthology.orchestra.run.smithi043.stdout:38654705710 2024-09-12T22:06:56.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705711 got 38654705710 for osd.2 2024-09-12T22:06:57.455 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:06:57.478 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:06:57.492 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:06:57.771 INFO:teuthology.orchestra.run.smithi043.stdout:38654705711 2024-09-12T22:06:57.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705711 got 38654705711 for osd.1 2024-09-12T22:06:57.786 DEBUG:teuthology.parallel:result is None 2024-09-12T22:06:57.805 INFO:teuthology.orchestra.run.smithi043.stdout:38654705711 2024-09-12T22:06:57.807 INFO:teuthology.orchestra.run.smithi043.stdout:356482285572 2024-09-12T22:06:57.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705711 got 38654705711 for osd.2 2024-09-12T22:06:57.819 DEBUG:teuthology.parallel:result is None 2024-09-12T22:06:57.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 356482285572 got 356482285572 for osd.0 2024-09-12T22:06:57.821 DEBUG:teuthology.parallel:result is None 2024-09-12T22:06:57.821 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T22:06:57.821 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:06:58.157 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:06:58.159 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:06:58.167 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-09-12T22:06:56.287352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":592798,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1027036,"kb_used_data":4236,"kb_used_omap":9,"kb_used_meta":1022710,"kb_avail":282088484,"statfs":{"total":289910292480,"available":288858607616,"internally_reserved":0,"allocated":4337664,"data_stored":2586134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10094,"internal_metadata":1047255186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":706,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.873704"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035891+0000","last_change":"2024-09-12T22:06:44.391498+0000","last_active":"2024-09-12T22:06:54.035891+0000","last_peered":"2024-09-12T22:06:54.035891+0000","last_clean":"2024-09-12T22:06:54.035891+0000","last_became_active":"2024-09-12T22:06:44.391100+0000","last_became_peered":"2024-09-12T22:06:44.391100+0000","last_unstale":"2024-09-12T22:06:54.035891+0000","last_undegraded":"2024-09-12T22:06:54.035891+0000","last_fullsized":"2024-09-12T22:06:54.035891+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:04.380570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.036011+0000","last_change":"2024-09-12T22:06:44.392987+0000","last_active":"2024-09-12T22:06:54.036011+0000","last_peered":"2024-09-12T22:06:54.036011+0000","last_clean":"2024-09-12T22:06:54.036011+0000","last_became_active":"2024-09-12T22:06:44.392188+0000","last_became_peered":"2024-09-12T22:06:44.392188+0000","last_unstale":"2024-09-12T22:06:54.036011+0000","last_undegraded":"2024-09-12T22:06:54.036011+0000","last_fullsized":"2024-09-12T22:06:54.036011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:36.209594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979690+0000","last_change":"2024-09-12T22:03:33.462148+0000","last_active":"2024-09-12T22:06:53.979690+0000","last_peered":"2024-09-12T22:06:53.979690+0000","last_clean":"2024-09-12T22:06:53.979690+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:06:53.979690+0000","last_undegraded":"2024-09-12T22:06:53.979690+0000","last_fullsized":"2024-09-12T22:06:53.979690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:36.909948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979484+0000","last_change":"2024-09-12T22:06:50.419886+0000","last_active":"2024-09-12T22:06:53.979484+0000","last_peered":"2024-09-12T22:06:53.979484+0000","last_clean":"2024-09-12T22:06:53.979484+0000","last_became_active":"2024-09-12T22:06:50.419429+0000","last_became_peered":"2024-09-12T22:06:50.419429+0000","last_unstale":"2024-09-12T22:06:53.979484+0000","last_undegraded":"2024-09-12T22:06:53.979484+0000","last_fullsized":"2024-09-12T22:06:53.979484+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:16.917462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035121+0000","last_change":"2024-09-12T22:06:44.392862+0000","last_active":"2024-09-12T22:06:54.035121+0000","last_peered":"2024-09-12T22:06:54.035121+0000","last_clean":"2024-09-12T22:06:54.035121+0000","last_became_active":"2024-09-12T22:06:44.391774+0000","last_became_peered":"2024-09-12T22:06:44.391774+0000","last_unstale":"2024-09-12T22:06:54.035121+0000","last_undegraded":"2024-09-12T22:06:54.035121+0000","last_fullsized":"2024-09-12T22:06:54.035121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:09.703417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979018+0000","last_change":"2024-09-12T22:06:50.414892+0000","last_active":"2024-09-12T22:06:53.979018+0000","last_peered":"2024-09-12T22:06:53.979018+0000","last_clean":"2024-09-12T22:06:53.979018+0000","last_became_active":"2024-09-12T22:06:50.414526+0000","last_became_peered":"2024-09-12T22:06:50.414526+0000","last_unstale":"2024-09-12T22:06:53.979018+0000","last_undegraded":"2024-09-12T22:06:53.979018+0000","last_fullsized":"2024-09-12T22:06:53.979018+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:29.766297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979359+0000","last_change":"2024-09-12T22:06:44.421423+0000","last_active":"2024-09-12T22:06:53.979359+0000","last_peered":"2024-09-12T22:06:53.979359+0000","last_clean":"2024-09-12T22:06:53.979359+0000","last_became_active":"2024-09-12T22:06:44.421094+0000","last_became_peered":"2024-09-12T22:06:44.421094+0000","last_unstale":"2024-09-12T22:06:53.979359+0000","last_undegraded":"2024-09-12T22:06:53.979359+0000","last_fullsized":"2024-09-12T22:06:53.979359+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:48.618058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979320+0000","last_change":"2024-09-12T22:06:44.395363+0000","last_active":"2024-09-12T22:06:53.979320+0000","last_peered":"2024-09-12T22:06:53.979320+0000","last_clean":"2024-09-12T22:06:53.979320+0000","last_became_active":"2024-09-12T22:06:44.394804+0000","last_became_peered":"2024-09-12T22:06:44.394804+0000","last_unstale":"2024-09-12T22:06:53.979320+0000","last_undegraded":"2024-09-12T22:06:53.979320+0000","last_fullsized":"2024-09-12T22:06:53.979320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:18.826036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980197+0000","last_change":"2024-09-12T22:06:44.390017+0000","last_active":"2024-09-12T22:06:53.980197+0000","last_peered":"2024-09-12T22:06:53.980197+0000","last_clean":"2024-09-12T22:06:53.980197+0000","last_became_active":"2024-09-12T22:06:44.389256+0000","last_became_peered":"2024-09-12T22:06:44.389256+0000","last_unstale":"2024-09-12T22:06:53.980197+0000","last_undegraded":"2024-09-12T22:06:53.980197+0000","last_fullsized":"2024-09-12T22:06:53.980197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:48.669357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035877+0000","last_change":"2024-09-12T22:06:44.392599+0000","last_active":"2024-09-12T22:06:54.035877+0000","last_peered":"2024-09-12T22:06:54.035877+0000","last_clean":"2024-09-12T22:06:54.035877+0000","last_became_active":"2024-09-12T22:06:44.391572+0000","last_became_peered":"2024-09-12T22:06:44.391572+0000","last_unstale":"2024-09-12T22:06:54.035877+0000","last_undegraded":"2024-09-12T22:06:54.035877+0000","last_fullsized":"2024-09-12T22:06:54.035877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:41.342271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979365+0000","last_change":"2024-09-12T22:06:50.420008+0000","last_active":"2024-09-12T22:06:53.979365+0000","last_peered":"2024-09-12T22:06:53.979365+0000","last_clean":"2024-09-12T22:06:53.979365+0000","last_became_active":"2024-09-12T22:06:50.419042+0000","last_became_peered":"2024-09-12T22:06:50.419042+0000","last_unstale":"2024-09-12T22:06:53.979365+0000","last_undegraded":"2024-09-12T22:06:53.979365+0000","last_fullsized":"2024-09-12T22:06:53.979365+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:39.365289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035352+0000","last_change":"2024-09-12T22:03:33.465069+0000","last_active":"2024-09-12T22:06:54.035352+0000","last_peered":"2024-09-12T22:06:54.035352+0000","last_clean":"2024-09-12T22:06:54.035352+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:06:54.035352+0000","last_undegraded":"2024-09-12T22:06:54.035352+0000","last_fullsized":"2024-09-12T22:06:54.035352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035321+0000","last_change":"2024-09-12T22:06:44.392909+0000","last_active":"2024-09-12T22:06:54.035321+0000","last_peered":"2024-09-12T22:06:54.035321+0000","last_clean":"2024-09-12T22:06:54.035321+0000","last_became_active":"2024-09-12T22:06:44.392491+0000","last_became_peered":"2024-09-12T22:06:44.392491+0000","last_unstale":"2024-09-12T22:06:54.035321+0000","last_undegraded":"2024-09-12T22:06:54.035321+0000","last_fullsized":"2024-09-12T22:06:54.035321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:09.585700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979180+0000","last_change":"2024-09-12T22:06:50.419973+0000","last_active":"2024-09-12T22:06:53.979180+0000","last_peered":"2024-09-12T22:06:53.979180+0000","last_clean":"2024-09-12T22:06:53.979180+0000","last_became_active":"2024-09-12T22:06:50.418325+0000","last_became_peered":"2024-09-12T22:06:50.418325+0000","last_unstale":"2024-09-12T22:06:53.979180+0000","last_undegraded":"2024-09-12T22:06:53.979180+0000","last_fullsized":"2024-09-12T22:06:53.979180+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:02.303968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979112+0000","last_change":"2024-09-12T22:06:50.419011+0000","last_active":"2024-09-12T22:06:53.979112+0000","last_peered":"2024-09-12T22:06:53.979112+0000","last_clean":"2024-09-12T22:06:53.979112+0000","last_became_active":"2024-09-12T22:06:50.418075+0000","last_became_peered":"2024-09-12T22:06:50.418075+0000","last_unstale":"2024-09-12T22:06:53.979112+0000","last_undegraded":"2024-09-12T22:06:53.979112+0000","last_fullsized":"2024-09-12T22:06:53.979112+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:16.440226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979399+0000","last_change":"2024-09-12T22:06:44.395099+0000","last_active":"2024-09-12T22:06:53.979399+0000","last_peered":"2024-09-12T22:06:53.979399+0000","last_clean":"2024-09-12T22:06:53.979399+0000","last_became_active":"2024-09-12T22:06:44.394486+0000","last_became_peered":"2024-09-12T22:06:44.394486+0000","last_unstale":"2024-09-12T22:06:53.979399+0000","last_undegraded":"2024-09-12T22:06:53.979399+0000","last_fullsized":"2024-09-12T22:06:53.979399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:47.461701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980180+0000","last_change":"2024-09-12T22:06:44.390021+0000","last_active":"2024-09-12T22:06:53.980180+0000","last_peered":"2024-09-12T22:06:53.980180+0000","last_clean":"2024-09-12T22:06:53.980180+0000","last_became_active":"2024-09-12T22:06:44.388967+0000","last_became_peered":"2024-09-12T22:06:44.388967+0000","last_unstale":"2024-09-12T22:06:53.980180+0000","last_undegraded":"2024-09-12T22:06:53.980180+0000","last_fullsized":"2024-09-12T22:06:53.980180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:15.769587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035728+0000","last_change":"2024-09-12T22:06:44.391191+0000","last_active":"2024-09-12T22:06:54.035728+0000","last_peered":"2024-09-12T22:06:54.035728+0000","last_clean":"2024-09-12T22:06:54.035728+0000","last_became_active":"2024-09-12T22:06:44.390858+0000","last_became_peered":"2024-09-12T22:06:44.390858+0000","last_unstale":"2024-09-12T22:06:54.035728+0000","last_undegraded":"2024-09-12T22:06:54.035728+0000","last_fullsized":"2024-09-12T22:06:54.035728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:30.878874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979804+0000","last_change":"2024-09-12T22:06:44.389205+0000","last_active":"2024-09-12T22:06:53.979804+0000","last_peered":"2024-09-12T22:06:53.979804+0000","last_clean":"2024-09-12T22:06:53.979804+0000","last_became_active":"2024-09-12T22:06:44.388761+0000","last_became_peered":"2024-09-12T22:06:44.388761+0000","last_unstale":"2024-09-12T22:06:53.979804+0000","last_undegraded":"2024-09-12T22:06:53.979804+0000","last_fullsized":"2024-09-12T22:06:53.979804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:31.790297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980172+0000","last_change":"2024-09-12T22:06:44.421429+0000","last_active":"2024-09-12T22:06:53.980172+0000","last_peered":"2024-09-12T22:06:53.980172+0000","last_clean":"2024-09-12T22:06:53.980172+0000","last_became_active":"2024-09-12T22:06:44.420768+0000","last_became_peered":"2024-09-12T22:06:44.420768+0000","last_unstale":"2024-09-12T22:06:53.980172+0000","last_undegraded":"2024-09-12T22:06:53.980172+0000","last_fullsized":"2024-09-12T22:06:53.980172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:25.634497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979404+0000","last_change":"2024-09-12T22:06:50.422914+0000","last_active":"2024-09-12T22:06:53.979404+0000","last_peered":"2024-09-12T22:06:53.979404+0000","last_clean":"2024-09-12T22:06:53.979404+0000","last_became_active":"2024-09-12T22:06:50.421758+0000","last_became_peered":"2024-09-12T22:06:50.421758+0000","last_unstale":"2024-09-12T22:06:53.979404+0000","last_undegraded":"2024-09-12T22:06:53.979404+0000","last_fullsized":"2024-09-12T22:06:53.979404+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:02.122833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035141+0000","last_change":"2024-09-12T22:03:33.460994+0000","last_active":"2024-09-12T22:06:54.035141+0000","last_peered":"2024-09-12T22:06:54.035141+0000","last_clean":"2024-09-12T22:06:54.035141+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:06:54.035141+0000","last_undegraded":"2024-09-12T22:06:54.035141+0000","last_fullsized":"2024-09-12T22:06:54.035141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:20.363291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979143+0000","last_change":"2024-09-12T22:06:50.417908+0000","last_active":"2024-09-12T22:06:53.979143+0000","last_peered":"2024-09-12T22:06:53.979143+0000","last_clean":"2024-09-12T22:06:53.979143+0000","last_became_active":"2024-09-12T22:06:50.416924+0000","last_became_peered":"2024-09-12T22:06:50.416924+0000","last_unstale":"2024-09-12T22:06:53.979143+0000","last_undegraded":"2024-09-12T22:06:53.979143+0000","last_fullsized":"2024-09-12T22:06:53.979143+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:28.247991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034792+0000","last_change":"2024-09-12T22:06:44.391876+0000","last_active":"2024-09-12T22:06:54.034792+0000","last_peered":"2024-09-12T22:06:54.034792+0000","last_clean":"2024-09-12T22:06:54.034792+0000","last_became_active":"2024-09-12T22:06:44.391480+0000","last_became_peered":"2024-09-12T22:06:44.391480+0000","last_unstale":"2024-09-12T22:06:54.034792+0000","last_undegraded":"2024-09-12T22:06:54.034792+0000","last_fullsized":"2024-09-12T22:06:54.034792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:43.161300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035981+0000","last_change":"2024-09-12T22:06:50.420130+0000","last_active":"2024-09-12T22:06:54.035981+0000","last_peered":"2024-09-12T22:06:54.035981+0000","last_clean":"2024-09-12T22:06:54.035981+0000","last_became_active":"2024-09-12T22:06:50.419573+0000","last_became_peered":"2024-09-12T22:06:50.419573+0000","last_unstale":"2024-09-12T22:06:54.035981+0000","last_undegraded":"2024-09-12T22:06:54.035981+0000","last_fullsized":"2024-09-12T22:06:54.035981+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:31.160831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980210+0000","last_change":"2024-09-12T22:06:50.420167+0000","last_active":"2024-09-12T22:06:53.980210+0000","last_peered":"2024-09-12T22:06:53.980210+0000","last_clean":"2024-09-12T22:06:53.980210+0000","last_became_active":"2024-09-12T22:06:50.419348+0000","last_became_peered":"2024-09-12T22:06:50.419348+0000","last_unstale":"2024-09-12T22:06:53.980210+0000","last_undegraded":"2024-09-12T22:06:53.980210+0000","last_fullsized":"2024-09-12T22:06:53.980210+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:19.786252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979690+0000","last_change":"2024-09-12T22:03:33.461282+0000","last_active":"2024-09-12T22:06:53.979690+0000","last_peered":"2024-09-12T22:06:53.979690+0000","last_clean":"2024-09-12T22:06:53.979690+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:06:53.979690+0000","last_undegraded":"2024-09-12T22:06:53.979690+0000","last_fullsized":"2024-09-12T22:06:53.979690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:32.302716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035627+0000","last_change":"2024-09-12T22:06:50.419329+0000","last_active":"2024-09-12T22:06:54.035627+0000","last_peered":"2024-09-12T22:06:54.035627+0000","last_clean":"2024-09-12T22:06:54.035627+0000","last_became_active":"2024-09-12T22:06:50.418755+0000","last_became_peered":"2024-09-12T22:06:50.418755+0000","last_unstale":"2024-09-12T22:06:54.035627+0000","last_undegraded":"2024-09-12T22:06:54.035627+0000","last_fullsized":"2024-09-12T22:06:54.035627+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:02.572755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979812+0000","last_change":"2024-09-12T22:06:44.397630+0000","last_active":"2024-09-12T22:06:53.979812+0000","last_peered":"2024-09-12T22:06:53.979812+0000","last_clean":"2024-09-12T22:06:53.979812+0000","last_became_active":"2024-09-12T22:06:44.397198+0000","last_became_peered":"2024-09-12T22:06:44.397198+0000","last_unstale":"2024-09-12T22:06:53.979812+0000","last_undegraded":"2024-09-12T22:06:53.979812+0000","last_fullsized":"2024-09-12T22:06:53.979812+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:31.843174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035267+0000","last_change":"2024-09-12T22:03:33.456842+0000","last_active":"2024-09-12T22:06:54.035267+0000","last_peered":"2024-09-12T22:06:54.035267+0000","last_clean":"2024-09-12T22:06:54.035267+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:06:54.035267+0000","last_undegraded":"2024-09-12T22:06:54.035267+0000","last_fullsized":"2024-09-12T22:06:54.035267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:56.383351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979590+0000","last_change":"2024-09-12T22:06:44.397416+0000","last_active":"2024-09-12T22:06:53.979590+0000","last_peered":"2024-09-12T22:06:53.979590+0000","last_clean":"2024-09-12T22:06:53.979590+0000","last_became_active":"2024-09-12T22:06:44.397074+0000","last_became_peered":"2024-09-12T22:06:44.397074+0000","last_unstale":"2024-09-12T22:06:53.979590+0000","last_undegraded":"2024-09-12T22:06:53.979590+0000","last_fullsized":"2024-09-12T22:06:53.979590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.834005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978818+0000","last_change":"2024-09-12T22:06:50.414965+0000","last_active":"2024-09-12T22:06:53.978818+0000","last_peered":"2024-09-12T22:06:53.978818+0000","last_clean":"2024-09-12T22:06:53.978818+0000","last_became_active":"2024-09-12T22:06:50.414626+0000","last_became_peered":"2024-09-12T22:06:50.414626+0000","last_unstale":"2024-09-12T22:06:53.978818+0000","last_undegraded":"2024-09-12T22:06:53.978818+0000","last_fullsized":"2024-09-12T22:06:53.978818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:30.619121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035494+0000","last_change":"2024-09-12T22:06:44.391923+0000","last_active":"2024-09-12T22:06:54.035494+0000","last_peered":"2024-09-12T22:06:54.035494+0000","last_clean":"2024-09-12T22:06:54.035494+0000","last_became_active":"2024-09-12T22:06:44.391447+0000","last_became_peered":"2024-09-12T22:06:44.391447+0000","last_unstale":"2024-09-12T22:06:54.035494+0000","last_undegraded":"2024-09-12T22:06:54.035494+0000","last_fullsized":"2024-09-12T22:06:54.035494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:32.308333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979499+0000","last_change":"2024-09-12T22:06:50.442693+0000","last_active":"2024-09-12T22:06:53.979499+0000","last_peered":"2024-09-12T22:06:53.979499+0000","last_clean":"2024-09-12T22:06:53.979499+0000","last_became_active":"2024-09-12T22:06:50.422232+0000","last_became_peered":"2024-09-12T22:06:50.422232+0000","last_unstale":"2024-09-12T22:06:53.979499+0000","last_undegraded":"2024-09-12T22:06:53.979499+0000","last_fullsized":"2024-09-12T22:06:53.979499+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:40.705556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035690+0000","last_change":"2024-09-12T22:06:44.390974+0000","last_active":"2024-09-12T22:06:54.035690+0000","last_peered":"2024-09-12T22:06:54.035690+0000","last_clean":"2024-09-12T22:06:54.035690+0000","last_became_active":"2024-09-12T22:06:44.390652+0000","last_became_peered":"2024-09-12T22:06:44.390652+0000","last_unstale":"2024-09-12T22:06:54.035690+0000","last_undegraded":"2024-09-12T22:06:54.035690+0000","last_fullsized":"2024-09-12T22:06:54.035690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:41.707065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979208+0000","last_change":"2024-09-12T22:06:50.417649+0000","last_active":"2024-09-12T22:06:53.979208+0000","last_peered":"2024-09-12T22:06:53.979208+0000","last_clean":"2024-09-12T22:06:53.979208+0000","last_became_active":"2024-09-12T22:06:50.417123+0000","last_became_peered":"2024-09-12T22:06:50.417123+0000","last_unstale":"2024-09-12T22:06:53.979208+0000","last_undegraded":"2024-09-12T22:06:53.979208+0000","last_fullsized":"2024-09-12T22:06:53.979208+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:01.612960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980187+0000","last_change":"2024-09-12T22:06:50.419787+0000","last_active":"2024-09-12T22:06:53.980187+0000","last_peered":"2024-09-12T22:06:53.980187+0000","last_clean":"2024-09-12T22:06:53.980187+0000","last_became_active":"2024-09-12T22:06:50.418817+0000","last_became_peered":"2024-09-12T22:06:50.418817+0000","last_unstale":"2024-09-12T22:06:53.980187+0000","last_undegraded":"2024-09-12T22:06:53.980187+0000","last_fullsized":"2024-09-12T22:06:53.980187+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:51.923601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035182+0000","last_change":"2024-09-12T22:06:50.419697+0000","last_active":"2024-09-12T22:06:54.035182+0000","last_peered":"2024-09-12T22:06:54.035182+0000","last_clean":"2024-09-12T22:06:54.035182+0000","last_became_active":"2024-09-12T22:06:50.419047+0000","last_became_peered":"2024-09-12T22:06:50.419047+0000","last_unstale":"2024-09-12T22:06:54.035182+0000","last_undegraded":"2024-09-12T22:06:54.035182+0000","last_fullsized":"2024-09-12T22:06:54.035182+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:31.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980033+0000","last_change":"2024-09-12T22:06:44.422294+0000","last_active":"2024-09-12T22:06:53.980033+0000","last_peered":"2024-09-12T22:06:53.980033+0000","last_clean":"2024-09-12T22:06:53.980033+0000","last_became_active":"2024-09-12T22:06:44.421955+0000","last_became_peered":"2024-09-12T22:06:44.421955+0000","last_unstale":"2024-09-12T22:06:53.980033+0000","last_undegraded":"2024-09-12T22:06:53.980033+0000","last_fullsized":"2024-09-12T22:06:53.980033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:40.047878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979018+0000","last_change":"2024-09-12T22:06:50.432341+0000","last_active":"2024-09-12T22:06:53.979018+0000","last_peered":"2024-09-12T22:06:53.979018+0000","last_clean":"2024-09-12T22:06:53.979018+0000","last_became_active":"2024-09-12T22:06:50.418227+0000","last_became_peered":"2024-09-12T22:06:50.418227+0000","last_unstale":"2024-09-12T22:06:53.979018+0000","last_undegraded":"2024-09-12T22:06:53.979018+0000","last_fullsized":"2024-09-12T22:06:53.979018+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:47.509209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979708+0000","last_change":"2024-09-12T22:06:50.426521+0000","last_active":"2024-09-12T22:06:53.979708+0000","last_peered":"2024-09-12T22:06:53.979708+0000","last_clean":"2024-09-12T22:06:53.979708+0000","last_became_active":"2024-09-12T22:06:50.418222+0000","last_became_peered":"2024-09-12T22:06:50.418222+0000","last_unstale":"2024-09-12T22:06:53.979708+0000","last_undegraded":"2024-09-12T22:06:53.979708+0000","last_fullsized":"2024-09-12T22:06:53.979708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:44.473880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034877+0000","last_change":"2024-09-12T22:03:33.465308+0000","last_active":"2024-09-12T22:06:54.034877+0000","last_peered":"2024-09-12T22:06:54.034877+0000","last_clean":"2024-09-12T22:06:54.034877+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:06:54.034877+0000","last_undegraded":"2024-09-12T22:06:54.034877+0000","last_fullsized":"2024-09-12T22:06:54.034877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:35.733622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035614+0000","last_change":"2024-09-12T22:03:32.461301+0000","last_active":"2024-09-12T22:06:54.035614+0000","last_peered":"2024-09-12T22:06:54.035614+0000","last_clean":"2024-09-12T22:06:54.035614+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:06:54.035614+0000","last_undegraded":"2024-09-12T22:06:54.035614+0000","last_fullsized":"2024-09-12T22:06:54.035614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:39.872272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034942+0000","last_change":"2024-09-12T22:06:44.391249+0000","last_active":"2024-09-12T22:06:54.034942+0000","last_peered":"2024-09-12T22:06:54.034942+0000","last_clean":"2024-09-12T22:06:54.034942+0000","last_became_active":"2024-09-12T22:06:44.390807+0000","last_became_peered":"2024-09-12T22:06:44.390807+0000","last_unstale":"2024-09-12T22:06:54.034942+0000","last_undegraded":"2024-09-12T22:06:54.034942+0000","last_fullsized":"2024-09-12T22:06:54.034942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:07.271893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980057+0000","last_change":"2024-09-12T22:03:32.459540+0000","last_active":"2024-09-12T22:06:53.980057+0000","last_peered":"2024-09-12T22:06:53.980057+0000","last_clean":"2024-09-12T22:06:53.980057+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:06:53.980057+0000","last_undegraded":"2024-09-12T22:06:53.980057+0000","last_fullsized":"2024-09-12T22:06:53.980057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:22.143242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979421+0000","last_change":"2024-09-12T22:06:44.421712+0000","last_active":"2024-09-12T22:06:53.979421+0000","last_peered":"2024-09-12T22:06:53.979421+0000","last_clean":"2024-09-12T22:06:53.979421+0000","last_became_active":"2024-09-12T22:06:44.421388+0000","last_became_peered":"2024-09-12T22:06:44.421388+0000","last_unstale":"2024-09-12T22:06:53.979421+0000","last_undegraded":"2024-09-12T22:06:53.979421+0000","last_fullsized":"2024-09-12T22:06:53.979421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:46.580311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980254+0000","last_change":"2024-09-12T22:06:44.421721+0000","last_active":"2024-09-12T22:06:53.980254+0000","last_peered":"2024-09-12T22:06:53.980254+0000","last_clean":"2024-09-12T22:06:53.980254+0000","last_became_active":"2024-09-12T22:06:44.421430+0000","last_became_peered":"2024-09-12T22:06:44.421430+0000","last_unstale":"2024-09-12T22:06:53.980254+0000","last_undegraded":"2024-09-12T22:06:53.980254+0000","last_fullsized":"2024-09-12T22:06:53.980254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:57.001470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979284+0000","last_change":"2024-09-12T22:06:44.397808+0000","last_active":"2024-09-12T22:06:53.979284+0000","last_peered":"2024-09-12T22:06:53.979284+0000","last_clean":"2024-09-12T22:06:53.979284+0000","last_became_active":"2024-09-12T22:06:44.397490+0000","last_became_peered":"2024-09-12T22:06:44.397490+0000","last_unstale":"2024-09-12T22:06:53.979284+0000","last_undegraded":"2024-09-12T22:06:53.979284+0000","last_fullsized":"2024-09-12T22:06:53.979284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:38.225078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979537+0000","last_change":"2024-09-12T22:06:50.426880+0000","last_active":"2024-09-12T22:06:53.979537+0000","last_peered":"2024-09-12T22:06:53.979537+0000","last_clean":"2024-09-12T22:06:53.979537+0000","last_became_active":"2024-09-12T22:06:50.417240+0000","last_became_peered":"2024-09-12T22:06:50.417240+0000","last_unstale":"2024-09-12T22:06:53.979537+0000","last_undegraded":"2024-09-12T22:06:53.979537+0000","last_fullsized":"2024-09-12T22:06:53.979537+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:24.836682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980207+0000","last_change":"2024-09-12T22:06:44.421723+0000","last_active":"2024-09-12T22:06:53.980207+0000","last_peered":"2024-09-12T22:06:53.980207+0000","last_clean":"2024-09-12T22:06:53.980207+0000","last_became_active":"2024-09-12T22:06:44.421071+0000","last_became_peered":"2024-09-12T22:06:44.421071+0000","last_unstale":"2024-09-12T22:06:53.980207+0000","last_undegraded":"2024-09-12T22:06:53.980207+0000","last_fullsized":"2024-09-12T22:06:53.980207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:16.039319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979544+0000","last_change":"2024-09-12T22:06:50.422136+0000","last_active":"2024-09-12T22:06:53.979544+0000","last_peered":"2024-09-12T22:06:53.979544+0000","last_clean":"2024-09-12T22:06:53.979544+0000","last_became_active":"2024-09-12T22:06:50.421734+0000","last_became_peered":"2024-09-12T22:06:50.421734+0000","last_unstale":"2024-09-12T22:06:53.979544+0000","last_undegraded":"2024-09-12T22:06:53.979544+0000","last_fullsized":"2024-09-12T22:06:53.979544+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:29.450310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979869+0000","last_change":"2024-09-12T22:03:33.459084+0000","last_active":"2024-09-12T22:06:53.979869+0000","last_peered":"2024-09-12T22:06:53.979869+0000","last_clean":"2024-09-12T22:06:53.979869+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:06:53.979869+0000","last_undegraded":"2024-09-12T22:06:53.979869+0000","last_fullsized":"2024-09-12T22:06:53.979869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:50.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035351+0000","last_change":"2024-09-12T22:03:32.461417+0000","last_active":"2024-09-12T22:06:54.035351+0000","last_peered":"2024-09-12T22:06:54.035351+0000","last_clean":"2024-09-12T22:06:54.035351+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:06:54.035351+0000","last_undegraded":"2024-09-12T22:06:54.035351+0000","last_fullsized":"2024-09-12T22:06:54.035351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:22.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979869+0000","last_change":"2024-09-12T22:06:50.419560+0000","last_active":"2024-09-12T22:06:53.979869+0000","last_peered":"2024-09-12T22:06:53.979869+0000","last_clean":"2024-09-12T22:06:53.979869+0000","last_became_active":"2024-09-12T22:06:50.418648+0000","last_became_peered":"2024-09-12T22:06:50.418648+0000","last_unstale":"2024-09-12T22:06:53.979869+0000","last_undegraded":"2024-09-12T22:06:53.979869+0000","last_fullsized":"2024-09-12T22:06:53.979869+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:58.944327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034997+0000","last_change":"2024-09-12T22:06:44.391442+0000","last_active":"2024-09-12T22:06:54.034997+0000","last_peered":"2024-09-12T22:06:54.034997+0000","last_clean":"2024-09-12T22:06:54.034997+0000","last_became_active":"2024-09-12T22:06:44.391078+0000","last_became_peered":"2024-09-12T22:06:44.391078+0000","last_unstale":"2024-09-12T22:06:54.034997+0000","last_undegraded":"2024-09-12T22:06:54.034997+0000","last_fullsized":"2024-09-12T22:06:54.034997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:26.602771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980404+0000","last_change":"2024-09-12T22:06:44.397142+0000","last_active":"2024-09-12T22:06:53.980404+0000","last_peered":"2024-09-12T22:06:53.980404+0000","last_clean":"2024-09-12T22:06:53.980404+0000","last_became_active":"2024-09-12T22:06:44.396783+0000","last_became_peered":"2024-09-12T22:06:44.396783+0000","last_unstale":"2024-09-12T22:06:53.980404+0000","last_undegraded":"2024-09-12T22:06:53.980404+0000","last_fullsized":"2024-09-12T22:06:53.980404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:27.631274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":315,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979021+0000","last_change":"2024-09-12T22:06:52.982526+0000","last_active":"2024-09-12T22:06:53.979021+0000","last_peered":"2024-09-12T22:06:53.979021+0000","last_clean":"2024-09-12T22:06:53.979021+0000","last_became_active":"2024-09-12T22:06:52.982174+0000","last_became_peered":"2024-09-12T22:06:52.982174+0000","last_unstale":"2024-09-12T22:06:53.979021+0000","last_undegraded":"2024-09-12T22:06:53.979021+0000","last_fullsized":"2024-09-12T22:06:53.979021+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:20.744009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979737+0000","last_change":"2024-09-12T22:06:50.444340+0000","last_active":"2024-09-12T22:06:53.979737+0000","last_peered":"2024-09-12T22:06:53.979737+0000","last_clean":"2024-09-12T22:06:53.979737+0000","last_became_active":"2024-09-12T22:06:50.422353+0000","last_became_peered":"2024-09-12T22:06:50.422353+0000","last_unstale":"2024-09-12T22:06:53.979737+0000","last_undegraded":"2024-09-12T22:06:53.979737+0000","last_fullsized":"2024-09-12T22:06:53.979737+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.662733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979420+0000","last_change":"2024-09-12T22:06:44.397029+0000","last_active":"2024-09-12T22:06:53.979420+0000","last_peered":"2024-09-12T22:06:53.979420+0000","last_clean":"2024-09-12T22:06:53.979420+0000","last_became_active":"2024-09-12T22:06:44.396659+0000","last_became_peered":"2024-09-12T22:06:44.396659+0000","last_unstale":"2024-09-12T22:06:53.979420+0000","last_undegraded":"2024-09-12T22:06:53.979420+0000","last_fullsized":"2024-09-12T22:06:53.979420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:07.404782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979992+0000","last_change":"2024-09-12T22:06:50.418936+0000","last_active":"2024-09-12T22:06:53.979992+0000","last_peered":"2024-09-12T22:06:53.979992+0000","last_clean":"2024-09-12T22:06:53.979992+0000","last_became_active":"2024-09-12T22:06:50.418443+0000","last_became_peered":"2024-09-12T22:06:50.418443+0000","last_unstale":"2024-09-12T22:06:53.979992+0000","last_undegraded":"2024-09-12T22:06:53.979992+0000","last_fullsized":"2024-09-12T22:06:53.979992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:40.432871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978897+0000","last_change":"2024-09-12T22:06:50.419409+0000","last_active":"2024-09-12T22:06:53.978897+0000","last_peered":"2024-09-12T22:06:53.978897+0000","last_clean":"2024-09-12T22:06:53.978897+0000","last_became_active":"2024-09-12T22:06:50.418160+0000","last_became_peered":"2024-09-12T22:06:50.418160+0000","last_unstale":"2024-09-12T22:06:53.978897+0000","last_undegraded":"2024-09-12T22:06:53.978897+0000","last_fullsized":"2024-09-12T22:06:53.978897+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:48.881995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978987+0000","last_change":"2024-09-12T22:06:44.396692+0000","last_active":"2024-09-12T22:06:53.978987+0000","last_peered":"2024-09-12T22:06:53.978987+0000","last_clean":"2024-09-12T22:06:53.978987+0000","last_became_active":"2024-09-12T22:06:44.396378+0000","last_became_peered":"2024-09-12T22:06:44.396378+0000","last_unstale":"2024-09-12T22:06:53.978987+0000","last_undegraded":"2024-09-12T22:06:53.978987+0000","last_fullsized":"2024-09-12T22:06:53.978987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:06.812790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035774+0000","last_change":"2024-09-12T22:06:44.392705+0000","last_active":"2024-09-12T22:06:54.035774+0000","last_peered":"2024-09-12T22:06:54.035774+0000","last_clean":"2024-09-12T22:06:54.035774+0000","last_became_active":"2024-09-12T22:06:44.391809+0000","last_became_peered":"2024-09-12T22:06:44.391809+0000","last_unstale":"2024-09-12T22:06:54.035774+0000","last_undegraded":"2024-09-12T22:06:54.035774+0000","last_fullsized":"2024-09-12T22:06:54.035774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:48.022906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979322+0000","last_change":"2024-09-12T22:06:44.397296+0000","last_active":"2024-09-12T22:06:53.979322+0000","last_peered":"2024-09-12T22:06:53.979322+0000","last_clean":"2024-09-12T22:06:53.979322+0000","last_became_active":"2024-09-12T22:06:44.396596+0000","last_became_peered":"2024-09-12T22:06:44.396596+0000","last_unstale":"2024-09-12T22:06:53.979322+0000","last_undegraded":"2024-09-12T22:06:53.979322+0000","last_fullsized":"2024-09-12T22:06:53.979322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:25.702361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035014+0000","last_change":"2024-09-12T22:06:50.419281+0000","last_active":"2024-09-12T22:06:54.035014+0000","last_peered":"2024-09-12T22:06:54.035014+0000","last_clean":"2024-09-12T22:06:54.035014+0000","last_became_active":"2024-09-12T22:06:50.418876+0000","last_became_peered":"2024-09-12T22:06:50.418876+0000","last_unstale":"2024-09-12T22:06:54.035014+0000","last_undegraded":"2024-09-12T22:06:54.035014+0000","last_fullsized":"2024-09-12T22:06:54.035014+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:14.574566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980382+0000","last_change":"2024-09-12T22:06:44.390385+0000","last_active":"2024-09-12T22:06:53.980382+0000","last_peered":"2024-09-12T22:06:53.980382+0000","last_clean":"2024-09-12T22:06:53.980382+0000","last_became_active":"2024-09-12T22:06:44.389680+0000","last_became_peered":"2024-09-12T22:06:44.389680+0000","last_unstale":"2024-09-12T22:06:53.980382+0000","last_undegraded":"2024-09-12T22:06:53.980382+0000","last_fullsized":"2024-09-12T22:06:53.980382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:28.579444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":183,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979720+0000","last_change":"2024-09-12T22:06:44.421429+0000","last_active":"2024-09-12T22:06:53.979720+0000","last_peered":"2024-09-12T22:06:53.979720+0000","last_clean":"2024-09-12T22:06:53.979720+0000","last_became_active":"2024-09-12T22:06:44.421088+0000","last_became_peered":"2024-09-12T22:06:44.421088+0000","last_unstale":"2024-09-12T22:06:53.979720+0000","last_undegraded":"2024-09-12T22:06:53.979720+0000","last_fullsized":"2024-09-12T22:06:53.979720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:29.121518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979693+0000","last_change":"2024-09-12T22:06:50.423638+0000","last_active":"2024-09-12T22:06:53.979693+0000","last_peered":"2024-09-12T22:06:53.979693+0000","last_clean":"2024-09-12T22:06:53.979693+0000","last_became_active":"2024-09-12T22:06:50.423052+0000","last_became_peered":"2024-09-12T22:06:50.423052+0000","last_unstale":"2024-09-12T22:06:53.979693+0000","last_undegraded":"2024-09-12T22:06:53.979693+0000","last_fullsized":"2024-09-12T22:06:53.979693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:49.458146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980024+0000","last_change":"2024-09-12T22:06:44.397769+0000","last_active":"2024-09-12T22:06:53.980024+0000","last_peered":"2024-09-12T22:06:53.980024+0000","last_clean":"2024-09-12T22:06:53.980024+0000","last_became_active":"2024-09-12T22:06:44.397452+0000","last_became_peered":"2024-09-12T22:06:44.397452+0000","last_unstale":"2024-09-12T22:06:53.980024+0000","last_undegraded":"2024-09-12T22:06:53.980024+0000","last_fullsized":"2024-09-12T22:06:53.980024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:56.815006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979460+0000","last_change":"2024-09-12T22:06:50.420039+0000","last_active":"2024-09-12T22:06:53.979460+0000","last_peered":"2024-09-12T22:06:53.979460+0000","last_clean":"2024-09-12T22:06:53.979460+0000","last_became_active":"2024-09-12T22:06:50.419551+0000","last_became_peered":"2024-09-12T22:06:50.419551+0000","last_unstale":"2024-09-12T22:06:53.979460+0000","last_undegraded":"2024-09-12T22:06:53.979460+0000","last_fullsized":"2024-09-12T22:06:53.979460+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:06.211607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980065+0000","last_change":"2024-09-12T22:06:44.397598+0000","last_active":"2024-09-12T22:06:53.980065+0000","last_peered":"2024-09-12T22:06:53.980065+0000","last_clean":"2024-09-12T22:06:53.980065+0000","last_became_active":"2024-09-12T22:06:44.396979+0000","last_became_peered":"2024-09-12T22:06:44.396979+0000","last_unstale":"2024-09-12T22:06:53.980065+0000","last_undegraded":"2024-09-12T22:06:53.980065+0000","last_fullsized":"2024-09-12T22:06:53.980065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:27.592588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035149+0000","last_change":"2024-09-12T22:06:50.419195+0000","last_active":"2024-09-12T22:06:54.035149+0000","last_peered":"2024-09-12T22:06:54.035149+0000","last_clean":"2024-09-12T22:06:54.035149+0000","last_became_active":"2024-09-12T22:06:50.418763+0000","last_became_peered":"2024-09-12T22:06:50.418763+0000","last_unstale":"2024-09-12T22:06:54.035149+0000","last_undegraded":"2024-09-12T22:06:54.035149+0000","last_fullsized":"2024-09-12T22:06:54.035149+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:15.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979795+0000","last_change":"2024-09-12T22:06:44.389682+0000","last_active":"2024-09-12T22:06:53.979795+0000","last_peered":"2024-09-12T22:06:53.979795+0000","last_clean":"2024-09-12T22:06:53.979795+0000","last_became_active":"2024-09-12T22:06:44.388887+0000","last_became_peered":"2024-09-12T22:06:44.388887+0000","last_unstale":"2024-09-12T22:06:53.979795+0000","last_undegraded":"2024-09-12T22:06:53.979795+0000","last_fullsized":"2024-09-12T22:06:53.979795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:09:27.376344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035461+0000","last_change":"2024-09-12T22:06:44.390603+0000","last_active":"2024-09-12T22:06:54.035461+0000","last_peered":"2024-09-12T22:06:54.035461+0000","last_clean":"2024-09-12T22:06:54.035461+0000","last_became_active":"2024-09-12T22:06:44.390260+0000","last_became_peered":"2024-09-12T22:06:44.390260+0000","last_unstale":"2024-09-12T22:06:54.035461+0000","last_undegraded":"2024-09-12T22:06:54.035461+0000","last_fullsized":"2024-09-12T22:06:54.035461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:42.158737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035313+0000","last_change":"2024-09-12T22:03:33.464893+0000","last_active":"2024-09-12T22:06:54.035313+0000","last_peered":"2024-09-12T22:06:54.035313+0000","last_clean":"2024-09-12T22:06:54.035313+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:06:54.035313+0000","last_undegraded":"2024-09-12T22:06:54.035313+0000","last_fullsized":"2024-09-12T22:06:54.035313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:47.948673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980033+0000","last_change":"2024-09-12T22:06:44.390378+0000","last_active":"2024-09-12T22:06:53.980033+0000","last_peered":"2024-09-12T22:06:53.980033+0000","last_clean":"2024-09-12T22:06:53.980033+0000","last_became_active":"2024-09-12T22:06:44.389622+0000","last_became_peered":"2024-09-12T22:06:44.389622+0000","last_unstale":"2024-09-12T22:06:53.980033+0000","last_undegraded":"2024-09-12T22:06:53.980033+0000","last_fullsized":"2024-09-12T22:06:53.980033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:57.877495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980321+0000","last_change":"2024-09-12T22:06:44.398054+0000","last_active":"2024-09-12T22:06:53.980321+0000","last_peered":"2024-09-12T22:06:53.980321+0000","last_clean":"2024-09-12T22:06:53.980321+0000","last_became_active":"2024-09-12T22:06:44.396735+0000","last_became_peered":"2024-09-12T22:06:44.396735+0000","last_unstale":"2024-09-12T22:06:53.980321+0000","last_undegraded":"2024-09-12T22:06:53.980321+0000","last_fullsized":"2024-09-12T22:06:53.980321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:54:49.919665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979023+0000","last_change":"2024-09-12T22:06:44.422129+0000","last_active":"2024-09-12T22:06:53.979023+0000","last_peered":"2024-09-12T22:06:53.979023+0000","last_clean":"2024-09-12T22:06:53.979023+0000","last_became_active":"2024-09-12T22:06:44.421723+0000","last_became_peered":"2024-09-12T22:06:44.421723+0000","last_unstale":"2024-09-12T22:06:53.979023+0000","last_undegraded":"2024-09-12T22:06:53.979023+0000","last_fullsized":"2024-09-12T22:06:53.979023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:11.198373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980261+0000","last_change":"2024-09-12T22:06:50.435272+0000","last_active":"2024-09-12T22:06:53.980261+0000","last_peered":"2024-09-12T22:06:53.980261+0000","last_clean":"2024-09-12T22:06:53.980261+0000","last_became_active":"2024-09-12T22:06:50.419354+0000","last_became_peered":"2024-09-12T22:06:50.419354+0000","last_unstale":"2024-09-12T22:06:53.980261+0000","last_undegraded":"2024-09-12T22:06:53.980261+0000","last_fullsized":"2024-09-12T22:06:53.980261+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:59.450087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979844+0000","last_change":"2024-09-12T22:06:50.418804+0000","last_active":"2024-09-12T22:06:53.979844+0000","last_peered":"2024-09-12T22:06:53.979844+0000","last_clean":"2024-09-12T22:06:53.979844+0000","last_became_active":"2024-09-12T22:06:50.418444+0000","last_became_peered":"2024-09-12T22:06:50.418444+0000","last_unstale":"2024-09-12T22:06:53.979844+0000","last_undegraded":"2024-09-12T22:06:53.979844+0000","last_fullsized":"2024-09-12T22:06:53.979844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:43.033754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034987+0000","last_change":"2024-09-12T22:06:50.419309+0000","last_active":"2024-09-12T22:06:54.034987+0000","last_peered":"2024-09-12T22:06:54.034987+0000","last_clean":"2024-09-12T22:06:54.034987+0000","last_became_active":"2024-09-12T22:06:50.418591+0000","last_became_peered":"2024-09-12T22:06:50.418591+0000","last_unstale":"2024-09-12T22:06:54.034987+0000","last_undegraded":"2024-09-12T22:06:54.034987+0000","last_fullsized":"2024-09-12T22:06:54.034987+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:23.918205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979863+0000","last_change":"2024-09-12T22:06:50.421370+0000","last_active":"2024-09-12T22:06:53.979863+0000","last_peered":"2024-09-12T22:06:53.979863+0000","last_clean":"2024-09-12T22:06:53.979863+0000","last_became_active":"2024-09-12T22:06:50.419642+0000","last_became_peered":"2024-09-12T22:06:50.419642+0000","last_unstale":"2024-09-12T22:06:53.979863+0000","last_undegraded":"2024-09-12T22:06:53.979863+0000","last_fullsized":"2024-09-12T22:06:53.979863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:13.028012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980078+0000","last_change":"2024-09-12T22:06:50.437734+0000","last_active":"2024-09-12T22:06:53.980078+0000","last_peered":"2024-09-12T22:06:53.980078+0000","last_clean":"2024-09-12T22:06:53.980078+0000","last_became_active":"2024-09-12T22:06:50.420099+0000","last_became_peered":"2024-09-12T22:06:50.420099+0000","last_unstale":"2024-09-12T22:06:53.980078+0000","last_undegraded":"2024-09-12T22:06:53.980078+0000","last_fullsized":"2024-09-12T22:06:53.980078+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:05.638054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034976+0000","last_change":"2024-09-12T22:03:54.194965+0000","last_active":"2024-09-12T22:06:54.034976+0000","last_peered":"2024-09-12T22:06:54.034976+0000","last_clean":"2024-09-12T22:06:54.034976+0000","last_became_active":"2024-09-12T22:03:54.194697+0000","last_became_peered":"2024-09-12T22:03:54.194697+0000","last_unstale":"2024-09-12T22:06:54.034976+0000","last_undegraded":"2024-09-12T22:06:54.034976+0000","last_fullsized":"2024-09-12T22:06:54.034976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:47.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":189,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035598+0000","last_change":"2024-09-12T22:06:50.430086+0000","last_active":"2024-09-12T22:06:54.035598+0000","last_peered":"2024-09-12T22:06:54.035598+0000","last_clean":"2024-09-12T22:06:54.035598+0000","last_became_active":"2024-09-12T22:06:50.423283+0000","last_became_peered":"2024-09-12T22:06:50.423283+0000","last_unstale":"2024-09-12T22:06:54.035598+0000","last_undegraded":"2024-09-12T22:06:54.035598+0000","last_fullsized":"2024-09-12T22:06:54.035598+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:38.836493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979901+0000","last_change":"2024-09-12T22:06:50.421357+0000","last_active":"2024-09-12T22:06:53.979901+0000","last_peered":"2024-09-12T22:06:53.979901+0000","last_clean":"2024-09-12T22:06:53.979901+0000","last_became_active":"2024-09-12T22:06:50.420171+0000","last_became_peered":"2024-09-12T22:06:50.420171+0000","last_unstale":"2024-09-12T22:06:53.979901+0000","last_undegraded":"2024-09-12T22:06:53.979901+0000","last_fullsized":"2024-09-12T22:06:53.979901+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:25.747880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979236+0000","last_change":"2024-09-12T22:06:50.418126+0000","last_active":"2024-09-12T22:06:53.979236+0000","last_peered":"2024-09-12T22:06:53.979236+0000","last_clean":"2024-09-12T22:06:53.979236+0000","last_became_active":"2024-09-12T22:06:50.417583+0000","last_became_peered":"2024-09-12T22:06:50.417583+0000","last_unstale":"2024-09-12T22:06:53.979236+0000","last_undegraded":"2024-09-12T22:06:53.979236+0000","last_fullsized":"2024-09-12T22:06:53.979236+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:17:44.500650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980312+0000","last_change":"2024-09-12T22:06:44.422538+0000","last_active":"2024-09-12T22:06:53.980312+0000","last_peered":"2024-09-12T22:06:53.980312+0000","last_clean":"2024-09-12T22:06:53.980312+0000","last_became_active":"2024-09-12T22:06:44.422217+0000","last_became_peered":"2024-09-12T22:06:44.422217+0000","last_unstale":"2024-09-12T22:06:53.980312+0000","last_undegraded":"2024-09-12T22:06:53.980312+0000","last_fullsized":"2024-09-12T22:06:53.980312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:10.635087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979185+0000","last_change":"2024-09-12T22:06:44.390100+0000","last_active":"2024-09-12T22:06:53.979185+0000","last_peered":"2024-09-12T22:06:53.979185+0000","last_clean":"2024-09-12T22:06:53.979185+0000","last_became_active":"2024-09-12T22:06:44.388560+0000","last_became_peered":"2024-09-12T22:06:44.388560+0000","last_unstale":"2024-09-12T22:06:53.979185+0000","last_undegraded":"2024-09-12T22:06:53.979185+0000","last_fullsized":"2024-09-12T22:06:53.979185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:18.786679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.036028+0000","last_change":"2024-09-12T22:03:33.460177+0000","last_active":"2024-09-12T22:06:54.036028+0000","last_peered":"2024-09-12T22:06:54.036028+0000","last_clean":"2024-09-12T22:06:54.036028+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:06:54.036028+0000","last_undegraded":"2024-09-12T22:06:54.036028+0000","last_fullsized":"2024-09-12T22:06:54.036028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979285+0000","last_change":"2024-09-12T22:06:44.388874+0000","last_active":"2024-09-12T22:06:53.979285+0000","last_peered":"2024-09-12T22:06:53.979285+0000","last_clean":"2024-09-12T22:06:53.979285+0000","last_became_active":"2024-09-12T22:06:44.388499+0000","last_became_peered":"2024-09-12T22:06:44.388499+0000","last_unstale":"2024-09-12T22:06:53.979285+0000","last_undegraded":"2024-09-12T22:06:53.979285+0000","last_fullsized":"2024-09-12T22:06:53.979285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:48.397806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980074+0000","last_change":"2024-09-12T22:06:50.419782+0000","last_active":"2024-09-12T22:06:53.980074+0000","last_peered":"2024-09-12T22:06:53.980074+0000","last_clean":"2024-09-12T22:06:53.980074+0000","last_became_active":"2024-09-12T22:06:50.418800+0000","last_became_peered":"2024-09-12T22:06:50.418800+0000","last_unstale":"2024-09-12T22:06:53.980074+0000","last_undegraded":"2024-09-12T22:06:53.980074+0000","last_fullsized":"2024-09-12T22:06:53.980074+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:42:06.678070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978996+0000","last_change":"2024-09-12T22:06:50.418163+0000","last_active":"2024-09-12T22:06:53.978996+0000","last_peered":"2024-09-12T22:06:53.978996+0000","last_clean":"2024-09-12T22:06:53.978996+0000","last_became_active":"2024-09-12T22:06:50.417455+0000","last_became_peered":"2024-09-12T22:06:50.417455+0000","last_unstale":"2024-09-12T22:06:53.978996+0000","last_undegraded":"2024-09-12T22:06:53.978996+0000","last_fullsized":"2024-09-12T22:06:53.978996+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:02:41.699273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035911+0000","last_change":"2024-09-12T22:03:33.465186+0000","last_active":"2024-09-12T22:06:54.035911+0000","last_peered":"2024-09-12T22:06:54.035911+0000","last_clean":"2024-09-12T22:06:54.035911+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:06:54.035911+0000","last_undegraded":"2024-09-12T22:06:54.035911+0000","last_fullsized":"2024-09-12T22:06:54.035911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:29.409225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035270+0000","last_change":"2024-09-12T22:06:44.391108+0000","last_active":"2024-09-12T22:06:54.035270+0000","last_peered":"2024-09-12T22:06:54.035270+0000","last_clean":"2024-09-12T22:06:54.035270+0000","last_became_active":"2024-09-12T22:06:44.390719+0000","last_became_peered":"2024-09-12T22:06:44.390719+0000","last_unstale":"2024-09-12T22:06:54.035270+0000","last_undegraded":"2024-09-12T22:06:54.035270+0000","last_fullsized":"2024-09-12T22:06:54.035270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:19.780194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035404+0000","last_change":"2024-09-12T22:06:44.392898+0000","last_active":"2024-09-12T22:06:54.035404+0000","last_peered":"2024-09-12T22:06:54.035404+0000","last_clean":"2024-09-12T22:06:54.035404+0000","last_became_active":"2024-09-12T22:06:44.392160+0000","last_became_peered":"2024-09-12T22:06:44.392160+0000","last_unstale":"2024-09-12T22:06:54.035404+0000","last_undegraded":"2024-09-12T22:06:54.035404+0000","last_fullsized":"2024-09-12T22:06:54.035404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:15:25.344346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035083+0000","last_change":"2024-09-12T22:06:50.419266+0000","last_active":"2024-09-12T22:06:54.035083+0000","last_peered":"2024-09-12T22:06:54.035083+0000","last_clean":"2024-09-12T22:06:54.035083+0000","last_became_active":"2024-09-12T22:06:50.418834+0000","last_became_peered":"2024-09-12T22:06:50.418834+0000","last_unstale":"2024-09-12T22:06:54.035083+0000","last_undegraded":"2024-09-12T22:06:54.035083+0000","last_fullsized":"2024-09-12T22:06:54.035083+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:32.300720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979215+0000","last_change":"2024-09-12T22:06:50.420055+0000","last_active":"2024-09-12T22:06:53.979215+0000","last_peered":"2024-09-12T22:06:53.979215+0000","last_clean":"2024-09-12T22:06:53.979215+0000","last_became_active":"2024-09-12T22:06:50.418856+0000","last_became_peered":"2024-09-12T22:06:50.418856+0000","last_unstale":"2024-09-12T22:06:53.979215+0000","last_undegraded":"2024-09-12T22:06:53.979215+0000","last_fullsized":"2024-09-12T22:06:53.979215+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:42.010524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980021+0000","last_change":"2024-09-12T22:06:50.439495+0000","last_active":"2024-09-12T22:06:53.980021+0000","last_peered":"2024-09-12T22:06:53.980021+0000","last_clean":"2024-09-12T22:06:53.980021+0000","last_became_active":"2024-09-12T22:06:50.421034+0000","last_became_peered":"2024-09-12T22:06:50.421034+0000","last_unstale":"2024-09-12T22:06:53.980021+0000","last_undegraded":"2024-09-12T22:06:53.980021+0000","last_fullsized":"2024-09-12T22:06:53.980021+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:46.276197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979173+0000","last_change":"2024-09-12T22:06:50.420937+0000","last_active":"2024-09-12T22:06:53.979173+0000","last_peered":"2024-09-12T22:06:53.979173+0000","last_clean":"2024-09-12T22:06:53.979173+0000","last_became_active":"2024-09-12T22:06:50.419417+0000","last_became_peered":"2024-09-12T22:06:50.419417+0000","last_unstale":"2024-09-12T22:06:53.979173+0000","last_undegraded":"2024-09-12T22:06:53.979173+0000","last_fullsized":"2024-09-12T22:06:53.979173+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:01:48.684913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035839+0000","last_change":"2024-09-12T22:03:32.461230+0000","last_active":"2024-09-12T22:06:54.035839+0000","last_peered":"2024-09-12T22:06:54.035839+0000","last_clean":"2024-09-12T22:06:54.035839+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:06:54.035839+0000","last_undegraded":"2024-09-12T22:06:54.035839+0000","last_fullsized":"2024-09-12T22:06:54.035839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:16.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035299+0000","last_change":"2024-09-12T22:06:44.392598+0000","last_active":"2024-09-12T22:06:54.035299+0000","last_peered":"2024-09-12T22:06:54.035299+0000","last_clean":"2024-09-12T22:06:54.035299+0000","last_became_active":"2024-09-12T22:06:44.392020+0000","last_became_peered":"2024-09-12T22:06:44.392020+0000","last_unstale":"2024-09-12T22:06:54.035299+0000","last_undegraded":"2024-09-12T22:06:54.035299+0000","last_fullsized":"2024-09-12T22:06:54.035299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:01.708696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979850+0000","last_change":"2024-09-12T22:06:44.394611+0000","last_active":"2024-09-12T22:06:53.979850+0000","last_peered":"2024-09-12T22:06:53.979850+0000","last_clean":"2024-09-12T22:06:53.979850+0000","last_became_active":"2024-09-12T22:06:44.394195+0000","last_became_peered":"2024-09-12T22:06:44.394195+0000","last_unstale":"2024-09-12T22:06:53.979850+0000","last_undegraded":"2024-09-12T22:06:53.979850+0000","last_fullsized":"2024-09-12T22:06:53.979850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:53.173265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978895+0000","last_change":"2024-09-12T22:06:50.421136+0000","last_active":"2024-09-12T22:06:53.978895+0000","last_peered":"2024-09-12T22:06:53.978895+0000","last_clean":"2024-09-12T22:06:53.978895+0000","last_became_active":"2024-09-12T22:06:50.420176+0000","last_became_peered":"2024-09-12T22:06:50.420176+0000","last_unstale":"2024-09-12T22:06:53.978895+0000","last_undegraded":"2024-09-12T22:06:53.978895+0000","last_fullsized":"2024-09-12T22:06:53.978895+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:24.868192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980485+0000","last_change":"2024-09-12T22:06:50.433450+0000","last_active":"2024-09-12T22:06:53.980485+0000","last_peered":"2024-09-12T22:06:53.980485+0000","last_clean":"2024-09-12T22:06:53.980485+0000","last_became_active":"2024-09-12T22:06:50.417229+0000","last_became_peered":"2024-09-12T22:06:50.417229+0000","last_unstale":"2024-09-12T22:06:53.980485+0000","last_undegraded":"2024-09-12T22:06:53.980485+0000","last_fullsized":"2024-09-12T22:06:53.980485+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:38.255675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2430,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705711,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":564512,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":562878,"kb_avail":93807328,"statfs":{"total":96636764160,"available":96058703872,"internally_reserved":0,"allocated":1646592,"data_stored":1060429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576387525},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705711,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411820,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":410174,"kb_avail":93960020,"statfs":{"total":96636764160,"available":96215060480,"internally_reserved":0,"allocated":1658880,"data_stored":1061064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":420018629},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285572,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50704,"kb_used_data":1008,"kb_used_omap":6,"kb_used_meta":49657,"kb_avail":94321136,"statfs":{"total":96636764160,"available":96584843264,"internally_reserved":0,"allocated":1032192,"data_stored":464641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6904,"internal_metadata":50849032},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:06:58.172 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:06:58.502 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:06:58.503 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:06:58.513 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-09-12T22:06:58.287908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":592798,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1027032,"kb_used_data":4244,"kb_used_omap":9,"kb_used_meta":1022710,"kb_avail":282088488,"statfs":{"total":289910292480,"available":288858611712,"internally_reserved":0,"allocated":4345856,"data_stored":2590395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10094,"internal_metadata":1047255186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":706,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.316394"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035891+0000","last_change":"2024-09-12T22:06:44.391498+0000","last_active":"2024-09-12T22:06:54.035891+0000","last_peered":"2024-09-12T22:06:54.035891+0000","last_clean":"2024-09-12T22:06:54.035891+0000","last_became_active":"2024-09-12T22:06:44.391100+0000","last_became_peered":"2024-09-12T22:06:44.391100+0000","last_unstale":"2024-09-12T22:06:54.035891+0000","last_undegraded":"2024-09-12T22:06:54.035891+0000","last_fullsized":"2024-09-12T22:06:54.035891+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:04.380570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.036011+0000","last_change":"2024-09-12T22:06:44.392987+0000","last_active":"2024-09-12T22:06:54.036011+0000","last_peered":"2024-09-12T22:06:54.036011+0000","last_clean":"2024-09-12T22:06:54.036011+0000","last_became_active":"2024-09-12T22:06:44.392188+0000","last_became_peered":"2024-09-12T22:06:44.392188+0000","last_unstale":"2024-09-12T22:06:54.036011+0000","last_undegraded":"2024-09-12T22:06:54.036011+0000","last_fullsized":"2024-09-12T22:06:54.036011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:36.209594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979690+0000","last_change":"2024-09-12T22:03:33.462148+0000","last_active":"2024-09-12T22:06:53.979690+0000","last_peered":"2024-09-12T22:06:53.979690+0000","last_clean":"2024-09-12T22:06:53.979690+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:06:53.979690+0000","last_undegraded":"2024-09-12T22:06:53.979690+0000","last_fullsized":"2024-09-12T22:06:53.979690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:36.909948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979484+0000","last_change":"2024-09-12T22:06:50.419886+0000","last_active":"2024-09-12T22:06:53.979484+0000","last_peered":"2024-09-12T22:06:53.979484+0000","last_clean":"2024-09-12T22:06:53.979484+0000","last_became_active":"2024-09-12T22:06:50.419429+0000","last_became_peered":"2024-09-12T22:06:50.419429+0000","last_unstale":"2024-09-12T22:06:53.979484+0000","last_undegraded":"2024-09-12T22:06:53.979484+0000","last_fullsized":"2024-09-12T22:06:53.979484+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:16.917462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035121+0000","last_change":"2024-09-12T22:06:44.392862+0000","last_active":"2024-09-12T22:06:54.035121+0000","last_peered":"2024-09-12T22:06:54.035121+0000","last_clean":"2024-09-12T22:06:54.035121+0000","last_became_active":"2024-09-12T22:06:44.391774+0000","last_became_peered":"2024-09-12T22:06:44.391774+0000","last_unstale":"2024-09-12T22:06:54.035121+0000","last_undegraded":"2024-09-12T22:06:54.035121+0000","last_fullsized":"2024-09-12T22:06:54.035121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:09.703417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979018+0000","last_change":"2024-09-12T22:06:50.414892+0000","last_active":"2024-09-12T22:06:53.979018+0000","last_peered":"2024-09-12T22:06:53.979018+0000","last_clean":"2024-09-12T22:06:53.979018+0000","last_became_active":"2024-09-12T22:06:50.414526+0000","last_became_peered":"2024-09-12T22:06:50.414526+0000","last_unstale":"2024-09-12T22:06:53.979018+0000","last_undegraded":"2024-09-12T22:06:53.979018+0000","last_fullsized":"2024-09-12T22:06:53.979018+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:29.766297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979359+0000","last_change":"2024-09-12T22:06:44.421423+0000","last_active":"2024-09-12T22:06:53.979359+0000","last_peered":"2024-09-12T22:06:53.979359+0000","last_clean":"2024-09-12T22:06:53.979359+0000","last_became_active":"2024-09-12T22:06:44.421094+0000","last_became_peered":"2024-09-12T22:06:44.421094+0000","last_unstale":"2024-09-12T22:06:53.979359+0000","last_undegraded":"2024-09-12T22:06:53.979359+0000","last_fullsized":"2024-09-12T22:06:53.979359+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:48.618058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979320+0000","last_change":"2024-09-12T22:06:44.395363+0000","last_active":"2024-09-12T22:06:53.979320+0000","last_peered":"2024-09-12T22:06:53.979320+0000","last_clean":"2024-09-12T22:06:53.979320+0000","last_became_active":"2024-09-12T22:06:44.394804+0000","last_became_peered":"2024-09-12T22:06:44.394804+0000","last_unstale":"2024-09-12T22:06:53.979320+0000","last_undegraded":"2024-09-12T22:06:53.979320+0000","last_fullsized":"2024-09-12T22:06:53.979320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:18.826036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980197+0000","last_change":"2024-09-12T22:06:44.390017+0000","last_active":"2024-09-12T22:06:53.980197+0000","last_peered":"2024-09-12T22:06:53.980197+0000","last_clean":"2024-09-12T22:06:53.980197+0000","last_became_active":"2024-09-12T22:06:44.389256+0000","last_became_peered":"2024-09-12T22:06:44.389256+0000","last_unstale":"2024-09-12T22:06:53.980197+0000","last_undegraded":"2024-09-12T22:06:53.980197+0000","last_fullsized":"2024-09-12T22:06:53.980197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:48.669357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035877+0000","last_change":"2024-09-12T22:06:44.392599+0000","last_active":"2024-09-12T22:06:54.035877+0000","last_peered":"2024-09-12T22:06:54.035877+0000","last_clean":"2024-09-12T22:06:54.035877+0000","last_became_active":"2024-09-12T22:06:44.391572+0000","last_became_peered":"2024-09-12T22:06:44.391572+0000","last_unstale":"2024-09-12T22:06:54.035877+0000","last_undegraded":"2024-09-12T22:06:54.035877+0000","last_fullsized":"2024-09-12T22:06:54.035877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:41.342271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979365+0000","last_change":"2024-09-12T22:06:50.420008+0000","last_active":"2024-09-12T22:06:53.979365+0000","last_peered":"2024-09-12T22:06:53.979365+0000","last_clean":"2024-09-12T22:06:53.979365+0000","last_became_active":"2024-09-12T22:06:50.419042+0000","last_became_peered":"2024-09-12T22:06:50.419042+0000","last_unstale":"2024-09-12T22:06:53.979365+0000","last_undegraded":"2024-09-12T22:06:53.979365+0000","last_fullsized":"2024-09-12T22:06:53.979365+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:39.365289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035352+0000","last_change":"2024-09-12T22:03:33.465069+0000","last_active":"2024-09-12T22:06:54.035352+0000","last_peered":"2024-09-12T22:06:54.035352+0000","last_clean":"2024-09-12T22:06:54.035352+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:06:54.035352+0000","last_undegraded":"2024-09-12T22:06:54.035352+0000","last_fullsized":"2024-09-12T22:06:54.035352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035321+0000","last_change":"2024-09-12T22:06:44.392909+0000","last_active":"2024-09-12T22:06:54.035321+0000","last_peered":"2024-09-12T22:06:54.035321+0000","last_clean":"2024-09-12T22:06:54.035321+0000","last_became_active":"2024-09-12T22:06:44.392491+0000","last_became_peered":"2024-09-12T22:06:44.392491+0000","last_unstale":"2024-09-12T22:06:54.035321+0000","last_undegraded":"2024-09-12T22:06:54.035321+0000","last_fullsized":"2024-09-12T22:06:54.035321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:09.585700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979180+0000","last_change":"2024-09-12T22:06:50.419973+0000","last_active":"2024-09-12T22:06:53.979180+0000","last_peered":"2024-09-12T22:06:53.979180+0000","last_clean":"2024-09-12T22:06:53.979180+0000","last_became_active":"2024-09-12T22:06:50.418325+0000","last_became_peered":"2024-09-12T22:06:50.418325+0000","last_unstale":"2024-09-12T22:06:53.979180+0000","last_undegraded":"2024-09-12T22:06:53.979180+0000","last_fullsized":"2024-09-12T22:06:53.979180+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:02.303968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979112+0000","last_change":"2024-09-12T22:06:50.419011+0000","last_active":"2024-09-12T22:06:53.979112+0000","last_peered":"2024-09-12T22:06:53.979112+0000","last_clean":"2024-09-12T22:06:53.979112+0000","last_became_active":"2024-09-12T22:06:50.418075+0000","last_became_peered":"2024-09-12T22:06:50.418075+0000","last_unstale":"2024-09-12T22:06:53.979112+0000","last_undegraded":"2024-09-12T22:06:53.979112+0000","last_fullsized":"2024-09-12T22:06:53.979112+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:16.440226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979399+0000","last_change":"2024-09-12T22:06:44.395099+0000","last_active":"2024-09-12T22:06:53.979399+0000","last_peered":"2024-09-12T22:06:53.979399+0000","last_clean":"2024-09-12T22:06:53.979399+0000","last_became_active":"2024-09-12T22:06:44.394486+0000","last_became_peered":"2024-09-12T22:06:44.394486+0000","last_unstale":"2024-09-12T22:06:53.979399+0000","last_undegraded":"2024-09-12T22:06:53.979399+0000","last_fullsized":"2024-09-12T22:06:53.979399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:47.461701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980180+0000","last_change":"2024-09-12T22:06:44.390021+0000","last_active":"2024-09-12T22:06:53.980180+0000","last_peered":"2024-09-12T22:06:53.980180+0000","last_clean":"2024-09-12T22:06:53.980180+0000","last_became_active":"2024-09-12T22:06:44.388967+0000","last_became_peered":"2024-09-12T22:06:44.388967+0000","last_unstale":"2024-09-12T22:06:53.980180+0000","last_undegraded":"2024-09-12T22:06:53.980180+0000","last_fullsized":"2024-09-12T22:06:53.980180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:15.769587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035728+0000","last_change":"2024-09-12T22:06:44.391191+0000","last_active":"2024-09-12T22:06:54.035728+0000","last_peered":"2024-09-12T22:06:54.035728+0000","last_clean":"2024-09-12T22:06:54.035728+0000","last_became_active":"2024-09-12T22:06:44.390858+0000","last_became_peered":"2024-09-12T22:06:44.390858+0000","last_unstale":"2024-09-12T22:06:54.035728+0000","last_undegraded":"2024-09-12T22:06:54.035728+0000","last_fullsized":"2024-09-12T22:06:54.035728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:30.878874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979804+0000","last_change":"2024-09-12T22:06:44.389205+0000","last_active":"2024-09-12T22:06:53.979804+0000","last_peered":"2024-09-12T22:06:53.979804+0000","last_clean":"2024-09-12T22:06:53.979804+0000","last_became_active":"2024-09-12T22:06:44.388761+0000","last_became_peered":"2024-09-12T22:06:44.388761+0000","last_unstale":"2024-09-12T22:06:53.979804+0000","last_undegraded":"2024-09-12T22:06:53.979804+0000","last_fullsized":"2024-09-12T22:06:53.979804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:31.790297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980172+0000","last_change":"2024-09-12T22:06:44.421429+0000","last_active":"2024-09-12T22:06:53.980172+0000","last_peered":"2024-09-12T22:06:53.980172+0000","last_clean":"2024-09-12T22:06:53.980172+0000","last_became_active":"2024-09-12T22:06:44.420768+0000","last_became_peered":"2024-09-12T22:06:44.420768+0000","last_unstale":"2024-09-12T22:06:53.980172+0000","last_undegraded":"2024-09-12T22:06:53.980172+0000","last_fullsized":"2024-09-12T22:06:53.980172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:25.634497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979404+0000","last_change":"2024-09-12T22:06:50.422914+0000","last_active":"2024-09-12T22:06:53.979404+0000","last_peered":"2024-09-12T22:06:53.979404+0000","last_clean":"2024-09-12T22:06:53.979404+0000","last_became_active":"2024-09-12T22:06:50.421758+0000","last_became_peered":"2024-09-12T22:06:50.421758+0000","last_unstale":"2024-09-12T22:06:53.979404+0000","last_undegraded":"2024-09-12T22:06:53.979404+0000","last_fullsized":"2024-09-12T22:06:53.979404+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:02.122833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035141+0000","last_change":"2024-09-12T22:03:33.460994+0000","last_active":"2024-09-12T22:06:54.035141+0000","last_peered":"2024-09-12T22:06:54.035141+0000","last_clean":"2024-09-12T22:06:54.035141+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:06:54.035141+0000","last_undegraded":"2024-09-12T22:06:54.035141+0000","last_fullsized":"2024-09-12T22:06:54.035141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:20.363291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979143+0000","last_change":"2024-09-12T22:06:50.417908+0000","last_active":"2024-09-12T22:06:53.979143+0000","last_peered":"2024-09-12T22:06:53.979143+0000","last_clean":"2024-09-12T22:06:53.979143+0000","last_became_active":"2024-09-12T22:06:50.416924+0000","last_became_peered":"2024-09-12T22:06:50.416924+0000","last_unstale":"2024-09-12T22:06:53.979143+0000","last_undegraded":"2024-09-12T22:06:53.979143+0000","last_fullsized":"2024-09-12T22:06:53.979143+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:28.247991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034792+0000","last_change":"2024-09-12T22:06:44.391876+0000","last_active":"2024-09-12T22:06:54.034792+0000","last_peered":"2024-09-12T22:06:54.034792+0000","last_clean":"2024-09-12T22:06:54.034792+0000","last_became_active":"2024-09-12T22:06:44.391480+0000","last_became_peered":"2024-09-12T22:06:44.391480+0000","last_unstale":"2024-09-12T22:06:54.034792+0000","last_undegraded":"2024-09-12T22:06:54.034792+0000","last_fullsized":"2024-09-12T22:06:54.034792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:43.161300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035981+0000","last_change":"2024-09-12T22:06:50.420130+0000","last_active":"2024-09-12T22:06:54.035981+0000","last_peered":"2024-09-12T22:06:54.035981+0000","last_clean":"2024-09-12T22:06:54.035981+0000","last_became_active":"2024-09-12T22:06:50.419573+0000","last_became_peered":"2024-09-12T22:06:50.419573+0000","last_unstale":"2024-09-12T22:06:54.035981+0000","last_undegraded":"2024-09-12T22:06:54.035981+0000","last_fullsized":"2024-09-12T22:06:54.035981+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:31.160831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980210+0000","last_change":"2024-09-12T22:06:50.420167+0000","last_active":"2024-09-12T22:06:53.980210+0000","last_peered":"2024-09-12T22:06:53.980210+0000","last_clean":"2024-09-12T22:06:53.980210+0000","last_became_active":"2024-09-12T22:06:50.419348+0000","last_became_peered":"2024-09-12T22:06:50.419348+0000","last_unstale":"2024-09-12T22:06:53.980210+0000","last_undegraded":"2024-09-12T22:06:53.980210+0000","last_fullsized":"2024-09-12T22:06:53.980210+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:19.786252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979690+0000","last_change":"2024-09-12T22:03:33.461282+0000","last_active":"2024-09-12T22:06:53.979690+0000","last_peered":"2024-09-12T22:06:53.979690+0000","last_clean":"2024-09-12T22:06:53.979690+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:06:53.979690+0000","last_undegraded":"2024-09-12T22:06:53.979690+0000","last_fullsized":"2024-09-12T22:06:53.979690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:32.302716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035627+0000","last_change":"2024-09-12T22:06:50.419329+0000","last_active":"2024-09-12T22:06:54.035627+0000","last_peered":"2024-09-12T22:06:54.035627+0000","last_clean":"2024-09-12T22:06:54.035627+0000","last_became_active":"2024-09-12T22:06:50.418755+0000","last_became_peered":"2024-09-12T22:06:50.418755+0000","last_unstale":"2024-09-12T22:06:54.035627+0000","last_undegraded":"2024-09-12T22:06:54.035627+0000","last_fullsized":"2024-09-12T22:06:54.035627+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:02.572755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979812+0000","last_change":"2024-09-12T22:06:44.397630+0000","last_active":"2024-09-12T22:06:53.979812+0000","last_peered":"2024-09-12T22:06:53.979812+0000","last_clean":"2024-09-12T22:06:53.979812+0000","last_became_active":"2024-09-12T22:06:44.397198+0000","last_became_peered":"2024-09-12T22:06:44.397198+0000","last_unstale":"2024-09-12T22:06:53.979812+0000","last_undegraded":"2024-09-12T22:06:53.979812+0000","last_fullsized":"2024-09-12T22:06:53.979812+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:31.843174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035267+0000","last_change":"2024-09-12T22:03:33.456842+0000","last_active":"2024-09-12T22:06:54.035267+0000","last_peered":"2024-09-12T22:06:54.035267+0000","last_clean":"2024-09-12T22:06:54.035267+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:06:54.035267+0000","last_undegraded":"2024-09-12T22:06:54.035267+0000","last_fullsized":"2024-09-12T22:06:54.035267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:56.383351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979590+0000","last_change":"2024-09-12T22:06:44.397416+0000","last_active":"2024-09-12T22:06:53.979590+0000","last_peered":"2024-09-12T22:06:53.979590+0000","last_clean":"2024-09-12T22:06:53.979590+0000","last_became_active":"2024-09-12T22:06:44.397074+0000","last_became_peered":"2024-09-12T22:06:44.397074+0000","last_unstale":"2024-09-12T22:06:53.979590+0000","last_undegraded":"2024-09-12T22:06:53.979590+0000","last_fullsized":"2024-09-12T22:06:53.979590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.834005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978818+0000","last_change":"2024-09-12T22:06:50.414965+0000","last_active":"2024-09-12T22:06:53.978818+0000","last_peered":"2024-09-12T22:06:53.978818+0000","last_clean":"2024-09-12T22:06:53.978818+0000","last_became_active":"2024-09-12T22:06:50.414626+0000","last_became_peered":"2024-09-12T22:06:50.414626+0000","last_unstale":"2024-09-12T22:06:53.978818+0000","last_undegraded":"2024-09-12T22:06:53.978818+0000","last_fullsized":"2024-09-12T22:06:53.978818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:30.619121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035494+0000","last_change":"2024-09-12T22:06:44.391923+0000","last_active":"2024-09-12T22:06:54.035494+0000","last_peered":"2024-09-12T22:06:54.035494+0000","last_clean":"2024-09-12T22:06:54.035494+0000","last_became_active":"2024-09-12T22:06:44.391447+0000","last_became_peered":"2024-09-12T22:06:44.391447+0000","last_unstale":"2024-09-12T22:06:54.035494+0000","last_undegraded":"2024-09-12T22:06:54.035494+0000","last_fullsized":"2024-09-12T22:06:54.035494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:32.308333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979499+0000","last_change":"2024-09-12T22:06:50.442693+0000","last_active":"2024-09-12T22:06:53.979499+0000","last_peered":"2024-09-12T22:06:53.979499+0000","last_clean":"2024-09-12T22:06:53.979499+0000","last_became_active":"2024-09-12T22:06:50.422232+0000","last_became_peered":"2024-09-12T22:06:50.422232+0000","last_unstale":"2024-09-12T22:06:53.979499+0000","last_undegraded":"2024-09-12T22:06:53.979499+0000","last_fullsized":"2024-09-12T22:06:53.979499+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:40.705556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035690+0000","last_change":"2024-09-12T22:06:44.390974+0000","last_active":"2024-09-12T22:06:54.035690+0000","last_peered":"2024-09-12T22:06:54.035690+0000","last_clean":"2024-09-12T22:06:54.035690+0000","last_became_active":"2024-09-12T22:06:44.390652+0000","last_became_peered":"2024-09-12T22:06:44.390652+0000","last_unstale":"2024-09-12T22:06:54.035690+0000","last_undegraded":"2024-09-12T22:06:54.035690+0000","last_fullsized":"2024-09-12T22:06:54.035690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:41.707065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979208+0000","last_change":"2024-09-12T22:06:50.417649+0000","last_active":"2024-09-12T22:06:53.979208+0000","last_peered":"2024-09-12T22:06:53.979208+0000","last_clean":"2024-09-12T22:06:53.979208+0000","last_became_active":"2024-09-12T22:06:50.417123+0000","last_became_peered":"2024-09-12T22:06:50.417123+0000","last_unstale":"2024-09-12T22:06:53.979208+0000","last_undegraded":"2024-09-12T22:06:53.979208+0000","last_fullsized":"2024-09-12T22:06:53.979208+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:01.612960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980187+0000","last_change":"2024-09-12T22:06:50.419787+0000","last_active":"2024-09-12T22:06:53.980187+0000","last_peered":"2024-09-12T22:06:53.980187+0000","last_clean":"2024-09-12T22:06:53.980187+0000","last_became_active":"2024-09-12T22:06:50.418817+0000","last_became_peered":"2024-09-12T22:06:50.418817+0000","last_unstale":"2024-09-12T22:06:53.980187+0000","last_undegraded":"2024-09-12T22:06:53.980187+0000","last_fullsized":"2024-09-12T22:06:53.980187+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:51.923601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035182+0000","last_change":"2024-09-12T22:06:50.419697+0000","last_active":"2024-09-12T22:06:54.035182+0000","last_peered":"2024-09-12T22:06:54.035182+0000","last_clean":"2024-09-12T22:06:54.035182+0000","last_became_active":"2024-09-12T22:06:50.419047+0000","last_became_peered":"2024-09-12T22:06:50.419047+0000","last_unstale":"2024-09-12T22:06:54.035182+0000","last_undegraded":"2024-09-12T22:06:54.035182+0000","last_fullsized":"2024-09-12T22:06:54.035182+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:31.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980033+0000","last_change":"2024-09-12T22:06:44.422294+0000","last_active":"2024-09-12T22:06:53.980033+0000","last_peered":"2024-09-12T22:06:53.980033+0000","last_clean":"2024-09-12T22:06:53.980033+0000","last_became_active":"2024-09-12T22:06:44.421955+0000","last_became_peered":"2024-09-12T22:06:44.421955+0000","last_unstale":"2024-09-12T22:06:53.980033+0000","last_undegraded":"2024-09-12T22:06:53.980033+0000","last_fullsized":"2024-09-12T22:06:53.980033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:40.047878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979018+0000","last_change":"2024-09-12T22:06:50.432341+0000","last_active":"2024-09-12T22:06:53.979018+0000","last_peered":"2024-09-12T22:06:53.979018+0000","last_clean":"2024-09-12T22:06:53.979018+0000","last_became_active":"2024-09-12T22:06:50.418227+0000","last_became_peered":"2024-09-12T22:06:50.418227+0000","last_unstale":"2024-09-12T22:06:53.979018+0000","last_undegraded":"2024-09-12T22:06:53.979018+0000","last_fullsized":"2024-09-12T22:06:53.979018+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:47.509209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979708+0000","last_change":"2024-09-12T22:06:50.426521+0000","last_active":"2024-09-12T22:06:53.979708+0000","last_peered":"2024-09-12T22:06:53.979708+0000","last_clean":"2024-09-12T22:06:53.979708+0000","last_became_active":"2024-09-12T22:06:50.418222+0000","last_became_peered":"2024-09-12T22:06:50.418222+0000","last_unstale":"2024-09-12T22:06:53.979708+0000","last_undegraded":"2024-09-12T22:06:53.979708+0000","last_fullsized":"2024-09-12T22:06:53.979708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:44.473880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034877+0000","last_change":"2024-09-12T22:03:33.465308+0000","last_active":"2024-09-12T22:06:54.034877+0000","last_peered":"2024-09-12T22:06:54.034877+0000","last_clean":"2024-09-12T22:06:54.034877+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:06:54.034877+0000","last_undegraded":"2024-09-12T22:06:54.034877+0000","last_fullsized":"2024-09-12T22:06:54.034877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:35.733622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035614+0000","last_change":"2024-09-12T22:03:32.461301+0000","last_active":"2024-09-12T22:06:54.035614+0000","last_peered":"2024-09-12T22:06:54.035614+0000","last_clean":"2024-09-12T22:06:54.035614+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:06:54.035614+0000","last_undegraded":"2024-09-12T22:06:54.035614+0000","last_fullsized":"2024-09-12T22:06:54.035614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:39.872272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034942+0000","last_change":"2024-09-12T22:06:44.391249+0000","last_active":"2024-09-12T22:06:54.034942+0000","last_peered":"2024-09-12T22:06:54.034942+0000","last_clean":"2024-09-12T22:06:54.034942+0000","last_became_active":"2024-09-12T22:06:44.390807+0000","last_became_peered":"2024-09-12T22:06:44.390807+0000","last_unstale":"2024-09-12T22:06:54.034942+0000","last_undegraded":"2024-09-12T22:06:54.034942+0000","last_fullsized":"2024-09-12T22:06:54.034942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:07.271893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980057+0000","last_change":"2024-09-12T22:03:32.459540+0000","last_active":"2024-09-12T22:06:53.980057+0000","last_peered":"2024-09-12T22:06:53.980057+0000","last_clean":"2024-09-12T22:06:53.980057+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:06:53.980057+0000","last_undegraded":"2024-09-12T22:06:53.980057+0000","last_fullsized":"2024-09-12T22:06:53.980057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:22.143242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979421+0000","last_change":"2024-09-12T22:06:44.421712+0000","last_active":"2024-09-12T22:06:53.979421+0000","last_peered":"2024-09-12T22:06:53.979421+0000","last_clean":"2024-09-12T22:06:53.979421+0000","last_became_active":"2024-09-12T22:06:44.421388+0000","last_became_peered":"2024-09-12T22:06:44.421388+0000","last_unstale":"2024-09-12T22:06:53.979421+0000","last_undegraded":"2024-09-12T22:06:53.979421+0000","last_fullsized":"2024-09-12T22:06:53.979421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:46.580311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980254+0000","last_change":"2024-09-12T22:06:44.421721+0000","last_active":"2024-09-12T22:06:53.980254+0000","last_peered":"2024-09-12T22:06:53.980254+0000","last_clean":"2024-09-12T22:06:53.980254+0000","last_became_active":"2024-09-12T22:06:44.421430+0000","last_became_peered":"2024-09-12T22:06:44.421430+0000","last_unstale":"2024-09-12T22:06:53.980254+0000","last_undegraded":"2024-09-12T22:06:53.980254+0000","last_fullsized":"2024-09-12T22:06:53.980254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:57.001470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979284+0000","last_change":"2024-09-12T22:06:44.397808+0000","last_active":"2024-09-12T22:06:53.979284+0000","last_peered":"2024-09-12T22:06:53.979284+0000","last_clean":"2024-09-12T22:06:53.979284+0000","last_became_active":"2024-09-12T22:06:44.397490+0000","last_became_peered":"2024-09-12T22:06:44.397490+0000","last_unstale":"2024-09-12T22:06:53.979284+0000","last_undegraded":"2024-09-12T22:06:53.979284+0000","last_fullsized":"2024-09-12T22:06:53.979284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:38.225078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979537+0000","last_change":"2024-09-12T22:06:50.426880+0000","last_active":"2024-09-12T22:06:53.979537+0000","last_peered":"2024-09-12T22:06:53.979537+0000","last_clean":"2024-09-12T22:06:53.979537+0000","last_became_active":"2024-09-12T22:06:50.417240+0000","last_became_peered":"2024-09-12T22:06:50.417240+0000","last_unstale":"2024-09-12T22:06:53.979537+0000","last_undegraded":"2024-09-12T22:06:53.979537+0000","last_fullsized":"2024-09-12T22:06:53.979537+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:24.836682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980207+0000","last_change":"2024-09-12T22:06:44.421723+0000","last_active":"2024-09-12T22:06:53.980207+0000","last_peered":"2024-09-12T22:06:53.980207+0000","last_clean":"2024-09-12T22:06:53.980207+0000","last_became_active":"2024-09-12T22:06:44.421071+0000","last_became_peered":"2024-09-12T22:06:44.421071+0000","last_unstale":"2024-09-12T22:06:53.980207+0000","last_undegraded":"2024-09-12T22:06:53.980207+0000","last_fullsized":"2024-09-12T22:06:53.980207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:16.039319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979544+0000","last_change":"2024-09-12T22:06:50.422136+0000","last_active":"2024-09-12T22:06:53.979544+0000","last_peered":"2024-09-12T22:06:53.979544+0000","last_clean":"2024-09-12T22:06:53.979544+0000","last_became_active":"2024-09-12T22:06:50.421734+0000","last_became_peered":"2024-09-12T22:06:50.421734+0000","last_unstale":"2024-09-12T22:06:53.979544+0000","last_undegraded":"2024-09-12T22:06:53.979544+0000","last_fullsized":"2024-09-12T22:06:53.979544+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:29.450310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979869+0000","last_change":"2024-09-12T22:03:33.459084+0000","last_active":"2024-09-12T22:06:53.979869+0000","last_peered":"2024-09-12T22:06:53.979869+0000","last_clean":"2024-09-12T22:06:53.979869+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:06:53.979869+0000","last_undegraded":"2024-09-12T22:06:53.979869+0000","last_fullsized":"2024-09-12T22:06:53.979869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:50.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035351+0000","last_change":"2024-09-12T22:03:32.461417+0000","last_active":"2024-09-12T22:06:54.035351+0000","last_peered":"2024-09-12T22:06:54.035351+0000","last_clean":"2024-09-12T22:06:54.035351+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:06:54.035351+0000","last_undegraded":"2024-09-12T22:06:54.035351+0000","last_fullsized":"2024-09-12T22:06:54.035351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:22.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979869+0000","last_change":"2024-09-12T22:06:50.419560+0000","last_active":"2024-09-12T22:06:53.979869+0000","last_peered":"2024-09-12T22:06:53.979869+0000","last_clean":"2024-09-12T22:06:53.979869+0000","last_became_active":"2024-09-12T22:06:50.418648+0000","last_became_peered":"2024-09-12T22:06:50.418648+0000","last_unstale":"2024-09-12T22:06:53.979869+0000","last_undegraded":"2024-09-12T22:06:53.979869+0000","last_fullsized":"2024-09-12T22:06:53.979869+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:58.944327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034997+0000","last_change":"2024-09-12T22:06:44.391442+0000","last_active":"2024-09-12T22:06:54.034997+0000","last_peered":"2024-09-12T22:06:54.034997+0000","last_clean":"2024-09-12T22:06:54.034997+0000","last_became_active":"2024-09-12T22:06:44.391078+0000","last_became_peered":"2024-09-12T22:06:44.391078+0000","last_unstale":"2024-09-12T22:06:54.034997+0000","last_undegraded":"2024-09-12T22:06:54.034997+0000","last_fullsized":"2024-09-12T22:06:54.034997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:26.602771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980404+0000","last_change":"2024-09-12T22:06:44.397142+0000","last_active":"2024-09-12T22:06:53.980404+0000","last_peered":"2024-09-12T22:06:53.980404+0000","last_clean":"2024-09-12T22:06:53.980404+0000","last_became_active":"2024-09-12T22:06:44.396783+0000","last_became_peered":"2024-09-12T22:06:44.396783+0000","last_unstale":"2024-09-12T22:06:53.980404+0000","last_undegraded":"2024-09-12T22:06:53.980404+0000","last_fullsized":"2024-09-12T22:06:53.980404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:27.631274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":315,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979021+0000","last_change":"2024-09-12T22:06:52.982526+0000","last_active":"2024-09-12T22:06:53.979021+0000","last_peered":"2024-09-12T22:06:53.979021+0000","last_clean":"2024-09-12T22:06:53.979021+0000","last_became_active":"2024-09-12T22:06:52.982174+0000","last_became_peered":"2024-09-12T22:06:52.982174+0000","last_unstale":"2024-09-12T22:06:53.979021+0000","last_undegraded":"2024-09-12T22:06:53.979021+0000","last_fullsized":"2024-09-12T22:06:53.979021+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:20.744009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979737+0000","last_change":"2024-09-12T22:06:50.444340+0000","last_active":"2024-09-12T22:06:53.979737+0000","last_peered":"2024-09-12T22:06:53.979737+0000","last_clean":"2024-09-12T22:06:53.979737+0000","last_became_active":"2024-09-12T22:06:50.422353+0000","last_became_peered":"2024-09-12T22:06:50.422353+0000","last_unstale":"2024-09-12T22:06:53.979737+0000","last_undegraded":"2024-09-12T22:06:53.979737+0000","last_fullsized":"2024-09-12T22:06:53.979737+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.662733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979420+0000","last_change":"2024-09-12T22:06:44.397029+0000","last_active":"2024-09-12T22:06:53.979420+0000","last_peered":"2024-09-12T22:06:53.979420+0000","last_clean":"2024-09-12T22:06:53.979420+0000","last_became_active":"2024-09-12T22:06:44.396659+0000","last_became_peered":"2024-09-12T22:06:44.396659+0000","last_unstale":"2024-09-12T22:06:53.979420+0000","last_undegraded":"2024-09-12T22:06:53.979420+0000","last_fullsized":"2024-09-12T22:06:53.979420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:07.404782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979992+0000","last_change":"2024-09-12T22:06:50.418936+0000","last_active":"2024-09-12T22:06:53.979992+0000","last_peered":"2024-09-12T22:06:53.979992+0000","last_clean":"2024-09-12T22:06:53.979992+0000","last_became_active":"2024-09-12T22:06:50.418443+0000","last_became_peered":"2024-09-12T22:06:50.418443+0000","last_unstale":"2024-09-12T22:06:53.979992+0000","last_undegraded":"2024-09-12T22:06:53.979992+0000","last_fullsized":"2024-09-12T22:06:53.979992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:40.432871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978897+0000","last_change":"2024-09-12T22:06:50.419409+0000","last_active":"2024-09-12T22:06:53.978897+0000","last_peered":"2024-09-12T22:06:53.978897+0000","last_clean":"2024-09-12T22:06:53.978897+0000","last_became_active":"2024-09-12T22:06:50.418160+0000","last_became_peered":"2024-09-12T22:06:50.418160+0000","last_unstale":"2024-09-12T22:06:53.978897+0000","last_undegraded":"2024-09-12T22:06:53.978897+0000","last_fullsized":"2024-09-12T22:06:53.978897+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:48.881995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978987+0000","last_change":"2024-09-12T22:06:44.396692+0000","last_active":"2024-09-12T22:06:53.978987+0000","last_peered":"2024-09-12T22:06:53.978987+0000","last_clean":"2024-09-12T22:06:53.978987+0000","last_became_active":"2024-09-12T22:06:44.396378+0000","last_became_peered":"2024-09-12T22:06:44.396378+0000","last_unstale":"2024-09-12T22:06:53.978987+0000","last_undegraded":"2024-09-12T22:06:53.978987+0000","last_fullsized":"2024-09-12T22:06:53.978987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:06.812790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035774+0000","last_change":"2024-09-12T22:06:44.392705+0000","last_active":"2024-09-12T22:06:54.035774+0000","last_peered":"2024-09-12T22:06:54.035774+0000","last_clean":"2024-09-12T22:06:54.035774+0000","last_became_active":"2024-09-12T22:06:44.391809+0000","last_became_peered":"2024-09-12T22:06:44.391809+0000","last_unstale":"2024-09-12T22:06:54.035774+0000","last_undegraded":"2024-09-12T22:06:54.035774+0000","last_fullsized":"2024-09-12T22:06:54.035774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:48.022906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979322+0000","last_change":"2024-09-12T22:06:44.397296+0000","last_active":"2024-09-12T22:06:53.979322+0000","last_peered":"2024-09-12T22:06:53.979322+0000","last_clean":"2024-09-12T22:06:53.979322+0000","last_became_active":"2024-09-12T22:06:44.396596+0000","last_became_peered":"2024-09-12T22:06:44.396596+0000","last_unstale":"2024-09-12T22:06:53.979322+0000","last_undegraded":"2024-09-12T22:06:53.979322+0000","last_fullsized":"2024-09-12T22:06:53.979322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:25.702361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035014+0000","last_change":"2024-09-12T22:06:50.419281+0000","last_active":"2024-09-12T22:06:54.035014+0000","last_peered":"2024-09-12T22:06:54.035014+0000","last_clean":"2024-09-12T22:06:54.035014+0000","last_became_active":"2024-09-12T22:06:50.418876+0000","last_became_peered":"2024-09-12T22:06:50.418876+0000","last_unstale":"2024-09-12T22:06:54.035014+0000","last_undegraded":"2024-09-12T22:06:54.035014+0000","last_fullsized":"2024-09-12T22:06:54.035014+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:14.574566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980382+0000","last_change":"2024-09-12T22:06:44.390385+0000","last_active":"2024-09-12T22:06:53.980382+0000","last_peered":"2024-09-12T22:06:53.980382+0000","last_clean":"2024-09-12T22:06:53.980382+0000","last_became_active":"2024-09-12T22:06:44.389680+0000","last_became_peered":"2024-09-12T22:06:44.389680+0000","last_unstale":"2024-09-12T22:06:53.980382+0000","last_undegraded":"2024-09-12T22:06:53.980382+0000","last_fullsized":"2024-09-12T22:06:53.980382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:28.579444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":183,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979720+0000","last_change":"2024-09-12T22:06:44.421429+0000","last_active":"2024-09-12T22:06:53.979720+0000","last_peered":"2024-09-12T22:06:53.979720+0000","last_clean":"2024-09-12T22:06:53.979720+0000","last_became_active":"2024-09-12T22:06:44.421088+0000","last_became_peered":"2024-09-12T22:06:44.421088+0000","last_unstale":"2024-09-12T22:06:53.979720+0000","last_undegraded":"2024-09-12T22:06:53.979720+0000","last_fullsized":"2024-09-12T22:06:53.979720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:29.121518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979693+0000","last_change":"2024-09-12T22:06:50.423638+0000","last_active":"2024-09-12T22:06:53.979693+0000","last_peered":"2024-09-12T22:06:53.979693+0000","last_clean":"2024-09-12T22:06:53.979693+0000","last_became_active":"2024-09-12T22:06:50.423052+0000","last_became_peered":"2024-09-12T22:06:50.423052+0000","last_unstale":"2024-09-12T22:06:53.979693+0000","last_undegraded":"2024-09-12T22:06:53.979693+0000","last_fullsized":"2024-09-12T22:06:53.979693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:49.458146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980024+0000","last_change":"2024-09-12T22:06:44.397769+0000","last_active":"2024-09-12T22:06:53.980024+0000","last_peered":"2024-09-12T22:06:53.980024+0000","last_clean":"2024-09-12T22:06:53.980024+0000","last_became_active":"2024-09-12T22:06:44.397452+0000","last_became_peered":"2024-09-12T22:06:44.397452+0000","last_unstale":"2024-09-12T22:06:53.980024+0000","last_undegraded":"2024-09-12T22:06:53.980024+0000","last_fullsized":"2024-09-12T22:06:53.980024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:56.815006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979460+0000","last_change":"2024-09-12T22:06:50.420039+0000","last_active":"2024-09-12T22:06:53.979460+0000","last_peered":"2024-09-12T22:06:53.979460+0000","last_clean":"2024-09-12T22:06:53.979460+0000","last_became_active":"2024-09-12T22:06:50.419551+0000","last_became_peered":"2024-09-12T22:06:50.419551+0000","last_unstale":"2024-09-12T22:06:53.979460+0000","last_undegraded":"2024-09-12T22:06:53.979460+0000","last_fullsized":"2024-09-12T22:06:53.979460+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:06.211607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980065+0000","last_change":"2024-09-12T22:06:44.397598+0000","last_active":"2024-09-12T22:06:53.980065+0000","last_peered":"2024-09-12T22:06:53.980065+0000","last_clean":"2024-09-12T22:06:53.980065+0000","last_became_active":"2024-09-12T22:06:44.396979+0000","last_became_peered":"2024-09-12T22:06:44.396979+0000","last_unstale":"2024-09-12T22:06:53.980065+0000","last_undegraded":"2024-09-12T22:06:53.980065+0000","last_fullsized":"2024-09-12T22:06:53.980065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:27.592588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035149+0000","last_change":"2024-09-12T22:06:50.419195+0000","last_active":"2024-09-12T22:06:54.035149+0000","last_peered":"2024-09-12T22:06:54.035149+0000","last_clean":"2024-09-12T22:06:54.035149+0000","last_became_active":"2024-09-12T22:06:50.418763+0000","last_became_peered":"2024-09-12T22:06:50.418763+0000","last_unstale":"2024-09-12T22:06:54.035149+0000","last_undegraded":"2024-09-12T22:06:54.035149+0000","last_fullsized":"2024-09-12T22:06:54.035149+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:15.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979795+0000","last_change":"2024-09-12T22:06:44.389682+0000","last_active":"2024-09-12T22:06:53.979795+0000","last_peered":"2024-09-12T22:06:53.979795+0000","last_clean":"2024-09-12T22:06:53.979795+0000","last_became_active":"2024-09-12T22:06:44.388887+0000","last_became_peered":"2024-09-12T22:06:44.388887+0000","last_unstale":"2024-09-12T22:06:53.979795+0000","last_undegraded":"2024-09-12T22:06:53.979795+0000","last_fullsized":"2024-09-12T22:06:53.979795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:09:27.376344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035461+0000","last_change":"2024-09-12T22:06:44.390603+0000","last_active":"2024-09-12T22:06:54.035461+0000","last_peered":"2024-09-12T22:06:54.035461+0000","last_clean":"2024-09-12T22:06:54.035461+0000","last_became_active":"2024-09-12T22:06:44.390260+0000","last_became_peered":"2024-09-12T22:06:44.390260+0000","last_unstale":"2024-09-12T22:06:54.035461+0000","last_undegraded":"2024-09-12T22:06:54.035461+0000","last_fullsized":"2024-09-12T22:06:54.035461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:42.158737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035313+0000","last_change":"2024-09-12T22:03:33.464893+0000","last_active":"2024-09-12T22:06:54.035313+0000","last_peered":"2024-09-12T22:06:54.035313+0000","last_clean":"2024-09-12T22:06:54.035313+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:06:54.035313+0000","last_undegraded":"2024-09-12T22:06:54.035313+0000","last_fullsized":"2024-09-12T22:06:54.035313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:47.948673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980033+0000","last_change":"2024-09-12T22:06:44.390378+0000","last_active":"2024-09-12T22:06:53.980033+0000","last_peered":"2024-09-12T22:06:53.980033+0000","last_clean":"2024-09-12T22:06:53.980033+0000","last_became_active":"2024-09-12T22:06:44.389622+0000","last_became_peered":"2024-09-12T22:06:44.389622+0000","last_unstale":"2024-09-12T22:06:53.980033+0000","last_undegraded":"2024-09-12T22:06:53.980033+0000","last_fullsized":"2024-09-12T22:06:53.980033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:57.877495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980321+0000","last_change":"2024-09-12T22:06:44.398054+0000","last_active":"2024-09-12T22:06:53.980321+0000","last_peered":"2024-09-12T22:06:53.980321+0000","last_clean":"2024-09-12T22:06:53.980321+0000","last_became_active":"2024-09-12T22:06:44.396735+0000","last_became_peered":"2024-09-12T22:06:44.396735+0000","last_unstale":"2024-09-12T22:06:53.980321+0000","last_undegraded":"2024-09-12T22:06:53.980321+0000","last_fullsized":"2024-09-12T22:06:53.980321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:54:49.919665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979023+0000","last_change":"2024-09-12T22:06:44.422129+0000","last_active":"2024-09-12T22:06:53.979023+0000","last_peered":"2024-09-12T22:06:53.979023+0000","last_clean":"2024-09-12T22:06:53.979023+0000","last_became_active":"2024-09-12T22:06:44.421723+0000","last_became_peered":"2024-09-12T22:06:44.421723+0000","last_unstale":"2024-09-12T22:06:53.979023+0000","last_undegraded":"2024-09-12T22:06:53.979023+0000","last_fullsized":"2024-09-12T22:06:53.979023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:11.198373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980261+0000","last_change":"2024-09-12T22:06:50.435272+0000","last_active":"2024-09-12T22:06:53.980261+0000","last_peered":"2024-09-12T22:06:53.980261+0000","last_clean":"2024-09-12T22:06:53.980261+0000","last_became_active":"2024-09-12T22:06:50.419354+0000","last_became_peered":"2024-09-12T22:06:50.419354+0000","last_unstale":"2024-09-12T22:06:53.980261+0000","last_undegraded":"2024-09-12T22:06:53.980261+0000","last_fullsized":"2024-09-12T22:06:53.980261+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:59.450087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979844+0000","last_change":"2024-09-12T22:06:50.418804+0000","last_active":"2024-09-12T22:06:53.979844+0000","last_peered":"2024-09-12T22:06:53.979844+0000","last_clean":"2024-09-12T22:06:53.979844+0000","last_became_active":"2024-09-12T22:06:50.418444+0000","last_became_peered":"2024-09-12T22:06:50.418444+0000","last_unstale":"2024-09-12T22:06:53.979844+0000","last_undegraded":"2024-09-12T22:06:53.979844+0000","last_fullsized":"2024-09-12T22:06:53.979844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:43.033754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034987+0000","last_change":"2024-09-12T22:06:50.419309+0000","last_active":"2024-09-12T22:06:54.034987+0000","last_peered":"2024-09-12T22:06:54.034987+0000","last_clean":"2024-09-12T22:06:54.034987+0000","last_became_active":"2024-09-12T22:06:50.418591+0000","last_became_peered":"2024-09-12T22:06:50.418591+0000","last_unstale":"2024-09-12T22:06:54.034987+0000","last_undegraded":"2024-09-12T22:06:54.034987+0000","last_fullsized":"2024-09-12T22:06:54.034987+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:23.918205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979863+0000","last_change":"2024-09-12T22:06:50.421370+0000","last_active":"2024-09-12T22:06:53.979863+0000","last_peered":"2024-09-12T22:06:53.979863+0000","last_clean":"2024-09-12T22:06:53.979863+0000","last_became_active":"2024-09-12T22:06:50.419642+0000","last_became_peered":"2024-09-12T22:06:50.419642+0000","last_unstale":"2024-09-12T22:06:53.979863+0000","last_undegraded":"2024-09-12T22:06:53.979863+0000","last_fullsized":"2024-09-12T22:06:53.979863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:13.028012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980078+0000","last_change":"2024-09-12T22:06:50.437734+0000","last_active":"2024-09-12T22:06:53.980078+0000","last_peered":"2024-09-12T22:06:53.980078+0000","last_clean":"2024-09-12T22:06:53.980078+0000","last_became_active":"2024-09-12T22:06:50.420099+0000","last_became_peered":"2024-09-12T22:06:50.420099+0000","last_unstale":"2024-09-12T22:06:53.980078+0000","last_undegraded":"2024-09-12T22:06:53.980078+0000","last_fullsized":"2024-09-12T22:06:53.980078+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:05.638054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034976+0000","last_change":"2024-09-12T22:03:54.194965+0000","last_active":"2024-09-12T22:06:54.034976+0000","last_peered":"2024-09-12T22:06:54.034976+0000","last_clean":"2024-09-12T22:06:54.034976+0000","last_became_active":"2024-09-12T22:03:54.194697+0000","last_became_peered":"2024-09-12T22:03:54.194697+0000","last_unstale":"2024-09-12T22:06:54.034976+0000","last_undegraded":"2024-09-12T22:06:54.034976+0000","last_fullsized":"2024-09-12T22:06:54.034976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:47.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":189,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035598+0000","last_change":"2024-09-12T22:06:50.430086+0000","last_active":"2024-09-12T22:06:54.035598+0000","last_peered":"2024-09-12T22:06:54.035598+0000","last_clean":"2024-09-12T22:06:54.035598+0000","last_became_active":"2024-09-12T22:06:50.423283+0000","last_became_peered":"2024-09-12T22:06:50.423283+0000","last_unstale":"2024-09-12T22:06:54.035598+0000","last_undegraded":"2024-09-12T22:06:54.035598+0000","last_fullsized":"2024-09-12T22:06:54.035598+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:38.836493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979901+0000","last_change":"2024-09-12T22:06:50.421357+0000","last_active":"2024-09-12T22:06:53.979901+0000","last_peered":"2024-09-12T22:06:53.979901+0000","last_clean":"2024-09-12T22:06:53.979901+0000","last_became_active":"2024-09-12T22:06:50.420171+0000","last_became_peered":"2024-09-12T22:06:50.420171+0000","last_unstale":"2024-09-12T22:06:53.979901+0000","last_undegraded":"2024-09-12T22:06:53.979901+0000","last_fullsized":"2024-09-12T22:06:53.979901+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:25.747880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979236+0000","last_change":"2024-09-12T22:06:50.418126+0000","last_active":"2024-09-12T22:06:53.979236+0000","last_peered":"2024-09-12T22:06:53.979236+0000","last_clean":"2024-09-12T22:06:53.979236+0000","last_became_active":"2024-09-12T22:06:50.417583+0000","last_became_peered":"2024-09-12T22:06:50.417583+0000","last_unstale":"2024-09-12T22:06:53.979236+0000","last_undegraded":"2024-09-12T22:06:53.979236+0000","last_fullsized":"2024-09-12T22:06:53.979236+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:17:44.500650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980312+0000","last_change":"2024-09-12T22:06:44.422538+0000","last_active":"2024-09-12T22:06:53.980312+0000","last_peered":"2024-09-12T22:06:53.980312+0000","last_clean":"2024-09-12T22:06:53.980312+0000","last_became_active":"2024-09-12T22:06:44.422217+0000","last_became_peered":"2024-09-12T22:06:44.422217+0000","last_unstale":"2024-09-12T22:06:53.980312+0000","last_undegraded":"2024-09-12T22:06:53.980312+0000","last_fullsized":"2024-09-12T22:06:53.980312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:10.635087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979185+0000","last_change":"2024-09-12T22:06:44.390100+0000","last_active":"2024-09-12T22:06:53.979185+0000","last_peered":"2024-09-12T22:06:53.979185+0000","last_clean":"2024-09-12T22:06:53.979185+0000","last_became_active":"2024-09-12T22:06:44.388560+0000","last_became_peered":"2024-09-12T22:06:44.388560+0000","last_unstale":"2024-09-12T22:06:53.979185+0000","last_undegraded":"2024-09-12T22:06:53.979185+0000","last_fullsized":"2024-09-12T22:06:53.979185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:18.786679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.036028+0000","last_change":"2024-09-12T22:03:33.460177+0000","last_active":"2024-09-12T22:06:54.036028+0000","last_peered":"2024-09-12T22:06:54.036028+0000","last_clean":"2024-09-12T22:06:54.036028+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:06:54.036028+0000","last_undegraded":"2024-09-12T22:06:54.036028+0000","last_fullsized":"2024-09-12T22:06:54.036028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979285+0000","last_change":"2024-09-12T22:06:44.388874+0000","last_active":"2024-09-12T22:06:53.979285+0000","last_peered":"2024-09-12T22:06:53.979285+0000","last_clean":"2024-09-12T22:06:53.979285+0000","last_became_active":"2024-09-12T22:06:44.388499+0000","last_became_peered":"2024-09-12T22:06:44.388499+0000","last_unstale":"2024-09-12T22:06:53.979285+0000","last_undegraded":"2024-09-12T22:06:53.979285+0000","last_fullsized":"2024-09-12T22:06:53.979285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:48.397806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980074+0000","last_change":"2024-09-12T22:06:50.419782+0000","last_active":"2024-09-12T22:06:53.980074+0000","last_peered":"2024-09-12T22:06:53.980074+0000","last_clean":"2024-09-12T22:06:53.980074+0000","last_became_active":"2024-09-12T22:06:50.418800+0000","last_became_peered":"2024-09-12T22:06:50.418800+0000","last_unstale":"2024-09-12T22:06:53.980074+0000","last_undegraded":"2024-09-12T22:06:53.980074+0000","last_fullsized":"2024-09-12T22:06:53.980074+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:42:06.678070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978996+0000","last_change":"2024-09-12T22:06:50.418163+0000","last_active":"2024-09-12T22:06:53.978996+0000","last_peered":"2024-09-12T22:06:53.978996+0000","last_clean":"2024-09-12T22:06:53.978996+0000","last_became_active":"2024-09-12T22:06:50.417455+0000","last_became_peered":"2024-09-12T22:06:50.417455+0000","last_unstale":"2024-09-12T22:06:53.978996+0000","last_undegraded":"2024-09-12T22:06:53.978996+0000","last_fullsized":"2024-09-12T22:06:53.978996+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:02:41.699273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035911+0000","last_change":"2024-09-12T22:03:33.465186+0000","last_active":"2024-09-12T22:06:54.035911+0000","last_peered":"2024-09-12T22:06:54.035911+0000","last_clean":"2024-09-12T22:06:54.035911+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:06:54.035911+0000","last_undegraded":"2024-09-12T22:06:54.035911+0000","last_fullsized":"2024-09-12T22:06:54.035911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:29.409225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035270+0000","last_change":"2024-09-12T22:06:44.391108+0000","last_active":"2024-09-12T22:06:54.035270+0000","last_peered":"2024-09-12T22:06:54.035270+0000","last_clean":"2024-09-12T22:06:54.035270+0000","last_became_active":"2024-09-12T22:06:44.390719+0000","last_became_peered":"2024-09-12T22:06:44.390719+0000","last_unstale":"2024-09-12T22:06:54.035270+0000","last_undegraded":"2024-09-12T22:06:54.035270+0000","last_fullsized":"2024-09-12T22:06:54.035270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:19.780194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035404+0000","last_change":"2024-09-12T22:06:44.392898+0000","last_active":"2024-09-12T22:06:54.035404+0000","last_peered":"2024-09-12T22:06:54.035404+0000","last_clean":"2024-09-12T22:06:54.035404+0000","last_became_active":"2024-09-12T22:06:44.392160+0000","last_became_peered":"2024-09-12T22:06:44.392160+0000","last_unstale":"2024-09-12T22:06:54.035404+0000","last_undegraded":"2024-09-12T22:06:54.035404+0000","last_fullsized":"2024-09-12T22:06:54.035404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:15:25.344346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035083+0000","last_change":"2024-09-12T22:06:50.419266+0000","last_active":"2024-09-12T22:06:54.035083+0000","last_peered":"2024-09-12T22:06:54.035083+0000","last_clean":"2024-09-12T22:06:54.035083+0000","last_became_active":"2024-09-12T22:06:50.418834+0000","last_became_peered":"2024-09-12T22:06:50.418834+0000","last_unstale":"2024-09-12T22:06:54.035083+0000","last_undegraded":"2024-09-12T22:06:54.035083+0000","last_fullsized":"2024-09-12T22:06:54.035083+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:32.300720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979215+0000","last_change":"2024-09-12T22:06:50.420055+0000","last_active":"2024-09-12T22:06:53.979215+0000","last_peered":"2024-09-12T22:06:53.979215+0000","last_clean":"2024-09-12T22:06:53.979215+0000","last_became_active":"2024-09-12T22:06:50.418856+0000","last_became_peered":"2024-09-12T22:06:50.418856+0000","last_unstale":"2024-09-12T22:06:53.979215+0000","last_undegraded":"2024-09-12T22:06:53.979215+0000","last_fullsized":"2024-09-12T22:06:53.979215+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:42.010524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980021+0000","last_change":"2024-09-12T22:06:50.439495+0000","last_active":"2024-09-12T22:06:53.980021+0000","last_peered":"2024-09-12T22:06:53.980021+0000","last_clean":"2024-09-12T22:06:53.980021+0000","last_became_active":"2024-09-12T22:06:50.421034+0000","last_became_peered":"2024-09-12T22:06:50.421034+0000","last_unstale":"2024-09-12T22:06:53.980021+0000","last_undegraded":"2024-09-12T22:06:53.980021+0000","last_fullsized":"2024-09-12T22:06:53.980021+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:46.276197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979173+0000","last_change":"2024-09-12T22:06:50.420937+0000","last_active":"2024-09-12T22:06:53.979173+0000","last_peered":"2024-09-12T22:06:53.979173+0000","last_clean":"2024-09-12T22:06:53.979173+0000","last_became_active":"2024-09-12T22:06:50.419417+0000","last_became_peered":"2024-09-12T22:06:50.419417+0000","last_unstale":"2024-09-12T22:06:53.979173+0000","last_undegraded":"2024-09-12T22:06:53.979173+0000","last_fullsized":"2024-09-12T22:06:53.979173+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:01:48.684913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035839+0000","last_change":"2024-09-12T22:03:32.461230+0000","last_active":"2024-09-12T22:06:54.035839+0000","last_peered":"2024-09-12T22:06:54.035839+0000","last_clean":"2024-09-12T22:06:54.035839+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:06:54.035839+0000","last_undegraded":"2024-09-12T22:06:54.035839+0000","last_fullsized":"2024-09-12T22:06:54.035839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:16.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035299+0000","last_change":"2024-09-12T22:06:44.392598+0000","last_active":"2024-09-12T22:06:54.035299+0000","last_peered":"2024-09-12T22:06:54.035299+0000","last_clean":"2024-09-12T22:06:54.035299+0000","last_became_active":"2024-09-12T22:06:44.392020+0000","last_became_peered":"2024-09-12T22:06:44.392020+0000","last_unstale":"2024-09-12T22:06:54.035299+0000","last_undegraded":"2024-09-12T22:06:54.035299+0000","last_fullsized":"2024-09-12T22:06:54.035299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:01.708696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979850+0000","last_change":"2024-09-12T22:06:44.394611+0000","last_active":"2024-09-12T22:06:53.979850+0000","last_peered":"2024-09-12T22:06:53.979850+0000","last_clean":"2024-09-12T22:06:53.979850+0000","last_became_active":"2024-09-12T22:06:44.394195+0000","last_became_peered":"2024-09-12T22:06:44.394195+0000","last_unstale":"2024-09-12T22:06:53.979850+0000","last_undegraded":"2024-09-12T22:06:53.979850+0000","last_fullsized":"2024-09-12T22:06:53.979850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:53.173265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978895+0000","last_change":"2024-09-12T22:06:50.421136+0000","last_active":"2024-09-12T22:06:53.978895+0000","last_peered":"2024-09-12T22:06:53.978895+0000","last_clean":"2024-09-12T22:06:53.978895+0000","last_became_active":"2024-09-12T22:06:50.420176+0000","last_became_peered":"2024-09-12T22:06:50.420176+0000","last_unstale":"2024-09-12T22:06:53.978895+0000","last_undegraded":"2024-09-12T22:06:53.978895+0000","last_fullsized":"2024-09-12T22:06:53.978895+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:24.868192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980485+0000","last_change":"2024-09-12T22:06:50.433450+0000","last_active":"2024-09-12T22:06:53.980485+0000","last_peered":"2024-09-12T22:06:53.980485+0000","last_clean":"2024-09-12T22:06:53.980485+0000","last_became_active":"2024-09-12T22:06:50.417229+0000","last_became_peered":"2024-09-12T22:06:50.417229+0000","last_unstale":"2024-09-12T22:06:53.980485+0000","last_undegraded":"2024-09-12T22:06:53.980485+0000","last_fullsized":"2024-09-12T22:06:53.980485+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:38.255675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2430,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705712,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":564512,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":562878,"kb_avail":93807328,"statfs":{"total":96636764160,"available":96058703872,"internally_reserved":0,"allocated":1646592,"data_stored":1060429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576387525},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705712,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411820,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":410174,"kb_avail":93960020,"statfs":{"total":96636764160,"available":96215060480,"internally_reserved":0,"allocated":1658880,"data_stored":1061064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":420018629},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285573,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50700,"kb_used_data":1016,"kb_used_omap":6,"kb_used_meta":49657,"kb_avail":94321140,"statfs":{"total":96636764160,"available":96584847360,"internally_reserved":0,"allocated":1040384,"data_stored":468902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6904,"internal_metadata":50849032},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:06:58.517 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T22:06:58.517 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-12T22:06:58.861 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T22:06:58.874 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:06:58.874 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:06:59.172 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:06:59.173 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:06:59.183 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-09-12T22:06:58.287908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":592798,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1027032,"kb_used_data":4244,"kb_used_omap":9,"kb_used_meta":1022710,"kb_avail":282088488,"statfs":{"total":289910292480,"available":288858611712,"internally_reserved":0,"allocated":4345856,"data_stored":2590395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10094,"internal_metadata":1047255186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":706,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.316394"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035891+0000","last_change":"2024-09-12T22:06:44.391498+0000","last_active":"2024-09-12T22:06:54.035891+0000","last_peered":"2024-09-12T22:06:54.035891+0000","last_clean":"2024-09-12T22:06:54.035891+0000","last_became_active":"2024-09-12T22:06:44.391100+0000","last_became_peered":"2024-09-12T22:06:44.391100+0000","last_unstale":"2024-09-12T22:06:54.035891+0000","last_undegraded":"2024-09-12T22:06:54.035891+0000","last_fullsized":"2024-09-12T22:06:54.035891+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:04.380570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.036011+0000","last_change":"2024-09-12T22:06:44.392987+0000","last_active":"2024-09-12T22:06:54.036011+0000","last_peered":"2024-09-12T22:06:54.036011+0000","last_clean":"2024-09-12T22:06:54.036011+0000","last_became_active":"2024-09-12T22:06:44.392188+0000","last_became_peered":"2024-09-12T22:06:44.392188+0000","last_unstale":"2024-09-12T22:06:54.036011+0000","last_undegraded":"2024-09-12T22:06:54.036011+0000","last_fullsized":"2024-09-12T22:06:54.036011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:36.209594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979690+0000","last_change":"2024-09-12T22:03:33.462148+0000","last_active":"2024-09-12T22:06:53.979690+0000","last_peered":"2024-09-12T22:06:53.979690+0000","last_clean":"2024-09-12T22:06:53.979690+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:06:53.979690+0000","last_undegraded":"2024-09-12T22:06:53.979690+0000","last_fullsized":"2024-09-12T22:06:53.979690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:36.909948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979484+0000","last_change":"2024-09-12T22:06:50.419886+0000","last_active":"2024-09-12T22:06:53.979484+0000","last_peered":"2024-09-12T22:06:53.979484+0000","last_clean":"2024-09-12T22:06:53.979484+0000","last_became_active":"2024-09-12T22:06:50.419429+0000","last_became_peered":"2024-09-12T22:06:50.419429+0000","last_unstale":"2024-09-12T22:06:53.979484+0000","last_undegraded":"2024-09-12T22:06:53.979484+0000","last_fullsized":"2024-09-12T22:06:53.979484+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:16.917462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035121+0000","last_change":"2024-09-12T22:06:44.392862+0000","last_active":"2024-09-12T22:06:54.035121+0000","last_peered":"2024-09-12T22:06:54.035121+0000","last_clean":"2024-09-12T22:06:54.035121+0000","last_became_active":"2024-09-12T22:06:44.391774+0000","last_became_peered":"2024-09-12T22:06:44.391774+0000","last_unstale":"2024-09-12T22:06:54.035121+0000","last_undegraded":"2024-09-12T22:06:54.035121+0000","last_fullsized":"2024-09-12T22:06:54.035121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:09.703417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979018+0000","last_change":"2024-09-12T22:06:50.414892+0000","last_active":"2024-09-12T22:06:53.979018+0000","last_peered":"2024-09-12T22:06:53.979018+0000","last_clean":"2024-09-12T22:06:53.979018+0000","last_became_active":"2024-09-12T22:06:50.414526+0000","last_became_peered":"2024-09-12T22:06:50.414526+0000","last_unstale":"2024-09-12T22:06:53.979018+0000","last_undegraded":"2024-09-12T22:06:53.979018+0000","last_fullsized":"2024-09-12T22:06:53.979018+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:29.766297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979359+0000","last_change":"2024-09-12T22:06:44.421423+0000","last_active":"2024-09-12T22:06:53.979359+0000","last_peered":"2024-09-12T22:06:53.979359+0000","last_clean":"2024-09-12T22:06:53.979359+0000","last_became_active":"2024-09-12T22:06:44.421094+0000","last_became_peered":"2024-09-12T22:06:44.421094+0000","last_unstale":"2024-09-12T22:06:53.979359+0000","last_undegraded":"2024-09-12T22:06:53.979359+0000","last_fullsized":"2024-09-12T22:06:53.979359+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:48.618058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979320+0000","last_change":"2024-09-12T22:06:44.395363+0000","last_active":"2024-09-12T22:06:53.979320+0000","last_peered":"2024-09-12T22:06:53.979320+0000","last_clean":"2024-09-12T22:06:53.979320+0000","last_became_active":"2024-09-12T22:06:44.394804+0000","last_became_peered":"2024-09-12T22:06:44.394804+0000","last_unstale":"2024-09-12T22:06:53.979320+0000","last_undegraded":"2024-09-12T22:06:53.979320+0000","last_fullsized":"2024-09-12T22:06:53.979320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:18.826036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980197+0000","last_change":"2024-09-12T22:06:44.390017+0000","last_active":"2024-09-12T22:06:53.980197+0000","last_peered":"2024-09-12T22:06:53.980197+0000","last_clean":"2024-09-12T22:06:53.980197+0000","last_became_active":"2024-09-12T22:06:44.389256+0000","last_became_peered":"2024-09-12T22:06:44.389256+0000","last_unstale":"2024-09-12T22:06:53.980197+0000","last_undegraded":"2024-09-12T22:06:53.980197+0000","last_fullsized":"2024-09-12T22:06:53.980197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:48.669357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035877+0000","last_change":"2024-09-12T22:06:44.392599+0000","last_active":"2024-09-12T22:06:54.035877+0000","last_peered":"2024-09-12T22:06:54.035877+0000","last_clean":"2024-09-12T22:06:54.035877+0000","last_became_active":"2024-09-12T22:06:44.391572+0000","last_became_peered":"2024-09-12T22:06:44.391572+0000","last_unstale":"2024-09-12T22:06:54.035877+0000","last_undegraded":"2024-09-12T22:06:54.035877+0000","last_fullsized":"2024-09-12T22:06:54.035877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:41.342271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979365+0000","last_change":"2024-09-12T22:06:50.420008+0000","last_active":"2024-09-12T22:06:53.979365+0000","last_peered":"2024-09-12T22:06:53.979365+0000","last_clean":"2024-09-12T22:06:53.979365+0000","last_became_active":"2024-09-12T22:06:50.419042+0000","last_became_peered":"2024-09-12T22:06:50.419042+0000","last_unstale":"2024-09-12T22:06:53.979365+0000","last_undegraded":"2024-09-12T22:06:53.979365+0000","last_fullsized":"2024-09-12T22:06:53.979365+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:39.365289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035352+0000","last_change":"2024-09-12T22:03:33.465069+0000","last_active":"2024-09-12T22:06:54.035352+0000","last_peered":"2024-09-12T22:06:54.035352+0000","last_clean":"2024-09-12T22:06:54.035352+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:06:54.035352+0000","last_undegraded":"2024-09-12T22:06:54.035352+0000","last_fullsized":"2024-09-12T22:06:54.035352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035321+0000","last_change":"2024-09-12T22:06:44.392909+0000","last_active":"2024-09-12T22:06:54.035321+0000","last_peered":"2024-09-12T22:06:54.035321+0000","last_clean":"2024-09-12T22:06:54.035321+0000","last_became_active":"2024-09-12T22:06:44.392491+0000","last_became_peered":"2024-09-12T22:06:44.392491+0000","last_unstale":"2024-09-12T22:06:54.035321+0000","last_undegraded":"2024-09-12T22:06:54.035321+0000","last_fullsized":"2024-09-12T22:06:54.035321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:09.585700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979180+0000","last_change":"2024-09-12T22:06:50.419973+0000","last_active":"2024-09-12T22:06:53.979180+0000","last_peered":"2024-09-12T22:06:53.979180+0000","last_clean":"2024-09-12T22:06:53.979180+0000","last_became_active":"2024-09-12T22:06:50.418325+0000","last_became_peered":"2024-09-12T22:06:50.418325+0000","last_unstale":"2024-09-12T22:06:53.979180+0000","last_undegraded":"2024-09-12T22:06:53.979180+0000","last_fullsized":"2024-09-12T22:06:53.979180+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:02.303968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979112+0000","last_change":"2024-09-12T22:06:50.419011+0000","last_active":"2024-09-12T22:06:53.979112+0000","last_peered":"2024-09-12T22:06:53.979112+0000","last_clean":"2024-09-12T22:06:53.979112+0000","last_became_active":"2024-09-12T22:06:50.418075+0000","last_became_peered":"2024-09-12T22:06:50.418075+0000","last_unstale":"2024-09-12T22:06:53.979112+0000","last_undegraded":"2024-09-12T22:06:53.979112+0000","last_fullsized":"2024-09-12T22:06:53.979112+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:16.440226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979399+0000","last_change":"2024-09-12T22:06:44.395099+0000","last_active":"2024-09-12T22:06:53.979399+0000","last_peered":"2024-09-12T22:06:53.979399+0000","last_clean":"2024-09-12T22:06:53.979399+0000","last_became_active":"2024-09-12T22:06:44.394486+0000","last_became_peered":"2024-09-12T22:06:44.394486+0000","last_unstale":"2024-09-12T22:06:53.979399+0000","last_undegraded":"2024-09-12T22:06:53.979399+0000","last_fullsized":"2024-09-12T22:06:53.979399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:47.461701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980180+0000","last_change":"2024-09-12T22:06:44.390021+0000","last_active":"2024-09-12T22:06:53.980180+0000","last_peered":"2024-09-12T22:06:53.980180+0000","last_clean":"2024-09-12T22:06:53.980180+0000","last_became_active":"2024-09-12T22:06:44.388967+0000","last_became_peered":"2024-09-12T22:06:44.388967+0000","last_unstale":"2024-09-12T22:06:53.980180+0000","last_undegraded":"2024-09-12T22:06:53.980180+0000","last_fullsized":"2024-09-12T22:06:53.980180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:15.769587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035728+0000","last_change":"2024-09-12T22:06:44.391191+0000","last_active":"2024-09-12T22:06:54.035728+0000","last_peered":"2024-09-12T22:06:54.035728+0000","last_clean":"2024-09-12T22:06:54.035728+0000","last_became_active":"2024-09-12T22:06:44.390858+0000","last_became_peered":"2024-09-12T22:06:44.390858+0000","last_unstale":"2024-09-12T22:06:54.035728+0000","last_undegraded":"2024-09-12T22:06:54.035728+0000","last_fullsized":"2024-09-12T22:06:54.035728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:30.878874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979804+0000","last_change":"2024-09-12T22:06:44.389205+0000","last_active":"2024-09-12T22:06:53.979804+0000","last_peered":"2024-09-12T22:06:53.979804+0000","last_clean":"2024-09-12T22:06:53.979804+0000","last_became_active":"2024-09-12T22:06:44.388761+0000","last_became_peered":"2024-09-12T22:06:44.388761+0000","last_unstale":"2024-09-12T22:06:53.979804+0000","last_undegraded":"2024-09-12T22:06:53.979804+0000","last_fullsized":"2024-09-12T22:06:53.979804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:31.790297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980172+0000","last_change":"2024-09-12T22:06:44.421429+0000","last_active":"2024-09-12T22:06:53.980172+0000","last_peered":"2024-09-12T22:06:53.980172+0000","last_clean":"2024-09-12T22:06:53.980172+0000","last_became_active":"2024-09-12T22:06:44.420768+0000","last_became_peered":"2024-09-12T22:06:44.420768+0000","last_unstale":"2024-09-12T22:06:53.980172+0000","last_undegraded":"2024-09-12T22:06:53.980172+0000","last_fullsized":"2024-09-12T22:06:53.980172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:25.634497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979404+0000","last_change":"2024-09-12T22:06:50.422914+0000","last_active":"2024-09-12T22:06:53.979404+0000","last_peered":"2024-09-12T22:06:53.979404+0000","last_clean":"2024-09-12T22:06:53.979404+0000","last_became_active":"2024-09-12T22:06:50.421758+0000","last_became_peered":"2024-09-12T22:06:50.421758+0000","last_unstale":"2024-09-12T22:06:53.979404+0000","last_undegraded":"2024-09-12T22:06:53.979404+0000","last_fullsized":"2024-09-12T22:06:53.979404+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:02.122833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035141+0000","last_change":"2024-09-12T22:03:33.460994+0000","last_active":"2024-09-12T22:06:54.035141+0000","last_peered":"2024-09-12T22:06:54.035141+0000","last_clean":"2024-09-12T22:06:54.035141+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:06:54.035141+0000","last_undegraded":"2024-09-12T22:06:54.035141+0000","last_fullsized":"2024-09-12T22:06:54.035141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:20.363291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979143+0000","last_change":"2024-09-12T22:06:50.417908+0000","last_active":"2024-09-12T22:06:53.979143+0000","last_peered":"2024-09-12T22:06:53.979143+0000","last_clean":"2024-09-12T22:06:53.979143+0000","last_became_active":"2024-09-12T22:06:50.416924+0000","last_became_peered":"2024-09-12T22:06:50.416924+0000","last_unstale":"2024-09-12T22:06:53.979143+0000","last_undegraded":"2024-09-12T22:06:53.979143+0000","last_fullsized":"2024-09-12T22:06:53.979143+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:28.247991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034792+0000","last_change":"2024-09-12T22:06:44.391876+0000","last_active":"2024-09-12T22:06:54.034792+0000","last_peered":"2024-09-12T22:06:54.034792+0000","last_clean":"2024-09-12T22:06:54.034792+0000","last_became_active":"2024-09-12T22:06:44.391480+0000","last_became_peered":"2024-09-12T22:06:44.391480+0000","last_unstale":"2024-09-12T22:06:54.034792+0000","last_undegraded":"2024-09-12T22:06:54.034792+0000","last_fullsized":"2024-09-12T22:06:54.034792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:43.161300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035981+0000","last_change":"2024-09-12T22:06:50.420130+0000","last_active":"2024-09-12T22:06:54.035981+0000","last_peered":"2024-09-12T22:06:54.035981+0000","last_clean":"2024-09-12T22:06:54.035981+0000","last_became_active":"2024-09-12T22:06:50.419573+0000","last_became_peered":"2024-09-12T22:06:50.419573+0000","last_unstale":"2024-09-12T22:06:54.035981+0000","last_undegraded":"2024-09-12T22:06:54.035981+0000","last_fullsized":"2024-09-12T22:06:54.035981+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:31.160831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980210+0000","last_change":"2024-09-12T22:06:50.420167+0000","last_active":"2024-09-12T22:06:53.980210+0000","last_peered":"2024-09-12T22:06:53.980210+0000","last_clean":"2024-09-12T22:06:53.980210+0000","last_became_active":"2024-09-12T22:06:50.419348+0000","last_became_peered":"2024-09-12T22:06:50.419348+0000","last_unstale":"2024-09-12T22:06:53.980210+0000","last_undegraded":"2024-09-12T22:06:53.980210+0000","last_fullsized":"2024-09-12T22:06:53.980210+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:19.786252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979690+0000","last_change":"2024-09-12T22:03:33.461282+0000","last_active":"2024-09-12T22:06:53.979690+0000","last_peered":"2024-09-12T22:06:53.979690+0000","last_clean":"2024-09-12T22:06:53.979690+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:06:53.979690+0000","last_undegraded":"2024-09-12T22:06:53.979690+0000","last_fullsized":"2024-09-12T22:06:53.979690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:32.302716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035627+0000","last_change":"2024-09-12T22:06:50.419329+0000","last_active":"2024-09-12T22:06:54.035627+0000","last_peered":"2024-09-12T22:06:54.035627+0000","last_clean":"2024-09-12T22:06:54.035627+0000","last_became_active":"2024-09-12T22:06:50.418755+0000","last_became_peered":"2024-09-12T22:06:50.418755+0000","last_unstale":"2024-09-12T22:06:54.035627+0000","last_undegraded":"2024-09-12T22:06:54.035627+0000","last_fullsized":"2024-09-12T22:06:54.035627+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:02.572755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979812+0000","last_change":"2024-09-12T22:06:44.397630+0000","last_active":"2024-09-12T22:06:53.979812+0000","last_peered":"2024-09-12T22:06:53.979812+0000","last_clean":"2024-09-12T22:06:53.979812+0000","last_became_active":"2024-09-12T22:06:44.397198+0000","last_became_peered":"2024-09-12T22:06:44.397198+0000","last_unstale":"2024-09-12T22:06:53.979812+0000","last_undegraded":"2024-09-12T22:06:53.979812+0000","last_fullsized":"2024-09-12T22:06:53.979812+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:31.843174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035267+0000","last_change":"2024-09-12T22:03:33.456842+0000","last_active":"2024-09-12T22:06:54.035267+0000","last_peered":"2024-09-12T22:06:54.035267+0000","last_clean":"2024-09-12T22:06:54.035267+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:06:54.035267+0000","last_undegraded":"2024-09-12T22:06:54.035267+0000","last_fullsized":"2024-09-12T22:06:54.035267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:56.383351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979590+0000","last_change":"2024-09-12T22:06:44.397416+0000","last_active":"2024-09-12T22:06:53.979590+0000","last_peered":"2024-09-12T22:06:53.979590+0000","last_clean":"2024-09-12T22:06:53.979590+0000","last_became_active":"2024-09-12T22:06:44.397074+0000","last_became_peered":"2024-09-12T22:06:44.397074+0000","last_unstale":"2024-09-12T22:06:53.979590+0000","last_undegraded":"2024-09-12T22:06:53.979590+0000","last_fullsized":"2024-09-12T22:06:53.979590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.834005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978818+0000","last_change":"2024-09-12T22:06:50.414965+0000","last_active":"2024-09-12T22:06:53.978818+0000","last_peered":"2024-09-12T22:06:53.978818+0000","last_clean":"2024-09-12T22:06:53.978818+0000","last_became_active":"2024-09-12T22:06:50.414626+0000","last_became_peered":"2024-09-12T22:06:50.414626+0000","last_unstale":"2024-09-12T22:06:53.978818+0000","last_undegraded":"2024-09-12T22:06:53.978818+0000","last_fullsized":"2024-09-12T22:06:53.978818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:30.619121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035494+0000","last_change":"2024-09-12T22:06:44.391923+0000","last_active":"2024-09-12T22:06:54.035494+0000","last_peered":"2024-09-12T22:06:54.035494+0000","last_clean":"2024-09-12T22:06:54.035494+0000","last_became_active":"2024-09-12T22:06:44.391447+0000","last_became_peered":"2024-09-12T22:06:44.391447+0000","last_unstale":"2024-09-12T22:06:54.035494+0000","last_undegraded":"2024-09-12T22:06:54.035494+0000","last_fullsized":"2024-09-12T22:06:54.035494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:32.308333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979499+0000","last_change":"2024-09-12T22:06:50.442693+0000","last_active":"2024-09-12T22:06:53.979499+0000","last_peered":"2024-09-12T22:06:53.979499+0000","last_clean":"2024-09-12T22:06:53.979499+0000","last_became_active":"2024-09-12T22:06:50.422232+0000","last_became_peered":"2024-09-12T22:06:50.422232+0000","last_unstale":"2024-09-12T22:06:53.979499+0000","last_undegraded":"2024-09-12T22:06:53.979499+0000","last_fullsized":"2024-09-12T22:06:53.979499+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:40.705556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035690+0000","last_change":"2024-09-12T22:06:44.390974+0000","last_active":"2024-09-12T22:06:54.035690+0000","last_peered":"2024-09-12T22:06:54.035690+0000","last_clean":"2024-09-12T22:06:54.035690+0000","last_became_active":"2024-09-12T22:06:44.390652+0000","last_became_peered":"2024-09-12T22:06:44.390652+0000","last_unstale":"2024-09-12T22:06:54.035690+0000","last_undegraded":"2024-09-12T22:06:54.035690+0000","last_fullsized":"2024-09-12T22:06:54.035690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:41.707065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979208+0000","last_change":"2024-09-12T22:06:50.417649+0000","last_active":"2024-09-12T22:06:53.979208+0000","last_peered":"2024-09-12T22:06:53.979208+0000","last_clean":"2024-09-12T22:06:53.979208+0000","last_became_active":"2024-09-12T22:06:50.417123+0000","last_became_peered":"2024-09-12T22:06:50.417123+0000","last_unstale":"2024-09-12T22:06:53.979208+0000","last_undegraded":"2024-09-12T22:06:53.979208+0000","last_fullsized":"2024-09-12T22:06:53.979208+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:01.612960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980187+0000","last_change":"2024-09-12T22:06:50.419787+0000","last_active":"2024-09-12T22:06:53.980187+0000","last_peered":"2024-09-12T22:06:53.980187+0000","last_clean":"2024-09-12T22:06:53.980187+0000","last_became_active":"2024-09-12T22:06:50.418817+0000","last_became_peered":"2024-09-12T22:06:50.418817+0000","last_unstale":"2024-09-12T22:06:53.980187+0000","last_undegraded":"2024-09-12T22:06:53.980187+0000","last_fullsized":"2024-09-12T22:06:53.980187+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:51.923601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035182+0000","last_change":"2024-09-12T22:06:50.419697+0000","last_active":"2024-09-12T22:06:54.035182+0000","last_peered":"2024-09-12T22:06:54.035182+0000","last_clean":"2024-09-12T22:06:54.035182+0000","last_became_active":"2024-09-12T22:06:50.419047+0000","last_became_peered":"2024-09-12T22:06:50.419047+0000","last_unstale":"2024-09-12T22:06:54.035182+0000","last_undegraded":"2024-09-12T22:06:54.035182+0000","last_fullsized":"2024-09-12T22:06:54.035182+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:31.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980033+0000","last_change":"2024-09-12T22:06:44.422294+0000","last_active":"2024-09-12T22:06:53.980033+0000","last_peered":"2024-09-12T22:06:53.980033+0000","last_clean":"2024-09-12T22:06:53.980033+0000","last_became_active":"2024-09-12T22:06:44.421955+0000","last_became_peered":"2024-09-12T22:06:44.421955+0000","last_unstale":"2024-09-12T22:06:53.980033+0000","last_undegraded":"2024-09-12T22:06:53.980033+0000","last_fullsized":"2024-09-12T22:06:53.980033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:40.047878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979018+0000","last_change":"2024-09-12T22:06:50.432341+0000","last_active":"2024-09-12T22:06:53.979018+0000","last_peered":"2024-09-12T22:06:53.979018+0000","last_clean":"2024-09-12T22:06:53.979018+0000","last_became_active":"2024-09-12T22:06:50.418227+0000","last_became_peered":"2024-09-12T22:06:50.418227+0000","last_unstale":"2024-09-12T22:06:53.979018+0000","last_undegraded":"2024-09-12T22:06:53.979018+0000","last_fullsized":"2024-09-12T22:06:53.979018+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:47.509209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979708+0000","last_change":"2024-09-12T22:06:50.426521+0000","last_active":"2024-09-12T22:06:53.979708+0000","last_peered":"2024-09-12T22:06:53.979708+0000","last_clean":"2024-09-12T22:06:53.979708+0000","last_became_active":"2024-09-12T22:06:50.418222+0000","last_became_peered":"2024-09-12T22:06:50.418222+0000","last_unstale":"2024-09-12T22:06:53.979708+0000","last_undegraded":"2024-09-12T22:06:53.979708+0000","last_fullsized":"2024-09-12T22:06:53.979708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:44.473880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034877+0000","last_change":"2024-09-12T22:03:33.465308+0000","last_active":"2024-09-12T22:06:54.034877+0000","last_peered":"2024-09-12T22:06:54.034877+0000","last_clean":"2024-09-12T22:06:54.034877+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:06:54.034877+0000","last_undegraded":"2024-09-12T22:06:54.034877+0000","last_fullsized":"2024-09-12T22:06:54.034877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:35.733622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035614+0000","last_change":"2024-09-12T22:03:32.461301+0000","last_active":"2024-09-12T22:06:54.035614+0000","last_peered":"2024-09-12T22:06:54.035614+0000","last_clean":"2024-09-12T22:06:54.035614+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:06:54.035614+0000","last_undegraded":"2024-09-12T22:06:54.035614+0000","last_fullsized":"2024-09-12T22:06:54.035614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:39.872272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034942+0000","last_change":"2024-09-12T22:06:44.391249+0000","last_active":"2024-09-12T22:06:54.034942+0000","last_peered":"2024-09-12T22:06:54.034942+0000","last_clean":"2024-09-12T22:06:54.034942+0000","last_became_active":"2024-09-12T22:06:44.390807+0000","last_became_peered":"2024-09-12T22:06:44.390807+0000","last_unstale":"2024-09-12T22:06:54.034942+0000","last_undegraded":"2024-09-12T22:06:54.034942+0000","last_fullsized":"2024-09-12T22:06:54.034942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:07.271893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980057+0000","last_change":"2024-09-12T22:03:32.459540+0000","last_active":"2024-09-12T22:06:53.980057+0000","last_peered":"2024-09-12T22:06:53.980057+0000","last_clean":"2024-09-12T22:06:53.980057+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:06:53.980057+0000","last_undegraded":"2024-09-12T22:06:53.980057+0000","last_fullsized":"2024-09-12T22:06:53.980057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:22.143242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979421+0000","last_change":"2024-09-12T22:06:44.421712+0000","last_active":"2024-09-12T22:06:53.979421+0000","last_peered":"2024-09-12T22:06:53.979421+0000","last_clean":"2024-09-12T22:06:53.979421+0000","last_became_active":"2024-09-12T22:06:44.421388+0000","last_became_peered":"2024-09-12T22:06:44.421388+0000","last_unstale":"2024-09-12T22:06:53.979421+0000","last_undegraded":"2024-09-12T22:06:53.979421+0000","last_fullsized":"2024-09-12T22:06:53.979421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:46.580311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980254+0000","last_change":"2024-09-12T22:06:44.421721+0000","last_active":"2024-09-12T22:06:53.980254+0000","last_peered":"2024-09-12T22:06:53.980254+0000","last_clean":"2024-09-12T22:06:53.980254+0000","last_became_active":"2024-09-12T22:06:44.421430+0000","last_became_peered":"2024-09-12T22:06:44.421430+0000","last_unstale":"2024-09-12T22:06:53.980254+0000","last_undegraded":"2024-09-12T22:06:53.980254+0000","last_fullsized":"2024-09-12T22:06:53.980254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:57.001470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979284+0000","last_change":"2024-09-12T22:06:44.397808+0000","last_active":"2024-09-12T22:06:53.979284+0000","last_peered":"2024-09-12T22:06:53.979284+0000","last_clean":"2024-09-12T22:06:53.979284+0000","last_became_active":"2024-09-12T22:06:44.397490+0000","last_became_peered":"2024-09-12T22:06:44.397490+0000","last_unstale":"2024-09-12T22:06:53.979284+0000","last_undegraded":"2024-09-12T22:06:53.979284+0000","last_fullsized":"2024-09-12T22:06:53.979284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:38.225078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979537+0000","last_change":"2024-09-12T22:06:50.426880+0000","last_active":"2024-09-12T22:06:53.979537+0000","last_peered":"2024-09-12T22:06:53.979537+0000","last_clean":"2024-09-12T22:06:53.979537+0000","last_became_active":"2024-09-12T22:06:50.417240+0000","last_became_peered":"2024-09-12T22:06:50.417240+0000","last_unstale":"2024-09-12T22:06:53.979537+0000","last_undegraded":"2024-09-12T22:06:53.979537+0000","last_fullsized":"2024-09-12T22:06:53.979537+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:24.836682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980207+0000","last_change":"2024-09-12T22:06:44.421723+0000","last_active":"2024-09-12T22:06:53.980207+0000","last_peered":"2024-09-12T22:06:53.980207+0000","last_clean":"2024-09-12T22:06:53.980207+0000","last_became_active":"2024-09-12T22:06:44.421071+0000","last_became_peered":"2024-09-12T22:06:44.421071+0000","last_unstale":"2024-09-12T22:06:53.980207+0000","last_undegraded":"2024-09-12T22:06:53.980207+0000","last_fullsized":"2024-09-12T22:06:53.980207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:16.039319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979544+0000","last_change":"2024-09-12T22:06:50.422136+0000","last_active":"2024-09-12T22:06:53.979544+0000","last_peered":"2024-09-12T22:06:53.979544+0000","last_clean":"2024-09-12T22:06:53.979544+0000","last_became_active":"2024-09-12T22:06:50.421734+0000","last_became_peered":"2024-09-12T22:06:50.421734+0000","last_unstale":"2024-09-12T22:06:53.979544+0000","last_undegraded":"2024-09-12T22:06:53.979544+0000","last_fullsized":"2024-09-12T22:06:53.979544+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:29.450310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979869+0000","last_change":"2024-09-12T22:03:33.459084+0000","last_active":"2024-09-12T22:06:53.979869+0000","last_peered":"2024-09-12T22:06:53.979869+0000","last_clean":"2024-09-12T22:06:53.979869+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:06:53.979869+0000","last_undegraded":"2024-09-12T22:06:53.979869+0000","last_fullsized":"2024-09-12T22:06:53.979869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:50.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035351+0000","last_change":"2024-09-12T22:03:32.461417+0000","last_active":"2024-09-12T22:06:54.035351+0000","last_peered":"2024-09-12T22:06:54.035351+0000","last_clean":"2024-09-12T22:06:54.035351+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:06:54.035351+0000","last_undegraded":"2024-09-12T22:06:54.035351+0000","last_fullsized":"2024-09-12T22:06:54.035351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:22.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979869+0000","last_change":"2024-09-12T22:06:50.419560+0000","last_active":"2024-09-12T22:06:53.979869+0000","last_peered":"2024-09-12T22:06:53.979869+0000","last_clean":"2024-09-12T22:06:53.979869+0000","last_became_active":"2024-09-12T22:06:50.418648+0000","last_became_peered":"2024-09-12T22:06:50.418648+0000","last_unstale":"2024-09-12T22:06:53.979869+0000","last_undegraded":"2024-09-12T22:06:53.979869+0000","last_fullsized":"2024-09-12T22:06:53.979869+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:58.944327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034997+0000","last_change":"2024-09-12T22:06:44.391442+0000","last_active":"2024-09-12T22:06:54.034997+0000","last_peered":"2024-09-12T22:06:54.034997+0000","last_clean":"2024-09-12T22:06:54.034997+0000","last_became_active":"2024-09-12T22:06:44.391078+0000","last_became_peered":"2024-09-12T22:06:44.391078+0000","last_unstale":"2024-09-12T22:06:54.034997+0000","last_undegraded":"2024-09-12T22:06:54.034997+0000","last_fullsized":"2024-09-12T22:06:54.034997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:26.602771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980404+0000","last_change":"2024-09-12T22:06:44.397142+0000","last_active":"2024-09-12T22:06:53.980404+0000","last_peered":"2024-09-12T22:06:53.980404+0000","last_clean":"2024-09-12T22:06:53.980404+0000","last_became_active":"2024-09-12T22:06:44.396783+0000","last_became_peered":"2024-09-12T22:06:44.396783+0000","last_unstale":"2024-09-12T22:06:53.980404+0000","last_undegraded":"2024-09-12T22:06:53.980404+0000","last_fullsized":"2024-09-12T22:06:53.980404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:27.631274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":315,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979021+0000","last_change":"2024-09-12T22:06:52.982526+0000","last_active":"2024-09-12T22:06:53.979021+0000","last_peered":"2024-09-12T22:06:53.979021+0000","last_clean":"2024-09-12T22:06:53.979021+0000","last_became_active":"2024-09-12T22:06:52.982174+0000","last_became_peered":"2024-09-12T22:06:52.982174+0000","last_unstale":"2024-09-12T22:06:53.979021+0000","last_undegraded":"2024-09-12T22:06:53.979021+0000","last_fullsized":"2024-09-12T22:06:53.979021+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:20.744009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979737+0000","last_change":"2024-09-12T22:06:50.444340+0000","last_active":"2024-09-12T22:06:53.979737+0000","last_peered":"2024-09-12T22:06:53.979737+0000","last_clean":"2024-09-12T22:06:53.979737+0000","last_became_active":"2024-09-12T22:06:50.422353+0000","last_became_peered":"2024-09-12T22:06:50.422353+0000","last_unstale":"2024-09-12T22:06:53.979737+0000","last_undegraded":"2024-09-12T22:06:53.979737+0000","last_fullsized":"2024-09-12T22:06:53.979737+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.662733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979420+0000","last_change":"2024-09-12T22:06:44.397029+0000","last_active":"2024-09-12T22:06:53.979420+0000","last_peered":"2024-09-12T22:06:53.979420+0000","last_clean":"2024-09-12T22:06:53.979420+0000","last_became_active":"2024-09-12T22:06:44.396659+0000","last_became_peered":"2024-09-12T22:06:44.396659+0000","last_unstale":"2024-09-12T22:06:53.979420+0000","last_undegraded":"2024-09-12T22:06:53.979420+0000","last_fullsized":"2024-09-12T22:06:53.979420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:07.404782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979992+0000","last_change":"2024-09-12T22:06:50.418936+0000","last_active":"2024-09-12T22:06:53.979992+0000","last_peered":"2024-09-12T22:06:53.979992+0000","last_clean":"2024-09-12T22:06:53.979992+0000","last_became_active":"2024-09-12T22:06:50.418443+0000","last_became_peered":"2024-09-12T22:06:50.418443+0000","last_unstale":"2024-09-12T22:06:53.979992+0000","last_undegraded":"2024-09-12T22:06:53.979992+0000","last_fullsized":"2024-09-12T22:06:53.979992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:40.432871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978897+0000","last_change":"2024-09-12T22:06:50.419409+0000","last_active":"2024-09-12T22:06:53.978897+0000","last_peered":"2024-09-12T22:06:53.978897+0000","last_clean":"2024-09-12T22:06:53.978897+0000","last_became_active":"2024-09-12T22:06:50.418160+0000","last_became_peered":"2024-09-12T22:06:50.418160+0000","last_unstale":"2024-09-12T22:06:53.978897+0000","last_undegraded":"2024-09-12T22:06:53.978897+0000","last_fullsized":"2024-09-12T22:06:53.978897+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:48.881995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978987+0000","last_change":"2024-09-12T22:06:44.396692+0000","last_active":"2024-09-12T22:06:53.978987+0000","last_peered":"2024-09-12T22:06:53.978987+0000","last_clean":"2024-09-12T22:06:53.978987+0000","last_became_active":"2024-09-12T22:06:44.396378+0000","last_became_peered":"2024-09-12T22:06:44.396378+0000","last_unstale":"2024-09-12T22:06:53.978987+0000","last_undegraded":"2024-09-12T22:06:53.978987+0000","last_fullsized":"2024-09-12T22:06:53.978987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:06.812790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035774+0000","last_change":"2024-09-12T22:06:44.392705+0000","last_active":"2024-09-12T22:06:54.035774+0000","last_peered":"2024-09-12T22:06:54.035774+0000","last_clean":"2024-09-12T22:06:54.035774+0000","last_became_active":"2024-09-12T22:06:44.391809+0000","last_became_peered":"2024-09-12T22:06:44.391809+0000","last_unstale":"2024-09-12T22:06:54.035774+0000","last_undegraded":"2024-09-12T22:06:54.035774+0000","last_fullsized":"2024-09-12T22:06:54.035774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:48.022906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979322+0000","last_change":"2024-09-12T22:06:44.397296+0000","last_active":"2024-09-12T22:06:53.979322+0000","last_peered":"2024-09-12T22:06:53.979322+0000","last_clean":"2024-09-12T22:06:53.979322+0000","last_became_active":"2024-09-12T22:06:44.396596+0000","last_became_peered":"2024-09-12T22:06:44.396596+0000","last_unstale":"2024-09-12T22:06:53.979322+0000","last_undegraded":"2024-09-12T22:06:53.979322+0000","last_fullsized":"2024-09-12T22:06:53.979322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:25.702361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035014+0000","last_change":"2024-09-12T22:06:50.419281+0000","last_active":"2024-09-12T22:06:54.035014+0000","last_peered":"2024-09-12T22:06:54.035014+0000","last_clean":"2024-09-12T22:06:54.035014+0000","last_became_active":"2024-09-12T22:06:50.418876+0000","last_became_peered":"2024-09-12T22:06:50.418876+0000","last_unstale":"2024-09-12T22:06:54.035014+0000","last_undegraded":"2024-09-12T22:06:54.035014+0000","last_fullsized":"2024-09-12T22:06:54.035014+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:14.574566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980382+0000","last_change":"2024-09-12T22:06:44.390385+0000","last_active":"2024-09-12T22:06:53.980382+0000","last_peered":"2024-09-12T22:06:53.980382+0000","last_clean":"2024-09-12T22:06:53.980382+0000","last_became_active":"2024-09-12T22:06:44.389680+0000","last_became_peered":"2024-09-12T22:06:44.389680+0000","last_unstale":"2024-09-12T22:06:53.980382+0000","last_undegraded":"2024-09-12T22:06:53.980382+0000","last_fullsized":"2024-09-12T22:06:53.980382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:28.579444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":183,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979720+0000","last_change":"2024-09-12T22:06:44.421429+0000","last_active":"2024-09-12T22:06:53.979720+0000","last_peered":"2024-09-12T22:06:53.979720+0000","last_clean":"2024-09-12T22:06:53.979720+0000","last_became_active":"2024-09-12T22:06:44.421088+0000","last_became_peered":"2024-09-12T22:06:44.421088+0000","last_unstale":"2024-09-12T22:06:53.979720+0000","last_undegraded":"2024-09-12T22:06:53.979720+0000","last_fullsized":"2024-09-12T22:06:53.979720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:29.121518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979693+0000","last_change":"2024-09-12T22:06:50.423638+0000","last_active":"2024-09-12T22:06:53.979693+0000","last_peered":"2024-09-12T22:06:53.979693+0000","last_clean":"2024-09-12T22:06:53.979693+0000","last_became_active":"2024-09-12T22:06:50.423052+0000","last_became_peered":"2024-09-12T22:06:50.423052+0000","last_unstale":"2024-09-12T22:06:53.979693+0000","last_undegraded":"2024-09-12T22:06:53.979693+0000","last_fullsized":"2024-09-12T22:06:53.979693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:49.458146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980024+0000","last_change":"2024-09-12T22:06:44.397769+0000","last_active":"2024-09-12T22:06:53.980024+0000","last_peered":"2024-09-12T22:06:53.980024+0000","last_clean":"2024-09-12T22:06:53.980024+0000","last_became_active":"2024-09-12T22:06:44.397452+0000","last_became_peered":"2024-09-12T22:06:44.397452+0000","last_unstale":"2024-09-12T22:06:53.980024+0000","last_undegraded":"2024-09-12T22:06:53.980024+0000","last_fullsized":"2024-09-12T22:06:53.980024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:56.815006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979460+0000","last_change":"2024-09-12T22:06:50.420039+0000","last_active":"2024-09-12T22:06:53.979460+0000","last_peered":"2024-09-12T22:06:53.979460+0000","last_clean":"2024-09-12T22:06:53.979460+0000","last_became_active":"2024-09-12T22:06:50.419551+0000","last_became_peered":"2024-09-12T22:06:50.419551+0000","last_unstale":"2024-09-12T22:06:53.979460+0000","last_undegraded":"2024-09-12T22:06:53.979460+0000","last_fullsized":"2024-09-12T22:06:53.979460+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:06.211607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980065+0000","last_change":"2024-09-12T22:06:44.397598+0000","last_active":"2024-09-12T22:06:53.980065+0000","last_peered":"2024-09-12T22:06:53.980065+0000","last_clean":"2024-09-12T22:06:53.980065+0000","last_became_active":"2024-09-12T22:06:44.396979+0000","last_became_peered":"2024-09-12T22:06:44.396979+0000","last_unstale":"2024-09-12T22:06:53.980065+0000","last_undegraded":"2024-09-12T22:06:53.980065+0000","last_fullsized":"2024-09-12T22:06:53.980065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:27.592588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035149+0000","last_change":"2024-09-12T22:06:50.419195+0000","last_active":"2024-09-12T22:06:54.035149+0000","last_peered":"2024-09-12T22:06:54.035149+0000","last_clean":"2024-09-12T22:06:54.035149+0000","last_became_active":"2024-09-12T22:06:50.418763+0000","last_became_peered":"2024-09-12T22:06:50.418763+0000","last_unstale":"2024-09-12T22:06:54.035149+0000","last_undegraded":"2024-09-12T22:06:54.035149+0000","last_fullsized":"2024-09-12T22:06:54.035149+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:15.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979795+0000","last_change":"2024-09-12T22:06:44.389682+0000","last_active":"2024-09-12T22:06:53.979795+0000","last_peered":"2024-09-12T22:06:53.979795+0000","last_clean":"2024-09-12T22:06:53.979795+0000","last_became_active":"2024-09-12T22:06:44.388887+0000","last_became_peered":"2024-09-12T22:06:44.388887+0000","last_unstale":"2024-09-12T22:06:53.979795+0000","last_undegraded":"2024-09-12T22:06:53.979795+0000","last_fullsized":"2024-09-12T22:06:53.979795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:09:27.376344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035461+0000","last_change":"2024-09-12T22:06:44.390603+0000","last_active":"2024-09-12T22:06:54.035461+0000","last_peered":"2024-09-12T22:06:54.035461+0000","last_clean":"2024-09-12T22:06:54.035461+0000","last_became_active":"2024-09-12T22:06:44.390260+0000","last_became_peered":"2024-09-12T22:06:44.390260+0000","last_unstale":"2024-09-12T22:06:54.035461+0000","last_undegraded":"2024-09-12T22:06:54.035461+0000","last_fullsized":"2024-09-12T22:06:54.035461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:42.158737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035313+0000","last_change":"2024-09-12T22:03:33.464893+0000","last_active":"2024-09-12T22:06:54.035313+0000","last_peered":"2024-09-12T22:06:54.035313+0000","last_clean":"2024-09-12T22:06:54.035313+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:06:54.035313+0000","last_undegraded":"2024-09-12T22:06:54.035313+0000","last_fullsized":"2024-09-12T22:06:54.035313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:47.948673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980033+0000","last_change":"2024-09-12T22:06:44.390378+0000","last_active":"2024-09-12T22:06:53.980033+0000","last_peered":"2024-09-12T22:06:53.980033+0000","last_clean":"2024-09-12T22:06:53.980033+0000","last_became_active":"2024-09-12T22:06:44.389622+0000","last_became_peered":"2024-09-12T22:06:44.389622+0000","last_unstale":"2024-09-12T22:06:53.980033+0000","last_undegraded":"2024-09-12T22:06:53.980033+0000","last_fullsized":"2024-09-12T22:06:53.980033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:57.877495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980321+0000","last_change":"2024-09-12T22:06:44.398054+0000","last_active":"2024-09-12T22:06:53.980321+0000","last_peered":"2024-09-12T22:06:53.980321+0000","last_clean":"2024-09-12T22:06:53.980321+0000","last_became_active":"2024-09-12T22:06:44.396735+0000","last_became_peered":"2024-09-12T22:06:44.396735+0000","last_unstale":"2024-09-12T22:06:53.980321+0000","last_undegraded":"2024-09-12T22:06:53.980321+0000","last_fullsized":"2024-09-12T22:06:53.980321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:54:49.919665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979023+0000","last_change":"2024-09-12T22:06:44.422129+0000","last_active":"2024-09-12T22:06:53.979023+0000","last_peered":"2024-09-12T22:06:53.979023+0000","last_clean":"2024-09-12T22:06:53.979023+0000","last_became_active":"2024-09-12T22:06:44.421723+0000","last_became_peered":"2024-09-12T22:06:44.421723+0000","last_unstale":"2024-09-12T22:06:53.979023+0000","last_undegraded":"2024-09-12T22:06:53.979023+0000","last_fullsized":"2024-09-12T22:06:53.979023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:11.198373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980261+0000","last_change":"2024-09-12T22:06:50.435272+0000","last_active":"2024-09-12T22:06:53.980261+0000","last_peered":"2024-09-12T22:06:53.980261+0000","last_clean":"2024-09-12T22:06:53.980261+0000","last_became_active":"2024-09-12T22:06:50.419354+0000","last_became_peered":"2024-09-12T22:06:50.419354+0000","last_unstale":"2024-09-12T22:06:53.980261+0000","last_undegraded":"2024-09-12T22:06:53.980261+0000","last_fullsized":"2024-09-12T22:06:53.980261+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:59.450087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979844+0000","last_change":"2024-09-12T22:06:50.418804+0000","last_active":"2024-09-12T22:06:53.979844+0000","last_peered":"2024-09-12T22:06:53.979844+0000","last_clean":"2024-09-12T22:06:53.979844+0000","last_became_active":"2024-09-12T22:06:50.418444+0000","last_became_peered":"2024-09-12T22:06:50.418444+0000","last_unstale":"2024-09-12T22:06:53.979844+0000","last_undegraded":"2024-09-12T22:06:53.979844+0000","last_fullsized":"2024-09-12T22:06:53.979844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:43.033754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034987+0000","last_change":"2024-09-12T22:06:50.419309+0000","last_active":"2024-09-12T22:06:54.034987+0000","last_peered":"2024-09-12T22:06:54.034987+0000","last_clean":"2024-09-12T22:06:54.034987+0000","last_became_active":"2024-09-12T22:06:50.418591+0000","last_became_peered":"2024-09-12T22:06:50.418591+0000","last_unstale":"2024-09-12T22:06:54.034987+0000","last_undegraded":"2024-09-12T22:06:54.034987+0000","last_fullsized":"2024-09-12T22:06:54.034987+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:23.918205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979863+0000","last_change":"2024-09-12T22:06:50.421370+0000","last_active":"2024-09-12T22:06:53.979863+0000","last_peered":"2024-09-12T22:06:53.979863+0000","last_clean":"2024-09-12T22:06:53.979863+0000","last_became_active":"2024-09-12T22:06:50.419642+0000","last_became_peered":"2024-09-12T22:06:50.419642+0000","last_unstale":"2024-09-12T22:06:53.979863+0000","last_undegraded":"2024-09-12T22:06:53.979863+0000","last_fullsized":"2024-09-12T22:06:53.979863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:13.028012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980078+0000","last_change":"2024-09-12T22:06:50.437734+0000","last_active":"2024-09-12T22:06:53.980078+0000","last_peered":"2024-09-12T22:06:53.980078+0000","last_clean":"2024-09-12T22:06:53.980078+0000","last_became_active":"2024-09-12T22:06:50.420099+0000","last_became_peered":"2024-09-12T22:06:50.420099+0000","last_unstale":"2024-09-12T22:06:53.980078+0000","last_undegraded":"2024-09-12T22:06:53.980078+0000","last_fullsized":"2024-09-12T22:06:53.980078+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:05.638054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034976+0000","last_change":"2024-09-12T22:03:54.194965+0000","last_active":"2024-09-12T22:06:54.034976+0000","last_peered":"2024-09-12T22:06:54.034976+0000","last_clean":"2024-09-12T22:06:54.034976+0000","last_became_active":"2024-09-12T22:03:54.194697+0000","last_became_peered":"2024-09-12T22:03:54.194697+0000","last_unstale":"2024-09-12T22:06:54.034976+0000","last_undegraded":"2024-09-12T22:06:54.034976+0000","last_fullsized":"2024-09-12T22:06:54.034976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:47.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":189,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035598+0000","last_change":"2024-09-12T22:06:50.430086+0000","last_active":"2024-09-12T22:06:54.035598+0000","last_peered":"2024-09-12T22:06:54.035598+0000","last_clean":"2024-09-12T22:06:54.035598+0000","last_became_active":"2024-09-12T22:06:50.423283+0000","last_became_peered":"2024-09-12T22:06:50.423283+0000","last_unstale":"2024-09-12T22:06:54.035598+0000","last_undegraded":"2024-09-12T22:06:54.035598+0000","last_fullsized":"2024-09-12T22:06:54.035598+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:38.836493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979901+0000","last_change":"2024-09-12T22:06:50.421357+0000","last_active":"2024-09-12T22:06:53.979901+0000","last_peered":"2024-09-12T22:06:53.979901+0000","last_clean":"2024-09-12T22:06:53.979901+0000","last_became_active":"2024-09-12T22:06:50.420171+0000","last_became_peered":"2024-09-12T22:06:50.420171+0000","last_unstale":"2024-09-12T22:06:53.979901+0000","last_undegraded":"2024-09-12T22:06:53.979901+0000","last_fullsized":"2024-09-12T22:06:53.979901+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:25.747880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979236+0000","last_change":"2024-09-12T22:06:50.418126+0000","last_active":"2024-09-12T22:06:53.979236+0000","last_peered":"2024-09-12T22:06:53.979236+0000","last_clean":"2024-09-12T22:06:53.979236+0000","last_became_active":"2024-09-12T22:06:50.417583+0000","last_became_peered":"2024-09-12T22:06:50.417583+0000","last_unstale":"2024-09-12T22:06:53.979236+0000","last_undegraded":"2024-09-12T22:06:53.979236+0000","last_fullsized":"2024-09-12T22:06:53.979236+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:17:44.500650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980312+0000","last_change":"2024-09-12T22:06:44.422538+0000","last_active":"2024-09-12T22:06:53.980312+0000","last_peered":"2024-09-12T22:06:53.980312+0000","last_clean":"2024-09-12T22:06:53.980312+0000","last_became_active":"2024-09-12T22:06:44.422217+0000","last_became_peered":"2024-09-12T22:06:44.422217+0000","last_unstale":"2024-09-12T22:06:53.980312+0000","last_undegraded":"2024-09-12T22:06:53.980312+0000","last_fullsized":"2024-09-12T22:06:53.980312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:10.635087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979185+0000","last_change":"2024-09-12T22:06:44.390100+0000","last_active":"2024-09-12T22:06:53.979185+0000","last_peered":"2024-09-12T22:06:53.979185+0000","last_clean":"2024-09-12T22:06:53.979185+0000","last_became_active":"2024-09-12T22:06:44.388560+0000","last_became_peered":"2024-09-12T22:06:44.388560+0000","last_unstale":"2024-09-12T22:06:53.979185+0000","last_undegraded":"2024-09-12T22:06:53.979185+0000","last_fullsized":"2024-09-12T22:06:53.979185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:18.786679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.036028+0000","last_change":"2024-09-12T22:03:33.460177+0000","last_active":"2024-09-12T22:06:54.036028+0000","last_peered":"2024-09-12T22:06:54.036028+0000","last_clean":"2024-09-12T22:06:54.036028+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:06:54.036028+0000","last_undegraded":"2024-09-12T22:06:54.036028+0000","last_fullsized":"2024-09-12T22:06:54.036028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979285+0000","last_change":"2024-09-12T22:06:44.388874+0000","last_active":"2024-09-12T22:06:53.979285+0000","last_peered":"2024-09-12T22:06:53.979285+0000","last_clean":"2024-09-12T22:06:53.979285+0000","last_became_active":"2024-09-12T22:06:44.388499+0000","last_became_peered":"2024-09-12T22:06:44.388499+0000","last_unstale":"2024-09-12T22:06:53.979285+0000","last_undegraded":"2024-09-12T22:06:53.979285+0000","last_fullsized":"2024-09-12T22:06:53.979285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:48.397806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980074+0000","last_change":"2024-09-12T22:06:50.419782+0000","last_active":"2024-09-12T22:06:53.980074+0000","last_peered":"2024-09-12T22:06:53.980074+0000","last_clean":"2024-09-12T22:06:53.980074+0000","last_became_active":"2024-09-12T22:06:50.418800+0000","last_became_peered":"2024-09-12T22:06:50.418800+0000","last_unstale":"2024-09-12T22:06:53.980074+0000","last_undegraded":"2024-09-12T22:06:53.980074+0000","last_fullsized":"2024-09-12T22:06:53.980074+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:42:06.678070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978996+0000","last_change":"2024-09-12T22:06:50.418163+0000","last_active":"2024-09-12T22:06:53.978996+0000","last_peered":"2024-09-12T22:06:53.978996+0000","last_clean":"2024-09-12T22:06:53.978996+0000","last_became_active":"2024-09-12T22:06:50.417455+0000","last_became_peered":"2024-09-12T22:06:50.417455+0000","last_unstale":"2024-09-12T22:06:53.978996+0000","last_undegraded":"2024-09-12T22:06:53.978996+0000","last_fullsized":"2024-09-12T22:06:53.978996+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:02:41.699273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035911+0000","last_change":"2024-09-12T22:03:33.465186+0000","last_active":"2024-09-12T22:06:54.035911+0000","last_peered":"2024-09-12T22:06:54.035911+0000","last_clean":"2024-09-12T22:06:54.035911+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:06:54.035911+0000","last_undegraded":"2024-09-12T22:06:54.035911+0000","last_fullsized":"2024-09-12T22:06:54.035911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:29.409225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035270+0000","last_change":"2024-09-12T22:06:44.391108+0000","last_active":"2024-09-12T22:06:54.035270+0000","last_peered":"2024-09-12T22:06:54.035270+0000","last_clean":"2024-09-12T22:06:54.035270+0000","last_became_active":"2024-09-12T22:06:44.390719+0000","last_became_peered":"2024-09-12T22:06:44.390719+0000","last_unstale":"2024-09-12T22:06:54.035270+0000","last_undegraded":"2024-09-12T22:06:54.035270+0000","last_fullsized":"2024-09-12T22:06:54.035270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:19.780194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035404+0000","last_change":"2024-09-12T22:06:44.392898+0000","last_active":"2024-09-12T22:06:54.035404+0000","last_peered":"2024-09-12T22:06:54.035404+0000","last_clean":"2024-09-12T22:06:54.035404+0000","last_became_active":"2024-09-12T22:06:44.392160+0000","last_became_peered":"2024-09-12T22:06:44.392160+0000","last_unstale":"2024-09-12T22:06:54.035404+0000","last_undegraded":"2024-09-12T22:06:54.035404+0000","last_fullsized":"2024-09-12T22:06:54.035404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:15:25.344346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035083+0000","last_change":"2024-09-12T22:06:50.419266+0000","last_active":"2024-09-12T22:06:54.035083+0000","last_peered":"2024-09-12T22:06:54.035083+0000","last_clean":"2024-09-12T22:06:54.035083+0000","last_became_active":"2024-09-12T22:06:50.418834+0000","last_became_peered":"2024-09-12T22:06:50.418834+0000","last_unstale":"2024-09-12T22:06:54.035083+0000","last_undegraded":"2024-09-12T22:06:54.035083+0000","last_fullsized":"2024-09-12T22:06:54.035083+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:32.300720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979215+0000","last_change":"2024-09-12T22:06:50.420055+0000","last_active":"2024-09-12T22:06:53.979215+0000","last_peered":"2024-09-12T22:06:53.979215+0000","last_clean":"2024-09-12T22:06:53.979215+0000","last_became_active":"2024-09-12T22:06:50.418856+0000","last_became_peered":"2024-09-12T22:06:50.418856+0000","last_unstale":"2024-09-12T22:06:53.979215+0000","last_undegraded":"2024-09-12T22:06:53.979215+0000","last_fullsized":"2024-09-12T22:06:53.979215+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:42.010524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980021+0000","last_change":"2024-09-12T22:06:50.439495+0000","last_active":"2024-09-12T22:06:53.980021+0000","last_peered":"2024-09-12T22:06:53.980021+0000","last_clean":"2024-09-12T22:06:53.980021+0000","last_became_active":"2024-09-12T22:06:50.421034+0000","last_became_peered":"2024-09-12T22:06:50.421034+0000","last_unstale":"2024-09-12T22:06:53.980021+0000","last_undegraded":"2024-09-12T22:06:53.980021+0000","last_fullsized":"2024-09-12T22:06:53.980021+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:46.276197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979173+0000","last_change":"2024-09-12T22:06:50.420937+0000","last_active":"2024-09-12T22:06:53.979173+0000","last_peered":"2024-09-12T22:06:53.979173+0000","last_clean":"2024-09-12T22:06:53.979173+0000","last_became_active":"2024-09-12T22:06:50.419417+0000","last_became_peered":"2024-09-12T22:06:50.419417+0000","last_unstale":"2024-09-12T22:06:53.979173+0000","last_undegraded":"2024-09-12T22:06:53.979173+0000","last_fullsized":"2024-09-12T22:06:53.979173+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:01:48.684913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035839+0000","last_change":"2024-09-12T22:03:32.461230+0000","last_active":"2024-09-12T22:06:54.035839+0000","last_peered":"2024-09-12T22:06:54.035839+0000","last_clean":"2024-09-12T22:06:54.035839+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:06:54.035839+0000","last_undegraded":"2024-09-12T22:06:54.035839+0000","last_fullsized":"2024-09-12T22:06:54.035839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:16.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035299+0000","last_change":"2024-09-12T22:06:44.392598+0000","last_active":"2024-09-12T22:06:54.035299+0000","last_peered":"2024-09-12T22:06:54.035299+0000","last_clean":"2024-09-12T22:06:54.035299+0000","last_became_active":"2024-09-12T22:06:44.392020+0000","last_became_peered":"2024-09-12T22:06:44.392020+0000","last_unstale":"2024-09-12T22:06:54.035299+0000","last_undegraded":"2024-09-12T22:06:54.035299+0000","last_fullsized":"2024-09-12T22:06:54.035299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:01.708696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979850+0000","last_change":"2024-09-12T22:06:44.394611+0000","last_active":"2024-09-12T22:06:53.979850+0000","last_peered":"2024-09-12T22:06:53.979850+0000","last_clean":"2024-09-12T22:06:53.979850+0000","last_became_active":"2024-09-12T22:06:44.394195+0000","last_became_peered":"2024-09-12T22:06:44.394195+0000","last_unstale":"2024-09-12T22:06:53.979850+0000","last_undegraded":"2024-09-12T22:06:53.979850+0000","last_fullsized":"2024-09-12T22:06:53.979850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:53.173265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978895+0000","last_change":"2024-09-12T22:06:50.421136+0000","last_active":"2024-09-12T22:06:53.978895+0000","last_peered":"2024-09-12T22:06:53.978895+0000","last_clean":"2024-09-12T22:06:53.978895+0000","last_became_active":"2024-09-12T22:06:50.420176+0000","last_became_peered":"2024-09-12T22:06:50.420176+0000","last_unstale":"2024-09-12T22:06:53.978895+0000","last_undegraded":"2024-09-12T22:06:53.978895+0000","last_fullsized":"2024-09-12T22:06:53.978895+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:24.868192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980485+0000","last_change":"2024-09-12T22:06:50.433450+0000","last_active":"2024-09-12T22:06:53.980485+0000","last_peered":"2024-09-12T22:06:53.980485+0000","last_clean":"2024-09-12T22:06:53.980485+0000","last_became_active":"2024-09-12T22:06:50.417229+0000","last_became_peered":"2024-09-12T22:06:50.417229+0000","last_unstale":"2024-09-12T22:06:53.980485+0000","last_undegraded":"2024-09-12T22:06:53.980485+0000","last_fullsized":"2024-09-12T22:06:53.980485+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:38.255675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2430,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705712,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":564512,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":562878,"kb_avail":93807328,"statfs":{"total":96636764160,"available":96058703872,"internally_reserved":0,"allocated":1646592,"data_stored":1060429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576387525},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705712,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411820,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":410174,"kb_avail":93960020,"statfs":{"total":96636764160,"available":96215060480,"internally_reserved":0,"allocated":1658880,"data_stored":1061064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":420018629},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285573,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50700,"kb_used_data":1016,"kb_used_omap":6,"kb_used_meta":49657,"kb_avail":94321140,"statfs":{"total":96636764160,"available":96584847360,"internally_reserved":0,"allocated":1040384,"data_stored":468902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6904,"internal_metadata":50849032},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:06:59.187 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:06:59.517 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:06:59.519 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:06:59.529 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-09-12T22:06:58.287908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":592798,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1027032,"kb_used_data":4244,"kb_used_omap":9,"kb_used_meta":1022710,"kb_avail":282088488,"statfs":{"total":289910292480,"available":288858611712,"internally_reserved":0,"allocated":4345856,"data_stored":2590395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10094,"internal_metadata":1047255186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":706,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.316394"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035891+0000","last_change":"2024-09-12T22:06:44.391498+0000","last_active":"2024-09-12T22:06:54.035891+0000","last_peered":"2024-09-12T22:06:54.035891+0000","last_clean":"2024-09-12T22:06:54.035891+0000","last_became_active":"2024-09-12T22:06:44.391100+0000","last_became_peered":"2024-09-12T22:06:44.391100+0000","last_unstale":"2024-09-12T22:06:54.035891+0000","last_undegraded":"2024-09-12T22:06:54.035891+0000","last_fullsized":"2024-09-12T22:06:54.035891+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:04.380570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.036011+0000","last_change":"2024-09-12T22:06:44.392987+0000","last_active":"2024-09-12T22:06:54.036011+0000","last_peered":"2024-09-12T22:06:54.036011+0000","last_clean":"2024-09-12T22:06:54.036011+0000","last_became_active":"2024-09-12T22:06:44.392188+0000","last_became_peered":"2024-09-12T22:06:44.392188+0000","last_unstale":"2024-09-12T22:06:54.036011+0000","last_undegraded":"2024-09-12T22:06:54.036011+0000","last_fullsized":"2024-09-12T22:06:54.036011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:36.209594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979690+0000","last_change":"2024-09-12T22:03:33.462148+0000","last_active":"2024-09-12T22:06:53.979690+0000","last_peered":"2024-09-12T22:06:53.979690+0000","last_clean":"2024-09-12T22:06:53.979690+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:06:53.979690+0000","last_undegraded":"2024-09-12T22:06:53.979690+0000","last_fullsized":"2024-09-12T22:06:53.979690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:36.909948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979484+0000","last_change":"2024-09-12T22:06:50.419886+0000","last_active":"2024-09-12T22:06:53.979484+0000","last_peered":"2024-09-12T22:06:53.979484+0000","last_clean":"2024-09-12T22:06:53.979484+0000","last_became_active":"2024-09-12T22:06:50.419429+0000","last_became_peered":"2024-09-12T22:06:50.419429+0000","last_unstale":"2024-09-12T22:06:53.979484+0000","last_undegraded":"2024-09-12T22:06:53.979484+0000","last_fullsized":"2024-09-12T22:06:53.979484+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:16.917462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035121+0000","last_change":"2024-09-12T22:06:44.392862+0000","last_active":"2024-09-12T22:06:54.035121+0000","last_peered":"2024-09-12T22:06:54.035121+0000","last_clean":"2024-09-12T22:06:54.035121+0000","last_became_active":"2024-09-12T22:06:44.391774+0000","last_became_peered":"2024-09-12T22:06:44.391774+0000","last_unstale":"2024-09-12T22:06:54.035121+0000","last_undegraded":"2024-09-12T22:06:54.035121+0000","last_fullsized":"2024-09-12T22:06:54.035121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:09.703417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979018+0000","last_change":"2024-09-12T22:06:50.414892+0000","last_active":"2024-09-12T22:06:53.979018+0000","last_peered":"2024-09-12T22:06:53.979018+0000","last_clean":"2024-09-12T22:06:53.979018+0000","last_became_active":"2024-09-12T22:06:50.414526+0000","last_became_peered":"2024-09-12T22:06:50.414526+0000","last_unstale":"2024-09-12T22:06:53.979018+0000","last_undegraded":"2024-09-12T22:06:53.979018+0000","last_fullsized":"2024-09-12T22:06:53.979018+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:29.766297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979359+0000","last_change":"2024-09-12T22:06:44.421423+0000","last_active":"2024-09-12T22:06:53.979359+0000","last_peered":"2024-09-12T22:06:53.979359+0000","last_clean":"2024-09-12T22:06:53.979359+0000","last_became_active":"2024-09-12T22:06:44.421094+0000","last_became_peered":"2024-09-12T22:06:44.421094+0000","last_unstale":"2024-09-12T22:06:53.979359+0000","last_undegraded":"2024-09-12T22:06:53.979359+0000","last_fullsized":"2024-09-12T22:06:53.979359+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:48.618058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979320+0000","last_change":"2024-09-12T22:06:44.395363+0000","last_active":"2024-09-12T22:06:53.979320+0000","last_peered":"2024-09-12T22:06:53.979320+0000","last_clean":"2024-09-12T22:06:53.979320+0000","last_became_active":"2024-09-12T22:06:44.394804+0000","last_became_peered":"2024-09-12T22:06:44.394804+0000","last_unstale":"2024-09-12T22:06:53.979320+0000","last_undegraded":"2024-09-12T22:06:53.979320+0000","last_fullsized":"2024-09-12T22:06:53.979320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:18.826036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980197+0000","last_change":"2024-09-12T22:06:44.390017+0000","last_active":"2024-09-12T22:06:53.980197+0000","last_peered":"2024-09-12T22:06:53.980197+0000","last_clean":"2024-09-12T22:06:53.980197+0000","last_became_active":"2024-09-12T22:06:44.389256+0000","last_became_peered":"2024-09-12T22:06:44.389256+0000","last_unstale":"2024-09-12T22:06:53.980197+0000","last_undegraded":"2024-09-12T22:06:53.980197+0000","last_fullsized":"2024-09-12T22:06:53.980197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:48.669357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035877+0000","last_change":"2024-09-12T22:06:44.392599+0000","last_active":"2024-09-12T22:06:54.035877+0000","last_peered":"2024-09-12T22:06:54.035877+0000","last_clean":"2024-09-12T22:06:54.035877+0000","last_became_active":"2024-09-12T22:06:44.391572+0000","last_became_peered":"2024-09-12T22:06:44.391572+0000","last_unstale":"2024-09-12T22:06:54.035877+0000","last_undegraded":"2024-09-12T22:06:54.035877+0000","last_fullsized":"2024-09-12T22:06:54.035877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:41.342271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979365+0000","last_change":"2024-09-12T22:06:50.420008+0000","last_active":"2024-09-12T22:06:53.979365+0000","last_peered":"2024-09-12T22:06:53.979365+0000","last_clean":"2024-09-12T22:06:53.979365+0000","last_became_active":"2024-09-12T22:06:50.419042+0000","last_became_peered":"2024-09-12T22:06:50.419042+0000","last_unstale":"2024-09-12T22:06:53.979365+0000","last_undegraded":"2024-09-12T22:06:53.979365+0000","last_fullsized":"2024-09-12T22:06:53.979365+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:39.365289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035352+0000","last_change":"2024-09-12T22:03:33.465069+0000","last_active":"2024-09-12T22:06:54.035352+0000","last_peered":"2024-09-12T22:06:54.035352+0000","last_clean":"2024-09-12T22:06:54.035352+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:06:54.035352+0000","last_undegraded":"2024-09-12T22:06:54.035352+0000","last_fullsized":"2024-09-12T22:06:54.035352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035321+0000","last_change":"2024-09-12T22:06:44.392909+0000","last_active":"2024-09-12T22:06:54.035321+0000","last_peered":"2024-09-12T22:06:54.035321+0000","last_clean":"2024-09-12T22:06:54.035321+0000","last_became_active":"2024-09-12T22:06:44.392491+0000","last_became_peered":"2024-09-12T22:06:44.392491+0000","last_unstale":"2024-09-12T22:06:54.035321+0000","last_undegraded":"2024-09-12T22:06:54.035321+0000","last_fullsized":"2024-09-12T22:06:54.035321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:09.585700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979180+0000","last_change":"2024-09-12T22:06:50.419973+0000","last_active":"2024-09-12T22:06:53.979180+0000","last_peered":"2024-09-12T22:06:53.979180+0000","last_clean":"2024-09-12T22:06:53.979180+0000","last_became_active":"2024-09-12T22:06:50.418325+0000","last_became_peered":"2024-09-12T22:06:50.418325+0000","last_unstale":"2024-09-12T22:06:53.979180+0000","last_undegraded":"2024-09-12T22:06:53.979180+0000","last_fullsized":"2024-09-12T22:06:53.979180+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:02.303968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979112+0000","last_change":"2024-09-12T22:06:50.419011+0000","last_active":"2024-09-12T22:06:53.979112+0000","last_peered":"2024-09-12T22:06:53.979112+0000","last_clean":"2024-09-12T22:06:53.979112+0000","last_became_active":"2024-09-12T22:06:50.418075+0000","last_became_peered":"2024-09-12T22:06:50.418075+0000","last_unstale":"2024-09-12T22:06:53.979112+0000","last_undegraded":"2024-09-12T22:06:53.979112+0000","last_fullsized":"2024-09-12T22:06:53.979112+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:16.440226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979399+0000","last_change":"2024-09-12T22:06:44.395099+0000","last_active":"2024-09-12T22:06:53.979399+0000","last_peered":"2024-09-12T22:06:53.979399+0000","last_clean":"2024-09-12T22:06:53.979399+0000","last_became_active":"2024-09-12T22:06:44.394486+0000","last_became_peered":"2024-09-12T22:06:44.394486+0000","last_unstale":"2024-09-12T22:06:53.979399+0000","last_undegraded":"2024-09-12T22:06:53.979399+0000","last_fullsized":"2024-09-12T22:06:53.979399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:47.461701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980180+0000","last_change":"2024-09-12T22:06:44.390021+0000","last_active":"2024-09-12T22:06:53.980180+0000","last_peered":"2024-09-12T22:06:53.980180+0000","last_clean":"2024-09-12T22:06:53.980180+0000","last_became_active":"2024-09-12T22:06:44.388967+0000","last_became_peered":"2024-09-12T22:06:44.388967+0000","last_unstale":"2024-09-12T22:06:53.980180+0000","last_undegraded":"2024-09-12T22:06:53.980180+0000","last_fullsized":"2024-09-12T22:06:53.980180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:15.769587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035728+0000","last_change":"2024-09-12T22:06:44.391191+0000","last_active":"2024-09-12T22:06:54.035728+0000","last_peered":"2024-09-12T22:06:54.035728+0000","last_clean":"2024-09-12T22:06:54.035728+0000","last_became_active":"2024-09-12T22:06:44.390858+0000","last_became_peered":"2024-09-12T22:06:44.390858+0000","last_unstale":"2024-09-12T22:06:54.035728+0000","last_undegraded":"2024-09-12T22:06:54.035728+0000","last_fullsized":"2024-09-12T22:06:54.035728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:30.878874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979804+0000","last_change":"2024-09-12T22:06:44.389205+0000","last_active":"2024-09-12T22:06:53.979804+0000","last_peered":"2024-09-12T22:06:53.979804+0000","last_clean":"2024-09-12T22:06:53.979804+0000","last_became_active":"2024-09-12T22:06:44.388761+0000","last_became_peered":"2024-09-12T22:06:44.388761+0000","last_unstale":"2024-09-12T22:06:53.979804+0000","last_undegraded":"2024-09-12T22:06:53.979804+0000","last_fullsized":"2024-09-12T22:06:53.979804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:31.790297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980172+0000","last_change":"2024-09-12T22:06:44.421429+0000","last_active":"2024-09-12T22:06:53.980172+0000","last_peered":"2024-09-12T22:06:53.980172+0000","last_clean":"2024-09-12T22:06:53.980172+0000","last_became_active":"2024-09-12T22:06:44.420768+0000","last_became_peered":"2024-09-12T22:06:44.420768+0000","last_unstale":"2024-09-12T22:06:53.980172+0000","last_undegraded":"2024-09-12T22:06:53.980172+0000","last_fullsized":"2024-09-12T22:06:53.980172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:25.634497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979404+0000","last_change":"2024-09-12T22:06:50.422914+0000","last_active":"2024-09-12T22:06:53.979404+0000","last_peered":"2024-09-12T22:06:53.979404+0000","last_clean":"2024-09-12T22:06:53.979404+0000","last_became_active":"2024-09-12T22:06:50.421758+0000","last_became_peered":"2024-09-12T22:06:50.421758+0000","last_unstale":"2024-09-12T22:06:53.979404+0000","last_undegraded":"2024-09-12T22:06:53.979404+0000","last_fullsized":"2024-09-12T22:06:53.979404+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:02.122833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035141+0000","last_change":"2024-09-12T22:03:33.460994+0000","last_active":"2024-09-12T22:06:54.035141+0000","last_peered":"2024-09-12T22:06:54.035141+0000","last_clean":"2024-09-12T22:06:54.035141+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:06:54.035141+0000","last_undegraded":"2024-09-12T22:06:54.035141+0000","last_fullsized":"2024-09-12T22:06:54.035141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:20.363291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979143+0000","last_change":"2024-09-12T22:06:50.417908+0000","last_active":"2024-09-12T22:06:53.979143+0000","last_peered":"2024-09-12T22:06:53.979143+0000","last_clean":"2024-09-12T22:06:53.979143+0000","last_became_active":"2024-09-12T22:06:50.416924+0000","last_became_peered":"2024-09-12T22:06:50.416924+0000","last_unstale":"2024-09-12T22:06:53.979143+0000","last_undegraded":"2024-09-12T22:06:53.979143+0000","last_fullsized":"2024-09-12T22:06:53.979143+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:28.247991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034792+0000","last_change":"2024-09-12T22:06:44.391876+0000","last_active":"2024-09-12T22:06:54.034792+0000","last_peered":"2024-09-12T22:06:54.034792+0000","last_clean":"2024-09-12T22:06:54.034792+0000","last_became_active":"2024-09-12T22:06:44.391480+0000","last_became_peered":"2024-09-12T22:06:44.391480+0000","last_unstale":"2024-09-12T22:06:54.034792+0000","last_undegraded":"2024-09-12T22:06:54.034792+0000","last_fullsized":"2024-09-12T22:06:54.034792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:43.161300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035981+0000","last_change":"2024-09-12T22:06:50.420130+0000","last_active":"2024-09-12T22:06:54.035981+0000","last_peered":"2024-09-12T22:06:54.035981+0000","last_clean":"2024-09-12T22:06:54.035981+0000","last_became_active":"2024-09-12T22:06:50.419573+0000","last_became_peered":"2024-09-12T22:06:50.419573+0000","last_unstale":"2024-09-12T22:06:54.035981+0000","last_undegraded":"2024-09-12T22:06:54.035981+0000","last_fullsized":"2024-09-12T22:06:54.035981+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:31.160831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980210+0000","last_change":"2024-09-12T22:06:50.420167+0000","last_active":"2024-09-12T22:06:53.980210+0000","last_peered":"2024-09-12T22:06:53.980210+0000","last_clean":"2024-09-12T22:06:53.980210+0000","last_became_active":"2024-09-12T22:06:50.419348+0000","last_became_peered":"2024-09-12T22:06:50.419348+0000","last_unstale":"2024-09-12T22:06:53.980210+0000","last_undegraded":"2024-09-12T22:06:53.980210+0000","last_fullsized":"2024-09-12T22:06:53.980210+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:19.786252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979690+0000","last_change":"2024-09-12T22:03:33.461282+0000","last_active":"2024-09-12T22:06:53.979690+0000","last_peered":"2024-09-12T22:06:53.979690+0000","last_clean":"2024-09-12T22:06:53.979690+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:06:53.979690+0000","last_undegraded":"2024-09-12T22:06:53.979690+0000","last_fullsized":"2024-09-12T22:06:53.979690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:32.302716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035627+0000","last_change":"2024-09-12T22:06:50.419329+0000","last_active":"2024-09-12T22:06:54.035627+0000","last_peered":"2024-09-12T22:06:54.035627+0000","last_clean":"2024-09-12T22:06:54.035627+0000","last_became_active":"2024-09-12T22:06:50.418755+0000","last_became_peered":"2024-09-12T22:06:50.418755+0000","last_unstale":"2024-09-12T22:06:54.035627+0000","last_undegraded":"2024-09-12T22:06:54.035627+0000","last_fullsized":"2024-09-12T22:06:54.035627+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:02.572755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979812+0000","last_change":"2024-09-12T22:06:44.397630+0000","last_active":"2024-09-12T22:06:53.979812+0000","last_peered":"2024-09-12T22:06:53.979812+0000","last_clean":"2024-09-12T22:06:53.979812+0000","last_became_active":"2024-09-12T22:06:44.397198+0000","last_became_peered":"2024-09-12T22:06:44.397198+0000","last_unstale":"2024-09-12T22:06:53.979812+0000","last_undegraded":"2024-09-12T22:06:53.979812+0000","last_fullsized":"2024-09-12T22:06:53.979812+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:31.843174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035267+0000","last_change":"2024-09-12T22:03:33.456842+0000","last_active":"2024-09-12T22:06:54.035267+0000","last_peered":"2024-09-12T22:06:54.035267+0000","last_clean":"2024-09-12T22:06:54.035267+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:06:54.035267+0000","last_undegraded":"2024-09-12T22:06:54.035267+0000","last_fullsized":"2024-09-12T22:06:54.035267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:56.383351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979590+0000","last_change":"2024-09-12T22:06:44.397416+0000","last_active":"2024-09-12T22:06:53.979590+0000","last_peered":"2024-09-12T22:06:53.979590+0000","last_clean":"2024-09-12T22:06:53.979590+0000","last_became_active":"2024-09-12T22:06:44.397074+0000","last_became_peered":"2024-09-12T22:06:44.397074+0000","last_unstale":"2024-09-12T22:06:53.979590+0000","last_undegraded":"2024-09-12T22:06:53.979590+0000","last_fullsized":"2024-09-12T22:06:53.979590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.834005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978818+0000","last_change":"2024-09-12T22:06:50.414965+0000","last_active":"2024-09-12T22:06:53.978818+0000","last_peered":"2024-09-12T22:06:53.978818+0000","last_clean":"2024-09-12T22:06:53.978818+0000","last_became_active":"2024-09-12T22:06:50.414626+0000","last_became_peered":"2024-09-12T22:06:50.414626+0000","last_unstale":"2024-09-12T22:06:53.978818+0000","last_undegraded":"2024-09-12T22:06:53.978818+0000","last_fullsized":"2024-09-12T22:06:53.978818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:30.619121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035494+0000","last_change":"2024-09-12T22:06:44.391923+0000","last_active":"2024-09-12T22:06:54.035494+0000","last_peered":"2024-09-12T22:06:54.035494+0000","last_clean":"2024-09-12T22:06:54.035494+0000","last_became_active":"2024-09-12T22:06:44.391447+0000","last_became_peered":"2024-09-12T22:06:44.391447+0000","last_unstale":"2024-09-12T22:06:54.035494+0000","last_undegraded":"2024-09-12T22:06:54.035494+0000","last_fullsized":"2024-09-12T22:06:54.035494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:32.308333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979499+0000","last_change":"2024-09-12T22:06:50.442693+0000","last_active":"2024-09-12T22:06:53.979499+0000","last_peered":"2024-09-12T22:06:53.979499+0000","last_clean":"2024-09-12T22:06:53.979499+0000","last_became_active":"2024-09-12T22:06:50.422232+0000","last_became_peered":"2024-09-12T22:06:50.422232+0000","last_unstale":"2024-09-12T22:06:53.979499+0000","last_undegraded":"2024-09-12T22:06:53.979499+0000","last_fullsized":"2024-09-12T22:06:53.979499+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:40.705556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035690+0000","last_change":"2024-09-12T22:06:44.390974+0000","last_active":"2024-09-12T22:06:54.035690+0000","last_peered":"2024-09-12T22:06:54.035690+0000","last_clean":"2024-09-12T22:06:54.035690+0000","last_became_active":"2024-09-12T22:06:44.390652+0000","last_became_peered":"2024-09-12T22:06:44.390652+0000","last_unstale":"2024-09-12T22:06:54.035690+0000","last_undegraded":"2024-09-12T22:06:54.035690+0000","last_fullsized":"2024-09-12T22:06:54.035690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:41.707065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979208+0000","last_change":"2024-09-12T22:06:50.417649+0000","last_active":"2024-09-12T22:06:53.979208+0000","last_peered":"2024-09-12T22:06:53.979208+0000","last_clean":"2024-09-12T22:06:53.979208+0000","last_became_active":"2024-09-12T22:06:50.417123+0000","last_became_peered":"2024-09-12T22:06:50.417123+0000","last_unstale":"2024-09-12T22:06:53.979208+0000","last_undegraded":"2024-09-12T22:06:53.979208+0000","last_fullsized":"2024-09-12T22:06:53.979208+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:01.612960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980187+0000","last_change":"2024-09-12T22:06:50.419787+0000","last_active":"2024-09-12T22:06:53.980187+0000","last_peered":"2024-09-12T22:06:53.980187+0000","last_clean":"2024-09-12T22:06:53.980187+0000","last_became_active":"2024-09-12T22:06:50.418817+0000","last_became_peered":"2024-09-12T22:06:50.418817+0000","last_unstale":"2024-09-12T22:06:53.980187+0000","last_undegraded":"2024-09-12T22:06:53.980187+0000","last_fullsized":"2024-09-12T22:06:53.980187+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:51.923601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035182+0000","last_change":"2024-09-12T22:06:50.419697+0000","last_active":"2024-09-12T22:06:54.035182+0000","last_peered":"2024-09-12T22:06:54.035182+0000","last_clean":"2024-09-12T22:06:54.035182+0000","last_became_active":"2024-09-12T22:06:50.419047+0000","last_became_peered":"2024-09-12T22:06:50.419047+0000","last_unstale":"2024-09-12T22:06:54.035182+0000","last_undegraded":"2024-09-12T22:06:54.035182+0000","last_fullsized":"2024-09-12T22:06:54.035182+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:31.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980033+0000","last_change":"2024-09-12T22:06:44.422294+0000","last_active":"2024-09-12T22:06:53.980033+0000","last_peered":"2024-09-12T22:06:53.980033+0000","last_clean":"2024-09-12T22:06:53.980033+0000","last_became_active":"2024-09-12T22:06:44.421955+0000","last_became_peered":"2024-09-12T22:06:44.421955+0000","last_unstale":"2024-09-12T22:06:53.980033+0000","last_undegraded":"2024-09-12T22:06:53.980033+0000","last_fullsized":"2024-09-12T22:06:53.980033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:40.047878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979018+0000","last_change":"2024-09-12T22:06:50.432341+0000","last_active":"2024-09-12T22:06:53.979018+0000","last_peered":"2024-09-12T22:06:53.979018+0000","last_clean":"2024-09-12T22:06:53.979018+0000","last_became_active":"2024-09-12T22:06:50.418227+0000","last_became_peered":"2024-09-12T22:06:50.418227+0000","last_unstale":"2024-09-12T22:06:53.979018+0000","last_undegraded":"2024-09-12T22:06:53.979018+0000","last_fullsized":"2024-09-12T22:06:53.979018+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:47.509209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979708+0000","last_change":"2024-09-12T22:06:50.426521+0000","last_active":"2024-09-12T22:06:53.979708+0000","last_peered":"2024-09-12T22:06:53.979708+0000","last_clean":"2024-09-12T22:06:53.979708+0000","last_became_active":"2024-09-12T22:06:50.418222+0000","last_became_peered":"2024-09-12T22:06:50.418222+0000","last_unstale":"2024-09-12T22:06:53.979708+0000","last_undegraded":"2024-09-12T22:06:53.979708+0000","last_fullsized":"2024-09-12T22:06:53.979708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:44.473880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034877+0000","last_change":"2024-09-12T22:03:33.465308+0000","last_active":"2024-09-12T22:06:54.034877+0000","last_peered":"2024-09-12T22:06:54.034877+0000","last_clean":"2024-09-12T22:06:54.034877+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:06:54.034877+0000","last_undegraded":"2024-09-12T22:06:54.034877+0000","last_fullsized":"2024-09-12T22:06:54.034877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:35.733622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035614+0000","last_change":"2024-09-12T22:03:32.461301+0000","last_active":"2024-09-12T22:06:54.035614+0000","last_peered":"2024-09-12T22:06:54.035614+0000","last_clean":"2024-09-12T22:06:54.035614+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:06:54.035614+0000","last_undegraded":"2024-09-12T22:06:54.035614+0000","last_fullsized":"2024-09-12T22:06:54.035614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:39.872272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034942+0000","last_change":"2024-09-12T22:06:44.391249+0000","last_active":"2024-09-12T22:06:54.034942+0000","last_peered":"2024-09-12T22:06:54.034942+0000","last_clean":"2024-09-12T22:06:54.034942+0000","last_became_active":"2024-09-12T22:06:44.390807+0000","last_became_peered":"2024-09-12T22:06:44.390807+0000","last_unstale":"2024-09-12T22:06:54.034942+0000","last_undegraded":"2024-09-12T22:06:54.034942+0000","last_fullsized":"2024-09-12T22:06:54.034942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:07.271893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980057+0000","last_change":"2024-09-12T22:03:32.459540+0000","last_active":"2024-09-12T22:06:53.980057+0000","last_peered":"2024-09-12T22:06:53.980057+0000","last_clean":"2024-09-12T22:06:53.980057+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:06:53.980057+0000","last_undegraded":"2024-09-12T22:06:53.980057+0000","last_fullsized":"2024-09-12T22:06:53.980057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:22.143242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979421+0000","last_change":"2024-09-12T22:06:44.421712+0000","last_active":"2024-09-12T22:06:53.979421+0000","last_peered":"2024-09-12T22:06:53.979421+0000","last_clean":"2024-09-12T22:06:53.979421+0000","last_became_active":"2024-09-12T22:06:44.421388+0000","last_became_peered":"2024-09-12T22:06:44.421388+0000","last_unstale":"2024-09-12T22:06:53.979421+0000","last_undegraded":"2024-09-12T22:06:53.979421+0000","last_fullsized":"2024-09-12T22:06:53.979421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:46.580311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980254+0000","last_change":"2024-09-12T22:06:44.421721+0000","last_active":"2024-09-12T22:06:53.980254+0000","last_peered":"2024-09-12T22:06:53.980254+0000","last_clean":"2024-09-12T22:06:53.980254+0000","last_became_active":"2024-09-12T22:06:44.421430+0000","last_became_peered":"2024-09-12T22:06:44.421430+0000","last_unstale":"2024-09-12T22:06:53.980254+0000","last_undegraded":"2024-09-12T22:06:53.980254+0000","last_fullsized":"2024-09-12T22:06:53.980254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:57.001470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979284+0000","last_change":"2024-09-12T22:06:44.397808+0000","last_active":"2024-09-12T22:06:53.979284+0000","last_peered":"2024-09-12T22:06:53.979284+0000","last_clean":"2024-09-12T22:06:53.979284+0000","last_became_active":"2024-09-12T22:06:44.397490+0000","last_became_peered":"2024-09-12T22:06:44.397490+0000","last_unstale":"2024-09-12T22:06:53.979284+0000","last_undegraded":"2024-09-12T22:06:53.979284+0000","last_fullsized":"2024-09-12T22:06:53.979284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:38.225078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979537+0000","last_change":"2024-09-12T22:06:50.426880+0000","last_active":"2024-09-12T22:06:53.979537+0000","last_peered":"2024-09-12T22:06:53.979537+0000","last_clean":"2024-09-12T22:06:53.979537+0000","last_became_active":"2024-09-12T22:06:50.417240+0000","last_became_peered":"2024-09-12T22:06:50.417240+0000","last_unstale":"2024-09-12T22:06:53.979537+0000","last_undegraded":"2024-09-12T22:06:53.979537+0000","last_fullsized":"2024-09-12T22:06:53.979537+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:24.836682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980207+0000","last_change":"2024-09-12T22:06:44.421723+0000","last_active":"2024-09-12T22:06:53.980207+0000","last_peered":"2024-09-12T22:06:53.980207+0000","last_clean":"2024-09-12T22:06:53.980207+0000","last_became_active":"2024-09-12T22:06:44.421071+0000","last_became_peered":"2024-09-12T22:06:44.421071+0000","last_unstale":"2024-09-12T22:06:53.980207+0000","last_undegraded":"2024-09-12T22:06:53.980207+0000","last_fullsized":"2024-09-12T22:06:53.980207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:16.039319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979544+0000","last_change":"2024-09-12T22:06:50.422136+0000","last_active":"2024-09-12T22:06:53.979544+0000","last_peered":"2024-09-12T22:06:53.979544+0000","last_clean":"2024-09-12T22:06:53.979544+0000","last_became_active":"2024-09-12T22:06:50.421734+0000","last_became_peered":"2024-09-12T22:06:50.421734+0000","last_unstale":"2024-09-12T22:06:53.979544+0000","last_undegraded":"2024-09-12T22:06:53.979544+0000","last_fullsized":"2024-09-12T22:06:53.979544+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:29.450310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979869+0000","last_change":"2024-09-12T22:03:33.459084+0000","last_active":"2024-09-12T22:06:53.979869+0000","last_peered":"2024-09-12T22:06:53.979869+0000","last_clean":"2024-09-12T22:06:53.979869+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:06:53.979869+0000","last_undegraded":"2024-09-12T22:06:53.979869+0000","last_fullsized":"2024-09-12T22:06:53.979869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:50.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035351+0000","last_change":"2024-09-12T22:03:32.461417+0000","last_active":"2024-09-12T22:06:54.035351+0000","last_peered":"2024-09-12T22:06:54.035351+0000","last_clean":"2024-09-12T22:06:54.035351+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:06:54.035351+0000","last_undegraded":"2024-09-12T22:06:54.035351+0000","last_fullsized":"2024-09-12T22:06:54.035351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:22.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979869+0000","last_change":"2024-09-12T22:06:50.419560+0000","last_active":"2024-09-12T22:06:53.979869+0000","last_peered":"2024-09-12T22:06:53.979869+0000","last_clean":"2024-09-12T22:06:53.979869+0000","last_became_active":"2024-09-12T22:06:50.418648+0000","last_became_peered":"2024-09-12T22:06:50.418648+0000","last_unstale":"2024-09-12T22:06:53.979869+0000","last_undegraded":"2024-09-12T22:06:53.979869+0000","last_fullsized":"2024-09-12T22:06:53.979869+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:58.944327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034997+0000","last_change":"2024-09-12T22:06:44.391442+0000","last_active":"2024-09-12T22:06:54.034997+0000","last_peered":"2024-09-12T22:06:54.034997+0000","last_clean":"2024-09-12T22:06:54.034997+0000","last_became_active":"2024-09-12T22:06:44.391078+0000","last_became_peered":"2024-09-12T22:06:44.391078+0000","last_unstale":"2024-09-12T22:06:54.034997+0000","last_undegraded":"2024-09-12T22:06:54.034997+0000","last_fullsized":"2024-09-12T22:06:54.034997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:26.602771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980404+0000","last_change":"2024-09-12T22:06:44.397142+0000","last_active":"2024-09-12T22:06:53.980404+0000","last_peered":"2024-09-12T22:06:53.980404+0000","last_clean":"2024-09-12T22:06:53.980404+0000","last_became_active":"2024-09-12T22:06:44.396783+0000","last_became_peered":"2024-09-12T22:06:44.396783+0000","last_unstale":"2024-09-12T22:06:53.980404+0000","last_undegraded":"2024-09-12T22:06:53.980404+0000","last_fullsized":"2024-09-12T22:06:53.980404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:27.631274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":315,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979021+0000","last_change":"2024-09-12T22:06:52.982526+0000","last_active":"2024-09-12T22:06:53.979021+0000","last_peered":"2024-09-12T22:06:53.979021+0000","last_clean":"2024-09-12T22:06:53.979021+0000","last_became_active":"2024-09-12T22:06:52.982174+0000","last_became_peered":"2024-09-12T22:06:52.982174+0000","last_unstale":"2024-09-12T22:06:53.979021+0000","last_undegraded":"2024-09-12T22:06:53.979021+0000","last_fullsized":"2024-09-12T22:06:53.979021+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:20.744009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979737+0000","last_change":"2024-09-12T22:06:50.444340+0000","last_active":"2024-09-12T22:06:53.979737+0000","last_peered":"2024-09-12T22:06:53.979737+0000","last_clean":"2024-09-12T22:06:53.979737+0000","last_became_active":"2024-09-12T22:06:50.422353+0000","last_became_peered":"2024-09-12T22:06:50.422353+0000","last_unstale":"2024-09-12T22:06:53.979737+0000","last_undegraded":"2024-09-12T22:06:53.979737+0000","last_fullsized":"2024-09-12T22:06:53.979737+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.662733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979420+0000","last_change":"2024-09-12T22:06:44.397029+0000","last_active":"2024-09-12T22:06:53.979420+0000","last_peered":"2024-09-12T22:06:53.979420+0000","last_clean":"2024-09-12T22:06:53.979420+0000","last_became_active":"2024-09-12T22:06:44.396659+0000","last_became_peered":"2024-09-12T22:06:44.396659+0000","last_unstale":"2024-09-12T22:06:53.979420+0000","last_undegraded":"2024-09-12T22:06:53.979420+0000","last_fullsized":"2024-09-12T22:06:53.979420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:07.404782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979992+0000","last_change":"2024-09-12T22:06:50.418936+0000","last_active":"2024-09-12T22:06:53.979992+0000","last_peered":"2024-09-12T22:06:53.979992+0000","last_clean":"2024-09-12T22:06:53.979992+0000","last_became_active":"2024-09-12T22:06:50.418443+0000","last_became_peered":"2024-09-12T22:06:50.418443+0000","last_unstale":"2024-09-12T22:06:53.979992+0000","last_undegraded":"2024-09-12T22:06:53.979992+0000","last_fullsized":"2024-09-12T22:06:53.979992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:40.432871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978897+0000","last_change":"2024-09-12T22:06:50.419409+0000","last_active":"2024-09-12T22:06:53.978897+0000","last_peered":"2024-09-12T22:06:53.978897+0000","last_clean":"2024-09-12T22:06:53.978897+0000","last_became_active":"2024-09-12T22:06:50.418160+0000","last_became_peered":"2024-09-12T22:06:50.418160+0000","last_unstale":"2024-09-12T22:06:53.978897+0000","last_undegraded":"2024-09-12T22:06:53.978897+0000","last_fullsized":"2024-09-12T22:06:53.978897+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:48.881995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978987+0000","last_change":"2024-09-12T22:06:44.396692+0000","last_active":"2024-09-12T22:06:53.978987+0000","last_peered":"2024-09-12T22:06:53.978987+0000","last_clean":"2024-09-12T22:06:53.978987+0000","last_became_active":"2024-09-12T22:06:44.396378+0000","last_became_peered":"2024-09-12T22:06:44.396378+0000","last_unstale":"2024-09-12T22:06:53.978987+0000","last_undegraded":"2024-09-12T22:06:53.978987+0000","last_fullsized":"2024-09-12T22:06:53.978987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:06.812790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035774+0000","last_change":"2024-09-12T22:06:44.392705+0000","last_active":"2024-09-12T22:06:54.035774+0000","last_peered":"2024-09-12T22:06:54.035774+0000","last_clean":"2024-09-12T22:06:54.035774+0000","last_became_active":"2024-09-12T22:06:44.391809+0000","last_became_peered":"2024-09-12T22:06:44.391809+0000","last_unstale":"2024-09-12T22:06:54.035774+0000","last_undegraded":"2024-09-12T22:06:54.035774+0000","last_fullsized":"2024-09-12T22:06:54.035774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:48.022906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979322+0000","last_change":"2024-09-12T22:06:44.397296+0000","last_active":"2024-09-12T22:06:53.979322+0000","last_peered":"2024-09-12T22:06:53.979322+0000","last_clean":"2024-09-12T22:06:53.979322+0000","last_became_active":"2024-09-12T22:06:44.396596+0000","last_became_peered":"2024-09-12T22:06:44.396596+0000","last_unstale":"2024-09-12T22:06:53.979322+0000","last_undegraded":"2024-09-12T22:06:53.979322+0000","last_fullsized":"2024-09-12T22:06:53.979322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:25.702361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035014+0000","last_change":"2024-09-12T22:06:50.419281+0000","last_active":"2024-09-12T22:06:54.035014+0000","last_peered":"2024-09-12T22:06:54.035014+0000","last_clean":"2024-09-12T22:06:54.035014+0000","last_became_active":"2024-09-12T22:06:50.418876+0000","last_became_peered":"2024-09-12T22:06:50.418876+0000","last_unstale":"2024-09-12T22:06:54.035014+0000","last_undegraded":"2024-09-12T22:06:54.035014+0000","last_fullsized":"2024-09-12T22:06:54.035014+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:14.574566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980382+0000","last_change":"2024-09-12T22:06:44.390385+0000","last_active":"2024-09-12T22:06:53.980382+0000","last_peered":"2024-09-12T22:06:53.980382+0000","last_clean":"2024-09-12T22:06:53.980382+0000","last_became_active":"2024-09-12T22:06:44.389680+0000","last_became_peered":"2024-09-12T22:06:44.389680+0000","last_unstale":"2024-09-12T22:06:53.980382+0000","last_undegraded":"2024-09-12T22:06:53.980382+0000","last_fullsized":"2024-09-12T22:06:53.980382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:28.579444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":183,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979720+0000","last_change":"2024-09-12T22:06:44.421429+0000","last_active":"2024-09-12T22:06:53.979720+0000","last_peered":"2024-09-12T22:06:53.979720+0000","last_clean":"2024-09-12T22:06:53.979720+0000","last_became_active":"2024-09-12T22:06:44.421088+0000","last_became_peered":"2024-09-12T22:06:44.421088+0000","last_unstale":"2024-09-12T22:06:53.979720+0000","last_undegraded":"2024-09-12T22:06:53.979720+0000","last_fullsized":"2024-09-12T22:06:53.979720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:29.121518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979693+0000","last_change":"2024-09-12T22:06:50.423638+0000","last_active":"2024-09-12T22:06:53.979693+0000","last_peered":"2024-09-12T22:06:53.979693+0000","last_clean":"2024-09-12T22:06:53.979693+0000","last_became_active":"2024-09-12T22:06:50.423052+0000","last_became_peered":"2024-09-12T22:06:50.423052+0000","last_unstale":"2024-09-12T22:06:53.979693+0000","last_undegraded":"2024-09-12T22:06:53.979693+0000","last_fullsized":"2024-09-12T22:06:53.979693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:49.458146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980024+0000","last_change":"2024-09-12T22:06:44.397769+0000","last_active":"2024-09-12T22:06:53.980024+0000","last_peered":"2024-09-12T22:06:53.980024+0000","last_clean":"2024-09-12T22:06:53.980024+0000","last_became_active":"2024-09-12T22:06:44.397452+0000","last_became_peered":"2024-09-12T22:06:44.397452+0000","last_unstale":"2024-09-12T22:06:53.980024+0000","last_undegraded":"2024-09-12T22:06:53.980024+0000","last_fullsized":"2024-09-12T22:06:53.980024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:56.815006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979460+0000","last_change":"2024-09-12T22:06:50.420039+0000","last_active":"2024-09-12T22:06:53.979460+0000","last_peered":"2024-09-12T22:06:53.979460+0000","last_clean":"2024-09-12T22:06:53.979460+0000","last_became_active":"2024-09-12T22:06:50.419551+0000","last_became_peered":"2024-09-12T22:06:50.419551+0000","last_unstale":"2024-09-12T22:06:53.979460+0000","last_undegraded":"2024-09-12T22:06:53.979460+0000","last_fullsized":"2024-09-12T22:06:53.979460+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:06.211607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980065+0000","last_change":"2024-09-12T22:06:44.397598+0000","last_active":"2024-09-12T22:06:53.980065+0000","last_peered":"2024-09-12T22:06:53.980065+0000","last_clean":"2024-09-12T22:06:53.980065+0000","last_became_active":"2024-09-12T22:06:44.396979+0000","last_became_peered":"2024-09-12T22:06:44.396979+0000","last_unstale":"2024-09-12T22:06:53.980065+0000","last_undegraded":"2024-09-12T22:06:53.980065+0000","last_fullsized":"2024-09-12T22:06:53.980065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:27.592588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035149+0000","last_change":"2024-09-12T22:06:50.419195+0000","last_active":"2024-09-12T22:06:54.035149+0000","last_peered":"2024-09-12T22:06:54.035149+0000","last_clean":"2024-09-12T22:06:54.035149+0000","last_became_active":"2024-09-12T22:06:50.418763+0000","last_became_peered":"2024-09-12T22:06:50.418763+0000","last_unstale":"2024-09-12T22:06:54.035149+0000","last_undegraded":"2024-09-12T22:06:54.035149+0000","last_fullsized":"2024-09-12T22:06:54.035149+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:15.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979795+0000","last_change":"2024-09-12T22:06:44.389682+0000","last_active":"2024-09-12T22:06:53.979795+0000","last_peered":"2024-09-12T22:06:53.979795+0000","last_clean":"2024-09-12T22:06:53.979795+0000","last_became_active":"2024-09-12T22:06:44.388887+0000","last_became_peered":"2024-09-12T22:06:44.388887+0000","last_unstale":"2024-09-12T22:06:53.979795+0000","last_undegraded":"2024-09-12T22:06:53.979795+0000","last_fullsized":"2024-09-12T22:06:53.979795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:09:27.376344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035461+0000","last_change":"2024-09-12T22:06:44.390603+0000","last_active":"2024-09-12T22:06:54.035461+0000","last_peered":"2024-09-12T22:06:54.035461+0000","last_clean":"2024-09-12T22:06:54.035461+0000","last_became_active":"2024-09-12T22:06:44.390260+0000","last_became_peered":"2024-09-12T22:06:44.390260+0000","last_unstale":"2024-09-12T22:06:54.035461+0000","last_undegraded":"2024-09-12T22:06:54.035461+0000","last_fullsized":"2024-09-12T22:06:54.035461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:42.158737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035313+0000","last_change":"2024-09-12T22:03:33.464893+0000","last_active":"2024-09-12T22:06:54.035313+0000","last_peered":"2024-09-12T22:06:54.035313+0000","last_clean":"2024-09-12T22:06:54.035313+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:06:54.035313+0000","last_undegraded":"2024-09-12T22:06:54.035313+0000","last_fullsized":"2024-09-12T22:06:54.035313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:47.948673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980033+0000","last_change":"2024-09-12T22:06:44.390378+0000","last_active":"2024-09-12T22:06:53.980033+0000","last_peered":"2024-09-12T22:06:53.980033+0000","last_clean":"2024-09-12T22:06:53.980033+0000","last_became_active":"2024-09-12T22:06:44.389622+0000","last_became_peered":"2024-09-12T22:06:44.389622+0000","last_unstale":"2024-09-12T22:06:53.980033+0000","last_undegraded":"2024-09-12T22:06:53.980033+0000","last_fullsized":"2024-09-12T22:06:53.980033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:57.877495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980321+0000","last_change":"2024-09-12T22:06:44.398054+0000","last_active":"2024-09-12T22:06:53.980321+0000","last_peered":"2024-09-12T22:06:53.980321+0000","last_clean":"2024-09-12T22:06:53.980321+0000","last_became_active":"2024-09-12T22:06:44.396735+0000","last_became_peered":"2024-09-12T22:06:44.396735+0000","last_unstale":"2024-09-12T22:06:53.980321+0000","last_undegraded":"2024-09-12T22:06:53.980321+0000","last_fullsized":"2024-09-12T22:06:53.980321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:54:49.919665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979023+0000","last_change":"2024-09-12T22:06:44.422129+0000","last_active":"2024-09-12T22:06:53.979023+0000","last_peered":"2024-09-12T22:06:53.979023+0000","last_clean":"2024-09-12T22:06:53.979023+0000","last_became_active":"2024-09-12T22:06:44.421723+0000","last_became_peered":"2024-09-12T22:06:44.421723+0000","last_unstale":"2024-09-12T22:06:53.979023+0000","last_undegraded":"2024-09-12T22:06:53.979023+0000","last_fullsized":"2024-09-12T22:06:53.979023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:11.198373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980261+0000","last_change":"2024-09-12T22:06:50.435272+0000","last_active":"2024-09-12T22:06:53.980261+0000","last_peered":"2024-09-12T22:06:53.980261+0000","last_clean":"2024-09-12T22:06:53.980261+0000","last_became_active":"2024-09-12T22:06:50.419354+0000","last_became_peered":"2024-09-12T22:06:50.419354+0000","last_unstale":"2024-09-12T22:06:53.980261+0000","last_undegraded":"2024-09-12T22:06:53.980261+0000","last_fullsized":"2024-09-12T22:06:53.980261+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:59.450087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979844+0000","last_change":"2024-09-12T22:06:50.418804+0000","last_active":"2024-09-12T22:06:53.979844+0000","last_peered":"2024-09-12T22:06:53.979844+0000","last_clean":"2024-09-12T22:06:53.979844+0000","last_became_active":"2024-09-12T22:06:50.418444+0000","last_became_peered":"2024-09-12T22:06:50.418444+0000","last_unstale":"2024-09-12T22:06:53.979844+0000","last_undegraded":"2024-09-12T22:06:53.979844+0000","last_fullsized":"2024-09-12T22:06:53.979844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:43.033754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034987+0000","last_change":"2024-09-12T22:06:50.419309+0000","last_active":"2024-09-12T22:06:54.034987+0000","last_peered":"2024-09-12T22:06:54.034987+0000","last_clean":"2024-09-12T22:06:54.034987+0000","last_became_active":"2024-09-12T22:06:50.418591+0000","last_became_peered":"2024-09-12T22:06:50.418591+0000","last_unstale":"2024-09-12T22:06:54.034987+0000","last_undegraded":"2024-09-12T22:06:54.034987+0000","last_fullsized":"2024-09-12T22:06:54.034987+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:23.918205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979863+0000","last_change":"2024-09-12T22:06:50.421370+0000","last_active":"2024-09-12T22:06:53.979863+0000","last_peered":"2024-09-12T22:06:53.979863+0000","last_clean":"2024-09-12T22:06:53.979863+0000","last_became_active":"2024-09-12T22:06:50.419642+0000","last_became_peered":"2024-09-12T22:06:50.419642+0000","last_unstale":"2024-09-12T22:06:53.979863+0000","last_undegraded":"2024-09-12T22:06:53.979863+0000","last_fullsized":"2024-09-12T22:06:53.979863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:13.028012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980078+0000","last_change":"2024-09-12T22:06:50.437734+0000","last_active":"2024-09-12T22:06:53.980078+0000","last_peered":"2024-09-12T22:06:53.980078+0000","last_clean":"2024-09-12T22:06:53.980078+0000","last_became_active":"2024-09-12T22:06:50.420099+0000","last_became_peered":"2024-09-12T22:06:50.420099+0000","last_unstale":"2024-09-12T22:06:53.980078+0000","last_undegraded":"2024-09-12T22:06:53.980078+0000","last_fullsized":"2024-09-12T22:06:53.980078+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:05.638054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034976+0000","last_change":"2024-09-12T22:03:54.194965+0000","last_active":"2024-09-12T22:06:54.034976+0000","last_peered":"2024-09-12T22:06:54.034976+0000","last_clean":"2024-09-12T22:06:54.034976+0000","last_became_active":"2024-09-12T22:03:54.194697+0000","last_became_peered":"2024-09-12T22:03:54.194697+0000","last_unstale":"2024-09-12T22:06:54.034976+0000","last_undegraded":"2024-09-12T22:06:54.034976+0000","last_fullsized":"2024-09-12T22:06:54.034976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:47.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":189,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035598+0000","last_change":"2024-09-12T22:06:50.430086+0000","last_active":"2024-09-12T22:06:54.035598+0000","last_peered":"2024-09-12T22:06:54.035598+0000","last_clean":"2024-09-12T22:06:54.035598+0000","last_became_active":"2024-09-12T22:06:50.423283+0000","last_became_peered":"2024-09-12T22:06:50.423283+0000","last_unstale":"2024-09-12T22:06:54.035598+0000","last_undegraded":"2024-09-12T22:06:54.035598+0000","last_fullsized":"2024-09-12T22:06:54.035598+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:38.836493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979901+0000","last_change":"2024-09-12T22:06:50.421357+0000","last_active":"2024-09-12T22:06:53.979901+0000","last_peered":"2024-09-12T22:06:53.979901+0000","last_clean":"2024-09-12T22:06:53.979901+0000","last_became_active":"2024-09-12T22:06:50.420171+0000","last_became_peered":"2024-09-12T22:06:50.420171+0000","last_unstale":"2024-09-12T22:06:53.979901+0000","last_undegraded":"2024-09-12T22:06:53.979901+0000","last_fullsized":"2024-09-12T22:06:53.979901+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:25.747880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979236+0000","last_change":"2024-09-12T22:06:50.418126+0000","last_active":"2024-09-12T22:06:53.979236+0000","last_peered":"2024-09-12T22:06:53.979236+0000","last_clean":"2024-09-12T22:06:53.979236+0000","last_became_active":"2024-09-12T22:06:50.417583+0000","last_became_peered":"2024-09-12T22:06:50.417583+0000","last_unstale":"2024-09-12T22:06:53.979236+0000","last_undegraded":"2024-09-12T22:06:53.979236+0000","last_fullsized":"2024-09-12T22:06:53.979236+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:17:44.500650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980312+0000","last_change":"2024-09-12T22:06:44.422538+0000","last_active":"2024-09-12T22:06:53.980312+0000","last_peered":"2024-09-12T22:06:53.980312+0000","last_clean":"2024-09-12T22:06:53.980312+0000","last_became_active":"2024-09-12T22:06:44.422217+0000","last_became_peered":"2024-09-12T22:06:44.422217+0000","last_unstale":"2024-09-12T22:06:53.980312+0000","last_undegraded":"2024-09-12T22:06:53.980312+0000","last_fullsized":"2024-09-12T22:06:53.980312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:10.635087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979185+0000","last_change":"2024-09-12T22:06:44.390100+0000","last_active":"2024-09-12T22:06:53.979185+0000","last_peered":"2024-09-12T22:06:53.979185+0000","last_clean":"2024-09-12T22:06:53.979185+0000","last_became_active":"2024-09-12T22:06:44.388560+0000","last_became_peered":"2024-09-12T22:06:44.388560+0000","last_unstale":"2024-09-12T22:06:53.979185+0000","last_undegraded":"2024-09-12T22:06:53.979185+0000","last_fullsized":"2024-09-12T22:06:53.979185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:18.786679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.036028+0000","last_change":"2024-09-12T22:03:33.460177+0000","last_active":"2024-09-12T22:06:54.036028+0000","last_peered":"2024-09-12T22:06:54.036028+0000","last_clean":"2024-09-12T22:06:54.036028+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:06:54.036028+0000","last_undegraded":"2024-09-12T22:06:54.036028+0000","last_fullsized":"2024-09-12T22:06:54.036028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979285+0000","last_change":"2024-09-12T22:06:44.388874+0000","last_active":"2024-09-12T22:06:53.979285+0000","last_peered":"2024-09-12T22:06:53.979285+0000","last_clean":"2024-09-12T22:06:53.979285+0000","last_became_active":"2024-09-12T22:06:44.388499+0000","last_became_peered":"2024-09-12T22:06:44.388499+0000","last_unstale":"2024-09-12T22:06:53.979285+0000","last_undegraded":"2024-09-12T22:06:53.979285+0000","last_fullsized":"2024-09-12T22:06:53.979285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:48.397806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980074+0000","last_change":"2024-09-12T22:06:50.419782+0000","last_active":"2024-09-12T22:06:53.980074+0000","last_peered":"2024-09-12T22:06:53.980074+0000","last_clean":"2024-09-12T22:06:53.980074+0000","last_became_active":"2024-09-12T22:06:50.418800+0000","last_became_peered":"2024-09-12T22:06:50.418800+0000","last_unstale":"2024-09-12T22:06:53.980074+0000","last_undegraded":"2024-09-12T22:06:53.980074+0000","last_fullsized":"2024-09-12T22:06:53.980074+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:42:06.678070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978996+0000","last_change":"2024-09-12T22:06:50.418163+0000","last_active":"2024-09-12T22:06:53.978996+0000","last_peered":"2024-09-12T22:06:53.978996+0000","last_clean":"2024-09-12T22:06:53.978996+0000","last_became_active":"2024-09-12T22:06:50.417455+0000","last_became_peered":"2024-09-12T22:06:50.417455+0000","last_unstale":"2024-09-12T22:06:53.978996+0000","last_undegraded":"2024-09-12T22:06:53.978996+0000","last_fullsized":"2024-09-12T22:06:53.978996+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:02:41.699273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035911+0000","last_change":"2024-09-12T22:03:33.465186+0000","last_active":"2024-09-12T22:06:54.035911+0000","last_peered":"2024-09-12T22:06:54.035911+0000","last_clean":"2024-09-12T22:06:54.035911+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:06:54.035911+0000","last_undegraded":"2024-09-12T22:06:54.035911+0000","last_fullsized":"2024-09-12T22:06:54.035911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:29.409225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035270+0000","last_change":"2024-09-12T22:06:44.391108+0000","last_active":"2024-09-12T22:06:54.035270+0000","last_peered":"2024-09-12T22:06:54.035270+0000","last_clean":"2024-09-12T22:06:54.035270+0000","last_became_active":"2024-09-12T22:06:44.390719+0000","last_became_peered":"2024-09-12T22:06:44.390719+0000","last_unstale":"2024-09-12T22:06:54.035270+0000","last_undegraded":"2024-09-12T22:06:54.035270+0000","last_fullsized":"2024-09-12T22:06:54.035270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:19.780194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035404+0000","last_change":"2024-09-12T22:06:44.392898+0000","last_active":"2024-09-12T22:06:54.035404+0000","last_peered":"2024-09-12T22:06:54.035404+0000","last_clean":"2024-09-12T22:06:54.035404+0000","last_became_active":"2024-09-12T22:06:44.392160+0000","last_became_peered":"2024-09-12T22:06:44.392160+0000","last_unstale":"2024-09-12T22:06:54.035404+0000","last_undegraded":"2024-09-12T22:06:54.035404+0000","last_fullsized":"2024-09-12T22:06:54.035404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:15:25.344346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035083+0000","last_change":"2024-09-12T22:06:50.419266+0000","last_active":"2024-09-12T22:06:54.035083+0000","last_peered":"2024-09-12T22:06:54.035083+0000","last_clean":"2024-09-12T22:06:54.035083+0000","last_became_active":"2024-09-12T22:06:50.418834+0000","last_became_peered":"2024-09-12T22:06:50.418834+0000","last_unstale":"2024-09-12T22:06:54.035083+0000","last_undegraded":"2024-09-12T22:06:54.035083+0000","last_fullsized":"2024-09-12T22:06:54.035083+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:32.300720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979215+0000","last_change":"2024-09-12T22:06:50.420055+0000","last_active":"2024-09-12T22:06:53.979215+0000","last_peered":"2024-09-12T22:06:53.979215+0000","last_clean":"2024-09-12T22:06:53.979215+0000","last_became_active":"2024-09-12T22:06:50.418856+0000","last_became_peered":"2024-09-12T22:06:50.418856+0000","last_unstale":"2024-09-12T22:06:53.979215+0000","last_undegraded":"2024-09-12T22:06:53.979215+0000","last_fullsized":"2024-09-12T22:06:53.979215+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:42.010524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980021+0000","last_change":"2024-09-12T22:06:50.439495+0000","last_active":"2024-09-12T22:06:53.980021+0000","last_peered":"2024-09-12T22:06:53.980021+0000","last_clean":"2024-09-12T22:06:53.980021+0000","last_became_active":"2024-09-12T22:06:50.421034+0000","last_became_peered":"2024-09-12T22:06:50.421034+0000","last_unstale":"2024-09-12T22:06:53.980021+0000","last_undegraded":"2024-09-12T22:06:53.980021+0000","last_fullsized":"2024-09-12T22:06:53.980021+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:46.276197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979173+0000","last_change":"2024-09-12T22:06:50.420937+0000","last_active":"2024-09-12T22:06:53.979173+0000","last_peered":"2024-09-12T22:06:53.979173+0000","last_clean":"2024-09-12T22:06:53.979173+0000","last_became_active":"2024-09-12T22:06:50.419417+0000","last_became_peered":"2024-09-12T22:06:50.419417+0000","last_unstale":"2024-09-12T22:06:53.979173+0000","last_undegraded":"2024-09-12T22:06:53.979173+0000","last_fullsized":"2024-09-12T22:06:53.979173+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:01:48.684913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035839+0000","last_change":"2024-09-12T22:03:32.461230+0000","last_active":"2024-09-12T22:06:54.035839+0000","last_peered":"2024-09-12T22:06:54.035839+0000","last_clean":"2024-09-12T22:06:54.035839+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:06:54.035839+0000","last_undegraded":"2024-09-12T22:06:54.035839+0000","last_fullsized":"2024-09-12T22:06:54.035839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:16.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035299+0000","last_change":"2024-09-12T22:06:44.392598+0000","last_active":"2024-09-12T22:06:54.035299+0000","last_peered":"2024-09-12T22:06:54.035299+0000","last_clean":"2024-09-12T22:06:54.035299+0000","last_became_active":"2024-09-12T22:06:44.392020+0000","last_became_peered":"2024-09-12T22:06:44.392020+0000","last_unstale":"2024-09-12T22:06:54.035299+0000","last_undegraded":"2024-09-12T22:06:54.035299+0000","last_fullsized":"2024-09-12T22:06:54.035299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:01.708696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979850+0000","last_change":"2024-09-12T22:06:44.394611+0000","last_active":"2024-09-12T22:06:53.979850+0000","last_peered":"2024-09-12T22:06:53.979850+0000","last_clean":"2024-09-12T22:06:53.979850+0000","last_became_active":"2024-09-12T22:06:44.394195+0000","last_became_peered":"2024-09-12T22:06:44.394195+0000","last_unstale":"2024-09-12T22:06:53.979850+0000","last_undegraded":"2024-09-12T22:06:53.979850+0000","last_fullsized":"2024-09-12T22:06:53.979850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:53.173265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978895+0000","last_change":"2024-09-12T22:06:50.421136+0000","last_active":"2024-09-12T22:06:53.978895+0000","last_peered":"2024-09-12T22:06:53.978895+0000","last_clean":"2024-09-12T22:06:53.978895+0000","last_became_active":"2024-09-12T22:06:50.420176+0000","last_became_peered":"2024-09-12T22:06:50.420176+0000","last_unstale":"2024-09-12T22:06:53.978895+0000","last_undegraded":"2024-09-12T22:06:53.978895+0000","last_fullsized":"2024-09-12T22:06:53.978895+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:24.868192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980485+0000","last_change":"2024-09-12T22:06:50.433450+0000","last_active":"2024-09-12T22:06:53.980485+0000","last_peered":"2024-09-12T22:06:53.980485+0000","last_clean":"2024-09-12T22:06:53.980485+0000","last_became_active":"2024-09-12T22:06:50.417229+0000","last_became_peered":"2024-09-12T22:06:50.417229+0000","last_unstale":"2024-09-12T22:06:53.980485+0000","last_undegraded":"2024-09-12T22:06:53.980485+0000","last_fullsized":"2024-09-12T22:06:53.980485+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:38.255675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2430,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705712,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":564512,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":562878,"kb_avail":93807328,"statfs":{"total":96636764160,"available":96058703872,"internally_reserved":0,"allocated":1646592,"data_stored":1060429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576387525},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705712,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411820,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":410174,"kb_avail":93960020,"statfs":{"total":96636764160,"available":96215060480,"internally_reserved":0,"allocated":1658880,"data_stored":1061064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":420018629},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285573,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50700,"kb_used_data":1016,"kb_used_omap":6,"kb_used_meta":49657,"kb_avail":94321140,"statfs":{"total":96636764160,"available":96584847360,"internally_reserved":0,"allocated":1040384,"data_stored":468902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6904,"internal_metadata":50849032},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:06:59.533 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:06:59.533 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:06:59.863 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:06:59.864 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:06:59.874 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-09-12T22:06:58.287908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":592798,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1027032,"kb_used_data":4244,"kb_used_omap":9,"kb_used_meta":1022710,"kb_avail":282088488,"statfs":{"total":289910292480,"available":288858611712,"internally_reserved":0,"allocated":4345856,"data_stored":2590395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10094,"internal_metadata":1047255186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":706,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.316394"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035891+0000","last_change":"2024-09-12T22:06:44.391498+0000","last_active":"2024-09-12T22:06:54.035891+0000","last_peered":"2024-09-12T22:06:54.035891+0000","last_clean":"2024-09-12T22:06:54.035891+0000","last_became_active":"2024-09-12T22:06:44.391100+0000","last_became_peered":"2024-09-12T22:06:44.391100+0000","last_unstale":"2024-09-12T22:06:54.035891+0000","last_undegraded":"2024-09-12T22:06:54.035891+0000","last_fullsized":"2024-09-12T22:06:54.035891+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:04.380570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.036011+0000","last_change":"2024-09-12T22:06:44.392987+0000","last_active":"2024-09-12T22:06:54.036011+0000","last_peered":"2024-09-12T22:06:54.036011+0000","last_clean":"2024-09-12T22:06:54.036011+0000","last_became_active":"2024-09-12T22:06:44.392188+0000","last_became_peered":"2024-09-12T22:06:44.392188+0000","last_unstale":"2024-09-12T22:06:54.036011+0000","last_undegraded":"2024-09-12T22:06:54.036011+0000","last_fullsized":"2024-09-12T22:06:54.036011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:36.209594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979690+0000","last_change":"2024-09-12T22:03:33.462148+0000","last_active":"2024-09-12T22:06:53.979690+0000","last_peered":"2024-09-12T22:06:53.979690+0000","last_clean":"2024-09-12T22:06:53.979690+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:06:53.979690+0000","last_undegraded":"2024-09-12T22:06:53.979690+0000","last_fullsized":"2024-09-12T22:06:53.979690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:36.909948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979484+0000","last_change":"2024-09-12T22:06:50.419886+0000","last_active":"2024-09-12T22:06:53.979484+0000","last_peered":"2024-09-12T22:06:53.979484+0000","last_clean":"2024-09-12T22:06:53.979484+0000","last_became_active":"2024-09-12T22:06:50.419429+0000","last_became_peered":"2024-09-12T22:06:50.419429+0000","last_unstale":"2024-09-12T22:06:53.979484+0000","last_undegraded":"2024-09-12T22:06:53.979484+0000","last_fullsized":"2024-09-12T22:06:53.979484+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:16.917462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035121+0000","last_change":"2024-09-12T22:06:44.392862+0000","last_active":"2024-09-12T22:06:54.035121+0000","last_peered":"2024-09-12T22:06:54.035121+0000","last_clean":"2024-09-12T22:06:54.035121+0000","last_became_active":"2024-09-12T22:06:44.391774+0000","last_became_peered":"2024-09-12T22:06:44.391774+0000","last_unstale":"2024-09-12T22:06:54.035121+0000","last_undegraded":"2024-09-12T22:06:54.035121+0000","last_fullsized":"2024-09-12T22:06:54.035121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:09.703417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979018+0000","last_change":"2024-09-12T22:06:50.414892+0000","last_active":"2024-09-12T22:06:53.979018+0000","last_peered":"2024-09-12T22:06:53.979018+0000","last_clean":"2024-09-12T22:06:53.979018+0000","last_became_active":"2024-09-12T22:06:50.414526+0000","last_became_peered":"2024-09-12T22:06:50.414526+0000","last_unstale":"2024-09-12T22:06:53.979018+0000","last_undegraded":"2024-09-12T22:06:53.979018+0000","last_fullsized":"2024-09-12T22:06:53.979018+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:29.766297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979359+0000","last_change":"2024-09-12T22:06:44.421423+0000","last_active":"2024-09-12T22:06:53.979359+0000","last_peered":"2024-09-12T22:06:53.979359+0000","last_clean":"2024-09-12T22:06:53.979359+0000","last_became_active":"2024-09-12T22:06:44.421094+0000","last_became_peered":"2024-09-12T22:06:44.421094+0000","last_unstale":"2024-09-12T22:06:53.979359+0000","last_undegraded":"2024-09-12T22:06:53.979359+0000","last_fullsized":"2024-09-12T22:06:53.979359+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:48.618058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979320+0000","last_change":"2024-09-12T22:06:44.395363+0000","last_active":"2024-09-12T22:06:53.979320+0000","last_peered":"2024-09-12T22:06:53.979320+0000","last_clean":"2024-09-12T22:06:53.979320+0000","last_became_active":"2024-09-12T22:06:44.394804+0000","last_became_peered":"2024-09-12T22:06:44.394804+0000","last_unstale":"2024-09-12T22:06:53.979320+0000","last_undegraded":"2024-09-12T22:06:53.979320+0000","last_fullsized":"2024-09-12T22:06:53.979320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:18.826036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980197+0000","last_change":"2024-09-12T22:06:44.390017+0000","last_active":"2024-09-12T22:06:53.980197+0000","last_peered":"2024-09-12T22:06:53.980197+0000","last_clean":"2024-09-12T22:06:53.980197+0000","last_became_active":"2024-09-12T22:06:44.389256+0000","last_became_peered":"2024-09-12T22:06:44.389256+0000","last_unstale":"2024-09-12T22:06:53.980197+0000","last_undegraded":"2024-09-12T22:06:53.980197+0000","last_fullsized":"2024-09-12T22:06:53.980197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:48.669357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035877+0000","last_change":"2024-09-12T22:06:44.392599+0000","last_active":"2024-09-12T22:06:54.035877+0000","last_peered":"2024-09-12T22:06:54.035877+0000","last_clean":"2024-09-12T22:06:54.035877+0000","last_became_active":"2024-09-12T22:06:44.391572+0000","last_became_peered":"2024-09-12T22:06:44.391572+0000","last_unstale":"2024-09-12T22:06:54.035877+0000","last_undegraded":"2024-09-12T22:06:54.035877+0000","last_fullsized":"2024-09-12T22:06:54.035877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:41.342271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979365+0000","last_change":"2024-09-12T22:06:50.420008+0000","last_active":"2024-09-12T22:06:53.979365+0000","last_peered":"2024-09-12T22:06:53.979365+0000","last_clean":"2024-09-12T22:06:53.979365+0000","last_became_active":"2024-09-12T22:06:50.419042+0000","last_became_peered":"2024-09-12T22:06:50.419042+0000","last_unstale":"2024-09-12T22:06:53.979365+0000","last_undegraded":"2024-09-12T22:06:53.979365+0000","last_fullsized":"2024-09-12T22:06:53.979365+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:39.365289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035352+0000","last_change":"2024-09-12T22:03:33.465069+0000","last_active":"2024-09-12T22:06:54.035352+0000","last_peered":"2024-09-12T22:06:54.035352+0000","last_clean":"2024-09-12T22:06:54.035352+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:06:54.035352+0000","last_undegraded":"2024-09-12T22:06:54.035352+0000","last_fullsized":"2024-09-12T22:06:54.035352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035321+0000","last_change":"2024-09-12T22:06:44.392909+0000","last_active":"2024-09-12T22:06:54.035321+0000","last_peered":"2024-09-12T22:06:54.035321+0000","last_clean":"2024-09-12T22:06:54.035321+0000","last_became_active":"2024-09-12T22:06:44.392491+0000","last_became_peered":"2024-09-12T22:06:44.392491+0000","last_unstale":"2024-09-12T22:06:54.035321+0000","last_undegraded":"2024-09-12T22:06:54.035321+0000","last_fullsized":"2024-09-12T22:06:54.035321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:09.585700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979180+0000","last_change":"2024-09-12T22:06:50.419973+0000","last_active":"2024-09-12T22:06:53.979180+0000","last_peered":"2024-09-12T22:06:53.979180+0000","last_clean":"2024-09-12T22:06:53.979180+0000","last_became_active":"2024-09-12T22:06:50.418325+0000","last_became_peered":"2024-09-12T22:06:50.418325+0000","last_unstale":"2024-09-12T22:06:53.979180+0000","last_undegraded":"2024-09-12T22:06:53.979180+0000","last_fullsized":"2024-09-12T22:06:53.979180+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:02.303968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979112+0000","last_change":"2024-09-12T22:06:50.419011+0000","last_active":"2024-09-12T22:06:53.979112+0000","last_peered":"2024-09-12T22:06:53.979112+0000","last_clean":"2024-09-12T22:06:53.979112+0000","last_became_active":"2024-09-12T22:06:50.418075+0000","last_became_peered":"2024-09-12T22:06:50.418075+0000","last_unstale":"2024-09-12T22:06:53.979112+0000","last_undegraded":"2024-09-12T22:06:53.979112+0000","last_fullsized":"2024-09-12T22:06:53.979112+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:16.440226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979399+0000","last_change":"2024-09-12T22:06:44.395099+0000","last_active":"2024-09-12T22:06:53.979399+0000","last_peered":"2024-09-12T22:06:53.979399+0000","last_clean":"2024-09-12T22:06:53.979399+0000","last_became_active":"2024-09-12T22:06:44.394486+0000","last_became_peered":"2024-09-12T22:06:44.394486+0000","last_unstale":"2024-09-12T22:06:53.979399+0000","last_undegraded":"2024-09-12T22:06:53.979399+0000","last_fullsized":"2024-09-12T22:06:53.979399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:47.461701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980180+0000","last_change":"2024-09-12T22:06:44.390021+0000","last_active":"2024-09-12T22:06:53.980180+0000","last_peered":"2024-09-12T22:06:53.980180+0000","last_clean":"2024-09-12T22:06:53.980180+0000","last_became_active":"2024-09-12T22:06:44.388967+0000","last_became_peered":"2024-09-12T22:06:44.388967+0000","last_unstale":"2024-09-12T22:06:53.980180+0000","last_undegraded":"2024-09-12T22:06:53.980180+0000","last_fullsized":"2024-09-12T22:06:53.980180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:15.769587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035728+0000","last_change":"2024-09-12T22:06:44.391191+0000","last_active":"2024-09-12T22:06:54.035728+0000","last_peered":"2024-09-12T22:06:54.035728+0000","last_clean":"2024-09-12T22:06:54.035728+0000","last_became_active":"2024-09-12T22:06:44.390858+0000","last_became_peered":"2024-09-12T22:06:44.390858+0000","last_unstale":"2024-09-12T22:06:54.035728+0000","last_undegraded":"2024-09-12T22:06:54.035728+0000","last_fullsized":"2024-09-12T22:06:54.035728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:30.878874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979804+0000","last_change":"2024-09-12T22:06:44.389205+0000","last_active":"2024-09-12T22:06:53.979804+0000","last_peered":"2024-09-12T22:06:53.979804+0000","last_clean":"2024-09-12T22:06:53.979804+0000","last_became_active":"2024-09-12T22:06:44.388761+0000","last_became_peered":"2024-09-12T22:06:44.388761+0000","last_unstale":"2024-09-12T22:06:53.979804+0000","last_undegraded":"2024-09-12T22:06:53.979804+0000","last_fullsized":"2024-09-12T22:06:53.979804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:31.790297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980172+0000","last_change":"2024-09-12T22:06:44.421429+0000","last_active":"2024-09-12T22:06:53.980172+0000","last_peered":"2024-09-12T22:06:53.980172+0000","last_clean":"2024-09-12T22:06:53.980172+0000","last_became_active":"2024-09-12T22:06:44.420768+0000","last_became_peered":"2024-09-12T22:06:44.420768+0000","last_unstale":"2024-09-12T22:06:53.980172+0000","last_undegraded":"2024-09-12T22:06:53.980172+0000","last_fullsized":"2024-09-12T22:06:53.980172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:25.634497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979404+0000","last_change":"2024-09-12T22:06:50.422914+0000","last_active":"2024-09-12T22:06:53.979404+0000","last_peered":"2024-09-12T22:06:53.979404+0000","last_clean":"2024-09-12T22:06:53.979404+0000","last_became_active":"2024-09-12T22:06:50.421758+0000","last_became_peered":"2024-09-12T22:06:50.421758+0000","last_unstale":"2024-09-12T22:06:53.979404+0000","last_undegraded":"2024-09-12T22:06:53.979404+0000","last_fullsized":"2024-09-12T22:06:53.979404+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:02.122833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035141+0000","last_change":"2024-09-12T22:03:33.460994+0000","last_active":"2024-09-12T22:06:54.035141+0000","last_peered":"2024-09-12T22:06:54.035141+0000","last_clean":"2024-09-12T22:06:54.035141+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:06:54.035141+0000","last_undegraded":"2024-09-12T22:06:54.035141+0000","last_fullsized":"2024-09-12T22:06:54.035141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:20.363291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979143+0000","last_change":"2024-09-12T22:06:50.417908+0000","last_active":"2024-09-12T22:06:53.979143+0000","last_peered":"2024-09-12T22:06:53.979143+0000","last_clean":"2024-09-12T22:06:53.979143+0000","last_became_active":"2024-09-12T22:06:50.416924+0000","last_became_peered":"2024-09-12T22:06:50.416924+0000","last_unstale":"2024-09-12T22:06:53.979143+0000","last_undegraded":"2024-09-12T22:06:53.979143+0000","last_fullsized":"2024-09-12T22:06:53.979143+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:28.247991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034792+0000","last_change":"2024-09-12T22:06:44.391876+0000","last_active":"2024-09-12T22:06:54.034792+0000","last_peered":"2024-09-12T22:06:54.034792+0000","last_clean":"2024-09-12T22:06:54.034792+0000","last_became_active":"2024-09-12T22:06:44.391480+0000","last_became_peered":"2024-09-12T22:06:44.391480+0000","last_unstale":"2024-09-12T22:06:54.034792+0000","last_undegraded":"2024-09-12T22:06:54.034792+0000","last_fullsized":"2024-09-12T22:06:54.034792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:43.161300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035981+0000","last_change":"2024-09-12T22:06:50.420130+0000","last_active":"2024-09-12T22:06:54.035981+0000","last_peered":"2024-09-12T22:06:54.035981+0000","last_clean":"2024-09-12T22:06:54.035981+0000","last_became_active":"2024-09-12T22:06:50.419573+0000","last_became_peered":"2024-09-12T22:06:50.419573+0000","last_unstale":"2024-09-12T22:06:54.035981+0000","last_undegraded":"2024-09-12T22:06:54.035981+0000","last_fullsized":"2024-09-12T22:06:54.035981+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:31.160831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980210+0000","last_change":"2024-09-12T22:06:50.420167+0000","last_active":"2024-09-12T22:06:53.980210+0000","last_peered":"2024-09-12T22:06:53.980210+0000","last_clean":"2024-09-12T22:06:53.980210+0000","last_became_active":"2024-09-12T22:06:50.419348+0000","last_became_peered":"2024-09-12T22:06:50.419348+0000","last_unstale":"2024-09-12T22:06:53.980210+0000","last_undegraded":"2024-09-12T22:06:53.980210+0000","last_fullsized":"2024-09-12T22:06:53.980210+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:19.786252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979690+0000","last_change":"2024-09-12T22:03:33.461282+0000","last_active":"2024-09-12T22:06:53.979690+0000","last_peered":"2024-09-12T22:06:53.979690+0000","last_clean":"2024-09-12T22:06:53.979690+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:06:53.979690+0000","last_undegraded":"2024-09-12T22:06:53.979690+0000","last_fullsized":"2024-09-12T22:06:53.979690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:32.302716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035627+0000","last_change":"2024-09-12T22:06:50.419329+0000","last_active":"2024-09-12T22:06:54.035627+0000","last_peered":"2024-09-12T22:06:54.035627+0000","last_clean":"2024-09-12T22:06:54.035627+0000","last_became_active":"2024-09-12T22:06:50.418755+0000","last_became_peered":"2024-09-12T22:06:50.418755+0000","last_unstale":"2024-09-12T22:06:54.035627+0000","last_undegraded":"2024-09-12T22:06:54.035627+0000","last_fullsized":"2024-09-12T22:06:54.035627+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:02.572755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979812+0000","last_change":"2024-09-12T22:06:44.397630+0000","last_active":"2024-09-12T22:06:53.979812+0000","last_peered":"2024-09-12T22:06:53.979812+0000","last_clean":"2024-09-12T22:06:53.979812+0000","last_became_active":"2024-09-12T22:06:44.397198+0000","last_became_peered":"2024-09-12T22:06:44.397198+0000","last_unstale":"2024-09-12T22:06:53.979812+0000","last_undegraded":"2024-09-12T22:06:53.979812+0000","last_fullsized":"2024-09-12T22:06:53.979812+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:31.843174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035267+0000","last_change":"2024-09-12T22:03:33.456842+0000","last_active":"2024-09-12T22:06:54.035267+0000","last_peered":"2024-09-12T22:06:54.035267+0000","last_clean":"2024-09-12T22:06:54.035267+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:06:54.035267+0000","last_undegraded":"2024-09-12T22:06:54.035267+0000","last_fullsized":"2024-09-12T22:06:54.035267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:56.383351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979590+0000","last_change":"2024-09-12T22:06:44.397416+0000","last_active":"2024-09-12T22:06:53.979590+0000","last_peered":"2024-09-12T22:06:53.979590+0000","last_clean":"2024-09-12T22:06:53.979590+0000","last_became_active":"2024-09-12T22:06:44.397074+0000","last_became_peered":"2024-09-12T22:06:44.397074+0000","last_unstale":"2024-09-12T22:06:53.979590+0000","last_undegraded":"2024-09-12T22:06:53.979590+0000","last_fullsized":"2024-09-12T22:06:53.979590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.834005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978818+0000","last_change":"2024-09-12T22:06:50.414965+0000","last_active":"2024-09-12T22:06:53.978818+0000","last_peered":"2024-09-12T22:06:53.978818+0000","last_clean":"2024-09-12T22:06:53.978818+0000","last_became_active":"2024-09-12T22:06:50.414626+0000","last_became_peered":"2024-09-12T22:06:50.414626+0000","last_unstale":"2024-09-12T22:06:53.978818+0000","last_undegraded":"2024-09-12T22:06:53.978818+0000","last_fullsized":"2024-09-12T22:06:53.978818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:30.619121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035494+0000","last_change":"2024-09-12T22:06:44.391923+0000","last_active":"2024-09-12T22:06:54.035494+0000","last_peered":"2024-09-12T22:06:54.035494+0000","last_clean":"2024-09-12T22:06:54.035494+0000","last_became_active":"2024-09-12T22:06:44.391447+0000","last_became_peered":"2024-09-12T22:06:44.391447+0000","last_unstale":"2024-09-12T22:06:54.035494+0000","last_undegraded":"2024-09-12T22:06:54.035494+0000","last_fullsized":"2024-09-12T22:06:54.035494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:32.308333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979499+0000","last_change":"2024-09-12T22:06:50.442693+0000","last_active":"2024-09-12T22:06:53.979499+0000","last_peered":"2024-09-12T22:06:53.979499+0000","last_clean":"2024-09-12T22:06:53.979499+0000","last_became_active":"2024-09-12T22:06:50.422232+0000","last_became_peered":"2024-09-12T22:06:50.422232+0000","last_unstale":"2024-09-12T22:06:53.979499+0000","last_undegraded":"2024-09-12T22:06:53.979499+0000","last_fullsized":"2024-09-12T22:06:53.979499+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:40.705556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035690+0000","last_change":"2024-09-12T22:06:44.390974+0000","last_active":"2024-09-12T22:06:54.035690+0000","last_peered":"2024-09-12T22:06:54.035690+0000","last_clean":"2024-09-12T22:06:54.035690+0000","last_became_active":"2024-09-12T22:06:44.390652+0000","last_became_peered":"2024-09-12T22:06:44.390652+0000","last_unstale":"2024-09-12T22:06:54.035690+0000","last_undegraded":"2024-09-12T22:06:54.035690+0000","last_fullsized":"2024-09-12T22:06:54.035690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:41.707065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979208+0000","last_change":"2024-09-12T22:06:50.417649+0000","last_active":"2024-09-12T22:06:53.979208+0000","last_peered":"2024-09-12T22:06:53.979208+0000","last_clean":"2024-09-12T22:06:53.979208+0000","last_became_active":"2024-09-12T22:06:50.417123+0000","last_became_peered":"2024-09-12T22:06:50.417123+0000","last_unstale":"2024-09-12T22:06:53.979208+0000","last_undegraded":"2024-09-12T22:06:53.979208+0000","last_fullsized":"2024-09-12T22:06:53.979208+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:01.612960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980187+0000","last_change":"2024-09-12T22:06:50.419787+0000","last_active":"2024-09-12T22:06:53.980187+0000","last_peered":"2024-09-12T22:06:53.980187+0000","last_clean":"2024-09-12T22:06:53.980187+0000","last_became_active":"2024-09-12T22:06:50.418817+0000","last_became_peered":"2024-09-12T22:06:50.418817+0000","last_unstale":"2024-09-12T22:06:53.980187+0000","last_undegraded":"2024-09-12T22:06:53.980187+0000","last_fullsized":"2024-09-12T22:06:53.980187+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:51.923601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035182+0000","last_change":"2024-09-12T22:06:50.419697+0000","last_active":"2024-09-12T22:06:54.035182+0000","last_peered":"2024-09-12T22:06:54.035182+0000","last_clean":"2024-09-12T22:06:54.035182+0000","last_became_active":"2024-09-12T22:06:50.419047+0000","last_became_peered":"2024-09-12T22:06:50.419047+0000","last_unstale":"2024-09-12T22:06:54.035182+0000","last_undegraded":"2024-09-12T22:06:54.035182+0000","last_fullsized":"2024-09-12T22:06:54.035182+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:31.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980033+0000","last_change":"2024-09-12T22:06:44.422294+0000","last_active":"2024-09-12T22:06:53.980033+0000","last_peered":"2024-09-12T22:06:53.980033+0000","last_clean":"2024-09-12T22:06:53.980033+0000","last_became_active":"2024-09-12T22:06:44.421955+0000","last_became_peered":"2024-09-12T22:06:44.421955+0000","last_unstale":"2024-09-12T22:06:53.980033+0000","last_undegraded":"2024-09-12T22:06:53.980033+0000","last_fullsized":"2024-09-12T22:06:53.980033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:40.047878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979018+0000","last_change":"2024-09-12T22:06:50.432341+0000","last_active":"2024-09-12T22:06:53.979018+0000","last_peered":"2024-09-12T22:06:53.979018+0000","last_clean":"2024-09-12T22:06:53.979018+0000","last_became_active":"2024-09-12T22:06:50.418227+0000","last_became_peered":"2024-09-12T22:06:50.418227+0000","last_unstale":"2024-09-12T22:06:53.979018+0000","last_undegraded":"2024-09-12T22:06:53.979018+0000","last_fullsized":"2024-09-12T22:06:53.979018+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:47.509209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979708+0000","last_change":"2024-09-12T22:06:50.426521+0000","last_active":"2024-09-12T22:06:53.979708+0000","last_peered":"2024-09-12T22:06:53.979708+0000","last_clean":"2024-09-12T22:06:53.979708+0000","last_became_active":"2024-09-12T22:06:50.418222+0000","last_became_peered":"2024-09-12T22:06:50.418222+0000","last_unstale":"2024-09-12T22:06:53.979708+0000","last_undegraded":"2024-09-12T22:06:53.979708+0000","last_fullsized":"2024-09-12T22:06:53.979708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:44.473880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034877+0000","last_change":"2024-09-12T22:03:33.465308+0000","last_active":"2024-09-12T22:06:54.034877+0000","last_peered":"2024-09-12T22:06:54.034877+0000","last_clean":"2024-09-12T22:06:54.034877+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:06:54.034877+0000","last_undegraded":"2024-09-12T22:06:54.034877+0000","last_fullsized":"2024-09-12T22:06:54.034877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:35.733622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035614+0000","last_change":"2024-09-12T22:03:32.461301+0000","last_active":"2024-09-12T22:06:54.035614+0000","last_peered":"2024-09-12T22:06:54.035614+0000","last_clean":"2024-09-12T22:06:54.035614+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:06:54.035614+0000","last_undegraded":"2024-09-12T22:06:54.035614+0000","last_fullsized":"2024-09-12T22:06:54.035614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:39.872272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034942+0000","last_change":"2024-09-12T22:06:44.391249+0000","last_active":"2024-09-12T22:06:54.034942+0000","last_peered":"2024-09-12T22:06:54.034942+0000","last_clean":"2024-09-12T22:06:54.034942+0000","last_became_active":"2024-09-12T22:06:44.390807+0000","last_became_peered":"2024-09-12T22:06:44.390807+0000","last_unstale":"2024-09-12T22:06:54.034942+0000","last_undegraded":"2024-09-12T22:06:54.034942+0000","last_fullsized":"2024-09-12T22:06:54.034942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:07.271893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980057+0000","last_change":"2024-09-12T22:03:32.459540+0000","last_active":"2024-09-12T22:06:53.980057+0000","last_peered":"2024-09-12T22:06:53.980057+0000","last_clean":"2024-09-12T22:06:53.980057+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:06:53.980057+0000","last_undegraded":"2024-09-12T22:06:53.980057+0000","last_fullsized":"2024-09-12T22:06:53.980057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:22.143242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979421+0000","last_change":"2024-09-12T22:06:44.421712+0000","last_active":"2024-09-12T22:06:53.979421+0000","last_peered":"2024-09-12T22:06:53.979421+0000","last_clean":"2024-09-12T22:06:53.979421+0000","last_became_active":"2024-09-12T22:06:44.421388+0000","last_became_peered":"2024-09-12T22:06:44.421388+0000","last_unstale":"2024-09-12T22:06:53.979421+0000","last_undegraded":"2024-09-12T22:06:53.979421+0000","last_fullsized":"2024-09-12T22:06:53.979421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:46.580311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980254+0000","last_change":"2024-09-12T22:06:44.421721+0000","last_active":"2024-09-12T22:06:53.980254+0000","last_peered":"2024-09-12T22:06:53.980254+0000","last_clean":"2024-09-12T22:06:53.980254+0000","last_became_active":"2024-09-12T22:06:44.421430+0000","last_became_peered":"2024-09-12T22:06:44.421430+0000","last_unstale":"2024-09-12T22:06:53.980254+0000","last_undegraded":"2024-09-12T22:06:53.980254+0000","last_fullsized":"2024-09-12T22:06:53.980254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:57.001470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979284+0000","last_change":"2024-09-12T22:06:44.397808+0000","last_active":"2024-09-12T22:06:53.979284+0000","last_peered":"2024-09-12T22:06:53.979284+0000","last_clean":"2024-09-12T22:06:53.979284+0000","last_became_active":"2024-09-12T22:06:44.397490+0000","last_became_peered":"2024-09-12T22:06:44.397490+0000","last_unstale":"2024-09-12T22:06:53.979284+0000","last_undegraded":"2024-09-12T22:06:53.979284+0000","last_fullsized":"2024-09-12T22:06:53.979284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:38.225078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979537+0000","last_change":"2024-09-12T22:06:50.426880+0000","last_active":"2024-09-12T22:06:53.979537+0000","last_peered":"2024-09-12T22:06:53.979537+0000","last_clean":"2024-09-12T22:06:53.979537+0000","last_became_active":"2024-09-12T22:06:50.417240+0000","last_became_peered":"2024-09-12T22:06:50.417240+0000","last_unstale":"2024-09-12T22:06:53.979537+0000","last_undegraded":"2024-09-12T22:06:53.979537+0000","last_fullsized":"2024-09-12T22:06:53.979537+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:24.836682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980207+0000","last_change":"2024-09-12T22:06:44.421723+0000","last_active":"2024-09-12T22:06:53.980207+0000","last_peered":"2024-09-12T22:06:53.980207+0000","last_clean":"2024-09-12T22:06:53.980207+0000","last_became_active":"2024-09-12T22:06:44.421071+0000","last_became_peered":"2024-09-12T22:06:44.421071+0000","last_unstale":"2024-09-12T22:06:53.980207+0000","last_undegraded":"2024-09-12T22:06:53.980207+0000","last_fullsized":"2024-09-12T22:06:53.980207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:16.039319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979544+0000","last_change":"2024-09-12T22:06:50.422136+0000","last_active":"2024-09-12T22:06:53.979544+0000","last_peered":"2024-09-12T22:06:53.979544+0000","last_clean":"2024-09-12T22:06:53.979544+0000","last_became_active":"2024-09-12T22:06:50.421734+0000","last_became_peered":"2024-09-12T22:06:50.421734+0000","last_unstale":"2024-09-12T22:06:53.979544+0000","last_undegraded":"2024-09-12T22:06:53.979544+0000","last_fullsized":"2024-09-12T22:06:53.979544+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:29.450310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979869+0000","last_change":"2024-09-12T22:03:33.459084+0000","last_active":"2024-09-12T22:06:53.979869+0000","last_peered":"2024-09-12T22:06:53.979869+0000","last_clean":"2024-09-12T22:06:53.979869+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:06:53.979869+0000","last_undegraded":"2024-09-12T22:06:53.979869+0000","last_fullsized":"2024-09-12T22:06:53.979869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:50.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035351+0000","last_change":"2024-09-12T22:03:32.461417+0000","last_active":"2024-09-12T22:06:54.035351+0000","last_peered":"2024-09-12T22:06:54.035351+0000","last_clean":"2024-09-12T22:06:54.035351+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:06:54.035351+0000","last_undegraded":"2024-09-12T22:06:54.035351+0000","last_fullsized":"2024-09-12T22:06:54.035351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:22.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979869+0000","last_change":"2024-09-12T22:06:50.419560+0000","last_active":"2024-09-12T22:06:53.979869+0000","last_peered":"2024-09-12T22:06:53.979869+0000","last_clean":"2024-09-12T22:06:53.979869+0000","last_became_active":"2024-09-12T22:06:50.418648+0000","last_became_peered":"2024-09-12T22:06:50.418648+0000","last_unstale":"2024-09-12T22:06:53.979869+0000","last_undegraded":"2024-09-12T22:06:53.979869+0000","last_fullsized":"2024-09-12T22:06:53.979869+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:58.944327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034997+0000","last_change":"2024-09-12T22:06:44.391442+0000","last_active":"2024-09-12T22:06:54.034997+0000","last_peered":"2024-09-12T22:06:54.034997+0000","last_clean":"2024-09-12T22:06:54.034997+0000","last_became_active":"2024-09-12T22:06:44.391078+0000","last_became_peered":"2024-09-12T22:06:44.391078+0000","last_unstale":"2024-09-12T22:06:54.034997+0000","last_undegraded":"2024-09-12T22:06:54.034997+0000","last_fullsized":"2024-09-12T22:06:54.034997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:26.602771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980404+0000","last_change":"2024-09-12T22:06:44.397142+0000","last_active":"2024-09-12T22:06:53.980404+0000","last_peered":"2024-09-12T22:06:53.980404+0000","last_clean":"2024-09-12T22:06:53.980404+0000","last_became_active":"2024-09-12T22:06:44.396783+0000","last_became_peered":"2024-09-12T22:06:44.396783+0000","last_unstale":"2024-09-12T22:06:53.980404+0000","last_undegraded":"2024-09-12T22:06:53.980404+0000","last_fullsized":"2024-09-12T22:06:53.980404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:27.631274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":315,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979021+0000","last_change":"2024-09-12T22:06:52.982526+0000","last_active":"2024-09-12T22:06:53.979021+0000","last_peered":"2024-09-12T22:06:53.979021+0000","last_clean":"2024-09-12T22:06:53.979021+0000","last_became_active":"2024-09-12T22:06:52.982174+0000","last_became_peered":"2024-09-12T22:06:52.982174+0000","last_unstale":"2024-09-12T22:06:53.979021+0000","last_undegraded":"2024-09-12T22:06:53.979021+0000","last_fullsized":"2024-09-12T22:06:53.979021+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:20.744009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979737+0000","last_change":"2024-09-12T22:06:50.444340+0000","last_active":"2024-09-12T22:06:53.979737+0000","last_peered":"2024-09-12T22:06:53.979737+0000","last_clean":"2024-09-12T22:06:53.979737+0000","last_became_active":"2024-09-12T22:06:50.422353+0000","last_became_peered":"2024-09-12T22:06:50.422353+0000","last_unstale":"2024-09-12T22:06:53.979737+0000","last_undegraded":"2024-09-12T22:06:53.979737+0000","last_fullsized":"2024-09-12T22:06:53.979737+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.662733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979420+0000","last_change":"2024-09-12T22:06:44.397029+0000","last_active":"2024-09-12T22:06:53.979420+0000","last_peered":"2024-09-12T22:06:53.979420+0000","last_clean":"2024-09-12T22:06:53.979420+0000","last_became_active":"2024-09-12T22:06:44.396659+0000","last_became_peered":"2024-09-12T22:06:44.396659+0000","last_unstale":"2024-09-12T22:06:53.979420+0000","last_undegraded":"2024-09-12T22:06:53.979420+0000","last_fullsized":"2024-09-12T22:06:53.979420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:07.404782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979992+0000","last_change":"2024-09-12T22:06:50.418936+0000","last_active":"2024-09-12T22:06:53.979992+0000","last_peered":"2024-09-12T22:06:53.979992+0000","last_clean":"2024-09-12T22:06:53.979992+0000","last_became_active":"2024-09-12T22:06:50.418443+0000","last_became_peered":"2024-09-12T22:06:50.418443+0000","last_unstale":"2024-09-12T22:06:53.979992+0000","last_undegraded":"2024-09-12T22:06:53.979992+0000","last_fullsized":"2024-09-12T22:06:53.979992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:40.432871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978897+0000","last_change":"2024-09-12T22:06:50.419409+0000","last_active":"2024-09-12T22:06:53.978897+0000","last_peered":"2024-09-12T22:06:53.978897+0000","last_clean":"2024-09-12T22:06:53.978897+0000","last_became_active":"2024-09-12T22:06:50.418160+0000","last_became_peered":"2024-09-12T22:06:50.418160+0000","last_unstale":"2024-09-12T22:06:53.978897+0000","last_undegraded":"2024-09-12T22:06:53.978897+0000","last_fullsized":"2024-09-12T22:06:53.978897+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:48.881995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978987+0000","last_change":"2024-09-12T22:06:44.396692+0000","last_active":"2024-09-12T22:06:53.978987+0000","last_peered":"2024-09-12T22:06:53.978987+0000","last_clean":"2024-09-12T22:06:53.978987+0000","last_became_active":"2024-09-12T22:06:44.396378+0000","last_became_peered":"2024-09-12T22:06:44.396378+0000","last_unstale":"2024-09-12T22:06:53.978987+0000","last_undegraded":"2024-09-12T22:06:53.978987+0000","last_fullsized":"2024-09-12T22:06:53.978987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:06.812790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035774+0000","last_change":"2024-09-12T22:06:44.392705+0000","last_active":"2024-09-12T22:06:54.035774+0000","last_peered":"2024-09-12T22:06:54.035774+0000","last_clean":"2024-09-12T22:06:54.035774+0000","last_became_active":"2024-09-12T22:06:44.391809+0000","last_became_peered":"2024-09-12T22:06:44.391809+0000","last_unstale":"2024-09-12T22:06:54.035774+0000","last_undegraded":"2024-09-12T22:06:54.035774+0000","last_fullsized":"2024-09-12T22:06:54.035774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:48.022906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979322+0000","last_change":"2024-09-12T22:06:44.397296+0000","last_active":"2024-09-12T22:06:53.979322+0000","last_peered":"2024-09-12T22:06:53.979322+0000","last_clean":"2024-09-12T22:06:53.979322+0000","last_became_active":"2024-09-12T22:06:44.396596+0000","last_became_peered":"2024-09-12T22:06:44.396596+0000","last_unstale":"2024-09-12T22:06:53.979322+0000","last_undegraded":"2024-09-12T22:06:53.979322+0000","last_fullsized":"2024-09-12T22:06:53.979322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:25.702361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035014+0000","last_change":"2024-09-12T22:06:50.419281+0000","last_active":"2024-09-12T22:06:54.035014+0000","last_peered":"2024-09-12T22:06:54.035014+0000","last_clean":"2024-09-12T22:06:54.035014+0000","last_became_active":"2024-09-12T22:06:50.418876+0000","last_became_peered":"2024-09-12T22:06:50.418876+0000","last_unstale":"2024-09-12T22:06:54.035014+0000","last_undegraded":"2024-09-12T22:06:54.035014+0000","last_fullsized":"2024-09-12T22:06:54.035014+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:14.574566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980382+0000","last_change":"2024-09-12T22:06:44.390385+0000","last_active":"2024-09-12T22:06:53.980382+0000","last_peered":"2024-09-12T22:06:53.980382+0000","last_clean":"2024-09-12T22:06:53.980382+0000","last_became_active":"2024-09-12T22:06:44.389680+0000","last_became_peered":"2024-09-12T22:06:44.389680+0000","last_unstale":"2024-09-12T22:06:53.980382+0000","last_undegraded":"2024-09-12T22:06:53.980382+0000","last_fullsized":"2024-09-12T22:06:53.980382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:28.579444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":183,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979720+0000","last_change":"2024-09-12T22:06:44.421429+0000","last_active":"2024-09-12T22:06:53.979720+0000","last_peered":"2024-09-12T22:06:53.979720+0000","last_clean":"2024-09-12T22:06:53.979720+0000","last_became_active":"2024-09-12T22:06:44.421088+0000","last_became_peered":"2024-09-12T22:06:44.421088+0000","last_unstale":"2024-09-12T22:06:53.979720+0000","last_undegraded":"2024-09-12T22:06:53.979720+0000","last_fullsized":"2024-09-12T22:06:53.979720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:29.121518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979693+0000","last_change":"2024-09-12T22:06:50.423638+0000","last_active":"2024-09-12T22:06:53.979693+0000","last_peered":"2024-09-12T22:06:53.979693+0000","last_clean":"2024-09-12T22:06:53.979693+0000","last_became_active":"2024-09-12T22:06:50.423052+0000","last_became_peered":"2024-09-12T22:06:50.423052+0000","last_unstale":"2024-09-12T22:06:53.979693+0000","last_undegraded":"2024-09-12T22:06:53.979693+0000","last_fullsized":"2024-09-12T22:06:53.979693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:49.458146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980024+0000","last_change":"2024-09-12T22:06:44.397769+0000","last_active":"2024-09-12T22:06:53.980024+0000","last_peered":"2024-09-12T22:06:53.980024+0000","last_clean":"2024-09-12T22:06:53.980024+0000","last_became_active":"2024-09-12T22:06:44.397452+0000","last_became_peered":"2024-09-12T22:06:44.397452+0000","last_unstale":"2024-09-12T22:06:53.980024+0000","last_undegraded":"2024-09-12T22:06:53.980024+0000","last_fullsized":"2024-09-12T22:06:53.980024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:56.815006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979460+0000","last_change":"2024-09-12T22:06:50.420039+0000","last_active":"2024-09-12T22:06:53.979460+0000","last_peered":"2024-09-12T22:06:53.979460+0000","last_clean":"2024-09-12T22:06:53.979460+0000","last_became_active":"2024-09-12T22:06:50.419551+0000","last_became_peered":"2024-09-12T22:06:50.419551+0000","last_unstale":"2024-09-12T22:06:53.979460+0000","last_undegraded":"2024-09-12T22:06:53.979460+0000","last_fullsized":"2024-09-12T22:06:53.979460+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:06.211607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980065+0000","last_change":"2024-09-12T22:06:44.397598+0000","last_active":"2024-09-12T22:06:53.980065+0000","last_peered":"2024-09-12T22:06:53.980065+0000","last_clean":"2024-09-12T22:06:53.980065+0000","last_became_active":"2024-09-12T22:06:44.396979+0000","last_became_peered":"2024-09-12T22:06:44.396979+0000","last_unstale":"2024-09-12T22:06:53.980065+0000","last_undegraded":"2024-09-12T22:06:53.980065+0000","last_fullsized":"2024-09-12T22:06:53.980065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:27.592588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035149+0000","last_change":"2024-09-12T22:06:50.419195+0000","last_active":"2024-09-12T22:06:54.035149+0000","last_peered":"2024-09-12T22:06:54.035149+0000","last_clean":"2024-09-12T22:06:54.035149+0000","last_became_active":"2024-09-12T22:06:50.418763+0000","last_became_peered":"2024-09-12T22:06:50.418763+0000","last_unstale":"2024-09-12T22:06:54.035149+0000","last_undegraded":"2024-09-12T22:06:54.035149+0000","last_fullsized":"2024-09-12T22:06:54.035149+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:15.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979795+0000","last_change":"2024-09-12T22:06:44.389682+0000","last_active":"2024-09-12T22:06:53.979795+0000","last_peered":"2024-09-12T22:06:53.979795+0000","last_clean":"2024-09-12T22:06:53.979795+0000","last_became_active":"2024-09-12T22:06:44.388887+0000","last_became_peered":"2024-09-12T22:06:44.388887+0000","last_unstale":"2024-09-12T22:06:53.979795+0000","last_undegraded":"2024-09-12T22:06:53.979795+0000","last_fullsized":"2024-09-12T22:06:53.979795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:09:27.376344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035461+0000","last_change":"2024-09-12T22:06:44.390603+0000","last_active":"2024-09-12T22:06:54.035461+0000","last_peered":"2024-09-12T22:06:54.035461+0000","last_clean":"2024-09-12T22:06:54.035461+0000","last_became_active":"2024-09-12T22:06:44.390260+0000","last_became_peered":"2024-09-12T22:06:44.390260+0000","last_unstale":"2024-09-12T22:06:54.035461+0000","last_undegraded":"2024-09-12T22:06:54.035461+0000","last_fullsized":"2024-09-12T22:06:54.035461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:42.158737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035313+0000","last_change":"2024-09-12T22:03:33.464893+0000","last_active":"2024-09-12T22:06:54.035313+0000","last_peered":"2024-09-12T22:06:54.035313+0000","last_clean":"2024-09-12T22:06:54.035313+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:06:54.035313+0000","last_undegraded":"2024-09-12T22:06:54.035313+0000","last_fullsized":"2024-09-12T22:06:54.035313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:47.948673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980033+0000","last_change":"2024-09-12T22:06:44.390378+0000","last_active":"2024-09-12T22:06:53.980033+0000","last_peered":"2024-09-12T22:06:53.980033+0000","last_clean":"2024-09-12T22:06:53.980033+0000","last_became_active":"2024-09-12T22:06:44.389622+0000","last_became_peered":"2024-09-12T22:06:44.389622+0000","last_unstale":"2024-09-12T22:06:53.980033+0000","last_undegraded":"2024-09-12T22:06:53.980033+0000","last_fullsized":"2024-09-12T22:06:53.980033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:57.877495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980321+0000","last_change":"2024-09-12T22:06:44.398054+0000","last_active":"2024-09-12T22:06:53.980321+0000","last_peered":"2024-09-12T22:06:53.980321+0000","last_clean":"2024-09-12T22:06:53.980321+0000","last_became_active":"2024-09-12T22:06:44.396735+0000","last_became_peered":"2024-09-12T22:06:44.396735+0000","last_unstale":"2024-09-12T22:06:53.980321+0000","last_undegraded":"2024-09-12T22:06:53.980321+0000","last_fullsized":"2024-09-12T22:06:53.980321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:54:49.919665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979023+0000","last_change":"2024-09-12T22:06:44.422129+0000","last_active":"2024-09-12T22:06:53.979023+0000","last_peered":"2024-09-12T22:06:53.979023+0000","last_clean":"2024-09-12T22:06:53.979023+0000","last_became_active":"2024-09-12T22:06:44.421723+0000","last_became_peered":"2024-09-12T22:06:44.421723+0000","last_unstale":"2024-09-12T22:06:53.979023+0000","last_undegraded":"2024-09-12T22:06:53.979023+0000","last_fullsized":"2024-09-12T22:06:53.979023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:11.198373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980261+0000","last_change":"2024-09-12T22:06:50.435272+0000","last_active":"2024-09-12T22:06:53.980261+0000","last_peered":"2024-09-12T22:06:53.980261+0000","last_clean":"2024-09-12T22:06:53.980261+0000","last_became_active":"2024-09-12T22:06:50.419354+0000","last_became_peered":"2024-09-12T22:06:50.419354+0000","last_unstale":"2024-09-12T22:06:53.980261+0000","last_undegraded":"2024-09-12T22:06:53.980261+0000","last_fullsized":"2024-09-12T22:06:53.980261+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:59.450087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979844+0000","last_change":"2024-09-12T22:06:50.418804+0000","last_active":"2024-09-12T22:06:53.979844+0000","last_peered":"2024-09-12T22:06:53.979844+0000","last_clean":"2024-09-12T22:06:53.979844+0000","last_became_active":"2024-09-12T22:06:50.418444+0000","last_became_peered":"2024-09-12T22:06:50.418444+0000","last_unstale":"2024-09-12T22:06:53.979844+0000","last_undegraded":"2024-09-12T22:06:53.979844+0000","last_fullsized":"2024-09-12T22:06:53.979844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:43.033754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034987+0000","last_change":"2024-09-12T22:06:50.419309+0000","last_active":"2024-09-12T22:06:54.034987+0000","last_peered":"2024-09-12T22:06:54.034987+0000","last_clean":"2024-09-12T22:06:54.034987+0000","last_became_active":"2024-09-12T22:06:50.418591+0000","last_became_peered":"2024-09-12T22:06:50.418591+0000","last_unstale":"2024-09-12T22:06:54.034987+0000","last_undegraded":"2024-09-12T22:06:54.034987+0000","last_fullsized":"2024-09-12T22:06:54.034987+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:23.918205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979863+0000","last_change":"2024-09-12T22:06:50.421370+0000","last_active":"2024-09-12T22:06:53.979863+0000","last_peered":"2024-09-12T22:06:53.979863+0000","last_clean":"2024-09-12T22:06:53.979863+0000","last_became_active":"2024-09-12T22:06:50.419642+0000","last_became_peered":"2024-09-12T22:06:50.419642+0000","last_unstale":"2024-09-12T22:06:53.979863+0000","last_undegraded":"2024-09-12T22:06:53.979863+0000","last_fullsized":"2024-09-12T22:06:53.979863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:13.028012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980078+0000","last_change":"2024-09-12T22:06:50.437734+0000","last_active":"2024-09-12T22:06:53.980078+0000","last_peered":"2024-09-12T22:06:53.980078+0000","last_clean":"2024-09-12T22:06:53.980078+0000","last_became_active":"2024-09-12T22:06:50.420099+0000","last_became_peered":"2024-09-12T22:06:50.420099+0000","last_unstale":"2024-09-12T22:06:53.980078+0000","last_undegraded":"2024-09-12T22:06:53.980078+0000","last_fullsized":"2024-09-12T22:06:53.980078+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:05.638054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034976+0000","last_change":"2024-09-12T22:03:54.194965+0000","last_active":"2024-09-12T22:06:54.034976+0000","last_peered":"2024-09-12T22:06:54.034976+0000","last_clean":"2024-09-12T22:06:54.034976+0000","last_became_active":"2024-09-12T22:03:54.194697+0000","last_became_peered":"2024-09-12T22:03:54.194697+0000","last_unstale":"2024-09-12T22:06:54.034976+0000","last_undegraded":"2024-09-12T22:06:54.034976+0000","last_fullsized":"2024-09-12T22:06:54.034976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:47.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":189,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035598+0000","last_change":"2024-09-12T22:06:50.430086+0000","last_active":"2024-09-12T22:06:54.035598+0000","last_peered":"2024-09-12T22:06:54.035598+0000","last_clean":"2024-09-12T22:06:54.035598+0000","last_became_active":"2024-09-12T22:06:50.423283+0000","last_became_peered":"2024-09-12T22:06:50.423283+0000","last_unstale":"2024-09-12T22:06:54.035598+0000","last_undegraded":"2024-09-12T22:06:54.035598+0000","last_fullsized":"2024-09-12T22:06:54.035598+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:38.836493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979901+0000","last_change":"2024-09-12T22:06:50.421357+0000","last_active":"2024-09-12T22:06:53.979901+0000","last_peered":"2024-09-12T22:06:53.979901+0000","last_clean":"2024-09-12T22:06:53.979901+0000","last_became_active":"2024-09-12T22:06:50.420171+0000","last_became_peered":"2024-09-12T22:06:50.420171+0000","last_unstale":"2024-09-12T22:06:53.979901+0000","last_undegraded":"2024-09-12T22:06:53.979901+0000","last_fullsized":"2024-09-12T22:06:53.979901+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:25.747880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979236+0000","last_change":"2024-09-12T22:06:50.418126+0000","last_active":"2024-09-12T22:06:53.979236+0000","last_peered":"2024-09-12T22:06:53.979236+0000","last_clean":"2024-09-12T22:06:53.979236+0000","last_became_active":"2024-09-12T22:06:50.417583+0000","last_became_peered":"2024-09-12T22:06:50.417583+0000","last_unstale":"2024-09-12T22:06:53.979236+0000","last_undegraded":"2024-09-12T22:06:53.979236+0000","last_fullsized":"2024-09-12T22:06:53.979236+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:17:44.500650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980312+0000","last_change":"2024-09-12T22:06:44.422538+0000","last_active":"2024-09-12T22:06:53.980312+0000","last_peered":"2024-09-12T22:06:53.980312+0000","last_clean":"2024-09-12T22:06:53.980312+0000","last_became_active":"2024-09-12T22:06:44.422217+0000","last_became_peered":"2024-09-12T22:06:44.422217+0000","last_unstale":"2024-09-12T22:06:53.980312+0000","last_undegraded":"2024-09-12T22:06:53.980312+0000","last_fullsized":"2024-09-12T22:06:53.980312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:10.635087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979185+0000","last_change":"2024-09-12T22:06:44.390100+0000","last_active":"2024-09-12T22:06:53.979185+0000","last_peered":"2024-09-12T22:06:53.979185+0000","last_clean":"2024-09-12T22:06:53.979185+0000","last_became_active":"2024-09-12T22:06:44.388560+0000","last_became_peered":"2024-09-12T22:06:44.388560+0000","last_unstale":"2024-09-12T22:06:53.979185+0000","last_undegraded":"2024-09-12T22:06:53.979185+0000","last_fullsized":"2024-09-12T22:06:53.979185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:18.786679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.036028+0000","last_change":"2024-09-12T22:03:33.460177+0000","last_active":"2024-09-12T22:06:54.036028+0000","last_peered":"2024-09-12T22:06:54.036028+0000","last_clean":"2024-09-12T22:06:54.036028+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:06:54.036028+0000","last_undegraded":"2024-09-12T22:06:54.036028+0000","last_fullsized":"2024-09-12T22:06:54.036028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979285+0000","last_change":"2024-09-12T22:06:44.388874+0000","last_active":"2024-09-12T22:06:53.979285+0000","last_peered":"2024-09-12T22:06:53.979285+0000","last_clean":"2024-09-12T22:06:53.979285+0000","last_became_active":"2024-09-12T22:06:44.388499+0000","last_became_peered":"2024-09-12T22:06:44.388499+0000","last_unstale":"2024-09-12T22:06:53.979285+0000","last_undegraded":"2024-09-12T22:06:53.979285+0000","last_fullsized":"2024-09-12T22:06:53.979285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:48.397806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980074+0000","last_change":"2024-09-12T22:06:50.419782+0000","last_active":"2024-09-12T22:06:53.980074+0000","last_peered":"2024-09-12T22:06:53.980074+0000","last_clean":"2024-09-12T22:06:53.980074+0000","last_became_active":"2024-09-12T22:06:50.418800+0000","last_became_peered":"2024-09-12T22:06:50.418800+0000","last_unstale":"2024-09-12T22:06:53.980074+0000","last_undegraded":"2024-09-12T22:06:53.980074+0000","last_fullsized":"2024-09-12T22:06:53.980074+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:42:06.678070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978996+0000","last_change":"2024-09-12T22:06:50.418163+0000","last_active":"2024-09-12T22:06:53.978996+0000","last_peered":"2024-09-12T22:06:53.978996+0000","last_clean":"2024-09-12T22:06:53.978996+0000","last_became_active":"2024-09-12T22:06:50.417455+0000","last_became_peered":"2024-09-12T22:06:50.417455+0000","last_unstale":"2024-09-12T22:06:53.978996+0000","last_undegraded":"2024-09-12T22:06:53.978996+0000","last_fullsized":"2024-09-12T22:06:53.978996+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:02:41.699273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035911+0000","last_change":"2024-09-12T22:03:33.465186+0000","last_active":"2024-09-12T22:06:54.035911+0000","last_peered":"2024-09-12T22:06:54.035911+0000","last_clean":"2024-09-12T22:06:54.035911+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:06:54.035911+0000","last_undegraded":"2024-09-12T22:06:54.035911+0000","last_fullsized":"2024-09-12T22:06:54.035911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:29.409225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035270+0000","last_change":"2024-09-12T22:06:44.391108+0000","last_active":"2024-09-12T22:06:54.035270+0000","last_peered":"2024-09-12T22:06:54.035270+0000","last_clean":"2024-09-12T22:06:54.035270+0000","last_became_active":"2024-09-12T22:06:44.390719+0000","last_became_peered":"2024-09-12T22:06:44.390719+0000","last_unstale":"2024-09-12T22:06:54.035270+0000","last_undegraded":"2024-09-12T22:06:54.035270+0000","last_fullsized":"2024-09-12T22:06:54.035270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:19.780194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035404+0000","last_change":"2024-09-12T22:06:44.392898+0000","last_active":"2024-09-12T22:06:54.035404+0000","last_peered":"2024-09-12T22:06:54.035404+0000","last_clean":"2024-09-12T22:06:54.035404+0000","last_became_active":"2024-09-12T22:06:44.392160+0000","last_became_peered":"2024-09-12T22:06:44.392160+0000","last_unstale":"2024-09-12T22:06:54.035404+0000","last_undegraded":"2024-09-12T22:06:54.035404+0000","last_fullsized":"2024-09-12T22:06:54.035404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:15:25.344346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035083+0000","last_change":"2024-09-12T22:06:50.419266+0000","last_active":"2024-09-12T22:06:54.035083+0000","last_peered":"2024-09-12T22:06:54.035083+0000","last_clean":"2024-09-12T22:06:54.035083+0000","last_became_active":"2024-09-12T22:06:50.418834+0000","last_became_peered":"2024-09-12T22:06:50.418834+0000","last_unstale":"2024-09-12T22:06:54.035083+0000","last_undegraded":"2024-09-12T22:06:54.035083+0000","last_fullsized":"2024-09-12T22:06:54.035083+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:32.300720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979215+0000","last_change":"2024-09-12T22:06:50.420055+0000","last_active":"2024-09-12T22:06:53.979215+0000","last_peered":"2024-09-12T22:06:53.979215+0000","last_clean":"2024-09-12T22:06:53.979215+0000","last_became_active":"2024-09-12T22:06:50.418856+0000","last_became_peered":"2024-09-12T22:06:50.418856+0000","last_unstale":"2024-09-12T22:06:53.979215+0000","last_undegraded":"2024-09-12T22:06:53.979215+0000","last_fullsized":"2024-09-12T22:06:53.979215+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:42.010524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980021+0000","last_change":"2024-09-12T22:06:50.439495+0000","last_active":"2024-09-12T22:06:53.980021+0000","last_peered":"2024-09-12T22:06:53.980021+0000","last_clean":"2024-09-12T22:06:53.980021+0000","last_became_active":"2024-09-12T22:06:50.421034+0000","last_became_peered":"2024-09-12T22:06:50.421034+0000","last_unstale":"2024-09-12T22:06:53.980021+0000","last_undegraded":"2024-09-12T22:06:53.980021+0000","last_fullsized":"2024-09-12T22:06:53.980021+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:46.276197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979173+0000","last_change":"2024-09-12T22:06:50.420937+0000","last_active":"2024-09-12T22:06:53.979173+0000","last_peered":"2024-09-12T22:06:53.979173+0000","last_clean":"2024-09-12T22:06:53.979173+0000","last_became_active":"2024-09-12T22:06:50.419417+0000","last_became_peered":"2024-09-12T22:06:50.419417+0000","last_unstale":"2024-09-12T22:06:53.979173+0000","last_undegraded":"2024-09-12T22:06:53.979173+0000","last_fullsized":"2024-09-12T22:06:53.979173+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:01:48.684913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035839+0000","last_change":"2024-09-12T22:03:32.461230+0000","last_active":"2024-09-12T22:06:54.035839+0000","last_peered":"2024-09-12T22:06:54.035839+0000","last_clean":"2024-09-12T22:06:54.035839+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:06:54.035839+0000","last_undegraded":"2024-09-12T22:06:54.035839+0000","last_fullsized":"2024-09-12T22:06:54.035839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:16.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035299+0000","last_change":"2024-09-12T22:06:44.392598+0000","last_active":"2024-09-12T22:06:54.035299+0000","last_peered":"2024-09-12T22:06:54.035299+0000","last_clean":"2024-09-12T22:06:54.035299+0000","last_became_active":"2024-09-12T22:06:44.392020+0000","last_became_peered":"2024-09-12T22:06:44.392020+0000","last_unstale":"2024-09-12T22:06:54.035299+0000","last_undegraded":"2024-09-12T22:06:54.035299+0000","last_fullsized":"2024-09-12T22:06:54.035299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:01.708696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979850+0000","last_change":"2024-09-12T22:06:44.394611+0000","last_active":"2024-09-12T22:06:53.979850+0000","last_peered":"2024-09-12T22:06:53.979850+0000","last_clean":"2024-09-12T22:06:53.979850+0000","last_became_active":"2024-09-12T22:06:44.394195+0000","last_became_peered":"2024-09-12T22:06:44.394195+0000","last_unstale":"2024-09-12T22:06:53.979850+0000","last_undegraded":"2024-09-12T22:06:53.979850+0000","last_fullsized":"2024-09-12T22:06:53.979850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:53.173265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978895+0000","last_change":"2024-09-12T22:06:50.421136+0000","last_active":"2024-09-12T22:06:53.978895+0000","last_peered":"2024-09-12T22:06:53.978895+0000","last_clean":"2024-09-12T22:06:53.978895+0000","last_became_active":"2024-09-12T22:06:50.420176+0000","last_became_peered":"2024-09-12T22:06:50.420176+0000","last_unstale":"2024-09-12T22:06:53.978895+0000","last_undegraded":"2024-09-12T22:06:53.978895+0000","last_fullsized":"2024-09-12T22:06:53.978895+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:24.868192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980485+0000","last_change":"2024-09-12T22:06:50.433450+0000","last_active":"2024-09-12T22:06:53.980485+0000","last_peered":"2024-09-12T22:06:53.980485+0000","last_clean":"2024-09-12T22:06:53.980485+0000","last_became_active":"2024-09-12T22:06:50.417229+0000","last_became_peered":"2024-09-12T22:06:50.417229+0000","last_unstale":"2024-09-12T22:06:53.980485+0000","last_undegraded":"2024-09-12T22:06:53.980485+0000","last_fullsized":"2024-09-12T22:06:53.980485+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:38.255675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2430,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705712,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":564512,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":562878,"kb_avail":93807328,"statfs":{"total":96636764160,"available":96058703872,"internally_reserved":0,"allocated":1646592,"data_stored":1060429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576387525},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705712,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411820,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":410174,"kb_avail":93960020,"statfs":{"total":96636764160,"available":96215060480,"internally_reserved":0,"allocated":1658880,"data_stored":1061064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":420018629},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285573,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50700,"kb_used_data":1016,"kb_used_omap":6,"kb_used_meta":49657,"kb_avail":94321140,"statfs":{"total":96636764160,"available":96584847360,"internally_reserved":0,"allocated":1040384,"data_stored":468902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6904,"internal_metadata":50849032},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:06:59.881 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:07:00.204 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:07:00.204 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":93,"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","created":"2024-09-12T22:03:11.964028+0000","modified":"2024-09-12T22:06:53.975728+0000","last_up_change":"2024-09-12T22:06:43.370158+0000","last_in_change":"2024-09-12T22:03:12.758606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:03:22.281699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:03:26.987767+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:03:31.328134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:03:31.777050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb292153-0043-4981-8743-115f848d2064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":32,"up_from":83,"up_thru":90,"down_at":33,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6801","nonce":4154318214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6803","nonce":4154318214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6807","nonce":4154318214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6805","nonce":4154318214}]},"public_addr":"172.21.15.47:6801/4154318214","cluster_addr":"172.21.15.47:6803/4154318214","heartbeat_back_addr":"172.21.15.47:6807/4154318214","heartbeat_front_addr":"172.21.15.47:6805/4154318214","state":["exists","up"]},{"osd":1,"uuid":"5f0330a2-15ce-4ffb-a697-da1f930db079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6801","nonce":1334802479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6803","nonce":1334802479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6807","nonce":1334802479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6805","nonce":1334802479}]},"public_addr":"172.21.15.110:6801/1334802479","cluster_addr":"172.21.15.110:6803/1334802479","heartbeat_back_addr":"172.21.15.110:6807/1334802479","heartbeat_front_addr":"172.21.15.110:6805/1334802479","state":["exists","up"]},{"osd":2,"uuid":"ae0b014f-768c-4f57-82c6-3edf9aa9f856","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6801","nonce":3565874056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6803","nonce":3565874056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6807","nonce":3565874056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6805","nonce":3565874056}]},"public_addr":"172.21.15.146:6801/3565874056","cluster_addr":"172.21.15.146:6803/3565874056","heartbeat_back_addr":"172.21.15.146:6807/3565874056","heartbeat_front_addr":"172.21.15.146:6805/3565874056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:18.927187+0000","dead_epoch":32},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.386650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.957366+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.12","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:07:01.217 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T22:07:01.218 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T22:07:01.359 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T22:07:01.359 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T22:07:01.359 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T22:07:01.370 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T22:07:01.657 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T22:07:01.670 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T22:07:01.670 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T22:07:01.797 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T22:07:01.797 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T22:07:01.797 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T22:07:01.808 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T22:07:02.099 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T22:07:02.112 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T22:07:02.112 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T22:07:02.238 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T22:07:02.239 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T22:07:02.239 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T22:07:02.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T22:07:02.542 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T22:07:02.556 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:07:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:07:02.850 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:07:02.859 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-12T22:07:02.288836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":592798,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1027032,"kb_used_data":4244,"kb_used_omap":9,"kb_used_meta":1022710,"kb_avail":282088488,"statfs":{"total":289910292480,"available":288858611712,"internally_reserved":0,"allocated":4345856,"data_stored":2590395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10094,"internal_metadata":1047255186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.312328"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035891+0000","last_change":"2024-09-12T22:06:44.391498+0000","last_active":"2024-09-12T22:06:54.035891+0000","last_peered":"2024-09-12T22:06:54.035891+0000","last_clean":"2024-09-12T22:06:54.035891+0000","last_became_active":"2024-09-12T22:06:44.391100+0000","last_became_peered":"2024-09-12T22:06:44.391100+0000","last_unstale":"2024-09-12T22:06:54.035891+0000","last_undegraded":"2024-09-12T22:06:54.035891+0000","last_fullsized":"2024-09-12T22:06:54.035891+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:04.380570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.036011+0000","last_change":"2024-09-12T22:06:44.392987+0000","last_active":"2024-09-12T22:06:54.036011+0000","last_peered":"2024-09-12T22:06:54.036011+0000","last_clean":"2024-09-12T22:06:54.036011+0000","last_became_active":"2024-09-12T22:06:44.392188+0000","last_became_peered":"2024-09-12T22:06:44.392188+0000","last_unstale":"2024-09-12T22:06:54.036011+0000","last_undegraded":"2024-09-12T22:06:54.036011+0000","last_fullsized":"2024-09-12T22:06:54.036011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:36.209594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979690+0000","last_change":"2024-09-12T22:03:33.462148+0000","last_active":"2024-09-12T22:06:53.979690+0000","last_peered":"2024-09-12T22:06:53.979690+0000","last_clean":"2024-09-12T22:06:53.979690+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:06:53.979690+0000","last_undegraded":"2024-09-12T22:06:53.979690+0000","last_fullsized":"2024-09-12T22:06:53.979690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:36.909948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979484+0000","last_change":"2024-09-12T22:06:50.419886+0000","last_active":"2024-09-12T22:06:53.979484+0000","last_peered":"2024-09-12T22:06:53.979484+0000","last_clean":"2024-09-12T22:06:53.979484+0000","last_became_active":"2024-09-12T22:06:50.419429+0000","last_became_peered":"2024-09-12T22:06:50.419429+0000","last_unstale":"2024-09-12T22:06:53.979484+0000","last_undegraded":"2024-09-12T22:06:53.979484+0000","last_fullsized":"2024-09-12T22:06:53.979484+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:16.917462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035121+0000","last_change":"2024-09-12T22:06:44.392862+0000","last_active":"2024-09-12T22:06:54.035121+0000","last_peered":"2024-09-12T22:06:54.035121+0000","last_clean":"2024-09-12T22:06:54.035121+0000","last_became_active":"2024-09-12T22:06:44.391774+0000","last_became_peered":"2024-09-12T22:06:44.391774+0000","last_unstale":"2024-09-12T22:06:54.035121+0000","last_undegraded":"2024-09-12T22:06:54.035121+0000","last_fullsized":"2024-09-12T22:06:54.035121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:09.703417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979018+0000","last_change":"2024-09-12T22:06:50.414892+0000","last_active":"2024-09-12T22:06:53.979018+0000","last_peered":"2024-09-12T22:06:53.979018+0000","last_clean":"2024-09-12T22:06:53.979018+0000","last_became_active":"2024-09-12T22:06:50.414526+0000","last_became_peered":"2024-09-12T22:06:50.414526+0000","last_unstale":"2024-09-12T22:06:53.979018+0000","last_undegraded":"2024-09-12T22:06:53.979018+0000","last_fullsized":"2024-09-12T22:06:53.979018+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:29.766297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979359+0000","last_change":"2024-09-12T22:06:44.421423+0000","last_active":"2024-09-12T22:06:53.979359+0000","last_peered":"2024-09-12T22:06:53.979359+0000","last_clean":"2024-09-12T22:06:53.979359+0000","last_became_active":"2024-09-12T22:06:44.421094+0000","last_became_peered":"2024-09-12T22:06:44.421094+0000","last_unstale":"2024-09-12T22:06:53.979359+0000","last_undegraded":"2024-09-12T22:06:53.979359+0000","last_fullsized":"2024-09-12T22:06:53.979359+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:48.618058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979320+0000","last_change":"2024-09-12T22:06:44.395363+0000","last_active":"2024-09-12T22:06:53.979320+0000","last_peered":"2024-09-12T22:06:53.979320+0000","last_clean":"2024-09-12T22:06:53.979320+0000","last_became_active":"2024-09-12T22:06:44.394804+0000","last_became_peered":"2024-09-12T22:06:44.394804+0000","last_unstale":"2024-09-12T22:06:53.979320+0000","last_undegraded":"2024-09-12T22:06:53.979320+0000","last_fullsized":"2024-09-12T22:06:53.979320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:18.826036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980197+0000","last_change":"2024-09-12T22:06:44.390017+0000","last_active":"2024-09-12T22:06:53.980197+0000","last_peered":"2024-09-12T22:06:53.980197+0000","last_clean":"2024-09-12T22:06:53.980197+0000","last_became_active":"2024-09-12T22:06:44.389256+0000","last_became_peered":"2024-09-12T22:06:44.389256+0000","last_unstale":"2024-09-12T22:06:53.980197+0000","last_undegraded":"2024-09-12T22:06:53.980197+0000","last_fullsized":"2024-09-12T22:06:53.980197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:48.669357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035877+0000","last_change":"2024-09-12T22:06:44.392599+0000","last_active":"2024-09-12T22:06:54.035877+0000","last_peered":"2024-09-12T22:06:54.035877+0000","last_clean":"2024-09-12T22:06:54.035877+0000","last_became_active":"2024-09-12T22:06:44.391572+0000","last_became_peered":"2024-09-12T22:06:44.391572+0000","last_unstale":"2024-09-12T22:06:54.035877+0000","last_undegraded":"2024-09-12T22:06:54.035877+0000","last_fullsized":"2024-09-12T22:06:54.035877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:41.342271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979365+0000","last_change":"2024-09-12T22:06:50.420008+0000","last_active":"2024-09-12T22:06:53.979365+0000","last_peered":"2024-09-12T22:06:53.979365+0000","last_clean":"2024-09-12T22:06:53.979365+0000","last_became_active":"2024-09-12T22:06:50.419042+0000","last_became_peered":"2024-09-12T22:06:50.419042+0000","last_unstale":"2024-09-12T22:06:53.979365+0000","last_undegraded":"2024-09-12T22:06:53.979365+0000","last_fullsized":"2024-09-12T22:06:53.979365+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:39.365289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035352+0000","last_change":"2024-09-12T22:03:33.465069+0000","last_active":"2024-09-12T22:06:54.035352+0000","last_peered":"2024-09-12T22:06:54.035352+0000","last_clean":"2024-09-12T22:06:54.035352+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:06:54.035352+0000","last_undegraded":"2024-09-12T22:06:54.035352+0000","last_fullsized":"2024-09-12T22:06:54.035352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035321+0000","last_change":"2024-09-12T22:06:44.392909+0000","last_active":"2024-09-12T22:06:54.035321+0000","last_peered":"2024-09-12T22:06:54.035321+0000","last_clean":"2024-09-12T22:06:54.035321+0000","last_became_active":"2024-09-12T22:06:44.392491+0000","last_became_peered":"2024-09-12T22:06:44.392491+0000","last_unstale":"2024-09-12T22:06:54.035321+0000","last_undegraded":"2024-09-12T22:06:54.035321+0000","last_fullsized":"2024-09-12T22:06:54.035321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:09.585700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979180+0000","last_change":"2024-09-12T22:06:50.419973+0000","last_active":"2024-09-12T22:06:53.979180+0000","last_peered":"2024-09-12T22:06:53.979180+0000","last_clean":"2024-09-12T22:06:53.979180+0000","last_became_active":"2024-09-12T22:06:50.418325+0000","last_became_peered":"2024-09-12T22:06:50.418325+0000","last_unstale":"2024-09-12T22:06:53.979180+0000","last_undegraded":"2024-09-12T22:06:53.979180+0000","last_fullsized":"2024-09-12T22:06:53.979180+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:02.303968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979112+0000","last_change":"2024-09-12T22:06:50.419011+0000","last_active":"2024-09-12T22:06:53.979112+0000","last_peered":"2024-09-12T22:06:53.979112+0000","last_clean":"2024-09-12T22:06:53.979112+0000","last_became_active":"2024-09-12T22:06:50.418075+0000","last_became_peered":"2024-09-12T22:06:50.418075+0000","last_unstale":"2024-09-12T22:06:53.979112+0000","last_undegraded":"2024-09-12T22:06:53.979112+0000","last_fullsized":"2024-09-12T22:06:53.979112+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:16.440226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979399+0000","last_change":"2024-09-12T22:06:44.395099+0000","last_active":"2024-09-12T22:06:53.979399+0000","last_peered":"2024-09-12T22:06:53.979399+0000","last_clean":"2024-09-12T22:06:53.979399+0000","last_became_active":"2024-09-12T22:06:44.394486+0000","last_became_peered":"2024-09-12T22:06:44.394486+0000","last_unstale":"2024-09-12T22:06:53.979399+0000","last_undegraded":"2024-09-12T22:06:53.979399+0000","last_fullsized":"2024-09-12T22:06:53.979399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:47.461701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980180+0000","last_change":"2024-09-12T22:06:44.390021+0000","last_active":"2024-09-12T22:06:53.980180+0000","last_peered":"2024-09-12T22:06:53.980180+0000","last_clean":"2024-09-12T22:06:53.980180+0000","last_became_active":"2024-09-12T22:06:44.388967+0000","last_became_peered":"2024-09-12T22:06:44.388967+0000","last_unstale":"2024-09-12T22:06:53.980180+0000","last_undegraded":"2024-09-12T22:06:53.980180+0000","last_fullsized":"2024-09-12T22:06:53.980180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:15.769587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035728+0000","last_change":"2024-09-12T22:06:44.391191+0000","last_active":"2024-09-12T22:06:54.035728+0000","last_peered":"2024-09-12T22:06:54.035728+0000","last_clean":"2024-09-12T22:06:54.035728+0000","last_became_active":"2024-09-12T22:06:44.390858+0000","last_became_peered":"2024-09-12T22:06:44.390858+0000","last_unstale":"2024-09-12T22:06:54.035728+0000","last_undegraded":"2024-09-12T22:06:54.035728+0000","last_fullsized":"2024-09-12T22:06:54.035728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:30.878874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979804+0000","last_change":"2024-09-12T22:06:44.389205+0000","last_active":"2024-09-12T22:06:53.979804+0000","last_peered":"2024-09-12T22:06:53.979804+0000","last_clean":"2024-09-12T22:06:53.979804+0000","last_became_active":"2024-09-12T22:06:44.388761+0000","last_became_peered":"2024-09-12T22:06:44.388761+0000","last_unstale":"2024-09-12T22:06:53.979804+0000","last_undegraded":"2024-09-12T22:06:53.979804+0000","last_fullsized":"2024-09-12T22:06:53.979804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:31.790297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980172+0000","last_change":"2024-09-12T22:06:44.421429+0000","last_active":"2024-09-12T22:06:53.980172+0000","last_peered":"2024-09-12T22:06:53.980172+0000","last_clean":"2024-09-12T22:06:53.980172+0000","last_became_active":"2024-09-12T22:06:44.420768+0000","last_became_peered":"2024-09-12T22:06:44.420768+0000","last_unstale":"2024-09-12T22:06:53.980172+0000","last_undegraded":"2024-09-12T22:06:53.980172+0000","last_fullsized":"2024-09-12T22:06:53.980172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:25.634497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979404+0000","last_change":"2024-09-12T22:06:50.422914+0000","last_active":"2024-09-12T22:06:53.979404+0000","last_peered":"2024-09-12T22:06:53.979404+0000","last_clean":"2024-09-12T22:06:53.979404+0000","last_became_active":"2024-09-12T22:06:50.421758+0000","last_became_peered":"2024-09-12T22:06:50.421758+0000","last_unstale":"2024-09-12T22:06:53.979404+0000","last_undegraded":"2024-09-12T22:06:53.979404+0000","last_fullsized":"2024-09-12T22:06:53.979404+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:02.122833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035141+0000","last_change":"2024-09-12T22:03:33.460994+0000","last_active":"2024-09-12T22:06:54.035141+0000","last_peered":"2024-09-12T22:06:54.035141+0000","last_clean":"2024-09-12T22:06:54.035141+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:06:54.035141+0000","last_undegraded":"2024-09-12T22:06:54.035141+0000","last_fullsized":"2024-09-12T22:06:54.035141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:20.363291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979143+0000","last_change":"2024-09-12T22:06:50.417908+0000","last_active":"2024-09-12T22:06:53.979143+0000","last_peered":"2024-09-12T22:06:53.979143+0000","last_clean":"2024-09-12T22:06:53.979143+0000","last_became_active":"2024-09-12T22:06:50.416924+0000","last_became_peered":"2024-09-12T22:06:50.416924+0000","last_unstale":"2024-09-12T22:06:53.979143+0000","last_undegraded":"2024-09-12T22:06:53.979143+0000","last_fullsized":"2024-09-12T22:06:53.979143+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:28.247991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034792+0000","last_change":"2024-09-12T22:06:44.391876+0000","last_active":"2024-09-12T22:06:54.034792+0000","last_peered":"2024-09-12T22:06:54.034792+0000","last_clean":"2024-09-12T22:06:54.034792+0000","last_became_active":"2024-09-12T22:06:44.391480+0000","last_became_peered":"2024-09-12T22:06:44.391480+0000","last_unstale":"2024-09-12T22:06:54.034792+0000","last_undegraded":"2024-09-12T22:06:54.034792+0000","last_fullsized":"2024-09-12T22:06:54.034792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:43.161300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035981+0000","last_change":"2024-09-12T22:06:50.420130+0000","last_active":"2024-09-12T22:06:54.035981+0000","last_peered":"2024-09-12T22:06:54.035981+0000","last_clean":"2024-09-12T22:06:54.035981+0000","last_became_active":"2024-09-12T22:06:50.419573+0000","last_became_peered":"2024-09-12T22:06:50.419573+0000","last_unstale":"2024-09-12T22:06:54.035981+0000","last_undegraded":"2024-09-12T22:06:54.035981+0000","last_fullsized":"2024-09-12T22:06:54.035981+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:31.160831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980210+0000","last_change":"2024-09-12T22:06:50.420167+0000","last_active":"2024-09-12T22:06:53.980210+0000","last_peered":"2024-09-12T22:06:53.980210+0000","last_clean":"2024-09-12T22:06:53.980210+0000","last_became_active":"2024-09-12T22:06:50.419348+0000","last_became_peered":"2024-09-12T22:06:50.419348+0000","last_unstale":"2024-09-12T22:06:53.980210+0000","last_undegraded":"2024-09-12T22:06:53.980210+0000","last_fullsized":"2024-09-12T22:06:53.980210+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:19.786252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979690+0000","last_change":"2024-09-12T22:03:33.461282+0000","last_active":"2024-09-12T22:06:53.979690+0000","last_peered":"2024-09-12T22:06:53.979690+0000","last_clean":"2024-09-12T22:06:53.979690+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:06:53.979690+0000","last_undegraded":"2024-09-12T22:06:53.979690+0000","last_fullsized":"2024-09-12T22:06:53.979690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:32.302716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035627+0000","last_change":"2024-09-12T22:06:50.419329+0000","last_active":"2024-09-12T22:06:54.035627+0000","last_peered":"2024-09-12T22:06:54.035627+0000","last_clean":"2024-09-12T22:06:54.035627+0000","last_became_active":"2024-09-12T22:06:50.418755+0000","last_became_peered":"2024-09-12T22:06:50.418755+0000","last_unstale":"2024-09-12T22:06:54.035627+0000","last_undegraded":"2024-09-12T22:06:54.035627+0000","last_fullsized":"2024-09-12T22:06:54.035627+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:02.572755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979812+0000","last_change":"2024-09-12T22:06:44.397630+0000","last_active":"2024-09-12T22:06:53.979812+0000","last_peered":"2024-09-12T22:06:53.979812+0000","last_clean":"2024-09-12T22:06:53.979812+0000","last_became_active":"2024-09-12T22:06:44.397198+0000","last_became_peered":"2024-09-12T22:06:44.397198+0000","last_unstale":"2024-09-12T22:06:53.979812+0000","last_undegraded":"2024-09-12T22:06:53.979812+0000","last_fullsized":"2024-09-12T22:06:53.979812+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:31.843174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035267+0000","last_change":"2024-09-12T22:03:33.456842+0000","last_active":"2024-09-12T22:06:54.035267+0000","last_peered":"2024-09-12T22:06:54.035267+0000","last_clean":"2024-09-12T22:06:54.035267+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:06:54.035267+0000","last_undegraded":"2024-09-12T22:06:54.035267+0000","last_fullsized":"2024-09-12T22:06:54.035267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:56.383351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979590+0000","last_change":"2024-09-12T22:06:44.397416+0000","last_active":"2024-09-12T22:06:53.979590+0000","last_peered":"2024-09-12T22:06:53.979590+0000","last_clean":"2024-09-12T22:06:53.979590+0000","last_became_active":"2024-09-12T22:06:44.397074+0000","last_became_peered":"2024-09-12T22:06:44.397074+0000","last_unstale":"2024-09-12T22:06:53.979590+0000","last_undegraded":"2024-09-12T22:06:53.979590+0000","last_fullsized":"2024-09-12T22:06:53.979590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.834005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978818+0000","last_change":"2024-09-12T22:06:50.414965+0000","last_active":"2024-09-12T22:06:53.978818+0000","last_peered":"2024-09-12T22:06:53.978818+0000","last_clean":"2024-09-12T22:06:53.978818+0000","last_became_active":"2024-09-12T22:06:50.414626+0000","last_became_peered":"2024-09-12T22:06:50.414626+0000","last_unstale":"2024-09-12T22:06:53.978818+0000","last_undegraded":"2024-09-12T22:06:53.978818+0000","last_fullsized":"2024-09-12T22:06:53.978818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:30.619121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035494+0000","last_change":"2024-09-12T22:06:44.391923+0000","last_active":"2024-09-12T22:06:54.035494+0000","last_peered":"2024-09-12T22:06:54.035494+0000","last_clean":"2024-09-12T22:06:54.035494+0000","last_became_active":"2024-09-12T22:06:44.391447+0000","last_became_peered":"2024-09-12T22:06:44.391447+0000","last_unstale":"2024-09-12T22:06:54.035494+0000","last_undegraded":"2024-09-12T22:06:54.035494+0000","last_fullsized":"2024-09-12T22:06:54.035494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:32.308333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979499+0000","last_change":"2024-09-12T22:06:50.442693+0000","last_active":"2024-09-12T22:06:53.979499+0000","last_peered":"2024-09-12T22:06:53.979499+0000","last_clean":"2024-09-12T22:06:53.979499+0000","last_became_active":"2024-09-12T22:06:50.422232+0000","last_became_peered":"2024-09-12T22:06:50.422232+0000","last_unstale":"2024-09-12T22:06:53.979499+0000","last_undegraded":"2024-09-12T22:06:53.979499+0000","last_fullsized":"2024-09-12T22:06:53.979499+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:40.705556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035690+0000","last_change":"2024-09-12T22:06:44.390974+0000","last_active":"2024-09-12T22:06:54.035690+0000","last_peered":"2024-09-12T22:06:54.035690+0000","last_clean":"2024-09-12T22:06:54.035690+0000","last_became_active":"2024-09-12T22:06:44.390652+0000","last_became_peered":"2024-09-12T22:06:44.390652+0000","last_unstale":"2024-09-12T22:06:54.035690+0000","last_undegraded":"2024-09-12T22:06:54.035690+0000","last_fullsized":"2024-09-12T22:06:54.035690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:41.707065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979208+0000","last_change":"2024-09-12T22:06:50.417649+0000","last_active":"2024-09-12T22:06:53.979208+0000","last_peered":"2024-09-12T22:06:53.979208+0000","last_clean":"2024-09-12T22:06:53.979208+0000","last_became_active":"2024-09-12T22:06:50.417123+0000","last_became_peered":"2024-09-12T22:06:50.417123+0000","last_unstale":"2024-09-12T22:06:53.979208+0000","last_undegraded":"2024-09-12T22:06:53.979208+0000","last_fullsized":"2024-09-12T22:06:53.979208+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:01.612960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980187+0000","last_change":"2024-09-12T22:06:50.419787+0000","last_active":"2024-09-12T22:06:53.980187+0000","last_peered":"2024-09-12T22:06:53.980187+0000","last_clean":"2024-09-12T22:06:53.980187+0000","last_became_active":"2024-09-12T22:06:50.418817+0000","last_became_peered":"2024-09-12T22:06:50.418817+0000","last_unstale":"2024-09-12T22:06:53.980187+0000","last_undegraded":"2024-09-12T22:06:53.980187+0000","last_fullsized":"2024-09-12T22:06:53.980187+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:51.923601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035182+0000","last_change":"2024-09-12T22:06:50.419697+0000","last_active":"2024-09-12T22:06:54.035182+0000","last_peered":"2024-09-12T22:06:54.035182+0000","last_clean":"2024-09-12T22:06:54.035182+0000","last_became_active":"2024-09-12T22:06:50.419047+0000","last_became_peered":"2024-09-12T22:06:50.419047+0000","last_unstale":"2024-09-12T22:06:54.035182+0000","last_undegraded":"2024-09-12T22:06:54.035182+0000","last_fullsized":"2024-09-12T22:06:54.035182+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:31.820796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980033+0000","last_change":"2024-09-12T22:06:44.422294+0000","last_active":"2024-09-12T22:06:53.980033+0000","last_peered":"2024-09-12T22:06:53.980033+0000","last_clean":"2024-09-12T22:06:53.980033+0000","last_became_active":"2024-09-12T22:06:44.421955+0000","last_became_peered":"2024-09-12T22:06:44.421955+0000","last_unstale":"2024-09-12T22:06:53.980033+0000","last_undegraded":"2024-09-12T22:06:53.980033+0000","last_fullsized":"2024-09-12T22:06:53.980033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:40.047878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979018+0000","last_change":"2024-09-12T22:06:50.432341+0000","last_active":"2024-09-12T22:06:53.979018+0000","last_peered":"2024-09-12T22:06:53.979018+0000","last_clean":"2024-09-12T22:06:53.979018+0000","last_became_active":"2024-09-12T22:06:50.418227+0000","last_became_peered":"2024-09-12T22:06:50.418227+0000","last_unstale":"2024-09-12T22:06:53.979018+0000","last_undegraded":"2024-09-12T22:06:53.979018+0000","last_fullsized":"2024-09-12T22:06:53.979018+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:47.509209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979708+0000","last_change":"2024-09-12T22:06:50.426521+0000","last_active":"2024-09-12T22:06:53.979708+0000","last_peered":"2024-09-12T22:06:53.979708+0000","last_clean":"2024-09-12T22:06:53.979708+0000","last_became_active":"2024-09-12T22:06:50.418222+0000","last_became_peered":"2024-09-12T22:06:50.418222+0000","last_unstale":"2024-09-12T22:06:53.979708+0000","last_undegraded":"2024-09-12T22:06:53.979708+0000","last_fullsized":"2024-09-12T22:06:53.979708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:44.473880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034877+0000","last_change":"2024-09-12T22:03:33.465308+0000","last_active":"2024-09-12T22:06:54.034877+0000","last_peered":"2024-09-12T22:06:54.034877+0000","last_clean":"2024-09-12T22:06:54.034877+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:06:54.034877+0000","last_undegraded":"2024-09-12T22:06:54.034877+0000","last_fullsized":"2024-09-12T22:06:54.034877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:35.733622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035614+0000","last_change":"2024-09-12T22:03:32.461301+0000","last_active":"2024-09-12T22:06:54.035614+0000","last_peered":"2024-09-12T22:06:54.035614+0000","last_clean":"2024-09-12T22:06:54.035614+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:06:54.035614+0000","last_undegraded":"2024-09-12T22:06:54.035614+0000","last_fullsized":"2024-09-12T22:06:54.035614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:39.872272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034942+0000","last_change":"2024-09-12T22:06:44.391249+0000","last_active":"2024-09-12T22:06:54.034942+0000","last_peered":"2024-09-12T22:06:54.034942+0000","last_clean":"2024-09-12T22:06:54.034942+0000","last_became_active":"2024-09-12T22:06:44.390807+0000","last_became_peered":"2024-09-12T22:06:44.390807+0000","last_unstale":"2024-09-12T22:06:54.034942+0000","last_undegraded":"2024-09-12T22:06:54.034942+0000","last_fullsized":"2024-09-12T22:06:54.034942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:07.271893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980057+0000","last_change":"2024-09-12T22:03:32.459540+0000","last_active":"2024-09-12T22:06:53.980057+0000","last_peered":"2024-09-12T22:06:53.980057+0000","last_clean":"2024-09-12T22:06:53.980057+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:06:53.980057+0000","last_undegraded":"2024-09-12T22:06:53.980057+0000","last_fullsized":"2024-09-12T22:06:53.980057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:22.143242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979421+0000","last_change":"2024-09-12T22:06:44.421712+0000","last_active":"2024-09-12T22:06:53.979421+0000","last_peered":"2024-09-12T22:06:53.979421+0000","last_clean":"2024-09-12T22:06:53.979421+0000","last_became_active":"2024-09-12T22:06:44.421388+0000","last_became_peered":"2024-09-12T22:06:44.421388+0000","last_unstale":"2024-09-12T22:06:53.979421+0000","last_undegraded":"2024-09-12T22:06:53.979421+0000","last_fullsized":"2024-09-12T22:06:53.979421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:46.580311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980254+0000","last_change":"2024-09-12T22:06:44.421721+0000","last_active":"2024-09-12T22:06:53.980254+0000","last_peered":"2024-09-12T22:06:53.980254+0000","last_clean":"2024-09-12T22:06:53.980254+0000","last_became_active":"2024-09-12T22:06:44.421430+0000","last_became_peered":"2024-09-12T22:06:44.421430+0000","last_unstale":"2024-09-12T22:06:53.980254+0000","last_undegraded":"2024-09-12T22:06:53.980254+0000","last_fullsized":"2024-09-12T22:06:53.980254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:57.001470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979284+0000","last_change":"2024-09-12T22:06:44.397808+0000","last_active":"2024-09-12T22:06:53.979284+0000","last_peered":"2024-09-12T22:06:53.979284+0000","last_clean":"2024-09-12T22:06:53.979284+0000","last_became_active":"2024-09-12T22:06:44.397490+0000","last_became_peered":"2024-09-12T22:06:44.397490+0000","last_unstale":"2024-09-12T22:06:53.979284+0000","last_undegraded":"2024-09-12T22:06:53.979284+0000","last_fullsized":"2024-09-12T22:06:53.979284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:38.225078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979537+0000","last_change":"2024-09-12T22:06:50.426880+0000","last_active":"2024-09-12T22:06:53.979537+0000","last_peered":"2024-09-12T22:06:53.979537+0000","last_clean":"2024-09-12T22:06:53.979537+0000","last_became_active":"2024-09-12T22:06:50.417240+0000","last_became_peered":"2024-09-12T22:06:50.417240+0000","last_unstale":"2024-09-12T22:06:53.979537+0000","last_undegraded":"2024-09-12T22:06:53.979537+0000","last_fullsized":"2024-09-12T22:06:53.979537+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:24.836682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980207+0000","last_change":"2024-09-12T22:06:44.421723+0000","last_active":"2024-09-12T22:06:53.980207+0000","last_peered":"2024-09-12T22:06:53.980207+0000","last_clean":"2024-09-12T22:06:53.980207+0000","last_became_active":"2024-09-12T22:06:44.421071+0000","last_became_peered":"2024-09-12T22:06:44.421071+0000","last_unstale":"2024-09-12T22:06:53.980207+0000","last_undegraded":"2024-09-12T22:06:53.980207+0000","last_fullsized":"2024-09-12T22:06:53.980207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:16.039319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979544+0000","last_change":"2024-09-12T22:06:50.422136+0000","last_active":"2024-09-12T22:06:53.979544+0000","last_peered":"2024-09-12T22:06:53.979544+0000","last_clean":"2024-09-12T22:06:53.979544+0000","last_became_active":"2024-09-12T22:06:50.421734+0000","last_became_peered":"2024-09-12T22:06:50.421734+0000","last_unstale":"2024-09-12T22:06:53.979544+0000","last_undegraded":"2024-09-12T22:06:53.979544+0000","last_fullsized":"2024-09-12T22:06:53.979544+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:29.450310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979869+0000","last_change":"2024-09-12T22:03:33.459084+0000","last_active":"2024-09-12T22:06:53.979869+0000","last_peered":"2024-09-12T22:06:53.979869+0000","last_clean":"2024-09-12T22:06:53.979869+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:06:53.979869+0000","last_undegraded":"2024-09-12T22:06:53.979869+0000","last_fullsized":"2024-09-12T22:06:53.979869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:50.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035351+0000","last_change":"2024-09-12T22:03:32.461417+0000","last_active":"2024-09-12T22:06:54.035351+0000","last_peered":"2024-09-12T22:06:54.035351+0000","last_clean":"2024-09-12T22:06:54.035351+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:06:54.035351+0000","last_undegraded":"2024-09-12T22:06:54.035351+0000","last_fullsized":"2024-09-12T22:06:54.035351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:22.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979869+0000","last_change":"2024-09-12T22:06:50.419560+0000","last_active":"2024-09-12T22:06:53.979869+0000","last_peered":"2024-09-12T22:06:53.979869+0000","last_clean":"2024-09-12T22:06:53.979869+0000","last_became_active":"2024-09-12T22:06:50.418648+0000","last_became_peered":"2024-09-12T22:06:50.418648+0000","last_unstale":"2024-09-12T22:06:53.979869+0000","last_undegraded":"2024-09-12T22:06:53.979869+0000","last_fullsized":"2024-09-12T22:06:53.979869+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:58.944327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034997+0000","last_change":"2024-09-12T22:06:44.391442+0000","last_active":"2024-09-12T22:06:54.034997+0000","last_peered":"2024-09-12T22:06:54.034997+0000","last_clean":"2024-09-12T22:06:54.034997+0000","last_became_active":"2024-09-12T22:06:44.391078+0000","last_became_peered":"2024-09-12T22:06:44.391078+0000","last_unstale":"2024-09-12T22:06:54.034997+0000","last_undegraded":"2024-09-12T22:06:54.034997+0000","last_fullsized":"2024-09-12T22:06:54.034997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:26.602771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980404+0000","last_change":"2024-09-12T22:06:44.397142+0000","last_active":"2024-09-12T22:06:53.980404+0000","last_peered":"2024-09-12T22:06:53.980404+0000","last_clean":"2024-09-12T22:06:53.980404+0000","last_became_active":"2024-09-12T22:06:44.396783+0000","last_became_peered":"2024-09-12T22:06:44.396783+0000","last_unstale":"2024-09-12T22:06:53.980404+0000","last_undegraded":"2024-09-12T22:06:53.980404+0000","last_fullsized":"2024-09-12T22:06:53.980404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:27.631274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":315,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979021+0000","last_change":"2024-09-12T22:06:52.982526+0000","last_active":"2024-09-12T22:06:53.979021+0000","last_peered":"2024-09-12T22:06:53.979021+0000","last_clean":"2024-09-12T22:06:53.979021+0000","last_became_active":"2024-09-12T22:06:52.982174+0000","last_became_peered":"2024-09-12T22:06:52.982174+0000","last_unstale":"2024-09-12T22:06:53.979021+0000","last_undegraded":"2024-09-12T22:06:53.979021+0000","last_fullsized":"2024-09-12T22:06:53.979021+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:20.744009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979737+0000","last_change":"2024-09-12T22:06:50.444340+0000","last_active":"2024-09-12T22:06:53.979737+0000","last_peered":"2024-09-12T22:06:53.979737+0000","last_clean":"2024-09-12T22:06:53.979737+0000","last_became_active":"2024-09-12T22:06:50.422353+0000","last_became_peered":"2024-09-12T22:06:50.422353+0000","last_unstale":"2024-09-12T22:06:53.979737+0000","last_undegraded":"2024-09-12T22:06:53.979737+0000","last_fullsized":"2024-09-12T22:06:53.979737+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.662733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979420+0000","last_change":"2024-09-12T22:06:44.397029+0000","last_active":"2024-09-12T22:06:53.979420+0000","last_peered":"2024-09-12T22:06:53.979420+0000","last_clean":"2024-09-12T22:06:53.979420+0000","last_became_active":"2024-09-12T22:06:44.396659+0000","last_became_peered":"2024-09-12T22:06:44.396659+0000","last_unstale":"2024-09-12T22:06:53.979420+0000","last_undegraded":"2024-09-12T22:06:53.979420+0000","last_fullsized":"2024-09-12T22:06:53.979420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:07.404782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979992+0000","last_change":"2024-09-12T22:06:50.418936+0000","last_active":"2024-09-12T22:06:53.979992+0000","last_peered":"2024-09-12T22:06:53.979992+0000","last_clean":"2024-09-12T22:06:53.979992+0000","last_became_active":"2024-09-12T22:06:50.418443+0000","last_became_peered":"2024-09-12T22:06:50.418443+0000","last_unstale":"2024-09-12T22:06:53.979992+0000","last_undegraded":"2024-09-12T22:06:53.979992+0000","last_fullsized":"2024-09-12T22:06:53.979992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:40.432871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978897+0000","last_change":"2024-09-12T22:06:50.419409+0000","last_active":"2024-09-12T22:06:53.978897+0000","last_peered":"2024-09-12T22:06:53.978897+0000","last_clean":"2024-09-12T22:06:53.978897+0000","last_became_active":"2024-09-12T22:06:50.418160+0000","last_became_peered":"2024-09-12T22:06:50.418160+0000","last_unstale":"2024-09-12T22:06:53.978897+0000","last_undegraded":"2024-09-12T22:06:53.978897+0000","last_fullsized":"2024-09-12T22:06:53.978897+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:48.881995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978987+0000","last_change":"2024-09-12T22:06:44.396692+0000","last_active":"2024-09-12T22:06:53.978987+0000","last_peered":"2024-09-12T22:06:53.978987+0000","last_clean":"2024-09-12T22:06:53.978987+0000","last_became_active":"2024-09-12T22:06:44.396378+0000","last_became_peered":"2024-09-12T22:06:44.396378+0000","last_unstale":"2024-09-12T22:06:53.978987+0000","last_undegraded":"2024-09-12T22:06:53.978987+0000","last_fullsized":"2024-09-12T22:06:53.978987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:06.812790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035774+0000","last_change":"2024-09-12T22:06:44.392705+0000","last_active":"2024-09-12T22:06:54.035774+0000","last_peered":"2024-09-12T22:06:54.035774+0000","last_clean":"2024-09-12T22:06:54.035774+0000","last_became_active":"2024-09-12T22:06:44.391809+0000","last_became_peered":"2024-09-12T22:06:44.391809+0000","last_unstale":"2024-09-12T22:06:54.035774+0000","last_undegraded":"2024-09-12T22:06:54.035774+0000","last_fullsized":"2024-09-12T22:06:54.035774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:48.022906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979322+0000","last_change":"2024-09-12T22:06:44.397296+0000","last_active":"2024-09-12T22:06:53.979322+0000","last_peered":"2024-09-12T22:06:53.979322+0000","last_clean":"2024-09-12T22:06:53.979322+0000","last_became_active":"2024-09-12T22:06:44.396596+0000","last_became_peered":"2024-09-12T22:06:44.396596+0000","last_unstale":"2024-09-12T22:06:53.979322+0000","last_undegraded":"2024-09-12T22:06:53.979322+0000","last_fullsized":"2024-09-12T22:06:53.979322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:25.702361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035014+0000","last_change":"2024-09-12T22:06:50.419281+0000","last_active":"2024-09-12T22:06:54.035014+0000","last_peered":"2024-09-12T22:06:54.035014+0000","last_clean":"2024-09-12T22:06:54.035014+0000","last_became_active":"2024-09-12T22:06:50.418876+0000","last_became_peered":"2024-09-12T22:06:50.418876+0000","last_unstale":"2024-09-12T22:06:54.035014+0000","last_undegraded":"2024-09-12T22:06:54.035014+0000","last_fullsized":"2024-09-12T22:06:54.035014+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:14.574566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980382+0000","last_change":"2024-09-12T22:06:44.390385+0000","last_active":"2024-09-12T22:06:53.980382+0000","last_peered":"2024-09-12T22:06:53.980382+0000","last_clean":"2024-09-12T22:06:53.980382+0000","last_became_active":"2024-09-12T22:06:44.389680+0000","last_became_peered":"2024-09-12T22:06:44.389680+0000","last_unstale":"2024-09-12T22:06:53.980382+0000","last_undegraded":"2024-09-12T22:06:53.980382+0000","last_fullsized":"2024-09-12T22:06:53.980382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:28.579444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":183,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979720+0000","last_change":"2024-09-12T22:06:44.421429+0000","last_active":"2024-09-12T22:06:53.979720+0000","last_peered":"2024-09-12T22:06:53.979720+0000","last_clean":"2024-09-12T22:06:53.979720+0000","last_became_active":"2024-09-12T22:06:44.421088+0000","last_became_peered":"2024-09-12T22:06:44.421088+0000","last_unstale":"2024-09-12T22:06:53.979720+0000","last_undegraded":"2024-09-12T22:06:53.979720+0000","last_fullsized":"2024-09-12T22:06:53.979720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:29.121518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979693+0000","last_change":"2024-09-12T22:06:50.423638+0000","last_active":"2024-09-12T22:06:53.979693+0000","last_peered":"2024-09-12T22:06:53.979693+0000","last_clean":"2024-09-12T22:06:53.979693+0000","last_became_active":"2024-09-12T22:06:50.423052+0000","last_became_peered":"2024-09-12T22:06:50.423052+0000","last_unstale":"2024-09-12T22:06:53.979693+0000","last_undegraded":"2024-09-12T22:06:53.979693+0000","last_fullsized":"2024-09-12T22:06:53.979693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:49.458146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980024+0000","last_change":"2024-09-12T22:06:44.397769+0000","last_active":"2024-09-12T22:06:53.980024+0000","last_peered":"2024-09-12T22:06:53.980024+0000","last_clean":"2024-09-12T22:06:53.980024+0000","last_became_active":"2024-09-12T22:06:44.397452+0000","last_became_peered":"2024-09-12T22:06:44.397452+0000","last_unstale":"2024-09-12T22:06:53.980024+0000","last_undegraded":"2024-09-12T22:06:53.980024+0000","last_fullsized":"2024-09-12T22:06:53.980024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:56.815006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979460+0000","last_change":"2024-09-12T22:06:50.420039+0000","last_active":"2024-09-12T22:06:53.979460+0000","last_peered":"2024-09-12T22:06:53.979460+0000","last_clean":"2024-09-12T22:06:53.979460+0000","last_became_active":"2024-09-12T22:06:50.419551+0000","last_became_peered":"2024-09-12T22:06:50.419551+0000","last_unstale":"2024-09-12T22:06:53.979460+0000","last_undegraded":"2024-09-12T22:06:53.979460+0000","last_fullsized":"2024-09-12T22:06:53.979460+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:06.211607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980065+0000","last_change":"2024-09-12T22:06:44.397598+0000","last_active":"2024-09-12T22:06:53.980065+0000","last_peered":"2024-09-12T22:06:53.980065+0000","last_clean":"2024-09-12T22:06:53.980065+0000","last_became_active":"2024-09-12T22:06:44.396979+0000","last_became_peered":"2024-09-12T22:06:44.396979+0000","last_unstale":"2024-09-12T22:06:53.980065+0000","last_undegraded":"2024-09-12T22:06:53.980065+0000","last_fullsized":"2024-09-12T22:06:53.980065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:27.592588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035149+0000","last_change":"2024-09-12T22:06:50.419195+0000","last_active":"2024-09-12T22:06:54.035149+0000","last_peered":"2024-09-12T22:06:54.035149+0000","last_clean":"2024-09-12T22:06:54.035149+0000","last_became_active":"2024-09-12T22:06:50.418763+0000","last_became_peered":"2024-09-12T22:06:50.418763+0000","last_unstale":"2024-09-12T22:06:54.035149+0000","last_undegraded":"2024-09-12T22:06:54.035149+0000","last_fullsized":"2024-09-12T22:06:54.035149+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:15.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979795+0000","last_change":"2024-09-12T22:06:44.389682+0000","last_active":"2024-09-12T22:06:53.979795+0000","last_peered":"2024-09-12T22:06:53.979795+0000","last_clean":"2024-09-12T22:06:53.979795+0000","last_became_active":"2024-09-12T22:06:44.388887+0000","last_became_peered":"2024-09-12T22:06:44.388887+0000","last_unstale":"2024-09-12T22:06:53.979795+0000","last_undegraded":"2024-09-12T22:06:53.979795+0000","last_fullsized":"2024-09-12T22:06:53.979795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:09:27.376344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035461+0000","last_change":"2024-09-12T22:06:44.390603+0000","last_active":"2024-09-12T22:06:54.035461+0000","last_peered":"2024-09-12T22:06:54.035461+0000","last_clean":"2024-09-12T22:06:54.035461+0000","last_became_active":"2024-09-12T22:06:44.390260+0000","last_became_peered":"2024-09-12T22:06:44.390260+0000","last_unstale":"2024-09-12T22:06:54.035461+0000","last_undegraded":"2024-09-12T22:06:54.035461+0000","last_fullsized":"2024-09-12T22:06:54.035461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:42.158737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035313+0000","last_change":"2024-09-12T22:03:33.464893+0000","last_active":"2024-09-12T22:06:54.035313+0000","last_peered":"2024-09-12T22:06:54.035313+0000","last_clean":"2024-09-12T22:06:54.035313+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:06:54.035313+0000","last_undegraded":"2024-09-12T22:06:54.035313+0000","last_fullsized":"2024-09-12T22:06:54.035313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:47.948673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980033+0000","last_change":"2024-09-12T22:06:44.390378+0000","last_active":"2024-09-12T22:06:53.980033+0000","last_peered":"2024-09-12T22:06:53.980033+0000","last_clean":"2024-09-12T22:06:53.980033+0000","last_became_active":"2024-09-12T22:06:44.389622+0000","last_became_peered":"2024-09-12T22:06:44.389622+0000","last_unstale":"2024-09-12T22:06:53.980033+0000","last_undegraded":"2024-09-12T22:06:53.980033+0000","last_fullsized":"2024-09-12T22:06:53.980033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:57.877495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980321+0000","last_change":"2024-09-12T22:06:44.398054+0000","last_active":"2024-09-12T22:06:53.980321+0000","last_peered":"2024-09-12T22:06:53.980321+0000","last_clean":"2024-09-12T22:06:53.980321+0000","last_became_active":"2024-09-12T22:06:44.396735+0000","last_became_peered":"2024-09-12T22:06:44.396735+0000","last_unstale":"2024-09-12T22:06:53.980321+0000","last_undegraded":"2024-09-12T22:06:53.980321+0000","last_fullsized":"2024-09-12T22:06:53.980321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:54:49.919665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979023+0000","last_change":"2024-09-12T22:06:44.422129+0000","last_active":"2024-09-12T22:06:53.979023+0000","last_peered":"2024-09-12T22:06:53.979023+0000","last_clean":"2024-09-12T22:06:53.979023+0000","last_became_active":"2024-09-12T22:06:44.421723+0000","last_became_peered":"2024-09-12T22:06:44.421723+0000","last_unstale":"2024-09-12T22:06:53.979023+0000","last_undegraded":"2024-09-12T22:06:53.979023+0000","last_fullsized":"2024-09-12T22:06:53.979023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:11.198373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980261+0000","last_change":"2024-09-12T22:06:50.435272+0000","last_active":"2024-09-12T22:06:53.980261+0000","last_peered":"2024-09-12T22:06:53.980261+0000","last_clean":"2024-09-12T22:06:53.980261+0000","last_became_active":"2024-09-12T22:06:50.419354+0000","last_became_peered":"2024-09-12T22:06:50.419354+0000","last_unstale":"2024-09-12T22:06:53.980261+0000","last_undegraded":"2024-09-12T22:06:53.980261+0000","last_fullsized":"2024-09-12T22:06:53.980261+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:59.450087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979844+0000","last_change":"2024-09-12T22:06:50.418804+0000","last_active":"2024-09-12T22:06:53.979844+0000","last_peered":"2024-09-12T22:06:53.979844+0000","last_clean":"2024-09-12T22:06:53.979844+0000","last_became_active":"2024-09-12T22:06:50.418444+0000","last_became_peered":"2024-09-12T22:06:50.418444+0000","last_unstale":"2024-09-12T22:06:53.979844+0000","last_undegraded":"2024-09-12T22:06:53.979844+0000","last_fullsized":"2024-09-12T22:06:53.979844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:43.033754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034987+0000","last_change":"2024-09-12T22:06:50.419309+0000","last_active":"2024-09-12T22:06:54.034987+0000","last_peered":"2024-09-12T22:06:54.034987+0000","last_clean":"2024-09-12T22:06:54.034987+0000","last_became_active":"2024-09-12T22:06:50.418591+0000","last_became_peered":"2024-09-12T22:06:50.418591+0000","last_unstale":"2024-09-12T22:06:54.034987+0000","last_undegraded":"2024-09-12T22:06:54.034987+0000","last_fullsized":"2024-09-12T22:06:54.034987+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:23.918205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979863+0000","last_change":"2024-09-12T22:06:50.421370+0000","last_active":"2024-09-12T22:06:53.979863+0000","last_peered":"2024-09-12T22:06:53.979863+0000","last_clean":"2024-09-12T22:06:53.979863+0000","last_became_active":"2024-09-12T22:06:50.419642+0000","last_became_peered":"2024-09-12T22:06:50.419642+0000","last_unstale":"2024-09-12T22:06:53.979863+0000","last_undegraded":"2024-09-12T22:06:53.979863+0000","last_fullsized":"2024-09-12T22:06:53.979863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:13.028012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980078+0000","last_change":"2024-09-12T22:06:50.437734+0000","last_active":"2024-09-12T22:06:53.980078+0000","last_peered":"2024-09-12T22:06:53.980078+0000","last_clean":"2024-09-12T22:06:53.980078+0000","last_became_active":"2024-09-12T22:06:50.420099+0000","last_became_peered":"2024-09-12T22:06:50.420099+0000","last_unstale":"2024-09-12T22:06:53.980078+0000","last_undegraded":"2024-09-12T22:06:53.980078+0000","last_fullsized":"2024-09-12T22:06:53.980078+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:05.638054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034976+0000","last_change":"2024-09-12T22:03:54.194965+0000","last_active":"2024-09-12T22:06:54.034976+0000","last_peered":"2024-09-12T22:06:54.034976+0000","last_clean":"2024-09-12T22:06:54.034976+0000","last_became_active":"2024-09-12T22:03:54.194697+0000","last_became_peered":"2024-09-12T22:03:54.194697+0000","last_unstale":"2024-09-12T22:06:54.034976+0000","last_undegraded":"2024-09-12T22:06:54.034976+0000","last_fullsized":"2024-09-12T22:06:54.034976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:47.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":189,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035598+0000","last_change":"2024-09-12T22:06:50.430086+0000","last_active":"2024-09-12T22:06:54.035598+0000","last_peered":"2024-09-12T22:06:54.035598+0000","last_clean":"2024-09-12T22:06:54.035598+0000","last_became_active":"2024-09-12T22:06:50.423283+0000","last_became_peered":"2024-09-12T22:06:50.423283+0000","last_unstale":"2024-09-12T22:06:54.035598+0000","last_undegraded":"2024-09-12T22:06:54.035598+0000","last_fullsized":"2024-09-12T22:06:54.035598+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:38.836493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979901+0000","last_change":"2024-09-12T22:06:50.421357+0000","last_active":"2024-09-12T22:06:53.979901+0000","last_peered":"2024-09-12T22:06:53.979901+0000","last_clean":"2024-09-12T22:06:53.979901+0000","last_became_active":"2024-09-12T22:06:50.420171+0000","last_became_peered":"2024-09-12T22:06:50.420171+0000","last_unstale":"2024-09-12T22:06:53.979901+0000","last_undegraded":"2024-09-12T22:06:53.979901+0000","last_fullsized":"2024-09-12T22:06:53.979901+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:25.747880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979236+0000","last_change":"2024-09-12T22:06:50.418126+0000","last_active":"2024-09-12T22:06:53.979236+0000","last_peered":"2024-09-12T22:06:53.979236+0000","last_clean":"2024-09-12T22:06:53.979236+0000","last_became_active":"2024-09-12T22:06:50.417583+0000","last_became_peered":"2024-09-12T22:06:50.417583+0000","last_unstale":"2024-09-12T22:06:53.979236+0000","last_undegraded":"2024-09-12T22:06:53.979236+0000","last_fullsized":"2024-09-12T22:06:53.979236+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:17:44.500650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980312+0000","last_change":"2024-09-12T22:06:44.422538+0000","last_active":"2024-09-12T22:06:53.980312+0000","last_peered":"2024-09-12T22:06:53.980312+0000","last_clean":"2024-09-12T22:06:53.980312+0000","last_became_active":"2024-09-12T22:06:44.422217+0000","last_became_peered":"2024-09-12T22:06:44.422217+0000","last_unstale":"2024-09-12T22:06:53.980312+0000","last_undegraded":"2024-09-12T22:06:53.980312+0000","last_fullsized":"2024-09-12T22:06:53.980312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:10.635087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979185+0000","last_change":"2024-09-12T22:06:44.390100+0000","last_active":"2024-09-12T22:06:53.979185+0000","last_peered":"2024-09-12T22:06:53.979185+0000","last_clean":"2024-09-12T22:06:53.979185+0000","last_became_active":"2024-09-12T22:06:44.388560+0000","last_became_peered":"2024-09-12T22:06:44.388560+0000","last_unstale":"2024-09-12T22:06:53.979185+0000","last_undegraded":"2024-09-12T22:06:53.979185+0000","last_fullsized":"2024-09-12T22:06:53.979185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:18.786679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.036028+0000","last_change":"2024-09-12T22:03:33.460177+0000","last_active":"2024-09-12T22:06:54.036028+0000","last_peered":"2024-09-12T22:06:54.036028+0000","last_clean":"2024-09-12T22:06:54.036028+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:06:54.036028+0000","last_undegraded":"2024-09-12T22:06:54.036028+0000","last_fullsized":"2024-09-12T22:06:54.036028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:54.904513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979285+0000","last_change":"2024-09-12T22:06:44.388874+0000","last_active":"2024-09-12T22:06:53.979285+0000","last_peered":"2024-09-12T22:06:53.979285+0000","last_clean":"2024-09-12T22:06:53.979285+0000","last_became_active":"2024-09-12T22:06:44.388499+0000","last_became_peered":"2024-09-12T22:06:44.388499+0000","last_unstale":"2024-09-12T22:06:53.979285+0000","last_undegraded":"2024-09-12T22:06:53.979285+0000","last_fullsized":"2024-09-12T22:06:53.979285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:48.397806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980074+0000","last_change":"2024-09-12T22:06:50.419782+0000","last_active":"2024-09-12T22:06:53.980074+0000","last_peered":"2024-09-12T22:06:53.980074+0000","last_clean":"2024-09-12T22:06:53.980074+0000","last_became_active":"2024-09-12T22:06:50.418800+0000","last_became_peered":"2024-09-12T22:06:50.418800+0000","last_unstale":"2024-09-12T22:06:53.980074+0000","last_undegraded":"2024-09-12T22:06:53.980074+0000","last_fullsized":"2024-09-12T22:06:53.980074+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:42:06.678070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978996+0000","last_change":"2024-09-12T22:06:50.418163+0000","last_active":"2024-09-12T22:06:53.978996+0000","last_peered":"2024-09-12T22:06:53.978996+0000","last_clean":"2024-09-12T22:06:53.978996+0000","last_became_active":"2024-09-12T22:06:50.417455+0000","last_became_peered":"2024-09-12T22:06:50.417455+0000","last_unstale":"2024-09-12T22:06:53.978996+0000","last_undegraded":"2024-09-12T22:06:53.978996+0000","last_fullsized":"2024-09-12T22:06:53.978996+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:02:41.699273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035911+0000","last_change":"2024-09-12T22:03:33.465186+0000","last_active":"2024-09-12T22:06:54.035911+0000","last_peered":"2024-09-12T22:06:54.035911+0000","last_clean":"2024-09-12T22:06:54.035911+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:06:54.035911+0000","last_undegraded":"2024-09-12T22:06:54.035911+0000","last_fullsized":"2024-09-12T22:06:54.035911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:29.409225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035270+0000","last_change":"2024-09-12T22:06:44.391108+0000","last_active":"2024-09-12T22:06:54.035270+0000","last_peered":"2024-09-12T22:06:54.035270+0000","last_clean":"2024-09-12T22:06:54.035270+0000","last_became_active":"2024-09-12T22:06:44.390719+0000","last_became_peered":"2024-09-12T22:06:44.390719+0000","last_unstale":"2024-09-12T22:06:54.035270+0000","last_undegraded":"2024-09-12T22:06:54.035270+0000","last_fullsized":"2024-09-12T22:06:54.035270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:19.780194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035404+0000","last_change":"2024-09-12T22:06:44.392898+0000","last_active":"2024-09-12T22:06:54.035404+0000","last_peered":"2024-09-12T22:06:54.035404+0000","last_clean":"2024-09-12T22:06:54.035404+0000","last_became_active":"2024-09-12T22:06:44.392160+0000","last_became_peered":"2024-09-12T22:06:44.392160+0000","last_unstale":"2024-09-12T22:06:54.035404+0000","last_undegraded":"2024-09-12T22:06:54.035404+0000","last_fullsized":"2024-09-12T22:06:54.035404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:15:25.344346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035083+0000","last_change":"2024-09-12T22:06:50.419266+0000","last_active":"2024-09-12T22:06:54.035083+0000","last_peered":"2024-09-12T22:06:54.035083+0000","last_clean":"2024-09-12T22:06:54.035083+0000","last_became_active":"2024-09-12T22:06:50.418834+0000","last_became_peered":"2024-09-12T22:06:50.418834+0000","last_unstale":"2024-09-12T22:06:54.035083+0000","last_undegraded":"2024-09-12T22:06:54.035083+0000","last_fullsized":"2024-09-12T22:06:54.035083+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:32.300720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979215+0000","last_change":"2024-09-12T22:06:50.420055+0000","last_active":"2024-09-12T22:06:53.979215+0000","last_peered":"2024-09-12T22:06:53.979215+0000","last_clean":"2024-09-12T22:06:53.979215+0000","last_became_active":"2024-09-12T22:06:50.418856+0000","last_became_peered":"2024-09-12T22:06:50.418856+0000","last_unstale":"2024-09-12T22:06:53.979215+0000","last_undegraded":"2024-09-12T22:06:53.979215+0000","last_fullsized":"2024-09-12T22:06:53.979215+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:42.010524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980021+0000","last_change":"2024-09-12T22:06:50.439495+0000","last_active":"2024-09-12T22:06:53.980021+0000","last_peered":"2024-09-12T22:06:53.980021+0000","last_clean":"2024-09-12T22:06:53.980021+0000","last_became_active":"2024-09-12T22:06:50.421034+0000","last_became_peered":"2024-09-12T22:06:50.421034+0000","last_unstale":"2024-09-12T22:06:53.980021+0000","last_undegraded":"2024-09-12T22:06:53.980021+0000","last_fullsized":"2024-09-12T22:06:53.980021+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:46.276197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979173+0000","last_change":"2024-09-12T22:06:50.420937+0000","last_active":"2024-09-12T22:06:53.979173+0000","last_peered":"2024-09-12T22:06:53.979173+0000","last_clean":"2024-09-12T22:06:53.979173+0000","last_became_active":"2024-09-12T22:06:50.419417+0000","last_became_peered":"2024-09-12T22:06:50.419417+0000","last_unstale":"2024-09-12T22:06:53.979173+0000","last_undegraded":"2024-09-12T22:06:53.979173+0000","last_fullsized":"2024-09-12T22:06:53.979173+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:01:48.684913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035839+0000","last_change":"2024-09-12T22:03:32.461230+0000","last_active":"2024-09-12T22:06:54.035839+0000","last_peered":"2024-09-12T22:06:54.035839+0000","last_clean":"2024-09-12T22:06:54.035839+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:06:54.035839+0000","last_undegraded":"2024-09-12T22:06:54.035839+0000","last_fullsized":"2024-09-12T22:06:54.035839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:16.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035299+0000","last_change":"2024-09-12T22:06:44.392598+0000","last_active":"2024-09-12T22:06:54.035299+0000","last_peered":"2024-09-12T22:06:54.035299+0000","last_clean":"2024-09-12T22:06:54.035299+0000","last_became_active":"2024-09-12T22:06:44.392020+0000","last_became_peered":"2024-09-12T22:06:44.392020+0000","last_unstale":"2024-09-12T22:06:54.035299+0000","last_undegraded":"2024-09-12T22:06:54.035299+0000","last_fullsized":"2024-09-12T22:06:54.035299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:01.708696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979850+0000","last_change":"2024-09-12T22:06:44.394611+0000","last_active":"2024-09-12T22:06:53.979850+0000","last_peered":"2024-09-12T22:06:53.979850+0000","last_clean":"2024-09-12T22:06:53.979850+0000","last_became_active":"2024-09-12T22:06:44.394195+0000","last_became_peered":"2024-09-12T22:06:44.394195+0000","last_unstale":"2024-09-12T22:06:53.979850+0000","last_undegraded":"2024-09-12T22:06:53.979850+0000","last_fullsized":"2024-09-12T22:06:53.979850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:53.173265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.978895+0000","last_change":"2024-09-12T22:06:50.421136+0000","last_active":"2024-09-12T22:06:53.978895+0000","last_peered":"2024-09-12T22:06:53.978895+0000","last_clean":"2024-09-12T22:06:53.978895+0000","last_became_active":"2024-09-12T22:06:50.420176+0000","last_became_peered":"2024-09-12T22:06:50.420176+0000","last_unstale":"2024-09-12T22:06:53.978895+0000","last_undegraded":"2024-09-12T22:06:53.978895+0000","last_fullsized":"2024-09-12T22:06:53.978895+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:24.868192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980485+0000","last_change":"2024-09-12T22:06:50.433450+0000","last_active":"2024-09-12T22:06:53.980485+0000","last_peered":"2024-09-12T22:06:53.980485+0000","last_clean":"2024-09-12T22:06:53.980485+0000","last_became_active":"2024-09-12T22:06:50.417229+0000","last_became_peered":"2024-09-12T22:06:50.417229+0000","last_unstale":"2024-09-12T22:06:53.980485+0000","last_undegraded":"2024-09-12T22:06:53.980485+0000","last_fullsized":"2024-09-12T22:06:53.980485+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:38.255675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2430,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705712,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":564512,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":562878,"kb_avail":93807328,"statfs":{"total":96636764160,"available":96058703872,"internally_reserved":0,"allocated":1646592,"data_stored":1060429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576387525},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705712,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411820,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":410174,"kb_avail":93960020,"statfs":{"total":96636764160,"available":96215060480,"internally_reserved":0,"allocated":1658880,"data_stored":1061064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":420018629},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285573,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50700,"kb_used_data":1016,"kb_used_omap":6,"kb_used_meta":49657,"kb_avail":94321140,"statfs":{"total":96636764160,"available":96584847360,"internally_reserved":0,"allocated":1040384,"data_stored":468902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6904,"internal_metadata":50849032},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:07:02.866 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.866 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.866 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.866 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.866 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.867 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.867 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.867 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.867 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.867 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.867 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.867 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.868 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.868 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.868 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.869 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.869 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.869 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.869 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.870 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.870 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.870 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.870 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.870 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.871 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.871 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.871 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.871 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.872 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.872 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.872 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.872 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.872 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.873 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.873 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.873 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.873 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.873 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.874 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.874 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.874 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.874 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.875 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.875 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.875 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.875 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.876 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.876 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.876 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.876 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.877 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.877 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.877 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.877 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.877 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.878 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.878 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T22:03:22.303285+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.878 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T22:03:27.319181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.878 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.878 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.878 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T22:03:27.319181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.878 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.878 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.879 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T22:03:27.319181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.879 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.879 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.879 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T22:03:27.319181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.879 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.879 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.879 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.879 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T22:03:27.319181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.879 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.880 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.880 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T22:03:27.319181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.880 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.880 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.880 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T22:03:27.319181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.880 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.880 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.880 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T22:03:27.319181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.880 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.881 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.881 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.881 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.881 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.881 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.881 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.881 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.881 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.881 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.882 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.882 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.882 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.882 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.882 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.883 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.883 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.883 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.883 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.883 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.884 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.884 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.884 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.884 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.884 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:02.885 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T22:07:22.886 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:07:23.201 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:07:23.202 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:07:23.212 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-09-12T22:07:22.293724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":592798,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1027012,"kb_used_data":4244,"kb_used_omap":9,"kb_used_meta":1022710,"kb_avail":282088508,"statfs":{"total":289910292480,"available":288858632192,"internally_reserved":0,"allocated":4345856,"data_stored":2590395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10094,"internal_metadata":1047255186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002927"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:07.568999+0000","last_change":"2024-09-12T22:07:07.569038+0000","last_active":"2024-09-12T22:07:07.568999+0000","last_peered":"2024-09-12T22:07:07.568999+0000","last_clean":"2024-09-12T22:07:07.568999+0000","last_became_active":"2024-09-12T22:06:44.391100+0000","last_became_peered":"2024-09-12T22:06:44.391100+0000","last_unstale":"2024-09-12T22:07:07.568999+0000","last_undegraded":"2024-09-12T22:07:07.568999+0000","last_fullsized":"2024-09-12T22:07:07.568999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:07.568895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:07.568895+0000","last_clean_scrub_stamp":"2024-09-12T22:07:07.568895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:55.171097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:02.571064+0000","last_change":"2024-09-12T22:07:02.571103+0000","last_active":"2024-09-12T22:07:02.571064+0000","last_peered":"2024-09-12T22:07:02.571064+0000","last_clean":"2024-09-12T22:07:02.571064+0000","last_became_active":"2024-09-12T22:06:44.392188+0000","last_became_peered":"2024-09-12T22:06:44.392188+0000","last_unstale":"2024-09-12T22:07:02.571064+0000","last_undegraded":"2024-09-12T22:07:02.571064+0000","last_fullsized":"2024-09-12T22:07:02.571064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:02.570956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:02.570956+0000","last_clean_scrub_stamp":"2024-09-12T22:07:02.570956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:45.454533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979775+0000","last_change":"2024-09-12T22:03:33.462148+0000","last_active":"2024-09-12T22:06:53.979775+0000","last_peered":"2024-09-12T22:06:53.979775+0000","last_clean":"2024-09-12T22:06:53.979775+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:06:53.979775+0000","last_undegraded":"2024-09-12T22:06:53.979775+0000","last_fullsized":"2024-09-12T22:06:53.979775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:14.360867+0000","last_change":"2024-09-12T22:07:14.360891+0000","last_active":"2024-09-12T22:07:14.360867+0000","last_peered":"2024-09-12T22:07:14.360867+0000","last_clean":"2024-09-12T22:07:14.360867+0000","last_became_active":"2024-09-12T22:06:50.419429+0000","last_became_peered":"2024-09-12T22:06:50.419429+0000","last_unstale":"2024-09-12T22:07:14.360867+0000","last_undegraded":"2024-09-12T22:07:14.360867+0000","last_fullsized":"2024-09-12T22:07:14.360867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:14.360779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:14.360779+0000","last_clean_scrub_stamp":"2024-09-12T22:07:14.360779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:55.117684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035215+0000","last_change":"2024-09-12T22:06:44.392862+0000","last_active":"2024-09-12T22:06:54.035215+0000","last_peered":"2024-09-12T22:06:54.035215+0000","last_clean":"2024-09-12T22:06:54.035215+0000","last_became_active":"2024-09-12T22:06:44.391774+0000","last_became_peered":"2024-09-12T22:06:44.391774+0000","last_unstale":"2024-09-12T22:06:54.035215+0000","last_undegraded":"2024-09-12T22:06:54.035215+0000","last_fullsized":"2024-09-12T22:06:54.035215+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:15.359866+0000","last_change":"2024-09-12T22:07:15.359893+0000","last_active":"2024-09-12T22:07:15.359866+0000","last_peered":"2024-09-12T22:07:15.359866+0000","last_clean":"2024-09-12T22:07:15.359866+0000","last_became_active":"2024-09-12T22:06:50.414526+0000","last_became_peered":"2024-09-12T22:06:50.414526+0000","last_unstale":"2024-09-12T22:07:15.359866+0000","last_undegraded":"2024-09-12T22:07:15.359866+0000","last_fullsized":"2024-09-12T22:07:15.359866+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:15.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:15.359774+0000","last_clean_scrub_stamp":"2024-09-12T22:07:15.359774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:16.223853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979579+0000","last_change":"2024-09-12T22:06:44.421423+0000","last_active":"2024-09-12T22:06:53.979579+0000","last_peered":"2024-09-12T22:06:53.979579+0000","last_clean":"2024-09-12T22:06:53.979579+0000","last_became_active":"2024-09-12T22:06:44.421094+0000","last_became_peered":"2024-09-12T22:06:44.421094+0000","last_unstale":"2024-09-12T22:06:53.979579+0000","last_undegraded":"2024-09-12T22:06:53.979579+0000","last_fullsized":"2024-09-12T22:06:53.979579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979375+0000","last_change":"2024-09-12T22:06:44.395363+0000","last_active":"2024-09-12T22:06:53.979375+0000","last_peered":"2024-09-12T22:06:53.979375+0000","last_clean":"2024-09-12T22:06:53.979375+0000","last_became_active":"2024-09-12T22:06:44.394804+0000","last_became_peered":"2024-09-12T22:06:44.394804+0000","last_unstale":"2024-09-12T22:06:53.979375+0000","last_undegraded":"2024-09-12T22:06:53.979375+0000","last_fullsized":"2024-09-12T22:06:53.979375+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980248+0000","last_change":"2024-09-12T22:06:44.390017+0000","last_active":"2024-09-12T22:06:53.980248+0000","last_peered":"2024-09-12T22:06:53.980248+0000","last_clean":"2024-09-12T22:06:53.980248+0000","last_became_active":"2024-09-12T22:06:44.389256+0000","last_became_peered":"2024-09-12T22:06:44.389256+0000","last_unstale":"2024-09-12T22:06:53.980248+0000","last_undegraded":"2024-09-12T22:06:53.980248+0000","last_fullsized":"2024-09-12T22:06:53.980248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:15.484734+0000","last_change":"2024-09-12T22:07:15.484758+0000","last_active":"2024-09-12T22:07:15.484734+0000","last_peered":"2024-09-12T22:07:15.484734+0000","last_clean":"2024-09-12T22:07:15.484734+0000","last_became_active":"2024-09-12T22:06:44.391572+0000","last_became_peered":"2024-09-12T22:06:44.391572+0000","last_unstale":"2024-09-12T22:07:15.484734+0000","last_undegraded":"2024-09-12T22:07:15.484734+0000","last_fullsized":"2024-09-12T22:07:15.484734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:15.484646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:15.484646+0000","last_clean_scrub_stamp":"2024-09-12T22:07:15.484646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:05.597210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979435+0000","last_change":"2024-09-12T22:06:50.420008+0000","last_active":"2024-09-12T22:06:53.979435+0000","last_peered":"2024-09-12T22:06:53.979435+0000","last_clean":"2024-09-12T22:06:53.979435+0000","last_became_active":"2024-09-12T22:06:50.419042+0000","last_became_peered":"2024-09-12T22:06:50.419042+0000","last_unstale":"2024-09-12T22:06:53.979435+0000","last_undegraded":"2024-09-12T22:06:53.979435+0000","last_fullsized":"2024-09-12T22:06:53.979435+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035415+0000","last_change":"2024-09-12T22:03:33.465069+0000","last_active":"2024-09-12T22:06:54.035415+0000","last_peered":"2024-09-12T22:06:54.035415+0000","last_clean":"2024-09-12T22:06:54.035415+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:06:54.035415+0000","last_undegraded":"2024-09-12T22:06:54.035415+0000","last_fullsized":"2024-09-12T22:06:54.035415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:04.552650+0000","last_change":"2024-09-12T22:07:04.552671+0000","last_active":"2024-09-12T22:07:04.552650+0000","last_peered":"2024-09-12T22:07:04.552650+0000","last_clean":"2024-09-12T22:07:04.552650+0000","last_became_active":"2024-09-12T22:06:44.392491+0000","last_became_peered":"2024-09-12T22:06:44.392491+0000","last_unstale":"2024-09-12T22:07:04.552650+0000","last_undegraded":"2024-09-12T22:07:04.552650+0000","last_fullsized":"2024-09-12T22:07:04.552650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:04.552563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:04.552563+0000","last_clean_scrub_stamp":"2024-09-12T22:07:04.552563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:51.979285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:16.392714+0000","last_change":"2024-09-12T22:07:16.392737+0000","last_active":"2024-09-12T22:07:16.392714+0000","last_peered":"2024-09-12T22:07:16.392714+0000","last_clean":"2024-09-12T22:07:16.392714+0000","last_became_active":"2024-09-12T22:06:50.418325+0000","last_became_peered":"2024-09-12T22:06:50.418325+0000","last_unstale":"2024-09-12T22:07:16.392714+0000","last_undegraded":"2024-09-12T22:07:16.392714+0000","last_fullsized":"2024-09-12T22:07:16.392714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:16.392602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:16.392602+0000","last_clean_scrub_stamp":"2024-09-12T22:07:16.392602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:59.530527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:08.369681+0000","last_change":"2024-09-12T22:07:08.369704+0000","last_active":"2024-09-12T22:07:08.369681+0000","last_peered":"2024-09-12T22:07:08.369681+0000","last_clean":"2024-09-12T22:07:08.369681+0000","last_became_active":"2024-09-12T22:06:50.418075+0000","last_became_peered":"2024-09-12T22:06:50.418075+0000","last_unstale":"2024-09-12T22:07:08.369681+0000","last_undegraded":"2024-09-12T22:07:08.369681+0000","last_fullsized":"2024-09-12T22:07:08.369681+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:08.369593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:08.369593+0000","last_clean_scrub_stamp":"2024-09-12T22:07:08.369593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:35.314936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979465+0000","last_change":"2024-09-12T22:06:44.395099+0000","last_active":"2024-09-12T22:06:53.979465+0000","last_peered":"2024-09-12T22:06:53.979465+0000","last_clean":"2024-09-12T22:06:53.979465+0000","last_became_active":"2024-09-12T22:06:44.394486+0000","last_became_peered":"2024-09-12T22:06:44.394486+0000","last_unstale":"2024-09-12T22:06:53.979465+0000","last_undegraded":"2024-09-12T22:06:53.979465+0000","last_fullsized":"2024-09-12T22:06:53.979465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980240+0000","last_change":"2024-09-12T22:06:44.390021+0000","last_active":"2024-09-12T22:06:53.980240+0000","last_peered":"2024-09-12T22:06:53.980240+0000","last_clean":"2024-09-12T22:06:53.980240+0000","last_became_active":"2024-09-12T22:06:44.388967+0000","last_became_peered":"2024-09-12T22:06:44.388967+0000","last_unstale":"2024-09-12T22:06:53.980240+0000","last_undegraded":"2024-09-12T22:06:53.980240+0000","last_fullsized":"2024-09-12T22:06:53.980240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:08.608560+0000","last_change":"2024-09-12T22:07:08.608587+0000","last_active":"2024-09-12T22:07:08.608560+0000","last_peered":"2024-09-12T22:07:08.608560+0000","last_clean":"2024-09-12T22:07:08.608560+0000","last_became_active":"2024-09-12T22:06:44.390858+0000","last_became_peered":"2024-09-12T22:06:44.390858+0000","last_unstale":"2024-09-12T22:07:08.608560+0000","last_undegraded":"2024-09-12T22:07:08.608560+0000","last_fullsized":"2024-09-12T22:07:08.608560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:08.608471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:08.608471+0000","last_clean_scrub_stamp":"2024-09-12T22:07:08.608471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:44.761690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979888+0000","last_change":"2024-09-12T22:06:44.389205+0000","last_active":"2024-09-12T22:06:53.979888+0000","last_peered":"2024-09-12T22:06:53.979888+0000","last_clean":"2024-09-12T22:06:53.979888+0000","last_became_active":"2024-09-12T22:06:44.388761+0000","last_became_peered":"2024-09-12T22:06:44.388761+0000","last_unstale":"2024-09-12T22:06:53.979888+0000","last_undegraded":"2024-09-12T22:06:53.979888+0000","last_fullsized":"2024-09-12T22:06:53.979888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980209+0000","last_change":"2024-09-12T22:06:44.421429+0000","last_active":"2024-09-12T22:06:53.980209+0000","last_peered":"2024-09-12T22:06:53.980209+0000","last_clean":"2024-09-12T22:06:53.980209+0000","last_became_active":"2024-09-12T22:06:44.420768+0000","last_became_peered":"2024-09-12T22:06:44.420768+0000","last_unstale":"2024-09-12T22:06:53.980209+0000","last_undegraded":"2024-09-12T22:06:53.980209+0000","last_fullsized":"2024-09-12T22:06:53.980209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:02.466714+0000","last_change":"2024-09-12T22:07:02.466752+0000","last_active":"2024-09-12T22:07:02.466714+0000","last_peered":"2024-09-12T22:07:02.466714+0000","last_clean":"2024-09-12T22:07:02.466714+0000","last_became_active":"2024-09-12T22:06:50.421758+0000","last_became_peered":"2024-09-12T22:06:50.421758+0000","last_unstale":"2024-09-12T22:07:02.466714+0000","last_undegraded":"2024-09-12T22:07:02.466714+0000","last_fullsized":"2024-09-12T22:07:02.466714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:02.466611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:02.466611+0000","last_clean_scrub_stamp":"2024-09-12T22:07:02.466611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:13.189761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035210+0000","last_change":"2024-09-12T22:03:33.460994+0000","last_active":"2024-09-12T22:06:54.035210+0000","last_peered":"2024-09-12T22:06:54.035210+0000","last_clean":"2024-09-12T22:06:54.035210+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:06:54.035210+0000","last_undegraded":"2024-09-12T22:06:54.035210+0000","last_fullsized":"2024-09-12T22:06:54.035210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:15.972800+0000","last_change":"2024-09-12T22:07:15.972824+0000","last_active":"2024-09-12T22:07:15.972800+0000","last_peered":"2024-09-12T22:07:15.972800+0000","last_clean":"2024-09-12T22:07:15.972800+0000","last_became_active":"2024-09-12T22:06:50.416924+0000","last_became_peered":"2024-09-12T22:06:50.416924+0000","last_unstale":"2024-09-12T22:07:15.972800+0000","last_undegraded":"2024-09-12T22:07:15.972800+0000","last_fullsized":"2024-09-12T22:07:15.972800+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:15.972710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:15.972710+0000","last_clean_scrub_stamp":"2024-09-12T22:07:15.972710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:40.574353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:09.567288+0000","last_change":"2024-09-12T22:07:09.567334+0000","last_active":"2024-09-12T22:07:09.567288+0000","last_peered":"2024-09-12T22:07:09.567288+0000","last_clean":"2024-09-12T22:07:09.567288+0000","last_became_active":"2024-09-12T22:06:44.391480+0000","last_became_peered":"2024-09-12T22:06:44.391480+0000","last_unstale":"2024-09-12T22:07:09.567288+0000","last_undegraded":"2024-09-12T22:07:09.567288+0000","last_fullsized":"2024-09-12T22:07:09.567288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:09.567191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:09.567191+0000","last_clean_scrub_stamp":"2024-09-12T22:07:09.567191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:19.334017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":173,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.036047+0000","last_change":"2024-09-12T22:06:50.420130+0000","last_active":"2024-09-12T22:06:54.036047+0000","last_peered":"2024-09-12T22:06:54.036047+0000","last_clean":"2024-09-12T22:06:54.036047+0000","last_became_active":"2024-09-12T22:06:50.419573+0000","last_became_peered":"2024-09-12T22:06:50.419573+0000","last_unstale":"2024-09-12T22:06:54.036047+0000","last_undegraded":"2024-09-12T22:06:54.036047+0000","last_fullsized":"2024-09-12T22:06:54.036047+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980264+0000","last_change":"2024-09-12T22:06:50.420167+0000","last_active":"2024-09-12T22:06:53.980264+0000","last_peered":"2024-09-12T22:06:53.980264+0000","last_clean":"2024-09-12T22:06:53.980264+0000","last_became_active":"2024-09-12T22:06:50.419348+0000","last_became_peered":"2024-09-12T22:06:50.419348+0000","last_unstale":"2024-09-12T22:06:53.980264+0000","last_undegraded":"2024-09-12T22:06:53.980264+0000","last_fullsized":"2024-09-12T22:06:53.980264+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979773+0000","last_change":"2024-09-12T22:03:33.461282+0000","last_active":"2024-09-12T22:06:53.979773+0000","last_peered":"2024-09-12T22:06:53.979773+0000","last_clean":"2024-09-12T22:06:53.979773+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:06:53.979773+0000","last_undegraded":"2024-09-12T22:06:53.979773+0000","last_fullsized":"2024-09-12T22:06:53.979773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":173,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035688+0000","last_change":"2024-09-12T22:06:50.419329+0000","last_active":"2024-09-12T22:06:54.035688+0000","last_peered":"2024-09-12T22:06:54.035688+0000","last_clean":"2024-09-12T22:06:54.035688+0000","last_became_active":"2024-09-12T22:06:50.418755+0000","last_became_peered":"2024-09-12T22:06:50.418755+0000","last_unstale":"2024-09-12T22:06:54.035688+0000","last_undegraded":"2024-09-12T22:06:54.035688+0000","last_fullsized":"2024-09-12T22:06:54.035688+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:02.879310+0000","last_change":"2024-09-12T22:07:02.879360+0000","last_active":"2024-09-12T22:07:02.879310+0000","last_peered":"2024-09-12T22:07:02.879310+0000","last_clean":"2024-09-12T22:07:02.879310+0000","last_became_active":"2024-09-12T22:06:44.397198+0000","last_became_peered":"2024-09-12T22:06:44.397198+0000","last_unstale":"2024-09-12T22:07:02.879310+0000","last_undegraded":"2024-09-12T22:07:02.879310+0000","last_fullsized":"2024-09-12T22:07:02.879310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:02.879206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:02.879206+0000","last_clean_scrub_stamp":"2024-09-12T22:07:02.879206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:56.691650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035358+0000","last_change":"2024-09-12T22:03:33.456842+0000","last_active":"2024-09-12T22:06:54.035358+0000","last_peered":"2024-09-12T22:06:54.035358+0000","last_clean":"2024-09-12T22:06:54.035358+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:06:54.035358+0000","last_undegraded":"2024-09-12T22:06:54.035358+0000","last_fullsized":"2024-09-12T22:06:54.035358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:06.828211+0000","last_change":"2024-09-12T22:07:06.828268+0000","last_active":"2024-09-12T22:07:06.828211+0000","last_peered":"2024-09-12T22:07:06.828211+0000","last_clean":"2024-09-12T22:07:06.828211+0000","last_became_active":"2024-09-12T22:06:44.397074+0000","last_became_peered":"2024-09-12T22:06:44.397074+0000","last_unstale":"2024-09-12T22:07:06.828211+0000","last_undegraded":"2024-09-12T22:07:06.828211+0000","last_fullsized":"2024-09-12T22:07:06.828211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:06.828090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:06.828090+0000","last_clean_scrub_stamp":"2024-09-12T22:07:06.828090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:26:24.122811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:13.373982+0000","last_change":"2024-09-12T22:07:13.374006+0000","last_active":"2024-09-12T22:07:13.373982+0000","last_peered":"2024-09-12T22:07:13.373982+0000","last_clean":"2024-09-12T22:07:13.373982+0000","last_became_active":"2024-09-12T22:06:50.414626+0000","last_became_peered":"2024-09-12T22:06:50.414626+0000","last_unstale":"2024-09-12T22:07:13.373982+0000","last_undegraded":"2024-09-12T22:07:13.373982+0000","last_fullsized":"2024-09-12T22:07:13.373982+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:13.373893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:13.373893+0000","last_clean_scrub_stamp":"2024-09-12T22:07:13.373893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:01.475526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:11.545572+0000","last_change":"2024-09-12T22:07:11.545596+0000","last_active":"2024-09-12T22:07:11.545572+0000","last_peered":"2024-09-12T22:07:11.545572+0000","last_clean":"2024-09-12T22:07:11.545572+0000","last_became_active":"2024-09-12T22:06:44.391447+0000","last_became_peered":"2024-09-12T22:06:44.391447+0000","last_unstale":"2024-09-12T22:07:11.545572+0000","last_undegraded":"2024-09-12T22:07:11.545572+0000","last_fullsized":"2024-09-12T22:07:11.545572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:11.545486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:11.545486+0000","last_clean_scrub_stamp":"2024-09-12T22:07:11.545486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:37.307770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979546+0000","last_change":"2024-09-12T22:06:50.442693+0000","last_active":"2024-09-12T22:06:53.979546+0000","last_peered":"2024-09-12T22:06:53.979546+0000","last_clean":"2024-09-12T22:06:53.979546+0000","last_became_active":"2024-09-12T22:06:50.422232+0000","last_became_peered":"2024-09-12T22:06:50.422232+0000","last_unstale":"2024-09-12T22:06:53.979546+0000","last_undegraded":"2024-09-12T22:06:53.979546+0000","last_fullsized":"2024-09-12T22:06:53.979546+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:12.581801+0000","last_change":"2024-09-12T22:07:12.581841+0000","last_active":"2024-09-12T22:07:12.581801+0000","last_peered":"2024-09-12T22:07:12.581801+0000","last_clean":"2024-09-12T22:07:12.581801+0000","last_became_active":"2024-09-12T22:06:44.390652+0000","last_became_peered":"2024-09-12T22:06:44.390652+0000","last_unstale":"2024-09-12T22:07:12.581801+0000","last_undegraded":"2024-09-12T22:07:12.581801+0000","last_fullsized":"2024-09-12T22:07:12.581801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:12.581719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:12.581719+0000","last_clean_scrub_stamp":"2024-09-12T22:07:12.581719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:48.655239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:13.960253+0000","last_change":"2024-09-12T22:07:13.960279+0000","last_active":"2024-09-12T22:07:13.960253+0000","last_peered":"2024-09-12T22:07:13.960253+0000","last_clean":"2024-09-12T22:07:13.960253+0000","last_became_active":"2024-09-12T22:06:50.417123+0000","last_became_peered":"2024-09-12T22:06:50.417123+0000","last_unstale":"2024-09-12T22:07:13.960253+0000","last_undegraded":"2024-09-12T22:07:13.960253+0000","last_fullsized":"2024-09-12T22:07:13.960253+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:13.960165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:13.960165+0000","last_clean_scrub_stamp":"2024-09-12T22:07:13.960165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:46.981226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980222+0000","last_change":"2024-09-12T22:06:50.419787+0000","last_active":"2024-09-12T22:06:53.980222+0000","last_peered":"2024-09-12T22:06:53.980222+0000","last_clean":"2024-09-12T22:06:53.980222+0000","last_became_active":"2024-09-12T22:06:50.418817+0000","last_became_peered":"2024-09-12T22:06:50.418817+0000","last_unstale":"2024-09-12T22:06:53.980222+0000","last_undegraded":"2024-09-12T22:06:53.980222+0000","last_fullsized":"2024-09-12T22:06:53.980222+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035234+0000","last_change":"2024-09-12T22:06:50.419697+0000","last_active":"2024-09-12T22:06:54.035234+0000","last_peered":"2024-09-12T22:06:54.035234+0000","last_clean":"2024-09-12T22:06:54.035234+0000","last_became_active":"2024-09-12T22:06:50.419047+0000","last_became_peered":"2024-09-12T22:06:50.419047+0000","last_unstale":"2024-09-12T22:06:54.035234+0000","last_undegraded":"2024-09-12T22:06:54.035234+0000","last_fullsized":"2024-09-12T22:06:54.035234+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:09.935028+0000","last_change":"2024-09-12T22:07:09.935054+0000","last_active":"2024-09-12T22:07:09.935028+0000","last_peered":"2024-09-12T22:07:09.935028+0000","last_clean":"2024-09-12T22:07:09.935028+0000","last_became_active":"2024-09-12T22:06:44.421955+0000","last_became_peered":"2024-09-12T22:06:44.421955+0000","last_unstale":"2024-09-12T22:07:09.935028+0000","last_undegraded":"2024-09-12T22:07:09.935028+0000","last_fullsized":"2024-09-12T22:07:09.935028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:09.934934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:09.934934+0000","last_clean_scrub_stamp":"2024-09-12T22:07:09.934934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:12.156188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979088+0000","last_change":"2024-09-12T22:06:50.432341+0000","last_active":"2024-09-12T22:06:53.979088+0000","last_peered":"2024-09-12T22:06:53.979088+0000","last_clean":"2024-09-12T22:06:53.979088+0000","last_became_active":"2024-09-12T22:06:50.418227+0000","last_became_peered":"2024-09-12T22:06:50.418227+0000","last_unstale":"2024-09-12T22:06:53.979088+0000","last_undegraded":"2024-09-12T22:06:53.979088+0000","last_fullsized":"2024-09-12T22:06:53.979088+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979765+0000","last_change":"2024-09-12T22:06:50.426521+0000","last_active":"2024-09-12T22:06:53.979765+0000","last_peered":"2024-09-12T22:06:53.979765+0000","last_clean":"2024-09-12T22:06:53.979765+0000","last_became_active":"2024-09-12T22:06:50.418222+0000","last_became_peered":"2024-09-12T22:06:50.418222+0000","last_unstale":"2024-09-12T22:06:53.979765+0000","last_undegraded":"2024-09-12T22:06:53.979765+0000","last_fullsized":"2024-09-12T22:06:53.979765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.034938+0000","last_change":"2024-09-12T22:03:33.465308+0000","last_active":"2024-09-12T22:06:54.034938+0000","last_peered":"2024-09-12T22:06:54.034938+0000","last_clean":"2024-09-12T22:06:54.034938+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:06:54.034938+0000","last_undegraded":"2024-09-12T22:06:54.034938+0000","last_fullsized":"2024-09-12T22:06:54.034938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035691+0000","last_change":"2024-09-12T22:03:32.461301+0000","last_active":"2024-09-12T22:06:54.035691+0000","last_peered":"2024-09-12T22:06:54.035691+0000","last_clean":"2024-09-12T22:06:54.035691+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:06:54.035691+0000","last_undegraded":"2024-09-12T22:06:54.035691+0000","last_fullsized":"2024-09-12T22:06:54.035691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:06.545707+0000","last_change":"2024-09-12T22:07:06.545732+0000","last_active":"2024-09-12T22:07:06.545707+0000","last_peered":"2024-09-12T22:07:06.545707+0000","last_clean":"2024-09-12T22:07:06.545707+0000","last_became_active":"2024-09-12T22:06:44.390807+0000","last_became_peered":"2024-09-12T22:06:44.390807+0000","last_unstale":"2024-09-12T22:07:06.545707+0000","last_undegraded":"2024-09-12T22:07:06.545707+0000","last_fullsized":"2024-09-12T22:07:06.545707+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:06.545621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:06.545621+0000","last_clean_scrub_stamp":"2024-09-12T22:07:06.545621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:28.452733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980112+0000","last_change":"2024-09-12T22:03:32.459540+0000","last_active":"2024-09-12T22:06:53.980112+0000","last_peered":"2024-09-12T22:06:53.980112+0000","last_clean":"2024-09-12T22:06:53.980112+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:06:53.980112+0000","last_undegraded":"2024-09-12T22:06:53.980112+0000","last_fullsized":"2024-09-12T22:06:53.980112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979477+0000","last_change":"2024-09-12T22:06:44.421712+0000","last_active":"2024-09-12T22:06:53.979477+0000","last_peered":"2024-09-12T22:06:53.979477+0000","last_clean":"2024-09-12T22:06:53.979477+0000","last_became_active":"2024-09-12T22:06:44.421388+0000","last_became_peered":"2024-09-12T22:06:44.421388+0000","last_unstale":"2024-09-12T22:06:53.979477+0000","last_undegraded":"2024-09-12T22:06:53.979477+0000","last_fullsized":"2024-09-12T22:06:53.979477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":177,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:17.427660+0000","last_change":"2024-09-12T22:07:17.427684+0000","last_active":"2024-09-12T22:07:17.427660+0000","last_peered":"2024-09-12T22:07:17.427660+0000","last_clean":"2024-09-12T22:07:17.427660+0000","last_became_active":"2024-09-12T22:06:44.421430+0000","last_became_peered":"2024-09-12T22:06:44.421430+0000","last_unstale":"2024-09-12T22:07:17.427660+0000","last_undegraded":"2024-09-12T22:07:17.427660+0000","last_fullsized":"2024-09-12T22:07:17.427660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:17.427573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:17.427573+0000","last_clean_scrub_stamp":"2024-09-12T22:07:17.427573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:17.811728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:03.870785+0000","last_change":"2024-09-12T22:07:03.870814+0000","last_active":"2024-09-12T22:07:03.870785+0000","last_peered":"2024-09-12T22:07:03.870785+0000","last_clean":"2024-09-12T22:07:03.870785+0000","last_became_active":"2024-09-12T22:06:44.397490+0000","last_became_peered":"2024-09-12T22:06:44.397490+0000","last_unstale":"2024-09-12T22:07:03.870785+0000","last_undegraded":"2024-09-12T22:07:03.870785+0000","last_fullsized":"2024-09-12T22:07:03.870785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:03.870684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:03.870684+0000","last_clean_scrub_stamp":"2024-09-12T22:07:03.870684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:12.834646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979616+0000","last_change":"2024-09-12T22:06:50.426880+0000","last_active":"2024-09-12T22:06:53.979616+0000","last_peered":"2024-09-12T22:06:53.979616+0000","last_clean":"2024-09-12T22:06:53.979616+0000","last_became_active":"2024-09-12T22:06:50.417240+0000","last_became_peered":"2024-09-12T22:06:50.417240+0000","last_unstale":"2024-09-12T22:06:53.979616+0000","last_undegraded":"2024-09-12T22:06:53.979616+0000","last_fullsized":"2024-09-12T22:06:53.979616+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980244+0000","last_change":"2024-09-12T22:06:44.421723+0000","last_active":"2024-09-12T22:06:53.980244+0000","last_peered":"2024-09-12T22:06:53.980244+0000","last_clean":"2024-09-12T22:06:53.980244+0000","last_became_active":"2024-09-12T22:06:44.421071+0000","last_became_peered":"2024-09-12T22:06:44.421071+0000","last_unstale":"2024-09-12T22:06:53.980244+0000","last_undegraded":"2024-09-12T22:06:53.980244+0000","last_fullsized":"2024-09-12T22:06:53.980244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:03.424879+0000","last_change":"2024-09-12T22:07:03.424902+0000","last_active":"2024-09-12T22:07:03.424879+0000","last_peered":"2024-09-12T22:07:03.424879+0000","last_clean":"2024-09-12T22:07:03.424879+0000","last_became_active":"2024-09-12T22:06:50.421734+0000","last_became_peered":"2024-09-12T22:06:50.421734+0000","last_unstale":"2024-09-12T22:07:03.424879+0000","last_undegraded":"2024-09-12T22:07:03.424879+0000","last_fullsized":"2024-09-12T22:07:03.424879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:03.424792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:03.424792+0000","last_clean_scrub_stamp":"2024-09-12T22:07:03.424792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:12.328912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979928+0000","last_change":"2024-09-12T22:03:33.459084+0000","last_active":"2024-09-12T22:06:53.979928+0000","last_peered":"2024-09-12T22:06:53.979928+0000","last_clean":"2024-09-12T22:06:53.979928+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:06:53.979928+0000","last_undegraded":"2024-09-12T22:06:53.979928+0000","last_fullsized":"2024-09-12T22:06:53.979928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035465+0000","last_change":"2024-09-12T22:03:32.461417+0000","last_active":"2024-09-12T22:06:54.035465+0000","last_peered":"2024-09-12T22:06:54.035465+0000","last_clean":"2024-09-12T22:06:54.035465+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:06:54.035465+0000","last_undegraded":"2024-09-12T22:06:54.035465+0000","last_fullsized":"2024-09-12T22:06:54.035465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:12.415036+0000","last_change":"2024-09-12T22:07:12.415080+0000","last_active":"2024-09-12T22:07:12.415036+0000","last_peered":"2024-09-12T22:07:12.415036+0000","last_clean":"2024-09-12T22:07:12.415036+0000","last_became_active":"2024-09-12T22:06:50.418648+0000","last_became_peered":"2024-09-12T22:06:50.418648+0000","last_unstale":"2024-09-12T22:07:12.415036+0000","last_undegraded":"2024-09-12T22:07:12.415036+0000","last_fullsized":"2024-09-12T22:07:12.415036+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:12.414901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:12.414901+0000","last_clean_scrub_stamp":"2024-09-12T22:07:12.414901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:12.172982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":177,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:05.559724+0000","last_change":"2024-09-12T22:07:05.559748+0000","last_active":"2024-09-12T22:07:05.559724+0000","last_peered":"2024-09-12T22:07:05.559724+0000","last_clean":"2024-09-12T22:07:05.559724+0000","last_became_active":"2024-09-12T22:06:44.391078+0000","last_became_peered":"2024-09-12T22:06:44.391078+0000","last_unstale":"2024-09-12T22:07:05.559724+0000","last_undegraded":"2024-09-12T22:07:05.559724+0000","last_fullsized":"2024-09-12T22:07:05.559724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:05.559632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:05.559632+0000","last_clean_scrub_stamp":"2024-09-12T22:07:05.559632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:55.590535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:10.938968+0000","last_change":"2024-09-12T22:07:10.938995+0000","last_active":"2024-09-12T22:07:10.938968+0000","last_peered":"2024-09-12T22:07:10.938968+0000","last_clean":"2024-09-12T22:07:10.938968+0000","last_became_active":"2024-09-12T22:06:44.396783+0000","last_became_peered":"2024-09-12T22:06:44.396783+0000","last_unstale":"2024-09-12T22:07:10.938968+0000","last_undegraded":"2024-09-12T22:07:10.938968+0000","last_fullsized":"2024-09-12T22:07:10.938968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:10.938876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:10.938876+0000","last_clean_scrub_stamp":"2024-09-12T22:07:10.938876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:47.400030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":316,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979080+0000","last_change":"2024-09-12T22:06:52.982526+0000","last_active":"2024-09-12T22:06:53.979080+0000","last_peered":"2024-09-12T22:06:53.979080+0000","last_clean":"2024-09-12T22:06:53.979080+0000","last_became_active":"2024-09-12T22:06:52.982174+0000","last_became_peered":"2024-09-12T22:06:52.982174+0000","last_unstale":"2024-09-12T22:06:53.979080+0000","last_undegraded":"2024-09-12T22:06:53.979080+0000","last_fullsized":"2024-09-12T22:06:53.979080+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979867+0000","last_change":"2024-09-12T22:06:50.444340+0000","last_active":"2024-09-12T22:06:53.979867+0000","last_peered":"2024-09-12T22:06:53.979867+0000","last_clean":"2024-09-12T22:06:53.979867+0000","last_became_active":"2024-09-12T22:06:50.422353+0000","last_became_peered":"2024-09-12T22:06:50.422353+0000","last_unstale":"2024-09-12T22:06:53.979867+0000","last_undegraded":"2024-09-12T22:06:53.979867+0000","last_fullsized":"2024-09-12T22:06:53.979867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:12.943676+0000","last_change":"2024-09-12T22:07:12.943702+0000","last_active":"2024-09-12T22:07:12.943676+0000","last_peered":"2024-09-12T22:07:12.943676+0000","last_clean":"2024-09-12T22:07:12.943676+0000","last_became_active":"2024-09-12T22:06:44.396659+0000","last_became_peered":"2024-09-12T22:06:44.396659+0000","last_unstale":"2024-09-12T22:07:12.943676+0000","last_undegraded":"2024-09-12T22:07:12.943676+0000","last_fullsized":"2024-09-12T22:07:12.943676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:12.943584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:12.943584+0000","last_clean_scrub_stamp":"2024-09-12T22:07:12.943584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:28.806765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:09.396524+0000","last_change":"2024-09-12T22:07:09.396548+0000","last_active":"2024-09-12T22:07:09.396524+0000","last_peered":"2024-09-12T22:07:09.396524+0000","last_clean":"2024-09-12T22:07:09.396524+0000","last_became_active":"2024-09-12T22:06:50.418443+0000","last_became_peered":"2024-09-12T22:06:50.418443+0000","last_unstale":"2024-09-12T22:07:09.396524+0000","last_undegraded":"2024-09-12T22:07:09.396524+0000","last_fullsized":"2024-09-12T22:07:09.396524+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:09.396436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:09.396436+0000","last_clean_scrub_stamp":"2024-09-12T22:07:09.396436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:16.931640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:10.439511+0000","last_change":"2024-09-12T22:07:10.439544+0000","last_active":"2024-09-12T22:07:10.439511+0000","last_peered":"2024-09-12T22:07:10.439511+0000","last_clean":"2024-09-12T22:07:10.439511+0000","last_became_active":"2024-09-12T22:06:50.418160+0000","last_became_peered":"2024-09-12T22:06:50.418160+0000","last_unstale":"2024-09-12T22:07:10.439511+0000","last_undegraded":"2024-09-12T22:07:10.439511+0000","last_fullsized":"2024-09-12T22:07:10.439511+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:10.439427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:10.439427+0000","last_clean_scrub_stamp":"2024-09-12T22:07:10.439427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:51.021107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:14.933464+0000","last_change":"2024-09-12T22:07:14.933489+0000","last_active":"2024-09-12T22:07:14.933464+0000","last_peered":"2024-09-12T22:07:14.933464+0000","last_clean":"2024-09-12T22:07:14.933464+0000","last_became_active":"2024-09-12T22:06:44.396378+0000","last_became_peered":"2024-09-12T22:06:44.396378+0000","last_unstale":"2024-09-12T22:07:14.933464+0000","last_undegraded":"2024-09-12T22:07:14.933464+0000","last_fullsized":"2024-09-12T22:07:14.933464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:14.933368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:14.933368+0000","last_clean_scrub_stamp":"2024-09-12T22:07:14.933368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:47.246315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:17.465625+0000","last_change":"2024-09-12T22:07:17.465662+0000","last_active":"2024-09-12T22:07:17.465625+0000","last_peered":"2024-09-12T22:07:17.465625+0000","last_clean":"2024-09-12T22:07:17.465625+0000","last_became_active":"2024-09-12T22:06:44.391809+0000","last_became_peered":"2024-09-12T22:06:44.391809+0000","last_unstale":"2024-09-12T22:07:17.465625+0000","last_undegraded":"2024-09-12T22:07:17.465625+0000","last_fullsized":"2024-09-12T22:07:17.465625+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:17.465504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:17.465504+0000","last_clean_scrub_stamp":"2024-09-12T22:07:17.465504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:22.795263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:08.894316+0000","last_change":"2024-09-12T22:07:08.894340+0000","last_active":"2024-09-12T22:07:08.894316+0000","last_peered":"2024-09-12T22:07:08.894316+0000","last_clean":"2024-09-12T22:07:08.894316+0000","last_became_active":"2024-09-12T22:06:44.396596+0000","last_became_peered":"2024-09-12T22:06:44.396596+0000","last_unstale":"2024-09-12T22:07:08.894316+0000","last_undegraded":"2024-09-12T22:07:08.894316+0000","last_fullsized":"2024-09-12T22:07:08.894316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:08.894223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:08.894223+0000","last_clean_scrub_stamp":"2024-09-12T22:07:08.894223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:59.133246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035081+0000","last_change":"2024-09-12T22:06:50.419281+0000","last_active":"2024-09-12T22:06:54.035081+0000","last_peered":"2024-09-12T22:06:54.035081+0000","last_clean":"2024-09-12T22:06:54.035081+0000","last_became_active":"2024-09-12T22:06:50.418876+0000","last_became_peered":"2024-09-12T22:06:50.418876+0000","last_unstale":"2024-09-12T22:06:54.035081+0000","last_undegraded":"2024-09-12T22:06:54.035081+0000","last_fullsized":"2024-09-12T22:06:54.035081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980424+0000","last_change":"2024-09-12T22:06:44.390385+0000","last_active":"2024-09-12T22:06:53.980424+0000","last_peered":"2024-09-12T22:06:53.980424+0000","last_clean":"2024-09-12T22:06:53.980424+0000","last_became_active":"2024-09-12T22:06:44.389680+0000","last_became_peered":"2024-09-12T22:06:44.389680+0000","last_unstale":"2024-09-12T22:06:53.980424+0000","last_undegraded":"2024-09-12T22:06:53.980424+0000","last_fullsized":"2024-09-12T22:06:53.980424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":184,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979809+0000","last_change":"2024-09-12T22:06:44.421429+0000","last_active":"2024-09-12T22:06:53.979809+0000","last_peered":"2024-09-12T22:06:53.979809+0000","last_clean":"2024-09-12T22:06:53.979809+0000","last_became_active":"2024-09-12T22:06:44.421088+0000","last_became_peered":"2024-09-12T22:06:44.421088+0000","last_unstale":"2024-09-12T22:06:53.979809+0000","last_undegraded":"2024-09-12T22:06:53.979809+0000","last_fullsized":"2024-09-12T22:06:53.979809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:06.420142+0000","last_change":"2024-09-12T22:07:06.420187+0000","last_active":"2024-09-12T22:07:06.420142+0000","last_peered":"2024-09-12T22:07:06.420142+0000","last_clean":"2024-09-12T22:07:06.420142+0000","last_became_active":"2024-09-12T22:06:50.423052+0000","last_became_peered":"2024-09-12T22:06:50.423052+0000","last_unstale":"2024-09-12T22:07:06.420142+0000","last_undegraded":"2024-09-12T22:07:06.420142+0000","last_fullsized":"2024-09-12T22:07:06.420142+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:06.420019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:06.420019+0000","last_clean_scrub_stamp":"2024-09-12T22:07:06.420019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:43.805506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:01.910331+0000","last_change":"2024-09-12T22:07:01.910357+0000","last_active":"2024-09-12T22:07:01.910331+0000","last_peered":"2024-09-12T22:07:01.910331+0000","last_clean":"2024-09-12T22:07:01.910331+0000","last_became_active":"2024-09-12T22:06:44.397452+0000","last_became_peered":"2024-09-12T22:06:44.397452+0000","last_unstale":"2024-09-12T22:07:01.910331+0000","last_undegraded":"2024-09-12T22:07:01.910331+0000","last_fullsized":"2024-09-12T22:07:01.910331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:01.910235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:01.910235+0000","last_clean_scrub_stamp":"2024-09-12T22:07:01.910235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:30.512629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979505+0000","last_change":"2024-09-12T22:06:50.420039+0000","last_active":"2024-09-12T22:06:53.979505+0000","last_peered":"2024-09-12T22:06:53.979505+0000","last_clean":"2024-09-12T22:06:53.979505+0000","last_became_active":"2024-09-12T22:06:50.419551+0000","last_became_peered":"2024-09-12T22:06:50.419551+0000","last_unstale":"2024-09-12T22:06:53.979505+0000","last_undegraded":"2024-09-12T22:06:53.979505+0000","last_fullsized":"2024-09-12T22:06:53.979505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:04.846724+0000","last_change":"2024-09-12T22:07:04.846748+0000","last_active":"2024-09-12T22:07:04.846724+0000","last_peered":"2024-09-12T22:07:04.846724+0000","last_clean":"2024-09-12T22:07:04.846724+0000","last_became_active":"2024-09-12T22:06:44.396979+0000","last_became_peered":"2024-09-12T22:06:44.396979+0000","last_unstale":"2024-09-12T22:07:04.846724+0000","last_undegraded":"2024-09-12T22:07:04.846724+0000","last_fullsized":"2024-09-12T22:07:04.846724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:04.846632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:04.846632+0000","last_clean_scrub_stamp":"2024-09-12T22:07:04.846632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:01.019176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":181,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:03.572805+0000","last_change":"2024-09-12T22:07:03.572842+0000","last_active":"2024-09-12T22:07:03.572805+0000","last_peered":"2024-09-12T22:07:03.572805+0000","last_clean":"2024-09-12T22:07:03.572805+0000","last_became_active":"2024-09-12T22:06:50.418763+0000","last_became_peered":"2024-09-12T22:06:50.418763+0000","last_unstale":"2024-09-12T22:07:03.572805+0000","last_undegraded":"2024-09-12T22:07:03.572805+0000","last_fullsized":"2024-09-12T22:07:03.572805+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:03.572715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:03.572715+0000","last_clean_scrub_stamp":"2024-09-12T22:07:03.572715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:46.408963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979850+0000","last_change":"2024-09-12T22:06:44.389682+0000","last_active":"2024-09-12T22:06:53.979850+0000","last_peered":"2024-09-12T22:06:53.979850+0000","last_clean":"2024-09-12T22:06:53.979850+0000","last_became_active":"2024-09-12T22:06:44.388887+0000","last_became_peered":"2024-09-12T22:06:44.388887+0000","last_unstale":"2024-09-12T22:06:53.979850+0000","last_undegraded":"2024-09-12T22:06:53.979850+0000","last_fullsized":"2024-09-12T22:06:53.979850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":188,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:14.515746+0000","last_change":"2024-09-12T22:07:14.515781+0000","last_active":"2024-09-12T22:07:14.515746+0000","last_peered":"2024-09-12T22:07:14.515746+0000","last_clean":"2024-09-12T22:07:14.515746+0000","last_became_active":"2024-09-12T22:06:44.390260+0000","last_became_peered":"2024-09-12T22:06:44.390260+0000","last_unstale":"2024-09-12T22:07:14.515746+0000","last_undegraded":"2024-09-12T22:07:14.515746+0000","last_fullsized":"2024-09-12T22:07:14.515746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:14.515657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:14.515657+0000","last_clean_scrub_stamp":"2024-09-12T22:07:14.515657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:33.952425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035366+0000","last_change":"2024-09-12T22:03:33.464893+0000","last_active":"2024-09-12T22:06:54.035366+0000","last_peered":"2024-09-12T22:06:54.035366+0000","last_clean":"2024-09-12T22:06:54.035366+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:06:54.035366+0000","last_undegraded":"2024-09-12T22:06:54.035366+0000","last_fullsized":"2024-09-12T22:06:54.035366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980103+0000","last_change":"2024-09-12T22:06:44.390378+0000","last_active":"2024-09-12T22:06:53.980103+0000","last_peered":"2024-09-12T22:06:53.980103+0000","last_clean":"2024-09-12T22:06:53.980103+0000","last_became_active":"2024-09-12T22:06:44.389622+0000","last_became_peered":"2024-09-12T22:06:44.389622+0000","last_unstale":"2024-09-12T22:06:53.980103+0000","last_undegraded":"2024-09-12T22:06:53.980103+0000","last_fullsized":"2024-09-12T22:06:53.980103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":69,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:05.846797+0000","last_change":"2024-09-12T22:07:05.846822+0000","last_active":"2024-09-12T22:07:05.846797+0000","last_peered":"2024-09-12T22:07:05.846797+0000","last_clean":"2024-09-12T22:07:05.846797+0000","last_became_active":"2024-09-12T22:06:44.396735+0000","last_became_peered":"2024-09-12T22:06:44.396735+0000","last_unstale":"2024-09-12T22:07:05.846797+0000","last_undegraded":"2024-09-12T22:07:05.846797+0000","last_fullsized":"2024-09-12T22:07:05.846797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:05.846706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:05.846706+0000","last_clean_scrub_stamp":"2024-09-12T22:07:05.846706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:12.877837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:07.864716+0000","last_change":"2024-09-12T22:07:07.864739+0000","last_active":"2024-09-12T22:07:07.864716+0000","last_peered":"2024-09-12T22:07:07.864716+0000","last_clean":"2024-09-12T22:07:07.864716+0000","last_became_active":"2024-09-12T22:06:44.421723+0000","last_became_peered":"2024-09-12T22:06:44.421723+0000","last_unstale":"2024-09-12T22:07:07.864716+0000","last_undegraded":"2024-09-12T22:07:07.864716+0000","last_fullsized":"2024-09-12T22:07:07.864716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:07.864622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:07.864622+0000","last_clean_scrub_stamp":"2024-09-12T22:07:07.864622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:01.376833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980295+0000","last_change":"2024-09-12T22:06:50.435272+0000","last_active":"2024-09-12T22:06:53.980295+0000","last_peered":"2024-09-12T22:06:53.980295+0000","last_clean":"2024-09-12T22:06:53.980295+0000","last_became_active":"2024-09-12T22:06:50.419354+0000","last_became_peered":"2024-09-12T22:06:50.419354+0000","last_unstale":"2024-09-12T22:06:53.980295+0000","last_undegraded":"2024-09-12T22:06:53.980295+0000","last_fullsized":"2024-09-12T22:06:53.980295+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:11.417569+0000","last_change":"2024-09-12T22:07:11.417613+0000","last_active":"2024-09-12T22:07:11.417569+0000","last_peered":"2024-09-12T22:07:11.417569+0000","last_clean":"2024-09-12T22:07:11.417569+0000","last_became_active":"2024-09-12T22:06:50.418444+0000","last_became_peered":"2024-09-12T22:06:50.418444+0000","last_unstale":"2024-09-12T22:07:11.417569+0000","last_undegraded":"2024-09-12T22:07:11.417569+0000","last_fullsized":"2024-09-12T22:07:11.417569+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:11.417469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:11.417469+0000","last_clean_scrub_stamp":"2024-09-12T22:07:11.417469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:27.058849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":173,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035066+0000","last_change":"2024-09-12T22:06:50.419309+0000","last_active":"2024-09-12T22:06:54.035066+0000","last_peered":"2024-09-12T22:06:54.035066+0000","last_clean":"2024-09-12T22:06:54.035066+0000","last_became_active":"2024-09-12T22:06:50.418591+0000","last_became_peered":"2024-09-12T22:06:50.418591+0000","last_unstale":"2024-09-12T22:06:54.035066+0000","last_undegraded":"2024-09-12T22:06:54.035066+0000","last_fullsized":"2024-09-12T22:06:54.035066+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:04.444101+0000","last_change":"2024-09-12T22:07:04.444123+0000","last_active":"2024-09-12T22:07:04.444101+0000","last_peered":"2024-09-12T22:07:04.444101+0000","last_clean":"2024-09-12T22:07:04.444101+0000","last_became_active":"2024-09-12T22:06:50.419642+0000","last_became_peered":"2024-09-12T22:06:50.419642+0000","last_unstale":"2024-09-12T22:07:04.444101+0000","last_undegraded":"2024-09-12T22:07:04.444101+0000","last_fullsized":"2024-09-12T22:07:04.444101+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:04.444011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:04.444011+0000","last_clean_scrub_stamp":"2024-09-12T22:07:04.444011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:41.709278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980124+0000","last_change":"2024-09-12T22:06:50.437734+0000","last_active":"2024-09-12T22:06:53.980124+0000","last_peered":"2024-09-12T22:06:53.980124+0000","last_clean":"2024-09-12T22:06:53.980124+0000","last_became_active":"2024-09-12T22:06:50.420099+0000","last_became_peered":"2024-09-12T22:06:50.420099+0000","last_unstale":"2024-09-12T22:06:53.980124+0000","last_undegraded":"2024-09-12T22:06:53.980124+0000","last_fullsized":"2024-09-12T22:06:53.980124+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:16.437933+0000","last_change":"2024-09-12T22:07:16.437959+0000","last_active":"2024-09-12T22:07:16.437933+0000","last_peered":"2024-09-12T22:07:16.437933+0000","last_clean":"2024-09-12T22:07:16.437933+0000","last_became_active":"2024-09-12T22:03:54.194697+0000","last_became_peered":"2024-09-12T22:03:54.194697+0000","last_unstale":"2024-09-12T22:07:16.437933+0000","last_undegraded":"2024-09-12T22:07:16.437933+0000","last_fullsized":"2024-09-12T22:07:16.437933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:16.437816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:16.437816+0000","last_clean_scrub_stamp":"2024-09-12T22:07:16.437816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:32.952376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":190,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035656+0000","last_change":"2024-09-12T22:06:50.430086+0000","last_active":"2024-09-12T22:06:54.035656+0000","last_peered":"2024-09-12T22:06:54.035656+0000","last_clean":"2024-09-12T22:06:54.035656+0000","last_became_active":"2024-09-12T22:06:50.423283+0000","last_became_peered":"2024-09-12T22:06:50.423283+0000","last_unstale":"2024-09-12T22:06:54.035656+0000","last_undegraded":"2024-09-12T22:06:54.035656+0000","last_fullsized":"2024-09-12T22:06:54.035656+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:05.469217+0000","last_change":"2024-09-12T22:07:05.469261+0000","last_active":"2024-09-12T22:07:05.469217+0000","last_peered":"2024-09-12T22:07:05.469217+0000","last_clean":"2024-09-12T22:07:05.469217+0000","last_became_active":"2024-09-12T22:06:50.420171+0000","last_became_peered":"2024-09-12T22:06:50.420171+0000","last_unstale":"2024-09-12T22:07:05.469217+0000","last_undegraded":"2024-09-12T22:07:05.469217+0000","last_fullsized":"2024-09-12T22:07:05.469217+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:05.469120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:05.469120+0000","last_clean_scrub_stamp":"2024-09-12T22:07:05.469120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:42.616669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979550+0000","last_change":"2024-09-12T22:06:50.418126+0000","last_active":"2024-09-12T22:06:53.979550+0000","last_peered":"2024-09-12T22:06:53.979550+0000","last_clean":"2024-09-12T22:06:53.979550+0000","last_became_active":"2024-09-12T22:06:50.417583+0000","last_became_peered":"2024-09-12T22:06:50.417583+0000","last_unstale":"2024-09-12T22:06:53.979550+0000","last_undegraded":"2024-09-12T22:06:53.979550+0000","last_fullsized":"2024-09-12T22:06:53.979550+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:11.910998+0000","last_change":"2024-09-12T22:07:11.911025+0000","last_active":"2024-09-12T22:07:11.910998+0000","last_peered":"2024-09-12T22:07:11.910998+0000","last_clean":"2024-09-12T22:07:11.910998+0000","last_became_active":"2024-09-12T22:06:44.422217+0000","last_became_peered":"2024-09-12T22:06:44.422217+0000","last_unstale":"2024-09-12T22:07:11.910998+0000","last_undegraded":"2024-09-12T22:07:11.910998+0000","last_fullsized":"2024-09-12T22:07:11.910998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:11.910905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:11.910905+0000","last_clean_scrub_stamp":"2024-09-12T22:07:11.910905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:30:14.118448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979319+0000","last_change":"2024-09-12T22:06:44.390100+0000","last_active":"2024-09-12T22:06:53.979319+0000","last_peered":"2024-09-12T22:06:53.979319+0000","last_clean":"2024-09-12T22:06:53.979319+0000","last_became_active":"2024-09-12T22:06:44.388560+0000","last_became_peered":"2024-09-12T22:06:44.388560+0000","last_unstale":"2024-09-12T22:06:53.979319+0000","last_undegraded":"2024-09-12T22:06:53.979319+0000","last_fullsized":"2024-09-12T22:06:53.979319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.036077+0000","last_change":"2024-09-12T22:03:33.460177+0000","last_active":"2024-09-12T22:06:54.036077+0000","last_peered":"2024-09-12T22:06:54.036077+0000","last_clean":"2024-09-12T22:06:54.036077+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:06:54.036077+0000","last_undegraded":"2024-09-12T22:06:54.036077+0000","last_fullsized":"2024-09-12T22:06:54.036077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979361+0000","last_change":"2024-09-12T22:06:44.388874+0000","last_active":"2024-09-12T22:06:53.979361+0000","last_peered":"2024-09-12T22:06:53.979361+0000","last_clean":"2024-09-12T22:06:53.979361+0000","last_became_active":"2024-09-12T22:06:44.388499+0000","last_became_peered":"2024-09-12T22:06:44.388499+0000","last_unstale":"2024-09-12T22:06:53.979361+0000","last_undegraded":"2024-09-12T22:06:53.979361+0000","last_fullsized":"2024-09-12T22:06:53.979361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980130+0000","last_change":"2024-09-12T22:06:50.419782+0000","last_active":"2024-09-12T22:06:53.980130+0000","last_peered":"2024-09-12T22:06:53.980130+0000","last_clean":"2024-09-12T22:06:53.980130+0000","last_became_active":"2024-09-12T22:06:50.418800+0000","last_became_peered":"2024-09-12T22:06:50.418800+0000","last_unstale":"2024-09-12T22:06:53.980130+0000","last_undegraded":"2024-09-12T22:06:53.980130+0000","last_fullsized":"2024-09-12T22:06:53.980130+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979055+0000","last_change":"2024-09-12T22:06:50.418163+0000","last_active":"2024-09-12T22:06:53.979055+0000","last_peered":"2024-09-12T22:06:53.979055+0000","last_clean":"2024-09-12T22:06:53.979055+0000","last_became_active":"2024-09-12T22:06:50.417455+0000","last_became_peered":"2024-09-12T22:06:50.417455+0000","last_unstale":"2024-09-12T22:06:53.979055+0000","last_undegraded":"2024-09-12T22:06:53.979055+0000","last_fullsized":"2024-09-12T22:06:53.979055+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035955+0000","last_change":"2024-09-12T22:03:33.465186+0000","last_active":"2024-09-12T22:06:54.035955+0000","last_peered":"2024-09-12T22:06:54.035955+0000","last_clean":"2024-09-12T22:06:54.035955+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:06:54.035955+0000","last_undegraded":"2024-09-12T22:06:54.035955+0000","last_fullsized":"2024-09-12T22:06:54.035955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":178,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:10.540810+0000","last_change":"2024-09-12T22:07:10.540843+0000","last_active":"2024-09-12T22:07:10.540810+0000","last_peered":"2024-09-12T22:07:10.540810+0000","last_clean":"2024-09-12T22:07:10.540810+0000","last_became_active":"2024-09-12T22:06:44.390719+0000","last_became_peered":"2024-09-12T22:06:44.390719+0000","last_unstale":"2024-09-12T22:07:10.540810+0000","last_undegraded":"2024-09-12T22:07:10.540810+0000","last_fullsized":"2024-09-12T22:07:10.540810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-12T22:07:10.540723+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-12T22:07:10.540723+0000","last_clean_scrub_stamp":"2024-09-12T22:07:10.540723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:03.575272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035467+0000","last_change":"2024-09-12T22:06:44.392898+0000","last_active":"2024-09-12T22:06:54.035467+0000","last_peered":"2024-09-12T22:06:54.035467+0000","last_clean":"2024-09-12T22:06:54.035467+0000","last_became_active":"2024-09-12T22:06:44.392160+0000","last_became_peered":"2024-09-12T22:06:44.392160+0000","last_unstale":"2024-09-12T22:06:54.035467+0000","last_undegraded":"2024-09-12T22:06:54.035467+0000","last_fullsized":"2024-09-12T22:06:54.035467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":176,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035153+0000","last_change":"2024-09-12T22:06:50.419266+0000","last_active":"2024-09-12T22:06:54.035153+0000","last_peered":"2024-09-12T22:06:54.035153+0000","last_clean":"2024-09-12T22:06:54.035153+0000","last_became_active":"2024-09-12T22:06:50.418834+0000","last_became_peered":"2024-09-12T22:06:50.418834+0000","last_unstale":"2024-09-12T22:06:54.035153+0000","last_undegraded":"2024-09-12T22:06:54.035153+0000","last_fullsized":"2024-09-12T22:06:54.035153+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979261+0000","last_change":"2024-09-12T22:06:50.420055+0000","last_active":"2024-09-12T22:06:53.979261+0000","last_peered":"2024-09-12T22:06:53.979261+0000","last_clean":"2024-09-12T22:06:53.979261+0000","last_became_active":"2024-09-12T22:06:50.418856+0000","last_became_peered":"2024-09-12T22:06:50.418856+0000","last_unstale":"2024-09-12T22:06:53.979261+0000","last_undegraded":"2024-09-12T22:06:53.979261+0000","last_fullsized":"2024-09-12T22:06:53.979261+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980097+0000","last_change":"2024-09-12T22:06:50.439495+0000","last_active":"2024-09-12T22:06:53.980097+0000","last_peered":"2024-09-12T22:06:53.980097+0000","last_clean":"2024-09-12T22:06:53.980097+0000","last_became_active":"2024-09-12T22:06:50.421034+0000","last_became_peered":"2024-09-12T22:06:50.421034+0000","last_unstale":"2024-09-12T22:06:53.980097+0000","last_undegraded":"2024-09-12T22:06:53.980097+0000","last_fullsized":"2024-09-12T22:06:53.980097+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979229+0000","last_change":"2024-09-12T22:06:50.420937+0000","last_active":"2024-09-12T22:06:53.979229+0000","last_peered":"2024-09-12T22:06:53.979229+0000","last_clean":"2024-09-12T22:06:53.979229+0000","last_became_active":"2024-09-12T22:06:50.419417+0000","last_became_peered":"2024-09-12T22:06:50.419417+0000","last_unstale":"2024-09-12T22:06:53.979229+0000","last_undegraded":"2024-09-12T22:06:53.979229+0000","last_fullsized":"2024-09-12T22:06:53.979229+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:32.438151+0000","last_clean_scrub_stamp":"2024-09-12T22:03:32.438151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:54.035893+0000","last_change":"2024-09-12T22:03:32.461230+0000","last_active":"2024-09-12T22:06:54.035893+0000","last_peered":"2024-09-12T22:06:54.035893+0000","last_clean":"2024-09-12T22:06:54.035893+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:06:54.035893+0000","last_undegraded":"2024-09-12T22:06:54.035893+0000","last_fullsized":"2024-09-12T22:06:54.035893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:13.533869+0000","last_change":"2024-09-12T22:07:13.533895+0000","last_active":"2024-09-12T22:07:13.533869+0000","last_peered":"2024-09-12T22:07:13.533869+0000","last_clean":"2024-09-12T22:07:13.533869+0000","last_became_active":"2024-09-12T22:06:44.392020+0000","last_became_peered":"2024-09-12T22:06:44.392020+0000","last_unstale":"2024-09-12T22:07:13.533869+0000","last_undegraded":"2024-09-12T22:07:13.533869+0000","last_fullsized":"2024-09-12T22:07:13.533869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:13.533770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:13.533770+0000","last_clean_scrub_stamp":"2024-09-12T22:07:13.533770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:48.428924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:16.976909+0000","last_change":"2024-09-12T22:07:16.976939+0000","last_active":"2024-09-12T22:07:16.976909+0000","last_peered":"2024-09-12T22:07:16.976909+0000","last_clean":"2024-09-12T22:07:16.976909+0000","last_became_active":"2024-09-12T22:06:44.394195+0000","last_became_peered":"2024-09-12T22:06:44.394195+0000","last_unstale":"2024-09-12T22:07:16.976909+0000","last_undegraded":"2024-09-12T22:07:16.976909+0000","last_fullsized":"2024-09-12T22:07:16.976909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-12T22:07:16.976800+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-12T22:07:16.976800+0000","last_clean_scrub_stamp":"2024-09-12T22:07:16.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:48.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:07.410176+0000","last_change":"2024-09-12T22:07:07.410203+0000","last_active":"2024-09-12T22:07:07.410176+0000","last_peered":"2024-09-12T22:07:07.410176+0000","last_clean":"2024-09-12T22:07:07.410176+0000","last_became_active":"2024-09-12T22:06:50.420176+0000","last_became_peered":"2024-09-12T22:06:50.420176+0000","last_unstale":"2024-09-12T22:07:07.410176+0000","last_undegraded":"2024-09-12T22:07:07.410176+0000","last_fullsized":"2024-09-12T22:07:07.410176+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:07.410090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:07.410090+0000","last_clean_scrub_stamp":"2024-09-12T22:07:07.410090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:18.108691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.980515+0000","last_change":"2024-09-12T22:06:50.433450+0000","last_active":"2024-09-12T22:06:53.980515+0000","last_peered":"2024-09-12T22:06:53.980515+0000","last_clean":"2024-09-12T22:06:53.980515+0000","last_became_active":"2024-09-12T22:06:50.417229+0000","last_became_peered":"2024-09-12T22:06:50.417229+0000","last_unstale":"2024-09-12T22:06:53.980515+0000","last_undegraded":"2024-09-12T22:06:53.980515+0000","last_fullsized":"2024-09-12T22:06:53.980515+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:31.436642+0000","last_clean_scrub_stamp":"2024-09-12T22:03:31.436642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2430,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705716,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":564504,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":562878,"kb_avail":93807336,"statfs":{"total":96636764160,"available":96058712064,"internally_reserved":0,"allocated":1646592,"data_stored":1060429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576387525},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705716,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411812,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":410174,"kb_avail":93960028,"statfs":{"total":96636764160,"available":96215068672,"internally_reserved":0,"allocated":1658880,"data_stored":1061064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":420018629},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285577,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50696,"kb_used_data":1016,"kb_used_omap":6,"kb_used_meta":49657,"kb_avail":94321144,"statfs":{"total":96636764160,"available":96584851456,"internally_reserved":0,"allocated":1040384,"data_stored":468902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6904,"internal_metadata":50849032},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:07:23.217 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.217 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.217 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.217 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.217 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.217 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.217 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.218 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.218 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.218 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.218 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.218 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.218 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.218 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.218 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.218 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.219 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.219 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.219 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.219 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.219 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.219 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.219 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.219 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.220 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.220 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.220 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.220 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.220 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.220 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.220 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T22:03:22.303285+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.220 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T22:03:27.319181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.221 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.221 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.221 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T22:03:27.319181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.221 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.221 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.221 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.221 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.222 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.222 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.222 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.222 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.222 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.222 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.222 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.222 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.223 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.223 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.223 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.223 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.223 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.223 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.223 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.223 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T22:03:32.438151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.223 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.224 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T22:03:31.436642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:23.224 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T22:07:43.225 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:07:43.532 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:07:43.534 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:07:43.543 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-09-12T22:07:42.298216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":592798,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1027012,"kb_used_data":4244,"kb_used_omap":9,"kb_used_meta":1022710,"kb_avail":282088508,"statfs":{"total":289910292480,"available":288858632192,"internally_reserved":0,"allocated":4345856,"data_stored":2590395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10094,"internal_metadata":1047255186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002527"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:07.568999+0000","last_change":"2024-09-12T22:07:07.569038+0000","last_active":"2024-09-12T22:07:07.568999+0000","last_peered":"2024-09-12T22:07:07.568999+0000","last_clean":"2024-09-12T22:07:07.568999+0000","last_became_active":"2024-09-12T22:06:44.391100+0000","last_became_peered":"2024-09-12T22:06:44.391100+0000","last_unstale":"2024-09-12T22:07:07.568999+0000","last_undegraded":"2024-09-12T22:07:07.568999+0000","last_fullsized":"2024-09-12T22:07:07.568999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:07.568895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:07.568895+0000","last_clean_scrub_stamp":"2024-09-12T22:07:07.568895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:55.171097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:02.571064+0000","last_change":"2024-09-12T22:07:02.571103+0000","last_active":"2024-09-12T22:07:02.571064+0000","last_peered":"2024-09-12T22:07:02.571064+0000","last_clean":"2024-09-12T22:07:02.571064+0000","last_became_active":"2024-09-12T22:06:44.392188+0000","last_became_peered":"2024-09-12T22:06:44.392188+0000","last_unstale":"2024-09-12T22:07:02.571064+0000","last_undegraded":"2024-09-12T22:07:02.571064+0000","last_fullsized":"2024-09-12T22:07:02.571064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:02.570956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:02.570956+0000","last_clean_scrub_stamp":"2024-09-12T22:07:02.570956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:45.454533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:27.284600+0000","last_change":"2024-09-12T22:07:27.284627+0000","last_active":"2024-09-12T22:07:27.284600+0000","last_peered":"2024-09-12T22:07:27.284600+0000","last_clean":"2024-09-12T22:07:27.284600+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:07:27.284600+0000","last_undegraded":"2024-09-12T22:07:27.284600+0000","last_fullsized":"2024-09-12T22:07:27.284600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:27.284469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:27.284469+0000","last_clean_scrub_stamp":"2024-09-12T22:07:27.284469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:37.051296+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:14.360867+0000","last_change":"2024-09-12T22:07:14.360891+0000","last_active":"2024-09-12T22:07:14.360867+0000","last_peered":"2024-09-12T22:07:14.360867+0000","last_clean":"2024-09-12T22:07:14.360867+0000","last_became_active":"2024-09-12T22:06:50.419429+0000","last_became_peered":"2024-09-12T22:06:50.419429+0000","last_unstale":"2024-09-12T22:07:14.360867+0000","last_undegraded":"2024-09-12T22:07:14.360867+0000","last_fullsized":"2024-09-12T22:07:14.360867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:14.360779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:14.360779+0000","last_clean_scrub_stamp":"2024-09-12T22:07:14.360779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:55.117684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:19.462843+0000","last_change":"2024-09-12T22:07:19.462869+0000","last_active":"2024-09-12T22:07:19.462843+0000","last_peered":"2024-09-12T22:07:19.462843+0000","last_clean":"2024-09-12T22:07:19.462843+0000","last_became_active":"2024-09-12T22:06:44.391774+0000","last_became_peered":"2024-09-12T22:06:44.391774+0000","last_unstale":"2024-09-12T22:07:19.462843+0000","last_undegraded":"2024-09-12T22:07:19.462843+0000","last_fullsized":"2024-09-12T22:07:19.462843+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:19.462750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:19.462750+0000","last_clean_scrub_stamp":"2024-09-12T22:07:19.462750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:29.869167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:15.359866+0000","last_change":"2024-09-12T22:07:15.359893+0000","last_active":"2024-09-12T22:07:15.359866+0000","last_peered":"2024-09-12T22:07:15.359866+0000","last_clean":"2024-09-12T22:07:15.359866+0000","last_became_active":"2024-09-12T22:06:50.414526+0000","last_became_peered":"2024-09-12T22:06:50.414526+0000","last_unstale":"2024-09-12T22:07:15.359866+0000","last_undegraded":"2024-09-12T22:07:15.359866+0000","last_fullsized":"2024-09-12T22:07:15.359866+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:15.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:15.359774+0000","last_clean_scrub_stamp":"2024-09-12T22:07:15.359774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:16.223853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:30.335117+0000","last_change":"2024-09-12T22:07:30.335140+0000","last_active":"2024-09-12T22:07:30.335117+0000","last_peered":"2024-09-12T22:07:30.335117+0000","last_clean":"2024-09-12T22:07:30.335117+0000","last_became_active":"2024-09-12T22:06:44.421094+0000","last_became_peered":"2024-09-12T22:06:44.421094+0000","last_unstale":"2024-09-12T22:07:30.335117+0000","last_undegraded":"2024-09-12T22:07:30.335117+0000","last_fullsized":"2024-09-12T22:07:30.335117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:30.334984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:30.334984+0000","last_clean_scrub_stamp":"2024-09-12T22:07:30.334984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:56.481422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:29.341834+0000","last_change":"2024-09-12T22:07:29.341856+0000","last_active":"2024-09-12T22:07:29.341834+0000","last_peered":"2024-09-12T22:07:29.341834+0000","last_clean":"2024-09-12T22:07:29.341834+0000","last_became_active":"2024-09-12T22:06:44.394804+0000","last_became_peered":"2024-09-12T22:06:44.394804+0000","last_unstale":"2024-09-12T22:07:29.341834+0000","last_undegraded":"2024-09-12T22:07:29.341834+0000","last_fullsized":"2024-09-12T22:07:29.341834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:29.341727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:29.341727+0000","last_clean_scrub_stamp":"2024-09-12T22:07:29.341727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:55.104011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:22.045636+0000","last_change":"2024-09-12T22:07:22.045661+0000","last_active":"2024-09-12T22:07:22.045636+0000","last_peered":"2024-09-12T22:07:22.045636+0000","last_clean":"2024-09-12T22:07:22.045636+0000","last_became_active":"2024-09-12T22:06:44.389256+0000","last_became_peered":"2024-09-12T22:06:44.389256+0000","last_unstale":"2024-09-12T22:07:22.045636+0000","last_undegraded":"2024-09-12T22:07:22.045636+0000","last_fullsized":"2024-09-12T22:07:22.045636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:22.045548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:22.045548+0000","last_clean_scrub_stamp":"2024-09-12T22:07:22.045548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:19.963772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:15.484734+0000","last_change":"2024-09-12T22:07:15.484758+0000","last_active":"2024-09-12T22:07:15.484734+0000","last_peered":"2024-09-12T22:07:15.484734+0000","last_clean":"2024-09-12T22:07:15.484734+0000","last_became_active":"2024-09-12T22:06:44.391572+0000","last_became_peered":"2024-09-12T22:06:44.391572+0000","last_unstale":"2024-09-12T22:07:15.484734+0000","last_undegraded":"2024-09-12T22:07:15.484734+0000","last_fullsized":"2024-09-12T22:07:15.484734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:15.484646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:15.484646+0000","last_clean_scrub_stamp":"2024-09-12T22:07:15.484646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:05.597210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:18.424486+0000","last_change":"2024-09-12T22:07:18.424525+0000","last_active":"2024-09-12T22:07:18.424486+0000","last_peered":"2024-09-12T22:07:18.424486+0000","last_clean":"2024-09-12T22:07:18.424486+0000","last_became_active":"2024-09-12T22:06:50.419042+0000","last_became_peered":"2024-09-12T22:06:50.419042+0000","last_unstale":"2024-09-12T22:07:18.424486+0000","last_undegraded":"2024-09-12T22:07:18.424486+0000","last_fullsized":"2024-09-12T22:07:18.424486+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:18.424353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:18.424353+0000","last_clean_scrub_stamp":"2024-09-12T22:07:18.424353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:25.824204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:28.399124+0000","last_change":"2024-09-12T22:07:28.399150+0000","last_active":"2024-09-12T22:07:28.399124+0000","last_peered":"2024-09-12T22:07:28.399124+0000","last_clean":"2024-09-12T22:07:28.399124+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:07:28.399124+0000","last_undegraded":"2024-09-12T22:07:28.399124+0000","last_fullsized":"2024-09-12T22:07:28.399124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:28.399035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:28.399035+0000","last_clean_scrub_stamp":"2024-09-12T22:07:28.399035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:39.699369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:04.552650+0000","last_change":"2024-09-12T22:07:04.552671+0000","last_active":"2024-09-12T22:07:04.552650+0000","last_peered":"2024-09-12T22:07:04.552650+0000","last_clean":"2024-09-12T22:07:04.552650+0000","last_became_active":"2024-09-12T22:06:44.392491+0000","last_became_peered":"2024-09-12T22:06:44.392491+0000","last_unstale":"2024-09-12T22:07:04.552650+0000","last_undegraded":"2024-09-12T22:07:04.552650+0000","last_fullsized":"2024-09-12T22:07:04.552650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:04.552563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:04.552563+0000","last_clean_scrub_stamp":"2024-09-12T22:07:04.552563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:51.979285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:16.392714+0000","last_change":"2024-09-12T22:07:16.392737+0000","last_active":"2024-09-12T22:07:16.392714+0000","last_peered":"2024-09-12T22:07:16.392714+0000","last_clean":"2024-09-12T22:07:16.392714+0000","last_became_active":"2024-09-12T22:06:50.418325+0000","last_became_peered":"2024-09-12T22:06:50.418325+0000","last_unstale":"2024-09-12T22:07:16.392714+0000","last_undegraded":"2024-09-12T22:07:16.392714+0000","last_fullsized":"2024-09-12T22:07:16.392714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:16.392602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:16.392602+0000","last_clean_scrub_stamp":"2024-09-12T22:07:16.392602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:59.530527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:08.369681+0000","last_change":"2024-09-12T22:07:08.369704+0000","last_active":"2024-09-12T22:07:08.369681+0000","last_peered":"2024-09-12T22:07:08.369681+0000","last_clean":"2024-09-12T22:07:08.369681+0000","last_became_active":"2024-09-12T22:06:50.418075+0000","last_became_peered":"2024-09-12T22:06:50.418075+0000","last_unstale":"2024-09-12T22:07:08.369681+0000","last_undegraded":"2024-09-12T22:07:08.369681+0000","last_fullsized":"2024-09-12T22:07:08.369681+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:08.369593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:08.369593+0000","last_clean_scrub_stamp":"2024-09-12T22:07:08.369593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:35.314936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:28.292514+0000","last_change":"2024-09-12T22:07:28.292551+0000","last_active":"2024-09-12T22:07:28.292514+0000","last_peered":"2024-09-12T22:07:28.292514+0000","last_clean":"2024-09-12T22:07:28.292514+0000","last_became_active":"2024-09-12T22:06:44.394486+0000","last_became_peered":"2024-09-12T22:06:44.394486+0000","last_unstale":"2024-09-12T22:07:28.292514+0000","last_undegraded":"2024-09-12T22:07:28.292514+0000","last_fullsized":"2024-09-12T22:07:28.292514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:28.292403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:28.292403+0000","last_clean_scrub_stamp":"2024-09-12T22:07:28.292403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:04:02.574652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:21.000060+0000","last_change":"2024-09-12T22:07:21.000086+0000","last_active":"2024-09-12T22:07:21.000060+0000","last_peered":"2024-09-12T22:07:21.000060+0000","last_clean":"2024-09-12T22:07:21.000060+0000","last_became_active":"2024-09-12T22:06:44.388967+0000","last_became_peered":"2024-09-12T22:06:44.388967+0000","last_unstale":"2024-09-12T22:07:21.000060+0000","last_undegraded":"2024-09-12T22:07:21.000060+0000","last_fullsized":"2024-09-12T22:07:21.000060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:20.999966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:20.999966+0000","last_clean_scrub_stamp":"2024-09-12T22:07:20.999966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:13.296573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:08.608560+0000","last_change":"2024-09-12T22:07:08.608587+0000","last_active":"2024-09-12T22:07:08.608560+0000","last_peered":"2024-09-12T22:07:08.608560+0000","last_clean":"2024-09-12T22:07:08.608560+0000","last_became_active":"2024-09-12T22:06:44.390858+0000","last_became_peered":"2024-09-12T22:06:44.390858+0000","last_unstale":"2024-09-12T22:07:08.608560+0000","last_undegraded":"2024-09-12T22:07:08.608560+0000","last_fullsized":"2024-09-12T22:07:08.608560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:08.608471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:08.608471+0000","last_clean_scrub_stamp":"2024-09-12T22:07:08.608471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:44.761690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:18.963354+0000","last_change":"2024-09-12T22:07:18.963395+0000","last_active":"2024-09-12T22:07:18.963354+0000","last_peered":"2024-09-12T22:07:18.963354+0000","last_clean":"2024-09-12T22:07:18.963354+0000","last_became_active":"2024-09-12T22:06:44.388761+0000","last_became_peered":"2024-09-12T22:06:44.388761+0000","last_unstale":"2024-09-12T22:07:18.963354+0000","last_undegraded":"2024-09-12T22:07:18.963354+0000","last_fullsized":"2024-09-12T22:07:18.963354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:18.963268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:18.963268+0000","last_clean_scrub_stamp":"2024-09-12T22:07:18.963268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:18.057160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:23.358002+0000","last_change":"2024-09-12T22:07:23.358037+0000","last_active":"2024-09-12T22:07:23.358002+0000","last_peered":"2024-09-12T22:07:23.358002+0000","last_clean":"2024-09-12T22:07:23.358002+0000","last_became_active":"2024-09-12T22:06:44.420768+0000","last_became_peered":"2024-09-12T22:06:44.420768+0000","last_unstale":"2024-09-12T22:07:23.358002+0000","last_undegraded":"2024-09-12T22:07:23.358002+0000","last_fullsized":"2024-09-12T22:07:23.358002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:23.357913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:23.357913+0000","last_clean_scrub_stamp":"2024-09-12T22:07:23.357913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:13.388816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:02.466714+0000","last_change":"2024-09-12T22:07:02.466752+0000","last_active":"2024-09-12T22:07:02.466714+0000","last_peered":"2024-09-12T22:07:02.466714+0000","last_clean":"2024-09-12T22:07:02.466714+0000","last_became_active":"2024-09-12T22:06:50.421758+0000","last_became_peered":"2024-09-12T22:06:50.421758+0000","last_unstale":"2024-09-12T22:07:02.466714+0000","last_undegraded":"2024-09-12T22:07:02.466714+0000","last_fullsized":"2024-09-12T22:07:02.466714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:02.466611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:02.466611+0000","last_clean_scrub_stamp":"2024-09-12T22:07:02.466611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:13.189761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:26.446802+0000","last_change":"2024-09-12T22:07:26.446831+0000","last_active":"2024-09-12T22:07:26.446802+0000","last_peered":"2024-09-12T22:07:26.446802+0000","last_clean":"2024-09-12T22:07:26.446802+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:07:26.446802+0000","last_undegraded":"2024-09-12T22:07:26.446802+0000","last_fullsized":"2024-09-12T22:07:26.446802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:26.446680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:26.446680+0000","last_clean_scrub_stamp":"2024-09-12T22:07:26.446680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:25.568110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:15.972800+0000","last_change":"2024-09-12T22:07:15.972824+0000","last_active":"2024-09-12T22:07:15.972800+0000","last_peered":"2024-09-12T22:07:15.972800+0000","last_clean":"2024-09-12T22:07:15.972800+0000","last_became_active":"2024-09-12T22:06:50.416924+0000","last_became_peered":"2024-09-12T22:06:50.416924+0000","last_unstale":"2024-09-12T22:07:15.972800+0000","last_undegraded":"2024-09-12T22:07:15.972800+0000","last_fullsized":"2024-09-12T22:07:15.972800+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:15.972710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:15.972710+0000","last_clean_scrub_stamp":"2024-09-12T22:07:15.972710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:40.574353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:09.567288+0000","last_change":"2024-09-12T22:07:09.567334+0000","last_active":"2024-09-12T22:07:09.567288+0000","last_peered":"2024-09-12T22:07:09.567288+0000","last_clean":"2024-09-12T22:07:09.567288+0000","last_became_active":"2024-09-12T22:06:44.391480+0000","last_became_peered":"2024-09-12T22:06:44.391480+0000","last_unstale":"2024-09-12T22:07:09.567288+0000","last_undegraded":"2024-09-12T22:07:09.567288+0000","last_fullsized":"2024-09-12T22:07:09.567288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:09.567191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:09.567191+0000","last_clean_scrub_stamp":"2024-09-12T22:07:09.567191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:19.334017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":181,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:35.423991+0000","last_change":"2024-09-12T22:07:35.424017+0000","last_active":"2024-09-12T22:07:35.423991+0000","last_peered":"2024-09-12T22:07:35.423991+0000","last_clean":"2024-09-12T22:07:35.423991+0000","last_became_active":"2024-09-12T22:06:50.419573+0000","last_became_peered":"2024-09-12T22:06:50.419573+0000","last_unstale":"2024-09-12T22:07:35.423991+0000","last_undegraded":"2024-09-12T22:07:35.423991+0000","last_fullsized":"2024-09-12T22:07:35.423991+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:35.423892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:35.423892+0000","last_clean_scrub_stamp":"2024-09-12T22:07:35.423892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:47.589626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:29.935784+0000","last_change":"2024-09-12T22:07:29.935810+0000","last_active":"2024-09-12T22:07:29.935784+0000","last_peered":"2024-09-12T22:07:29.935784+0000","last_clean":"2024-09-12T22:07:29.935784+0000","last_became_active":"2024-09-12T22:06:50.419348+0000","last_became_peered":"2024-09-12T22:06:50.419348+0000","last_unstale":"2024-09-12T22:07:29.935784+0000","last_undegraded":"2024-09-12T22:07:29.935784+0000","last_fullsized":"2024-09-12T22:07:29.935784+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:29.935697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:29.935697+0000","last_clean_scrub_stamp":"2024-09-12T22:07:29.935697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:04.434011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:26.286826+0000","last_change":"2024-09-12T22:07:26.286849+0000","last_active":"2024-09-12T22:07:26.286826+0000","last_peered":"2024-09-12T22:07:26.286826+0000","last_clean":"2024-09-12T22:07:26.286826+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:07:26.286826+0000","last_undegraded":"2024-09-12T22:07:26.286826+0000","last_fullsized":"2024-09-12T22:07:26.286826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:26.286724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:26.286724+0000","last_clean_scrub_stamp":"2024-09-12T22:07:26.286724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:45:02.439942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":181,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:33.371808+0000","last_change":"2024-09-12T22:07:33.371840+0000","last_active":"2024-09-12T22:07:33.371808+0000","last_peered":"2024-09-12T22:07:33.371808+0000","last_clean":"2024-09-12T22:07:33.371808+0000","last_became_active":"2024-09-12T22:06:50.418755+0000","last_became_peered":"2024-09-12T22:06:50.418755+0000","last_unstale":"2024-09-12T22:07:33.371808+0000","last_undegraded":"2024-09-12T22:07:33.371808+0000","last_fullsized":"2024-09-12T22:07:33.371808+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:33.371721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:33.371721+0000","last_clean_scrub_stamp":"2024-09-12T22:07:33.371721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:37.920728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:02.879310+0000","last_change":"2024-09-12T22:07:02.879360+0000","last_active":"2024-09-12T22:07:02.879310+0000","last_peered":"2024-09-12T22:07:02.879310+0000","last_clean":"2024-09-12T22:07:02.879310+0000","last_became_active":"2024-09-12T22:06:44.397198+0000","last_became_peered":"2024-09-12T22:06:44.397198+0000","last_unstale":"2024-09-12T22:07:02.879310+0000","last_undegraded":"2024-09-12T22:07:02.879310+0000","last_fullsized":"2024-09-12T22:07:02.879310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:02.879206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:02.879206+0000","last_clean_scrub_stamp":"2024-09-12T22:07:02.879206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:56.691650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:24.482138+0000","last_change":"2024-09-12T22:07:24.482162+0000","last_active":"2024-09-12T22:07:24.482138+0000","last_peered":"2024-09-12T22:07:24.482138+0000","last_clean":"2024-09-12T22:07:24.482138+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:07:24.482138+0000","last_undegraded":"2024-09-12T22:07:24.482138+0000","last_fullsized":"2024-09-12T22:07:24.482138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:24.482040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:24.482040+0000","last_clean_scrub_stamp":"2024-09-12T22:07:24.482040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:27.727732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:06.828211+0000","last_change":"2024-09-12T22:07:06.828268+0000","last_active":"2024-09-12T22:07:06.828211+0000","last_peered":"2024-09-12T22:07:06.828211+0000","last_clean":"2024-09-12T22:07:06.828211+0000","last_became_active":"2024-09-12T22:06:44.397074+0000","last_became_peered":"2024-09-12T22:06:44.397074+0000","last_unstale":"2024-09-12T22:07:06.828211+0000","last_undegraded":"2024-09-12T22:07:06.828211+0000","last_fullsized":"2024-09-12T22:07:06.828211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:06.828090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:06.828090+0000","last_clean_scrub_stamp":"2024-09-12T22:07:06.828090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:26:24.122811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:13.373982+0000","last_change":"2024-09-12T22:07:13.374006+0000","last_active":"2024-09-12T22:07:13.373982+0000","last_peered":"2024-09-12T22:07:13.373982+0000","last_clean":"2024-09-12T22:07:13.373982+0000","last_became_active":"2024-09-12T22:06:50.414626+0000","last_became_peered":"2024-09-12T22:06:50.414626+0000","last_unstale":"2024-09-12T22:07:13.373982+0000","last_undegraded":"2024-09-12T22:07:13.373982+0000","last_fullsized":"2024-09-12T22:07:13.373982+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:13.373893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:13.373893+0000","last_clean_scrub_stamp":"2024-09-12T22:07:13.373893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:01.475526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:11.545572+0000","last_change":"2024-09-12T22:07:11.545596+0000","last_active":"2024-09-12T22:07:11.545572+0000","last_peered":"2024-09-12T22:07:11.545572+0000","last_clean":"2024-09-12T22:07:11.545572+0000","last_became_active":"2024-09-12T22:06:44.391447+0000","last_became_peered":"2024-09-12T22:06:44.391447+0000","last_unstale":"2024-09-12T22:07:11.545572+0000","last_undegraded":"2024-09-12T22:07:11.545572+0000","last_fullsized":"2024-09-12T22:07:11.545572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:11.545486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:11.545486+0000","last_clean_scrub_stamp":"2024-09-12T22:07:11.545486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:37.307770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"93'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:37.328382+0000","last_change":"2024-09-12T22:07:37.328414+0000","last_active":"2024-09-12T22:07:37.328382+0000","last_peered":"2024-09-12T22:07:37.328382+0000","last_clean":"2024-09-12T22:07:37.328382+0000","last_became_active":"2024-09-12T22:06:50.422232+0000","last_became_peered":"2024-09-12T22:06:50.422232+0000","last_unstale":"2024-09-12T22:07:37.328382+0000","last_undegraded":"2024-09-12T22:07:37.328382+0000","last_fullsized":"2024-09-12T22:07:37.328382+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-09-12T22:07:37.328299+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-09-12T22:07:37.328299+0000","last_clean_scrub_stamp":"2024-09-12T22:07:37.328299+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:47.734717+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:12.581801+0000","last_change":"2024-09-12T22:07:12.581841+0000","last_active":"2024-09-12T22:07:12.581801+0000","last_peered":"2024-09-12T22:07:12.581801+0000","last_clean":"2024-09-12T22:07:12.581801+0000","last_became_active":"2024-09-12T22:06:44.390652+0000","last_became_peered":"2024-09-12T22:06:44.390652+0000","last_unstale":"2024-09-12T22:07:12.581801+0000","last_undegraded":"2024-09-12T22:07:12.581801+0000","last_fullsized":"2024-09-12T22:07:12.581801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:12.581719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:12.581719+0000","last_clean_scrub_stamp":"2024-09-12T22:07:12.581719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:48.655239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:13.960253+0000","last_change":"2024-09-12T22:07:13.960279+0000","last_active":"2024-09-12T22:07:13.960253+0000","last_peered":"2024-09-12T22:07:13.960253+0000","last_clean":"2024-09-12T22:07:13.960253+0000","last_became_active":"2024-09-12T22:06:50.417123+0000","last_became_peered":"2024-09-12T22:06:50.417123+0000","last_unstale":"2024-09-12T22:07:13.960253+0000","last_undegraded":"2024-09-12T22:07:13.960253+0000","last_fullsized":"2024-09-12T22:07:13.960253+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:13.960165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:13.960165+0000","last_clean_scrub_stamp":"2024-09-12T22:07:13.960165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:46.981226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:27.937000+0000","last_change":"2024-09-12T22:07:27.937039+0000","last_active":"2024-09-12T22:07:27.937000+0000","last_peered":"2024-09-12T22:07:27.937000+0000","last_clean":"2024-09-12T22:07:27.937000+0000","last_became_active":"2024-09-12T22:06:50.418817+0000","last_became_peered":"2024-09-12T22:06:50.418817+0000","last_unstale":"2024-09-12T22:07:27.937000+0000","last_undegraded":"2024-09-12T22:07:27.937000+0000","last_fullsized":"2024-09-12T22:07:27.937000+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:27.936910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:27.936910+0000","last_clean_scrub_stamp":"2024-09-12T22:07:27.936910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:28.763778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":183,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:34.383000+0000","last_change":"2024-09-12T22:07:34.383027+0000","last_active":"2024-09-12T22:07:34.383000+0000","last_peered":"2024-09-12T22:07:34.383000+0000","last_clean":"2024-09-12T22:07:34.383000+0000","last_became_active":"2024-09-12T22:06:50.419047+0000","last_became_peered":"2024-09-12T22:06:50.419047+0000","last_unstale":"2024-09-12T22:07:34.383000+0000","last_undegraded":"2024-09-12T22:07:34.383000+0000","last_fullsized":"2024-09-12T22:07:34.383000+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:34.382912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:34.382912+0000","last_clean_scrub_stamp":"2024-09-12T22:07:34.382912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:10.988596+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:09.935028+0000","last_change":"2024-09-12T22:07:09.935054+0000","last_active":"2024-09-12T22:07:09.935028+0000","last_peered":"2024-09-12T22:07:09.935028+0000","last_clean":"2024-09-12T22:07:09.935028+0000","last_became_active":"2024-09-12T22:06:44.421955+0000","last_became_peered":"2024-09-12T22:06:44.421955+0000","last_unstale":"2024-09-12T22:07:09.935028+0000","last_undegraded":"2024-09-12T22:07:09.935028+0000","last_fullsized":"2024-09-12T22:07:09.935028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:09.934934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:09.934934+0000","last_clean_scrub_stamp":"2024-09-12T22:07:09.934934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:12.156188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"93'12","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:34.343687+0000","last_change":"2024-09-12T22:07:34.343726+0000","last_active":"2024-09-12T22:07:34.343687+0000","last_peered":"2024-09-12T22:07:34.343687+0000","last_clean":"2024-09-12T22:07:34.343687+0000","last_became_active":"2024-09-12T22:06:50.418227+0000","last_became_peered":"2024-09-12T22:06:50.418227+0000","last_unstale":"2024-09-12T22:07:34.343687+0000","last_undegraded":"2024-09-12T22:07:34.343687+0000","last_fullsized":"2024-09-12T22:07:34.343687+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'12","last_scrub_stamp":"2024-09-12T22:07:34.343592+0000","last_deep_scrub":"93'12","last_deep_scrub_stamp":"2024-09-12T22:07:34.343592+0000","last_clean_scrub_stamp":"2024-09-12T22:07:34.343592+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:50.858153+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"93'2","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:33.345688+0000","last_change":"2024-09-12T22:07:33.345716+0000","last_active":"2024-09-12T22:07:33.345688+0000","last_peered":"2024-09-12T22:07:33.345688+0000","last_clean":"2024-09-12T22:07:33.345688+0000","last_became_active":"2024-09-12T22:06:50.418222+0000","last_became_peered":"2024-09-12T22:06:50.418222+0000","last_unstale":"2024-09-12T22:07:33.345688+0000","last_undegraded":"2024-09-12T22:07:33.345688+0000","last_fullsized":"2024-09-12T22:07:33.345688+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-09-12T22:07:33.345601+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-09-12T22:07:33.345601+0000","last_clean_scrub_stamp":"2024-09-12T22:07:33.345601+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:23.458165+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:18.481105+0000","last_change":"2024-09-12T22:07:18.481127+0000","last_active":"2024-09-12T22:07:18.481105+0000","last_peered":"2024-09-12T22:07:18.481105+0000","last_clean":"2024-09-12T22:07:18.481105+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:07:18.481105+0000","last_undegraded":"2024-09-12T22:07:18.481105+0000","last_fullsized":"2024-09-12T22:07:18.481105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:18.481018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:18.481018+0000","last_clean_scrub_stamp":"2024-09-12T22:07:18.481018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:21.965567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"93'3","reported_seq":173,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:22.467164+0000","last_change":"2024-09-12T22:07:22.467192+0000","last_active":"2024-09-12T22:07:22.467164+0000","last_peered":"2024-09-12T22:07:22.467164+0000","last_clean":"2024-09-12T22:07:22.467164+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:07:22.467164+0000","last_undegraded":"2024-09-12T22:07:22.467164+0000","last_fullsized":"2024-09-12T22:07:22.467164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-09-12T22:07:22.467077+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-09-12T22:07:22.467077+0000","last_clean_scrub_stamp":"2024-09-12T22:07:22.467077+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:58.027127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:06.545707+0000","last_change":"2024-09-12T22:07:06.545732+0000","last_active":"2024-09-12T22:07:06.545707+0000","last_peered":"2024-09-12T22:07:06.545707+0000","last_clean":"2024-09-12T22:07:06.545707+0000","last_became_active":"2024-09-12T22:06:44.390807+0000","last_became_peered":"2024-09-12T22:06:44.390807+0000","last_unstale":"2024-09-12T22:07:06.545707+0000","last_undegraded":"2024-09-12T22:07:06.545707+0000","last_fullsized":"2024-09-12T22:07:06.545707+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:06.545621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:06.545621+0000","last_clean_scrub_stamp":"2024-09-12T22:07:06.545621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:28.452733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"93'2","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:24.319689+0000","last_change":"2024-09-12T22:07:24.319720+0000","last_active":"2024-09-12T22:07:24.319689+0000","last_peered":"2024-09-12T22:07:24.319689+0000","last_clean":"2024-09-12T22:07:24.319689+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:07:24.319689+0000","last_undegraded":"2024-09-12T22:07:24.319689+0000","last_fullsized":"2024-09-12T22:07:24.319689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-09-12T22:07:24.319603+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-09-12T22:07:24.319603+0000","last_clean_scrub_stamp":"2024-09-12T22:07:24.319603+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:46.226715+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:21.375835+0000","last_change":"2024-09-12T22:07:21.375858+0000","last_active":"2024-09-12T22:07:21.375835+0000","last_peered":"2024-09-12T22:07:21.375835+0000","last_clean":"2024-09-12T22:07:21.375835+0000","last_became_active":"2024-09-12T22:06:44.421388+0000","last_became_peered":"2024-09-12T22:06:44.421388+0000","last_unstale":"2024-09-12T22:07:21.375835+0000","last_undegraded":"2024-09-12T22:07:21.375835+0000","last_fullsized":"2024-09-12T22:07:21.375835+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:21.375718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:21.375718+0000","last_clean_scrub_stamp":"2024-09-12T22:07:21.375718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:46:04.211966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":177,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:17.427660+0000","last_change":"2024-09-12T22:07:17.427684+0000","last_active":"2024-09-12T22:07:17.427660+0000","last_peered":"2024-09-12T22:07:17.427660+0000","last_clean":"2024-09-12T22:07:17.427660+0000","last_became_active":"2024-09-12T22:06:44.421430+0000","last_became_peered":"2024-09-12T22:06:44.421430+0000","last_unstale":"2024-09-12T22:07:17.427660+0000","last_undegraded":"2024-09-12T22:07:17.427660+0000","last_fullsized":"2024-09-12T22:07:17.427660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:17.427573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:17.427573+0000","last_clean_scrub_stamp":"2024-09-12T22:07:17.427573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:17.811728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:03.870785+0000","last_change":"2024-09-12T22:07:03.870814+0000","last_active":"2024-09-12T22:07:03.870785+0000","last_peered":"2024-09-12T22:07:03.870785+0000","last_clean":"2024-09-12T22:07:03.870785+0000","last_became_active":"2024-09-12T22:06:44.397490+0000","last_became_peered":"2024-09-12T22:06:44.397490+0000","last_unstale":"2024-09-12T22:07:03.870785+0000","last_undegraded":"2024-09-12T22:07:03.870785+0000","last_fullsized":"2024-09-12T22:07:03.870785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:03.870684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:03.870684+0000","last_clean_scrub_stamp":"2024-09-12T22:07:03.870684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:12.834646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"93'3","reported_seq":58,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:30.936097+0000","last_change":"2024-09-12T22:07:30.936130+0000","last_active":"2024-09-12T22:07:30.936097+0000","last_peered":"2024-09-12T22:07:30.936097+0000","last_clean":"2024-09-12T22:07:30.936097+0000","last_became_active":"2024-09-12T22:06:50.417240+0000","last_became_peered":"2024-09-12T22:06:50.417240+0000","last_unstale":"2024-09-12T22:07:30.936097+0000","last_undegraded":"2024-09-12T22:07:30.936097+0000","last_fullsized":"2024-09-12T22:07:30.936097+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-09-12T22:07:30.936007+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-09-12T22:07:30.936007+0000","last_clean_scrub_stamp":"2024-09-12T22:07:30.936007+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:29.930143+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:19.418438+0000","last_change":"2024-09-12T22:07:19.418460+0000","last_active":"2024-09-12T22:07:19.418438+0000","last_peered":"2024-09-12T22:07:19.418438+0000","last_clean":"2024-09-12T22:07:19.418438+0000","last_became_active":"2024-09-12T22:06:44.421071+0000","last_became_peered":"2024-09-12T22:06:44.421071+0000","last_unstale":"2024-09-12T22:07:19.418438+0000","last_undegraded":"2024-09-12T22:07:19.418438+0000","last_fullsized":"2024-09-12T22:07:19.418438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:19.418317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:19.418317+0000","last_clean_scrub_stamp":"2024-09-12T22:07:19.418317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:37:30.589631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:03.424879+0000","last_change":"2024-09-12T22:07:03.424902+0000","last_active":"2024-09-12T22:07:03.424879+0000","last_peered":"2024-09-12T22:07:03.424879+0000","last_clean":"2024-09-12T22:07:03.424879+0000","last_became_active":"2024-09-12T22:06:50.421734+0000","last_became_peered":"2024-09-12T22:06:50.421734+0000","last_unstale":"2024-09-12T22:07:03.424879+0000","last_undegraded":"2024-09-12T22:07:03.424879+0000","last_fullsized":"2024-09-12T22:07:03.424879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:03.424792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:03.424792+0000","last_clean_scrub_stamp":"2024-09-12T22:07:03.424792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:12.328912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:25.316021+0000","last_change":"2024-09-12T22:07:25.316066+0000","last_active":"2024-09-12T22:07:25.316021+0000","last_peered":"2024-09-12T22:07:25.316021+0000","last_clean":"2024-09-12T22:07:25.316021+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:07:25.316021+0000","last_undegraded":"2024-09-12T22:07:25.316021+0000","last_fullsized":"2024-09-12T22:07:25.316021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:25.315901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:25.315901+0000","last_clean_scrub_stamp":"2024-09-12T22:07:25.315901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:12.918103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":170,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:23.497577+0000","last_change":"2024-09-12T22:07:23.497634+0000","last_active":"2024-09-12T22:07:23.497577+0000","last_peered":"2024-09-12T22:07:23.497577+0000","last_clean":"2024-09-12T22:07:23.497577+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:07:23.497577+0000","last_undegraded":"2024-09-12T22:07:23.497577+0000","last_fullsized":"2024-09-12T22:07:23.497577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:23.497437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:23.497437+0000","last_clean_scrub_stamp":"2024-09-12T22:07:23.497437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:20.804213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:12.415036+0000","last_change":"2024-09-12T22:07:12.415080+0000","last_active":"2024-09-12T22:07:12.415036+0000","last_peered":"2024-09-12T22:07:12.415036+0000","last_clean":"2024-09-12T22:07:12.415036+0000","last_became_active":"2024-09-12T22:06:50.418648+0000","last_became_peered":"2024-09-12T22:06:50.418648+0000","last_unstale":"2024-09-12T22:07:12.415036+0000","last_undegraded":"2024-09-12T22:07:12.415036+0000","last_fullsized":"2024-09-12T22:07:12.415036+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:12.414901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:12.414901+0000","last_clean_scrub_stamp":"2024-09-12T22:07:12.414901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:12.172982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":177,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:05.559724+0000","last_change":"2024-09-12T22:07:05.559748+0000","last_active":"2024-09-12T22:07:05.559724+0000","last_peered":"2024-09-12T22:07:05.559724+0000","last_clean":"2024-09-12T22:07:05.559724+0000","last_became_active":"2024-09-12T22:06:44.391078+0000","last_became_peered":"2024-09-12T22:06:44.391078+0000","last_unstale":"2024-09-12T22:07:05.559724+0000","last_undegraded":"2024-09-12T22:07:05.559724+0000","last_fullsized":"2024-09-12T22:07:05.559724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:05.559632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:05.559632+0000","last_clean_scrub_stamp":"2024-09-12T22:07:05.559632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:55.590535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:10.938968+0000","last_change":"2024-09-12T22:07:10.938995+0000","last_active":"2024-09-12T22:07:10.938968+0000","last_peered":"2024-09-12T22:07:10.938968+0000","last_clean":"2024-09-12T22:07:10.938968+0000","last_became_active":"2024-09-12T22:06:44.396783+0000","last_became_peered":"2024-09-12T22:06:44.396783+0000","last_unstale":"2024-09-12T22:07:10.938968+0000","last_undegraded":"2024-09-12T22:07:10.938968+0000","last_fullsized":"2024-09-12T22:07:10.938968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:10.938876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:10.938876+0000","last_clean_scrub_stamp":"2024-09-12T22:07:10.938876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:47.400030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":316,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979080+0000","last_change":"2024-09-12T22:06:52.982526+0000","last_active":"2024-09-12T22:06:53.979080+0000","last_peered":"2024-09-12T22:06:53.979080+0000","last_clean":"2024-09-12T22:06:53.979080+0000","last_became_active":"2024-09-12T22:06:52.982174+0000","last_became_peered":"2024-09-12T22:06:52.982174+0000","last_unstale":"2024-09-12T22:06:53.979080+0000","last_undegraded":"2024-09-12T22:06:53.979080+0000","last_fullsized":"2024-09-12T22:06:53.979080+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:22.303285+0000","last_clean_scrub_stamp":"2024-09-12T22:03:22.303285+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:06:53.979867+0000","last_change":"2024-09-12T22:06:50.444340+0000","last_active":"2024-09-12T22:06:53.979867+0000","last_peered":"2024-09-12T22:06:53.979867+0000","last_clean":"2024-09-12T22:06:53.979867+0000","last_became_active":"2024-09-12T22:06:50.422353+0000","last_became_peered":"2024-09-12T22:06:50.422353+0000","last_unstale":"2024-09-12T22:06:53.979867+0000","last_undegraded":"2024-09-12T22:06:53.979867+0000","last_fullsized":"2024-09-12T22:06:53.979867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:03:27.319181+0000","last_clean_scrub_stamp":"2024-09-12T22:03:27.319181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:12.943676+0000","last_change":"2024-09-12T22:07:12.943702+0000","last_active":"2024-09-12T22:07:12.943676+0000","last_peered":"2024-09-12T22:07:12.943676+0000","last_clean":"2024-09-12T22:07:12.943676+0000","last_became_active":"2024-09-12T22:06:44.396659+0000","last_became_peered":"2024-09-12T22:06:44.396659+0000","last_unstale":"2024-09-12T22:07:12.943676+0000","last_undegraded":"2024-09-12T22:07:12.943676+0000","last_fullsized":"2024-09-12T22:07:12.943676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:12.943584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:12.943584+0000","last_clean_scrub_stamp":"2024-09-12T22:07:12.943584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:28.806765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:09.396524+0000","last_change":"2024-09-12T22:07:09.396548+0000","last_active":"2024-09-12T22:07:09.396524+0000","last_peered":"2024-09-12T22:07:09.396524+0000","last_clean":"2024-09-12T22:07:09.396524+0000","last_became_active":"2024-09-12T22:06:50.418443+0000","last_became_peered":"2024-09-12T22:06:50.418443+0000","last_unstale":"2024-09-12T22:07:09.396524+0000","last_undegraded":"2024-09-12T22:07:09.396524+0000","last_fullsized":"2024-09-12T22:07:09.396524+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:09.396436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:09.396436+0000","last_clean_scrub_stamp":"2024-09-12T22:07:09.396436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:16.931640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:10.439511+0000","last_change":"2024-09-12T22:07:10.439544+0000","last_active":"2024-09-12T22:07:10.439511+0000","last_peered":"2024-09-12T22:07:10.439511+0000","last_clean":"2024-09-12T22:07:10.439511+0000","last_became_active":"2024-09-12T22:06:50.418160+0000","last_became_peered":"2024-09-12T22:06:50.418160+0000","last_unstale":"2024-09-12T22:07:10.439511+0000","last_undegraded":"2024-09-12T22:07:10.439511+0000","last_fullsized":"2024-09-12T22:07:10.439511+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:10.439427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:10.439427+0000","last_clean_scrub_stamp":"2024-09-12T22:07:10.439427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:51.021107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:14.933464+0000","last_change":"2024-09-12T22:07:14.933489+0000","last_active":"2024-09-12T22:07:14.933464+0000","last_peered":"2024-09-12T22:07:14.933464+0000","last_clean":"2024-09-12T22:07:14.933464+0000","last_became_active":"2024-09-12T22:06:44.396378+0000","last_became_peered":"2024-09-12T22:06:44.396378+0000","last_unstale":"2024-09-12T22:07:14.933464+0000","last_undegraded":"2024-09-12T22:07:14.933464+0000","last_fullsized":"2024-09-12T22:07:14.933464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:14.933368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:14.933368+0000","last_clean_scrub_stamp":"2024-09-12T22:07:14.933368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:47.246315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:17.465625+0000","last_change":"2024-09-12T22:07:17.465662+0000","last_active":"2024-09-12T22:07:17.465625+0000","last_peered":"2024-09-12T22:07:17.465625+0000","last_clean":"2024-09-12T22:07:17.465625+0000","last_became_active":"2024-09-12T22:06:44.391809+0000","last_became_peered":"2024-09-12T22:06:44.391809+0000","last_unstale":"2024-09-12T22:07:17.465625+0000","last_undegraded":"2024-09-12T22:07:17.465625+0000","last_fullsized":"2024-09-12T22:07:17.465625+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:17.465504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:17.465504+0000","last_clean_scrub_stamp":"2024-09-12T22:07:17.465504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:22.795263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:08.894316+0000","last_change":"2024-09-12T22:07:08.894340+0000","last_active":"2024-09-12T22:07:08.894316+0000","last_peered":"2024-09-12T22:07:08.894316+0000","last_clean":"2024-09-12T22:07:08.894316+0000","last_became_active":"2024-09-12T22:06:44.396596+0000","last_became_peered":"2024-09-12T22:06:44.396596+0000","last_unstale":"2024-09-12T22:07:08.894316+0000","last_undegraded":"2024-09-12T22:07:08.894316+0000","last_fullsized":"2024-09-12T22:07:08.894316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:08.894223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:08.894223+0000","last_clean_scrub_stamp":"2024-09-12T22:07:08.894223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:59.133246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":184,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:32.340264+0000","last_change":"2024-09-12T22:07:32.340264+0000","last_active":"2024-09-12T22:07:32.340264+0000","last_peered":"2024-09-12T22:07:32.340264+0000","last_clean":"2024-09-12T22:07:32.340264+0000","last_became_active":"2024-09-12T22:06:50.418876+0000","last_became_peered":"2024-09-12T22:06:50.418876+0000","last_unstale":"2024-09-12T22:07:32.340264+0000","last_undegraded":"2024-09-12T22:07:32.340264+0000","last_fullsized":"2024-09-12T22:07:32.340264+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:32.340093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:32.340093+0000","last_clean_scrub_stamp":"2024-09-12T22:07:32.340093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:47.371192+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:23.975211+0000","last_change":"2024-09-12T22:07:23.975234+0000","last_active":"2024-09-12T22:07:23.975211+0000","last_peered":"2024-09-12T22:07:23.975211+0000","last_clean":"2024-09-12T22:07:23.975211+0000","last_became_active":"2024-09-12T22:06:44.389680+0000","last_became_peered":"2024-09-12T22:06:44.389680+0000","last_unstale":"2024-09-12T22:07:23.975211+0000","last_undegraded":"2024-09-12T22:07:23.975211+0000","last_fullsized":"2024-09-12T22:07:23.975211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:23.975118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:23.975118+0000","last_clean_scrub_stamp":"2024-09-12T22:07:23.975118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:08.651715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"93'3","reported_seq":193,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:31.367252+0000","last_change":"2024-09-12T22:07:31.367299+0000","last_active":"2024-09-12T22:07:31.367252+0000","last_peered":"2024-09-12T22:07:31.367252+0000","last_clean":"2024-09-12T22:07:31.367252+0000","last_became_active":"2024-09-12T22:06:44.421088+0000","last_became_peered":"2024-09-12T22:06:44.421088+0000","last_unstale":"2024-09-12T22:07:31.367252+0000","last_undegraded":"2024-09-12T22:07:31.367252+0000","last_fullsized":"2024-09-12T22:07:31.367252+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-09-12T22:07:31.367151+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-09-12T22:07:31.367151+0000","last_clean_scrub_stamp":"2024-09-12T22:07:31.367151+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:14.840522+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:06.420142+0000","last_change":"2024-09-12T22:07:06.420187+0000","last_active":"2024-09-12T22:07:06.420142+0000","last_peered":"2024-09-12T22:07:06.420142+0000","last_clean":"2024-09-12T22:07:06.420142+0000","last_became_active":"2024-09-12T22:06:50.423052+0000","last_became_peered":"2024-09-12T22:06:50.423052+0000","last_unstale":"2024-09-12T22:07:06.420142+0000","last_undegraded":"2024-09-12T22:07:06.420142+0000","last_fullsized":"2024-09-12T22:07:06.420142+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:06.420019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:06.420019+0000","last_clean_scrub_stamp":"2024-09-12T22:07:06.420019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:43.805506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:01.910331+0000","last_change":"2024-09-12T22:07:01.910357+0000","last_active":"2024-09-12T22:07:01.910331+0000","last_peered":"2024-09-12T22:07:01.910331+0000","last_clean":"2024-09-12T22:07:01.910331+0000","last_became_active":"2024-09-12T22:06:44.397452+0000","last_became_peered":"2024-09-12T22:06:44.397452+0000","last_unstale":"2024-09-12T22:07:01.910331+0000","last_undegraded":"2024-09-12T22:07:01.910331+0000","last_fullsized":"2024-09-12T22:07:01.910331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:01.910235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:01.910235+0000","last_clean_scrub_stamp":"2024-09-12T22:07:01.910235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:30.512629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:20.424167+0000","last_change":"2024-09-12T22:07:20.424190+0000","last_active":"2024-09-12T22:07:20.424167+0000","last_peered":"2024-09-12T22:07:20.424167+0000","last_clean":"2024-09-12T22:07:20.424167+0000","last_became_active":"2024-09-12T22:06:50.419551+0000","last_became_peered":"2024-09-12T22:06:50.419551+0000","last_unstale":"2024-09-12T22:07:20.424167+0000","last_undegraded":"2024-09-12T22:07:20.424167+0000","last_fullsized":"2024-09-12T22:07:20.424167+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:20.424081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:20.424081+0000","last_clean_scrub_stamp":"2024-09-12T22:07:20.424081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.307657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:04.846724+0000","last_change":"2024-09-12T22:07:04.846748+0000","last_active":"2024-09-12T22:07:04.846724+0000","last_peered":"2024-09-12T22:07:04.846724+0000","last_clean":"2024-09-12T22:07:04.846724+0000","last_became_active":"2024-09-12T22:06:44.396979+0000","last_became_peered":"2024-09-12T22:06:44.396979+0000","last_unstale":"2024-09-12T22:07:04.846724+0000","last_undegraded":"2024-09-12T22:07:04.846724+0000","last_fullsized":"2024-09-12T22:07:04.846724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:04.846632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:04.846632+0000","last_clean_scrub_stamp":"2024-09-12T22:07:04.846632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:01.019176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":181,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:03.572805+0000","last_change":"2024-09-12T22:07:03.572842+0000","last_active":"2024-09-12T22:07:03.572805+0000","last_peered":"2024-09-12T22:07:03.572805+0000","last_clean":"2024-09-12T22:07:03.572805+0000","last_became_active":"2024-09-12T22:06:50.418763+0000","last_became_peered":"2024-09-12T22:06:50.418763+0000","last_unstale":"2024-09-12T22:07:03.572805+0000","last_undegraded":"2024-09-12T22:07:03.572805+0000","last_fullsized":"2024-09-12T22:07:03.572805+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:03.572715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:03.572715+0000","last_clean_scrub_stamp":"2024-09-12T22:07:03.572715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:46.408963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:19.989956+0000","last_change":"2024-09-12T22:07:19.990002+0000","last_active":"2024-09-12T22:07:19.989956+0000","last_peered":"2024-09-12T22:07:19.989956+0000","last_clean":"2024-09-12T22:07:19.989956+0000","last_became_active":"2024-09-12T22:06:44.388887+0000","last_became_peered":"2024-09-12T22:06:44.388887+0000","last_unstale":"2024-09-12T22:07:19.989956+0000","last_undegraded":"2024-09-12T22:07:19.989956+0000","last_fullsized":"2024-09-12T22:07:19.989956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:19.989839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:19.989839+0000","last_clean_scrub_stamp":"2024-09-12T22:07:19.989839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:23.809418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":188,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:14.515746+0000","last_change":"2024-09-12T22:07:14.515781+0000","last_active":"2024-09-12T22:07:14.515746+0000","last_peered":"2024-09-12T22:07:14.515746+0000","last_clean":"2024-09-12T22:07:14.515746+0000","last_became_active":"2024-09-12T22:06:44.390260+0000","last_became_peered":"2024-09-12T22:06:44.390260+0000","last_unstale":"2024-09-12T22:07:14.515746+0000","last_undegraded":"2024-09-12T22:07:14.515746+0000","last_fullsized":"2024-09-12T22:07:14.515746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:14.515657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:14.515657+0000","last_clean_scrub_stamp":"2024-09-12T22:07:14.515657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:33.952425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:27.443350+0000","last_change":"2024-09-12T22:07:27.443371+0000","last_active":"2024-09-12T22:07:27.443350+0000","last_peered":"2024-09-12T22:07:27.443350+0000","last_clean":"2024-09-12T22:07:27.443350+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:07:27.443350+0000","last_undegraded":"2024-09-12T22:07:27.443350+0000","last_fullsized":"2024-09-12T22:07:27.443350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:27.443262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:27.443262+0000","last_clean_scrub_stamp":"2024-09-12T22:07:27.443262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:37.330036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"93'3","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:25.010706+0000","last_change":"2024-09-12T22:07:25.010755+0000","last_active":"2024-09-12T22:07:25.010706+0000","last_peered":"2024-09-12T22:07:25.010706+0000","last_clean":"2024-09-12T22:07:25.010706+0000","last_became_active":"2024-09-12T22:06:44.389622+0000","last_became_peered":"2024-09-12T22:06:44.389622+0000","last_unstale":"2024-09-12T22:07:25.010706+0000","last_undegraded":"2024-09-12T22:07:25.010706+0000","last_fullsized":"2024-09-12T22:07:25.010706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-09-12T22:07:25.010610+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-09-12T22:07:25.010610+0000","last_clean_scrub_stamp":"2024-09-12T22:07:25.010610+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:27.483245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":69,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:05.846797+0000","last_change":"2024-09-12T22:07:05.846822+0000","last_active":"2024-09-12T22:07:05.846797+0000","last_peered":"2024-09-12T22:07:05.846797+0000","last_clean":"2024-09-12T22:07:05.846797+0000","last_became_active":"2024-09-12T22:06:44.396735+0000","last_became_peered":"2024-09-12T22:06:44.396735+0000","last_unstale":"2024-09-12T22:07:05.846797+0000","last_undegraded":"2024-09-12T22:07:05.846797+0000","last_fullsized":"2024-09-12T22:07:05.846797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:05.846706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:05.846706+0000","last_clean_scrub_stamp":"2024-09-12T22:07:05.846706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:12.877837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:07.864716+0000","last_change":"2024-09-12T22:07:07.864739+0000","last_active":"2024-09-12T22:07:07.864716+0000","last_peered":"2024-09-12T22:07:07.864716+0000","last_clean":"2024-09-12T22:07:07.864716+0000","last_became_active":"2024-09-12T22:06:44.421723+0000","last_became_peered":"2024-09-12T22:06:44.421723+0000","last_unstale":"2024-09-12T22:07:07.864716+0000","last_undegraded":"2024-09-12T22:07:07.864716+0000","last_fullsized":"2024-09-12T22:07:07.864716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:07.864622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:07.864622+0000","last_clean_scrub_stamp":"2024-09-12T22:07:07.864622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:01.376833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"93'2","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:32.993062+0000","last_change":"2024-09-12T22:07:32.993092+0000","last_active":"2024-09-12T22:07:32.993062+0000","last_peered":"2024-09-12T22:07:32.993062+0000","last_clean":"2024-09-12T22:07:32.993062+0000","last_became_active":"2024-09-12T22:06:50.419354+0000","last_became_peered":"2024-09-12T22:06:50.419354+0000","last_unstale":"2024-09-12T22:07:32.993062+0000","last_undegraded":"2024-09-12T22:07:32.993062+0000","last_fullsized":"2024-09-12T22:07:32.993062+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-09-12T22:07:32.992969+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-09-12T22:07:32.992969+0000","last_clean_scrub_stamp":"2024-09-12T22:07:32.992969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:10.979676+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:11.417569+0000","last_change":"2024-09-12T22:07:11.417613+0000","last_active":"2024-09-12T22:07:11.417569+0000","last_peered":"2024-09-12T22:07:11.417569+0000","last_clean":"2024-09-12T22:07:11.417569+0000","last_became_active":"2024-09-12T22:06:50.418444+0000","last_became_peered":"2024-09-12T22:06:50.418444+0000","last_unstale":"2024-09-12T22:07:11.417569+0000","last_undegraded":"2024-09-12T22:07:11.417569+0000","last_fullsized":"2024-09-12T22:07:11.417569+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:11.417469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:11.417469+0000","last_clean_scrub_stamp":"2024-09-12T22:07:11.417469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:27.058849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":181,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:31.378812+0000","last_change":"2024-09-12T22:07:31.378848+0000","last_active":"2024-09-12T22:07:31.378812+0000","last_peered":"2024-09-12T22:07:31.378812+0000","last_clean":"2024-09-12T22:07:31.378812+0000","last_became_active":"2024-09-12T22:06:50.418591+0000","last_became_peered":"2024-09-12T22:06:50.418591+0000","last_unstale":"2024-09-12T22:07:31.378812+0000","last_undegraded":"2024-09-12T22:07:31.378812+0000","last_fullsized":"2024-09-12T22:07:31.378812+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:31.378717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:31.378717+0000","last_clean_scrub_stamp":"2024-09-12T22:07:31.378717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:36.003398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:04.444101+0000","last_change":"2024-09-12T22:07:04.444123+0000","last_active":"2024-09-12T22:07:04.444101+0000","last_peered":"2024-09-12T22:07:04.444101+0000","last_clean":"2024-09-12T22:07:04.444101+0000","last_became_active":"2024-09-12T22:06:50.419642+0000","last_became_peered":"2024-09-12T22:06:50.419642+0000","last_unstale":"2024-09-12T22:07:04.444101+0000","last_undegraded":"2024-09-12T22:07:04.444101+0000","last_fullsized":"2024-09-12T22:07:04.444101+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:04.444011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:04.444011+0000","last_clean_scrub_stamp":"2024-09-12T22:07:04.444011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:41.709278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"93'10","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:35.362574+0000","last_change":"2024-09-12T22:07:35.362613+0000","last_active":"2024-09-12T22:07:35.362574+0000","last_peered":"2024-09-12T22:07:35.362574+0000","last_clean":"2024-09-12T22:07:35.362574+0000","last_became_active":"2024-09-12T22:06:50.420099+0000","last_became_peered":"2024-09-12T22:06:50.420099+0000","last_unstale":"2024-09-12T22:07:35.362574+0000","last_undegraded":"2024-09-12T22:07:35.362574+0000","last_fullsized":"2024-09-12T22:07:35.362574+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'10","last_scrub_stamp":"2024-09-12T22:07:35.362488+0000","last_deep_scrub":"93'10","last_deep_scrub_stamp":"2024-09-12T22:07:35.362488+0000","last_clean_scrub_stamp":"2024-09-12T22:07:35.362488+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:28.480723+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:16.437933+0000","last_change":"2024-09-12T22:07:16.437959+0000","last_active":"2024-09-12T22:07:16.437933+0000","last_peered":"2024-09-12T22:07:16.437933+0000","last_clean":"2024-09-12T22:07:16.437933+0000","last_became_active":"2024-09-12T22:03:54.194697+0000","last_became_peered":"2024-09-12T22:03:54.194697+0000","last_unstale":"2024-09-12T22:07:16.437933+0000","last_undegraded":"2024-09-12T22:07:16.437933+0000","last_fullsized":"2024-09-12T22:07:16.437933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:16.437816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:16.437816+0000","last_clean_scrub_stamp":"2024-09-12T22:07:16.437816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:32.952376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"93'5","reported_seq":200,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:36.465519+0000","last_change":"2024-09-12T22:07:36.465577+0000","last_active":"2024-09-12T22:07:36.465519+0000","last_peered":"2024-09-12T22:07:36.465519+0000","last_clean":"2024-09-12T22:07:36.465519+0000","last_became_active":"2024-09-12T22:06:50.423283+0000","last_became_peered":"2024-09-12T22:06:50.423283+0000","last_unstale":"2024-09-12T22:07:36.465519+0000","last_undegraded":"2024-09-12T22:07:36.465519+0000","last_fullsized":"2024-09-12T22:07:36.465519+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'5","last_scrub_stamp":"2024-09-12T22:07:36.465389+0000","last_deep_scrub":"93'5","last_deep_scrub_stamp":"2024-09-12T22:07:36.465389+0000","last_clean_scrub_stamp":"2024-09-12T22:07:36.465389+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:57.113864+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:05.469217+0000","last_change":"2024-09-12T22:07:05.469261+0000","last_active":"2024-09-12T22:07:05.469217+0000","last_peered":"2024-09-12T22:07:05.469217+0000","last_clean":"2024-09-12T22:07:05.469217+0000","last_became_active":"2024-09-12T22:06:50.420171+0000","last_became_peered":"2024-09-12T22:06:50.420171+0000","last_unstale":"2024-09-12T22:07:05.469217+0000","last_undegraded":"2024-09-12T22:07:05.469217+0000","last_fullsized":"2024-09-12T22:07:05.469217+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:05.469120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:05.469120+0000","last_clean_scrub_stamp":"2024-09-12T22:07:05.469120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:42.616669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:25.989281+0000","last_change":"2024-09-12T22:07:25.989305+0000","last_active":"2024-09-12T22:07:25.989281+0000","last_peered":"2024-09-12T22:07:25.989281+0000","last_clean":"2024-09-12T22:07:25.989281+0000","last_became_active":"2024-09-12T22:06:50.417583+0000","last_became_peered":"2024-09-12T22:06:50.417583+0000","last_unstale":"2024-09-12T22:07:25.989281+0000","last_undegraded":"2024-09-12T22:07:25.989281+0000","last_fullsized":"2024-09-12T22:07:25.989281+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:25.989193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:25.989193+0000","last_clean_scrub_stamp":"2024-09-12T22:07:25.989193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:44.325009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:11.910998+0000","last_change":"2024-09-12T22:07:11.911025+0000","last_active":"2024-09-12T22:07:11.910998+0000","last_peered":"2024-09-12T22:07:11.910998+0000","last_clean":"2024-09-12T22:07:11.910998+0000","last_became_active":"2024-09-12T22:06:44.422217+0000","last_became_peered":"2024-09-12T22:06:44.422217+0000","last_unstale":"2024-09-12T22:07:11.910998+0000","last_undegraded":"2024-09-12T22:07:11.910998+0000","last_fullsized":"2024-09-12T22:07:11.910998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:11.910905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:11.910905+0000","last_clean_scrub_stamp":"2024-09-12T22:07:11.910905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:30:14.118448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:23.024354+0000","last_change":"2024-09-12T22:07:23.024416+0000","last_active":"2024-09-12T22:07:23.024354+0000","last_peered":"2024-09-12T22:07:23.024354+0000","last_clean":"2024-09-12T22:07:23.024354+0000","last_became_active":"2024-09-12T22:06:44.388560+0000","last_became_peered":"2024-09-12T22:06:44.388560+0000","last_unstale":"2024-09-12T22:07:23.024354+0000","last_undegraded":"2024-09-12T22:07:23.024354+0000","last_fullsized":"2024-09-12T22:07:23.024354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:23.024247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:23.024247+0000","last_clean_scrub_stamp":"2024-09-12T22:07:23.024247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:37.145512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:25.434803+0000","last_change":"2024-09-12T22:07:25.434840+0000","last_active":"2024-09-12T22:07:25.434803+0000","last_peered":"2024-09-12T22:07:25.434803+0000","last_clean":"2024-09-12T22:07:25.434803+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:07:25.434803+0000","last_undegraded":"2024-09-12T22:07:25.434803+0000","last_fullsized":"2024-09-12T22:07:25.434803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:25.434715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:25.434715+0000","last_clean_scrub_stamp":"2024-09-12T22:07:25.434715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:49.661012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:17.944452+0000","last_change":"2024-09-12T22:07:17.944480+0000","last_active":"2024-09-12T22:07:17.944452+0000","last_peered":"2024-09-12T22:07:17.944452+0000","last_clean":"2024-09-12T22:07:17.944452+0000","last_became_active":"2024-09-12T22:06:44.388499+0000","last_became_peered":"2024-09-12T22:06:44.388499+0000","last_unstale":"2024-09-12T22:07:17.944452+0000","last_undegraded":"2024-09-12T22:07:17.944452+0000","last_fullsized":"2024-09-12T22:07:17.944452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:17.944364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:17.944364+0000","last_clean_scrub_stamp":"2024-09-12T22:07:17.944364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:54.139341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:28.944597+0000","last_change":"2024-09-12T22:07:28.944621+0000","last_active":"2024-09-12T22:07:28.944597+0000","last_peered":"2024-09-12T22:07:28.944597+0000","last_clean":"2024-09-12T22:07:28.944597+0000","last_became_active":"2024-09-12T22:06:50.418800+0000","last_became_peered":"2024-09-12T22:06:50.418800+0000","last_unstale":"2024-09-12T22:07:28.944597+0000","last_undegraded":"2024-09-12T22:07:28.944597+0000","last_fullsized":"2024-09-12T22:07:28.944597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:28.944505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:28.944505+0000","last_clean_scrub_stamp":"2024-09-12T22:07:28.944505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:16.884551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:26.968847+0000","last_change":"2024-09-12T22:07:26.968877+0000","last_active":"2024-09-12T22:07:26.968847+0000","last_peered":"2024-09-12T22:07:26.968847+0000","last_clean":"2024-09-12T22:07:26.968847+0000","last_became_active":"2024-09-12T22:06:50.417455+0000","last_became_peered":"2024-09-12T22:06:50.417455+0000","last_unstale":"2024-09-12T22:07:26.968847+0000","last_undegraded":"2024-09-12T22:07:26.968847+0000","last_fullsized":"2024-09-12T22:07:26.968847+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:26.968609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:26.968609+0000","last_clean_scrub_stamp":"2024-09-12T22:07:26.968609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:04.407628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:20.451355+0000","last_change":"2024-09-12T22:07:20.451384+0000","last_active":"2024-09-12T22:07:20.451355+0000","last_peered":"2024-09-12T22:07:20.451355+0000","last_clean":"2024-09-12T22:07:20.451355+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:07:20.451355+0000","last_undegraded":"2024-09-12T22:07:20.451355+0000","last_fullsized":"2024-09-12T22:07:20.451355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:20.451265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:20.451265+0000","last_clean_scrub_stamp":"2024-09-12T22:07:20.451265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:44.038540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":178,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:10.540810+0000","last_change":"2024-09-12T22:07:10.540843+0000","last_active":"2024-09-12T22:07:10.540810+0000","last_peered":"2024-09-12T22:07:10.540810+0000","last_clean":"2024-09-12T22:07:10.540810+0000","last_became_active":"2024-09-12T22:06:44.390719+0000","last_became_peered":"2024-09-12T22:06:44.390719+0000","last_unstale":"2024-09-12T22:07:10.540810+0000","last_undegraded":"2024-09-12T22:07:10.540810+0000","last_fullsized":"2024-09-12T22:07:10.540810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-12T22:07:10.540723+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-12T22:07:10.540723+0000","last_clean_scrub_stamp":"2024-09-12T22:07:10.540723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:03.575272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:29.413085+0000","last_change":"2024-09-12T22:07:29.413123+0000","last_active":"2024-09-12T22:07:29.413085+0000","last_peered":"2024-09-12T22:07:29.413085+0000","last_clean":"2024-09-12T22:07:29.413085+0000","last_became_active":"2024-09-12T22:06:44.392160+0000","last_became_peered":"2024-09-12T22:06:44.392160+0000","last_unstale":"2024-09-12T22:07:29.413085+0000","last_undegraded":"2024-09-12T22:07:29.413085+0000","last_fullsized":"2024-09-12T22:07:29.413085+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:29.412995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:29.412995+0000","last_clean_scrub_stamp":"2024-09-12T22:07:29.412995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:03.364785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":184,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:30.364234+0000","last_change":"2024-09-12T22:07:30.364260+0000","last_active":"2024-09-12T22:07:30.364234+0000","last_peered":"2024-09-12T22:07:30.364234+0000","last_clean":"2024-09-12T22:07:30.364234+0000","last_became_active":"2024-09-12T22:06:50.418834+0000","last_became_peered":"2024-09-12T22:06:50.418834+0000","last_unstale":"2024-09-12T22:07:30.364234+0000","last_undegraded":"2024-09-12T22:07:30.364234+0000","last_fullsized":"2024-09-12T22:07:30.364234+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-12T22:07:30.364142+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-12T22:07:30.364142+0000","last_clean_scrub_stamp":"2024-09-12T22:07:30.364142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:27.018090+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:22.370132+0000","last_change":"2024-09-12T22:07:22.370155+0000","last_active":"2024-09-12T22:07:22.370132+0000","last_peered":"2024-09-12T22:07:22.370132+0000","last_clean":"2024-09-12T22:07:22.370132+0000","last_became_active":"2024-09-12T22:06:50.418856+0000","last_became_peered":"2024-09-12T22:06:50.418856+0000","last_unstale":"2024-09-12T22:07:22.370132+0000","last_undegraded":"2024-09-12T22:07:22.370132+0000","last_fullsized":"2024-09-12T22:07:22.370132+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:22.370037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:22.370037+0000","last_clean_scrub_stamp":"2024-09-12T22:07:22.370037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:09.796759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"93'3","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:36.343497+0000","last_change":"2024-09-12T22:07:36.343529+0000","last_active":"2024-09-12T22:07:36.343497+0000","last_peered":"2024-09-12T22:07:36.343497+0000","last_clean":"2024-09-12T22:07:36.343497+0000","last_became_active":"2024-09-12T22:06:50.421034+0000","last_became_peered":"2024-09-12T22:06:50.421034+0000","last_unstale":"2024-09-12T22:07:36.343497+0000","last_undegraded":"2024-09-12T22:07:36.343497+0000","last_fullsized":"2024-09-12T22:07:36.343497+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-09-12T22:07:36.343412+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-09-12T22:07:36.343412+0000","last_clean_scrub_stamp":"2024-09-12T22:07:36.343412+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:39.827961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:32.341165+0000","last_change":"2024-09-12T22:07:32.341190+0000","last_active":"2024-09-12T22:07:32.341165+0000","last_peered":"2024-09-12T22:07:32.341165+0000","last_clean":"2024-09-12T22:07:32.341165+0000","last_became_active":"2024-09-12T22:06:50.419417+0000","last_became_peered":"2024-09-12T22:06:50.419417+0000","last_unstale":"2024-09-12T22:07:32.341165+0000","last_undegraded":"2024-09-12T22:07:32.341165+0000","last_fullsized":"2024-09-12T22:07:32.341165+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:32.341080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:32.341080+0000","last_clean_scrub_stamp":"2024-09-12T22:07:32.341080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:43.106443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"93'3","reported_seq":173,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:21.484625+0000","last_change":"2024-09-12T22:07:21.484653+0000","last_active":"2024-09-12T22:07:21.484625+0000","last_peered":"2024-09-12T22:07:21.484625+0000","last_clean":"2024-09-12T22:07:21.484625+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:07:21.484625+0000","last_undegraded":"2024-09-12T22:07:21.484625+0000","last_fullsized":"2024-09-12T22:07:21.484625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-09-12T22:07:21.484535+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-09-12T22:07:21.484535+0000","last_clean_scrub_stamp":"2024-09-12T22:07:21.484535+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:06.736983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:13.533869+0000","last_change":"2024-09-12T22:07:13.533895+0000","last_active":"2024-09-12T22:07:13.533869+0000","last_peered":"2024-09-12T22:07:13.533869+0000","last_clean":"2024-09-12T22:07:13.533869+0000","last_became_active":"2024-09-12T22:06:44.392020+0000","last_became_peered":"2024-09-12T22:06:44.392020+0000","last_unstale":"2024-09-12T22:07:13.533869+0000","last_undegraded":"2024-09-12T22:07:13.533869+0000","last_fullsized":"2024-09-12T22:07:13.533869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:13.533770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:13.533770+0000","last_clean_scrub_stamp":"2024-09-12T22:07:13.533770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:48.428924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:16.976909+0000","last_change":"2024-09-12T22:07:16.976939+0000","last_active":"2024-09-12T22:07:16.976909+0000","last_peered":"2024-09-12T22:07:16.976909+0000","last_clean":"2024-09-12T22:07:16.976909+0000","last_became_active":"2024-09-12T22:06:44.394195+0000","last_became_peered":"2024-09-12T22:06:44.394195+0000","last_unstale":"2024-09-12T22:07:16.976909+0000","last_undegraded":"2024-09-12T22:07:16.976909+0000","last_fullsized":"2024-09-12T22:07:16.976909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-12T22:07:16.976800+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-12T22:07:16.976800+0000","last_clean_scrub_stamp":"2024-09-12T22:07:16.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:48.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:07.410176+0000","last_change":"2024-09-12T22:07:07.410203+0000","last_active":"2024-09-12T22:07:07.410176+0000","last_peered":"2024-09-12T22:07:07.410176+0000","last_clean":"2024-09-12T22:07:07.410176+0000","last_became_active":"2024-09-12T22:06:50.420176+0000","last_became_peered":"2024-09-12T22:06:50.420176+0000","last_unstale":"2024-09-12T22:07:07.410176+0000","last_undegraded":"2024-09-12T22:07:07.410176+0000","last_fullsized":"2024-09-12T22:07:07.410176+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:07.410090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:07.410090+0000","last_clean_scrub_stamp":"2024-09-12T22:07:07.410090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:18.108691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:31.973565+0000","last_change":"2024-09-12T22:07:31.973645+0000","last_active":"2024-09-12T22:07:31.973565+0000","last_peered":"2024-09-12T22:07:31.973565+0000","last_clean":"2024-09-12T22:07:31.973565+0000","last_became_active":"2024-09-12T22:06:50.417229+0000","last_became_peered":"2024-09-12T22:06:50.417229+0000","last_unstale":"2024-09-12T22:07:31.973565+0000","last_undegraded":"2024-09-12T22:07:31.973565+0000","last_fullsized":"2024-09-12T22:07:31.973565+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'6","last_scrub_stamp":"2024-09-12T22:07:31.973463+0000","last_deep_scrub":"93'6","last_deep_scrub_stamp":"2024-09-12T22:07:31.973463+0000","last_clean_scrub_stamp":"2024-09-12T22:07:31.973463+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:41.760666+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2430,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705720,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":564504,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":562878,"kb_avail":93807336,"statfs":{"total":96636764160,"available":96058712064,"internally_reserved":0,"allocated":1646592,"data_stored":1060429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576387525},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705720,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411812,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":410174,"kb_avail":93960028,"statfs":{"total":96636764160,"available":96215068672,"internally_reserved":0,"allocated":1658880,"data_stored":1061064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":420018629},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285581,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50696,"kb_used_data":1016,"kb_used_omap":6,"kb_used_meta":49657,"kb_avail":94321144,"statfs":{"total":96636764160,"available":96584851456,"internally_reserved":0,"allocated":1040384,"data_stored":468902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6904,"internal_metadata":50849032},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:07:43.548 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T22:03:22.303285+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:43.548 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T22:03:27.319181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=3, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=7, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:07:43.549 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T22:08:03.549 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:08:03.859 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:08:03.861 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T22:08:03.870 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-09-12T22:08:02.303170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":592798,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1027012,"kb_used_data":4244,"kb_used_omap":9,"kb_used_meta":1022710,"kb_avail":282088508,"statfs":{"total":289910292480,"available":288858632192,"internally_reserved":0,"allocated":4345856,"data_stored":2590395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10094,"internal_metadata":1047255186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002833"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":176,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:07.569038+0000","last_change":"2024-09-12T22:07:07.569038+0000","last_active":"2024-09-12T22:07:07.569038+0000","last_peered":"2024-09-12T22:07:07.569038+0000","last_clean":"2024-09-12T22:07:07.569038+0000","last_became_active":"2024-09-12T22:06:44.391100+0000","last_became_peered":"2024-09-12T22:06:44.391100+0000","last_unstale":"2024-09-12T22:07:07.569038+0000","last_undegraded":"2024-09-12T22:07:07.569038+0000","last_fullsized":"2024-09-12T22:07:07.569038+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:07.568895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:07.568895+0000","last_clean_scrub_stamp":"2024-09-12T22:07:07.568895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:55.171097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":176,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:02.571103+0000","last_change":"2024-09-12T22:07:02.571103+0000","last_active":"2024-09-12T22:07:02.571103+0000","last_peered":"2024-09-12T22:07:02.571103+0000","last_clean":"2024-09-12T22:07:02.571103+0000","last_became_active":"2024-09-12T22:06:44.392188+0000","last_became_peered":"2024-09-12T22:06:44.392188+0000","last_unstale":"2024-09-12T22:07:02.571103+0000","last_undegraded":"2024-09-12T22:07:02.571103+0000","last_fullsized":"2024-09-12T22:07:02.571103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:02.570956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:02.570956+0000","last_clean_scrub_stamp":"2024-09-12T22:07:02.570956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:45.454533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:27.284627+0000","last_change":"2024-09-12T22:07:27.284627+0000","last_active":"2024-09-12T22:07:27.284627+0000","last_peered":"2024-09-12T22:07:27.284627+0000","last_clean":"2024-09-12T22:07:27.284627+0000","last_became_active":"2024-09-12T22:03:33.460084+0000","last_became_peered":"2024-09-12T22:03:33.460084+0000","last_unstale":"2024-09-12T22:07:27.284627+0000","last_undegraded":"2024-09-12T22:07:27.284627+0000","last_fullsized":"2024-09-12T22:07:27.284627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:27.284469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:27.284469+0000","last_clean_scrub_stamp":"2024-09-12T22:07:27.284469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:37.051296+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:14.360867+0000","last_change":"2024-09-12T22:07:14.360891+0000","last_active":"2024-09-12T22:07:14.360867+0000","last_peered":"2024-09-12T22:07:14.360867+0000","last_clean":"2024-09-12T22:07:14.360867+0000","last_became_active":"2024-09-12T22:06:50.419429+0000","last_became_peered":"2024-09-12T22:06:50.419429+0000","last_unstale":"2024-09-12T22:07:14.360867+0000","last_undegraded":"2024-09-12T22:07:14.360867+0000","last_fullsized":"2024-09-12T22:07:14.360867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:14.360779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:14.360779+0000","last_clean_scrub_stamp":"2024-09-12T22:07:14.360779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:55.117684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:19.462843+0000","last_change":"2024-09-12T22:07:19.462869+0000","last_active":"2024-09-12T22:07:19.462843+0000","last_peered":"2024-09-12T22:07:19.462843+0000","last_clean":"2024-09-12T22:07:19.462843+0000","last_became_active":"2024-09-12T22:06:44.391774+0000","last_became_peered":"2024-09-12T22:06:44.391774+0000","last_unstale":"2024-09-12T22:07:19.462843+0000","last_undegraded":"2024-09-12T22:07:19.462843+0000","last_fullsized":"2024-09-12T22:07:19.462843+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:19.462750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:19.462750+0000","last_clean_scrub_stamp":"2024-09-12T22:07:19.462750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:29.869167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:15.359866+0000","last_change":"2024-09-12T22:07:15.359893+0000","last_active":"2024-09-12T22:07:15.359866+0000","last_peered":"2024-09-12T22:07:15.359866+0000","last_clean":"2024-09-12T22:07:15.359866+0000","last_became_active":"2024-09-12T22:06:50.414526+0000","last_became_peered":"2024-09-12T22:06:50.414526+0000","last_unstale":"2024-09-12T22:07:15.359866+0000","last_undegraded":"2024-09-12T22:07:15.359866+0000","last_fullsized":"2024-09-12T22:07:15.359866+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:15.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:15.359774+0000","last_clean_scrub_stamp":"2024-09-12T22:07:15.359774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:16.223853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:30.335117+0000","last_change":"2024-09-12T22:07:30.335140+0000","last_active":"2024-09-12T22:07:30.335117+0000","last_peered":"2024-09-12T22:07:30.335117+0000","last_clean":"2024-09-12T22:07:30.335117+0000","last_became_active":"2024-09-12T22:06:44.421094+0000","last_became_peered":"2024-09-12T22:06:44.421094+0000","last_unstale":"2024-09-12T22:07:30.335117+0000","last_undegraded":"2024-09-12T22:07:30.335117+0000","last_fullsized":"2024-09-12T22:07:30.335117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:30.334984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:30.334984+0000","last_clean_scrub_stamp":"2024-09-12T22:07:30.334984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:56.481422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:29.341834+0000","last_change":"2024-09-12T22:07:29.341856+0000","last_active":"2024-09-12T22:07:29.341834+0000","last_peered":"2024-09-12T22:07:29.341834+0000","last_clean":"2024-09-12T22:07:29.341834+0000","last_became_active":"2024-09-12T22:06:44.394804+0000","last_became_peered":"2024-09-12T22:06:44.394804+0000","last_unstale":"2024-09-12T22:07:29.341834+0000","last_undegraded":"2024-09-12T22:07:29.341834+0000","last_fullsized":"2024-09-12T22:07:29.341834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:29.341727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:29.341727+0000","last_clean_scrub_stamp":"2024-09-12T22:07:29.341727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:55.104011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:22.045636+0000","last_change":"2024-09-12T22:07:22.045661+0000","last_active":"2024-09-12T22:07:22.045636+0000","last_peered":"2024-09-12T22:07:22.045636+0000","last_clean":"2024-09-12T22:07:22.045636+0000","last_became_active":"2024-09-12T22:06:44.389256+0000","last_became_peered":"2024-09-12T22:06:44.389256+0000","last_unstale":"2024-09-12T22:07:22.045636+0000","last_undegraded":"2024-09-12T22:07:22.045636+0000","last_fullsized":"2024-09-12T22:07:22.045636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:22.045548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:22.045548+0000","last_clean_scrub_stamp":"2024-09-12T22:07:22.045548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:19.963772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:15.484734+0000","last_change":"2024-09-12T22:07:15.484758+0000","last_active":"2024-09-12T22:07:15.484734+0000","last_peered":"2024-09-12T22:07:15.484734+0000","last_clean":"2024-09-12T22:07:15.484734+0000","last_became_active":"2024-09-12T22:06:44.391572+0000","last_became_peered":"2024-09-12T22:06:44.391572+0000","last_unstale":"2024-09-12T22:07:15.484734+0000","last_undegraded":"2024-09-12T22:07:15.484734+0000","last_fullsized":"2024-09-12T22:07:15.484734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:15.484646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:15.484646+0000","last_clean_scrub_stamp":"2024-09-12T22:07:15.484646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:05.597210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:18.424486+0000","last_change":"2024-09-12T22:07:18.424525+0000","last_active":"2024-09-12T22:07:18.424486+0000","last_peered":"2024-09-12T22:07:18.424486+0000","last_clean":"2024-09-12T22:07:18.424486+0000","last_became_active":"2024-09-12T22:06:50.419042+0000","last_became_peered":"2024-09-12T22:06:50.419042+0000","last_unstale":"2024-09-12T22:07:18.424486+0000","last_undegraded":"2024-09-12T22:07:18.424486+0000","last_fullsized":"2024-09-12T22:07:18.424486+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:18.424353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:18.424353+0000","last_clean_scrub_stamp":"2024-09-12T22:07:18.424353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:25.824204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:28.399124+0000","last_change":"2024-09-12T22:07:28.399150+0000","last_active":"2024-09-12T22:07:28.399124+0000","last_peered":"2024-09-12T22:07:28.399124+0000","last_clean":"2024-09-12T22:07:28.399124+0000","last_became_active":"2024-09-12T22:03:33.464551+0000","last_became_peered":"2024-09-12T22:03:33.464551+0000","last_unstale":"2024-09-12T22:07:28.399124+0000","last_undegraded":"2024-09-12T22:07:28.399124+0000","last_fullsized":"2024-09-12T22:07:28.399124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:28.399035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:28.399035+0000","last_clean_scrub_stamp":"2024-09-12T22:07:28.399035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:39.699369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:04.552650+0000","last_change":"2024-09-12T22:07:04.552671+0000","last_active":"2024-09-12T22:07:04.552650+0000","last_peered":"2024-09-12T22:07:04.552650+0000","last_clean":"2024-09-12T22:07:04.552650+0000","last_became_active":"2024-09-12T22:06:44.392491+0000","last_became_peered":"2024-09-12T22:06:44.392491+0000","last_unstale":"2024-09-12T22:07:04.552650+0000","last_undegraded":"2024-09-12T22:07:04.552650+0000","last_fullsized":"2024-09-12T22:07:04.552650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:04.552563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:04.552563+0000","last_clean_scrub_stamp":"2024-09-12T22:07:04.552563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:51.979285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:16.392714+0000","last_change":"2024-09-12T22:07:16.392737+0000","last_active":"2024-09-12T22:07:16.392714+0000","last_peered":"2024-09-12T22:07:16.392714+0000","last_clean":"2024-09-12T22:07:16.392714+0000","last_became_active":"2024-09-12T22:06:50.418325+0000","last_became_peered":"2024-09-12T22:06:50.418325+0000","last_unstale":"2024-09-12T22:07:16.392714+0000","last_undegraded":"2024-09-12T22:07:16.392714+0000","last_fullsized":"2024-09-12T22:07:16.392714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:16.392602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:16.392602+0000","last_clean_scrub_stamp":"2024-09-12T22:07:16.392602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:59.530527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:08.369681+0000","last_change":"2024-09-12T22:07:08.369704+0000","last_active":"2024-09-12T22:07:08.369681+0000","last_peered":"2024-09-12T22:07:08.369681+0000","last_clean":"2024-09-12T22:07:08.369681+0000","last_became_active":"2024-09-12T22:06:50.418075+0000","last_became_peered":"2024-09-12T22:06:50.418075+0000","last_unstale":"2024-09-12T22:07:08.369681+0000","last_undegraded":"2024-09-12T22:07:08.369681+0000","last_fullsized":"2024-09-12T22:07:08.369681+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:08.369593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:08.369593+0000","last_clean_scrub_stamp":"2024-09-12T22:07:08.369593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:35.314936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:28.292514+0000","last_change":"2024-09-12T22:07:28.292551+0000","last_active":"2024-09-12T22:07:28.292514+0000","last_peered":"2024-09-12T22:07:28.292514+0000","last_clean":"2024-09-12T22:07:28.292514+0000","last_became_active":"2024-09-12T22:06:44.394486+0000","last_became_peered":"2024-09-12T22:06:44.394486+0000","last_unstale":"2024-09-12T22:07:28.292514+0000","last_undegraded":"2024-09-12T22:07:28.292514+0000","last_fullsized":"2024-09-12T22:07:28.292514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:28.292403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:28.292403+0000","last_clean_scrub_stamp":"2024-09-12T22:07:28.292403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:04:02.574652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:21.000060+0000","last_change":"2024-09-12T22:07:21.000086+0000","last_active":"2024-09-12T22:07:21.000060+0000","last_peered":"2024-09-12T22:07:21.000060+0000","last_clean":"2024-09-12T22:07:21.000060+0000","last_became_active":"2024-09-12T22:06:44.388967+0000","last_became_peered":"2024-09-12T22:06:44.388967+0000","last_unstale":"2024-09-12T22:07:21.000060+0000","last_undegraded":"2024-09-12T22:07:21.000060+0000","last_fullsized":"2024-09-12T22:07:21.000060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:20.999966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:20.999966+0000","last_clean_scrub_stamp":"2024-09-12T22:07:20.999966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:13.296573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:08.608560+0000","last_change":"2024-09-12T22:07:08.608587+0000","last_active":"2024-09-12T22:07:08.608560+0000","last_peered":"2024-09-12T22:07:08.608560+0000","last_clean":"2024-09-12T22:07:08.608560+0000","last_became_active":"2024-09-12T22:06:44.390858+0000","last_became_peered":"2024-09-12T22:06:44.390858+0000","last_unstale":"2024-09-12T22:07:08.608560+0000","last_undegraded":"2024-09-12T22:07:08.608560+0000","last_fullsized":"2024-09-12T22:07:08.608560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:08.608471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:08.608471+0000","last_clean_scrub_stamp":"2024-09-12T22:07:08.608471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:44.761690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:18.963354+0000","last_change":"2024-09-12T22:07:18.963395+0000","last_active":"2024-09-12T22:07:18.963354+0000","last_peered":"2024-09-12T22:07:18.963354+0000","last_clean":"2024-09-12T22:07:18.963354+0000","last_became_active":"2024-09-12T22:06:44.388761+0000","last_became_peered":"2024-09-12T22:06:44.388761+0000","last_unstale":"2024-09-12T22:07:18.963354+0000","last_undegraded":"2024-09-12T22:07:18.963354+0000","last_fullsized":"2024-09-12T22:07:18.963354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:18.963268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:18.963268+0000","last_clean_scrub_stamp":"2024-09-12T22:07:18.963268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:18.057160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:23.358002+0000","last_change":"2024-09-12T22:07:23.358037+0000","last_active":"2024-09-12T22:07:23.358002+0000","last_peered":"2024-09-12T22:07:23.358002+0000","last_clean":"2024-09-12T22:07:23.358002+0000","last_became_active":"2024-09-12T22:06:44.420768+0000","last_became_peered":"2024-09-12T22:06:44.420768+0000","last_unstale":"2024-09-12T22:07:23.358002+0000","last_undegraded":"2024-09-12T22:07:23.358002+0000","last_fullsized":"2024-09-12T22:07:23.358002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:23.357913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:23.357913+0000","last_clean_scrub_stamp":"2024-09-12T22:07:23.357913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:13.388816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:02.466714+0000","last_change":"2024-09-12T22:07:02.466752+0000","last_active":"2024-09-12T22:07:02.466714+0000","last_peered":"2024-09-12T22:07:02.466714+0000","last_clean":"2024-09-12T22:07:02.466714+0000","last_became_active":"2024-09-12T22:06:50.421758+0000","last_became_peered":"2024-09-12T22:06:50.421758+0000","last_unstale":"2024-09-12T22:07:02.466714+0000","last_undegraded":"2024-09-12T22:07:02.466714+0000","last_fullsized":"2024-09-12T22:07:02.466714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:02.466611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:02.466611+0000","last_clean_scrub_stamp":"2024-09-12T22:07:02.466611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:13.189761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:26.446802+0000","last_change":"2024-09-12T22:07:26.446831+0000","last_active":"2024-09-12T22:07:26.446802+0000","last_peered":"2024-09-12T22:07:26.446802+0000","last_clean":"2024-09-12T22:07:26.446802+0000","last_became_active":"2024-09-12T22:03:33.460658+0000","last_became_peered":"2024-09-12T22:03:33.460658+0000","last_unstale":"2024-09-12T22:07:26.446802+0000","last_undegraded":"2024-09-12T22:07:26.446802+0000","last_fullsized":"2024-09-12T22:07:26.446802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:26.446680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:26.446680+0000","last_clean_scrub_stamp":"2024-09-12T22:07:26.446680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:25.568110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:15.972800+0000","last_change":"2024-09-12T22:07:15.972824+0000","last_active":"2024-09-12T22:07:15.972800+0000","last_peered":"2024-09-12T22:07:15.972800+0000","last_clean":"2024-09-12T22:07:15.972800+0000","last_became_active":"2024-09-12T22:06:50.416924+0000","last_became_peered":"2024-09-12T22:06:50.416924+0000","last_unstale":"2024-09-12T22:07:15.972800+0000","last_undegraded":"2024-09-12T22:07:15.972800+0000","last_fullsized":"2024-09-12T22:07:15.972800+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:15.972710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:15.972710+0000","last_clean_scrub_stamp":"2024-09-12T22:07:15.972710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:40.574353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":176,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:09.567334+0000","last_change":"2024-09-12T22:07:09.567334+0000","last_active":"2024-09-12T22:07:09.567334+0000","last_peered":"2024-09-12T22:07:09.567334+0000","last_clean":"2024-09-12T22:07:09.567334+0000","last_became_active":"2024-09-12T22:06:44.391480+0000","last_became_peered":"2024-09-12T22:06:44.391480+0000","last_unstale":"2024-09-12T22:07:09.567334+0000","last_undegraded":"2024-09-12T22:07:09.567334+0000","last_fullsized":"2024-09-12T22:07:09.567334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:09.567191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:09.567191+0000","last_clean_scrub_stamp":"2024-09-12T22:07:09.567191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:19.334017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":182,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:35.424017+0000","last_change":"2024-09-12T22:07:35.424017+0000","last_active":"2024-09-12T22:07:35.424017+0000","last_peered":"2024-09-12T22:07:35.424017+0000","last_clean":"2024-09-12T22:07:35.424017+0000","last_became_active":"2024-09-12T22:06:50.419573+0000","last_became_peered":"2024-09-12T22:06:50.419573+0000","last_unstale":"2024-09-12T22:07:35.424017+0000","last_undegraded":"2024-09-12T22:07:35.424017+0000","last_fullsized":"2024-09-12T22:07:35.424017+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:35.423892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:35.423892+0000","last_clean_scrub_stamp":"2024-09-12T22:07:35.423892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:47.589626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:29.935784+0000","last_change":"2024-09-12T22:07:29.935810+0000","last_active":"2024-09-12T22:07:29.935784+0000","last_peered":"2024-09-12T22:07:29.935784+0000","last_clean":"2024-09-12T22:07:29.935784+0000","last_became_active":"2024-09-12T22:06:50.419348+0000","last_became_peered":"2024-09-12T22:06:50.419348+0000","last_unstale":"2024-09-12T22:07:29.935784+0000","last_undegraded":"2024-09-12T22:07:29.935784+0000","last_fullsized":"2024-09-12T22:07:29.935784+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:29.935697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:29.935697+0000","last_clean_scrub_stamp":"2024-09-12T22:07:29.935697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:04.434011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:26.286849+0000","last_change":"2024-09-12T22:07:26.286849+0000","last_active":"2024-09-12T22:07:26.286849+0000","last_peered":"2024-09-12T22:07:26.286849+0000","last_clean":"2024-09-12T22:07:26.286849+0000","last_became_active":"2024-09-12T22:03:33.459923+0000","last_became_peered":"2024-09-12T22:03:33.459923+0000","last_unstale":"2024-09-12T22:07:26.286849+0000","last_undegraded":"2024-09-12T22:07:26.286849+0000","last_fullsized":"2024-09-12T22:07:26.286849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:26.286724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:26.286724+0000","last_clean_scrub_stamp":"2024-09-12T22:07:26.286724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:45:02.439942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":182,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:33.371840+0000","last_change":"2024-09-12T22:07:33.371840+0000","last_active":"2024-09-12T22:07:33.371840+0000","last_peered":"2024-09-12T22:07:33.371840+0000","last_clean":"2024-09-12T22:07:33.371840+0000","last_became_active":"2024-09-12T22:06:50.418755+0000","last_became_peered":"2024-09-12T22:06:50.418755+0000","last_unstale":"2024-09-12T22:07:33.371840+0000","last_undegraded":"2024-09-12T22:07:33.371840+0000","last_fullsized":"2024-09-12T22:07:33.371840+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:33.371721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:33.371721+0000","last_clean_scrub_stamp":"2024-09-12T22:07:33.371721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:37.920728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:02.879310+0000","last_change":"2024-09-12T22:07:02.879360+0000","last_active":"2024-09-12T22:07:02.879310+0000","last_peered":"2024-09-12T22:07:02.879310+0000","last_clean":"2024-09-12T22:07:02.879310+0000","last_became_active":"2024-09-12T22:06:44.397198+0000","last_became_peered":"2024-09-12T22:06:44.397198+0000","last_unstale":"2024-09-12T22:07:02.879310+0000","last_undegraded":"2024-09-12T22:07:02.879310+0000","last_fullsized":"2024-09-12T22:07:02.879310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:02.879206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:02.879206+0000","last_clean_scrub_stamp":"2024-09-12T22:07:02.879206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:56.691650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:24.482162+0000","last_change":"2024-09-12T22:07:24.482162+0000","last_active":"2024-09-12T22:07:24.482162+0000","last_peered":"2024-09-12T22:07:24.482162+0000","last_clean":"2024-09-12T22:07:24.482162+0000","last_became_active":"2024-09-12T22:03:33.456434+0000","last_became_peered":"2024-09-12T22:03:33.456434+0000","last_unstale":"2024-09-12T22:07:24.482162+0000","last_undegraded":"2024-09-12T22:07:24.482162+0000","last_fullsized":"2024-09-12T22:07:24.482162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:24.482040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:24.482040+0000","last_clean_scrub_stamp":"2024-09-12T22:07:24.482040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:27.727732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:06.828211+0000","last_change":"2024-09-12T22:07:06.828268+0000","last_active":"2024-09-12T22:07:06.828211+0000","last_peered":"2024-09-12T22:07:06.828211+0000","last_clean":"2024-09-12T22:07:06.828211+0000","last_became_active":"2024-09-12T22:06:44.397074+0000","last_became_peered":"2024-09-12T22:06:44.397074+0000","last_unstale":"2024-09-12T22:07:06.828211+0000","last_undegraded":"2024-09-12T22:07:06.828211+0000","last_fullsized":"2024-09-12T22:07:06.828211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:06.828090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:06.828090+0000","last_clean_scrub_stamp":"2024-09-12T22:07:06.828090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:26:24.122811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:13.373982+0000","last_change":"2024-09-12T22:07:13.374006+0000","last_active":"2024-09-12T22:07:13.373982+0000","last_peered":"2024-09-12T22:07:13.373982+0000","last_clean":"2024-09-12T22:07:13.373982+0000","last_became_active":"2024-09-12T22:06:50.414626+0000","last_became_peered":"2024-09-12T22:06:50.414626+0000","last_unstale":"2024-09-12T22:07:13.373982+0000","last_undegraded":"2024-09-12T22:07:13.373982+0000","last_fullsized":"2024-09-12T22:07:13.373982+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:13.373893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:13.373893+0000","last_clean_scrub_stamp":"2024-09-12T22:07:13.373893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:01.475526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:11.545572+0000","last_change":"2024-09-12T22:07:11.545596+0000","last_active":"2024-09-12T22:07:11.545572+0000","last_peered":"2024-09-12T22:07:11.545572+0000","last_clean":"2024-09-12T22:07:11.545572+0000","last_became_active":"2024-09-12T22:06:44.391447+0000","last_became_peered":"2024-09-12T22:06:44.391447+0000","last_unstale":"2024-09-12T22:07:11.545572+0000","last_undegraded":"2024-09-12T22:07:11.545572+0000","last_fullsized":"2024-09-12T22:07:11.545572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:11.545486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:11.545486+0000","last_clean_scrub_stamp":"2024-09-12T22:07:11.545486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:37.307770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"93'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:37.328382+0000","last_change":"2024-09-12T22:07:37.328414+0000","last_active":"2024-09-12T22:07:37.328382+0000","last_peered":"2024-09-12T22:07:37.328382+0000","last_clean":"2024-09-12T22:07:37.328382+0000","last_became_active":"2024-09-12T22:06:50.422232+0000","last_became_peered":"2024-09-12T22:06:50.422232+0000","last_unstale":"2024-09-12T22:07:37.328382+0000","last_undegraded":"2024-09-12T22:07:37.328382+0000","last_fullsized":"2024-09-12T22:07:37.328382+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-09-12T22:07:37.328299+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-09-12T22:07:37.328299+0000","last_clean_scrub_stamp":"2024-09-12T22:07:37.328299+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:47.734717+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:12.581801+0000","last_change":"2024-09-12T22:07:12.581841+0000","last_active":"2024-09-12T22:07:12.581801+0000","last_peered":"2024-09-12T22:07:12.581801+0000","last_clean":"2024-09-12T22:07:12.581801+0000","last_became_active":"2024-09-12T22:06:44.390652+0000","last_became_peered":"2024-09-12T22:06:44.390652+0000","last_unstale":"2024-09-12T22:07:12.581801+0000","last_undegraded":"2024-09-12T22:07:12.581801+0000","last_fullsized":"2024-09-12T22:07:12.581801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:12.581719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:12.581719+0000","last_clean_scrub_stamp":"2024-09-12T22:07:12.581719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:48.655239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:13.960253+0000","last_change":"2024-09-12T22:07:13.960279+0000","last_active":"2024-09-12T22:07:13.960253+0000","last_peered":"2024-09-12T22:07:13.960253+0000","last_clean":"2024-09-12T22:07:13.960253+0000","last_became_active":"2024-09-12T22:06:50.417123+0000","last_became_peered":"2024-09-12T22:06:50.417123+0000","last_unstale":"2024-09-12T22:07:13.960253+0000","last_undegraded":"2024-09-12T22:07:13.960253+0000","last_fullsized":"2024-09-12T22:07:13.960253+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:13.960165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:13.960165+0000","last_clean_scrub_stamp":"2024-09-12T22:07:13.960165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:46.981226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:27.937000+0000","last_change":"2024-09-12T22:07:27.937039+0000","last_active":"2024-09-12T22:07:27.937000+0000","last_peered":"2024-09-12T22:07:27.937000+0000","last_clean":"2024-09-12T22:07:27.937000+0000","last_became_active":"2024-09-12T22:06:50.418817+0000","last_became_peered":"2024-09-12T22:06:50.418817+0000","last_unstale":"2024-09-12T22:07:27.937000+0000","last_undegraded":"2024-09-12T22:07:27.937000+0000","last_fullsized":"2024-09-12T22:07:27.937000+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:27.936910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:27.936910+0000","last_clean_scrub_stamp":"2024-09-12T22:07:27.936910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:28.763778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":183,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:34.383000+0000","last_change":"2024-09-12T22:07:34.383027+0000","last_active":"2024-09-12T22:07:34.383000+0000","last_peered":"2024-09-12T22:07:34.383000+0000","last_clean":"2024-09-12T22:07:34.383000+0000","last_became_active":"2024-09-12T22:06:50.419047+0000","last_became_peered":"2024-09-12T22:06:50.419047+0000","last_unstale":"2024-09-12T22:07:34.383000+0000","last_undegraded":"2024-09-12T22:07:34.383000+0000","last_fullsized":"2024-09-12T22:07:34.383000+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:34.382912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:34.382912+0000","last_clean_scrub_stamp":"2024-09-12T22:07:34.382912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:10.988596+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:09.935028+0000","last_change":"2024-09-12T22:07:09.935054+0000","last_active":"2024-09-12T22:07:09.935028+0000","last_peered":"2024-09-12T22:07:09.935028+0000","last_clean":"2024-09-12T22:07:09.935028+0000","last_became_active":"2024-09-12T22:06:44.421955+0000","last_became_peered":"2024-09-12T22:06:44.421955+0000","last_unstale":"2024-09-12T22:07:09.935028+0000","last_undegraded":"2024-09-12T22:07:09.935028+0000","last_fullsized":"2024-09-12T22:07:09.935028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:09.934934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:09.934934+0000","last_clean_scrub_stamp":"2024-09-12T22:07:09.934934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:12.156188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"93'12","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:34.343687+0000","last_change":"2024-09-12T22:07:34.343726+0000","last_active":"2024-09-12T22:07:34.343687+0000","last_peered":"2024-09-12T22:07:34.343687+0000","last_clean":"2024-09-12T22:07:34.343687+0000","last_became_active":"2024-09-12T22:06:50.418227+0000","last_became_peered":"2024-09-12T22:06:50.418227+0000","last_unstale":"2024-09-12T22:07:34.343687+0000","last_undegraded":"2024-09-12T22:07:34.343687+0000","last_fullsized":"2024-09-12T22:07:34.343687+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'12","last_scrub_stamp":"2024-09-12T22:07:34.343592+0000","last_deep_scrub":"93'12","last_deep_scrub_stamp":"2024-09-12T22:07:34.343592+0000","last_clean_scrub_stamp":"2024-09-12T22:07:34.343592+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:50.858153+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"93'2","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:33.345688+0000","last_change":"2024-09-12T22:07:33.345716+0000","last_active":"2024-09-12T22:07:33.345688+0000","last_peered":"2024-09-12T22:07:33.345688+0000","last_clean":"2024-09-12T22:07:33.345688+0000","last_became_active":"2024-09-12T22:06:50.418222+0000","last_became_peered":"2024-09-12T22:06:50.418222+0000","last_unstale":"2024-09-12T22:07:33.345688+0000","last_undegraded":"2024-09-12T22:07:33.345688+0000","last_fullsized":"2024-09-12T22:07:33.345688+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-09-12T22:07:33.345601+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-09-12T22:07:33.345601+0000","last_clean_scrub_stamp":"2024-09-12T22:07:33.345601+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:23.458165+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:18.481127+0000","last_change":"2024-09-12T22:07:18.481127+0000","last_active":"2024-09-12T22:07:18.481127+0000","last_peered":"2024-09-12T22:07:18.481127+0000","last_clean":"2024-09-12T22:07:18.481127+0000","last_became_active":"2024-09-12T22:03:33.464601+0000","last_became_peered":"2024-09-12T22:03:33.464601+0000","last_unstale":"2024-09-12T22:07:18.481127+0000","last_undegraded":"2024-09-12T22:07:18.481127+0000","last_fullsized":"2024-09-12T22:07:18.481127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:18.481018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:18.481018+0000","last_clean_scrub_stamp":"2024-09-12T22:07:18.481018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:21.965567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"93'3","reported_seq":173,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:22.467164+0000","last_change":"2024-09-12T22:07:22.467192+0000","last_active":"2024-09-12T22:07:22.467164+0000","last_peered":"2024-09-12T22:07:22.467164+0000","last_clean":"2024-09-12T22:07:22.467164+0000","last_became_active":"2024-09-12T22:03:32.460946+0000","last_became_peered":"2024-09-12T22:03:32.460946+0000","last_unstale":"2024-09-12T22:07:22.467164+0000","last_undegraded":"2024-09-12T22:07:22.467164+0000","last_fullsized":"2024-09-12T22:07:22.467164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-09-12T22:07:22.467077+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-09-12T22:07:22.467077+0000","last_clean_scrub_stamp":"2024-09-12T22:07:22.467077+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:58.027127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":176,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:06.545732+0000","last_change":"2024-09-12T22:07:06.545732+0000","last_active":"2024-09-12T22:07:06.545732+0000","last_peered":"2024-09-12T22:07:06.545732+0000","last_clean":"2024-09-12T22:07:06.545732+0000","last_became_active":"2024-09-12T22:06:44.390807+0000","last_became_peered":"2024-09-12T22:06:44.390807+0000","last_unstale":"2024-09-12T22:07:06.545732+0000","last_undegraded":"2024-09-12T22:07:06.545732+0000","last_fullsized":"2024-09-12T22:07:06.545732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:06.545621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:06.545621+0000","last_clean_scrub_stamp":"2024-09-12T22:07:06.545621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:28.452733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"93'2","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:24.319689+0000","last_change":"2024-09-12T22:07:24.319720+0000","last_active":"2024-09-12T22:07:24.319689+0000","last_peered":"2024-09-12T22:07:24.319689+0000","last_clean":"2024-09-12T22:07:24.319689+0000","last_became_active":"2024-09-12T22:03:32.458145+0000","last_became_peered":"2024-09-12T22:03:32.458145+0000","last_unstale":"2024-09-12T22:07:24.319689+0000","last_undegraded":"2024-09-12T22:07:24.319689+0000","last_fullsized":"2024-09-12T22:07:24.319689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-09-12T22:07:24.319603+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-09-12T22:07:24.319603+0000","last_clean_scrub_stamp":"2024-09-12T22:07:24.319603+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:46.226715+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":176,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:21.375858+0000","last_change":"2024-09-12T22:07:21.375858+0000","last_active":"2024-09-12T22:07:21.375858+0000","last_peered":"2024-09-12T22:07:21.375858+0000","last_clean":"2024-09-12T22:07:21.375858+0000","last_became_active":"2024-09-12T22:06:44.421388+0000","last_became_peered":"2024-09-12T22:06:44.421388+0000","last_unstale":"2024-09-12T22:07:21.375858+0000","last_undegraded":"2024-09-12T22:07:21.375858+0000","last_fullsized":"2024-09-12T22:07:21.375858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:21.375718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:21.375718+0000","last_clean_scrub_stamp":"2024-09-12T22:07:21.375718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:46:04.211966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":177,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:17.427660+0000","last_change":"2024-09-12T22:07:17.427684+0000","last_active":"2024-09-12T22:07:17.427660+0000","last_peered":"2024-09-12T22:07:17.427660+0000","last_clean":"2024-09-12T22:07:17.427660+0000","last_became_active":"2024-09-12T22:06:44.421430+0000","last_became_peered":"2024-09-12T22:06:44.421430+0000","last_unstale":"2024-09-12T22:07:17.427660+0000","last_undegraded":"2024-09-12T22:07:17.427660+0000","last_fullsized":"2024-09-12T22:07:17.427660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:17.427573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:17.427573+0000","last_clean_scrub_stamp":"2024-09-12T22:07:17.427573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:17.811728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:03.870785+0000","last_change":"2024-09-12T22:07:03.870814+0000","last_active":"2024-09-12T22:07:03.870785+0000","last_peered":"2024-09-12T22:07:03.870785+0000","last_clean":"2024-09-12T22:07:03.870785+0000","last_became_active":"2024-09-12T22:06:44.397490+0000","last_became_peered":"2024-09-12T22:06:44.397490+0000","last_unstale":"2024-09-12T22:07:03.870785+0000","last_undegraded":"2024-09-12T22:07:03.870785+0000","last_fullsized":"2024-09-12T22:07:03.870785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:03.870684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:03.870684+0000","last_clean_scrub_stamp":"2024-09-12T22:07:03.870684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:12.834646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"93'3","reported_seq":58,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:30.936097+0000","last_change":"2024-09-12T22:07:30.936130+0000","last_active":"2024-09-12T22:07:30.936097+0000","last_peered":"2024-09-12T22:07:30.936097+0000","last_clean":"2024-09-12T22:07:30.936097+0000","last_became_active":"2024-09-12T22:06:50.417240+0000","last_became_peered":"2024-09-12T22:06:50.417240+0000","last_unstale":"2024-09-12T22:07:30.936097+0000","last_undegraded":"2024-09-12T22:07:30.936097+0000","last_fullsized":"2024-09-12T22:07:30.936097+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-09-12T22:07:30.936007+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-09-12T22:07:30.936007+0000","last_clean_scrub_stamp":"2024-09-12T22:07:30.936007+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:29.930143+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:19.418438+0000","last_change":"2024-09-12T22:07:19.418460+0000","last_active":"2024-09-12T22:07:19.418438+0000","last_peered":"2024-09-12T22:07:19.418438+0000","last_clean":"2024-09-12T22:07:19.418438+0000","last_became_active":"2024-09-12T22:06:44.421071+0000","last_became_peered":"2024-09-12T22:06:44.421071+0000","last_unstale":"2024-09-12T22:07:19.418438+0000","last_undegraded":"2024-09-12T22:07:19.418438+0000","last_fullsized":"2024-09-12T22:07:19.418438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:19.418317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:19.418317+0000","last_clean_scrub_stamp":"2024-09-12T22:07:19.418317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:37:30.589631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:03.424879+0000","last_change":"2024-09-12T22:07:03.424902+0000","last_active":"2024-09-12T22:07:03.424879+0000","last_peered":"2024-09-12T22:07:03.424879+0000","last_clean":"2024-09-12T22:07:03.424879+0000","last_became_active":"2024-09-12T22:06:50.421734+0000","last_became_peered":"2024-09-12T22:06:50.421734+0000","last_unstale":"2024-09-12T22:07:03.424879+0000","last_undegraded":"2024-09-12T22:07:03.424879+0000","last_fullsized":"2024-09-12T22:07:03.424879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:03.424792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:03.424792+0000","last_clean_scrub_stamp":"2024-09-12T22:07:03.424792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:12.328912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:25.316021+0000","last_change":"2024-09-12T22:07:25.316066+0000","last_active":"2024-09-12T22:07:25.316021+0000","last_peered":"2024-09-12T22:07:25.316021+0000","last_clean":"2024-09-12T22:07:25.316021+0000","last_became_active":"2024-09-12T22:03:33.457998+0000","last_became_peered":"2024-09-12T22:03:33.457998+0000","last_unstale":"2024-09-12T22:07:25.316021+0000","last_undegraded":"2024-09-12T22:07:25.316021+0000","last_fullsized":"2024-09-12T22:07:25.316021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:25.315901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:25.315901+0000","last_clean_scrub_stamp":"2024-09-12T22:07:25.315901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:12.918103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":171,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:23.497634+0000","last_change":"2024-09-12T22:07:23.497634+0000","last_active":"2024-09-12T22:07:23.497634+0000","last_peered":"2024-09-12T22:07:23.497634+0000","last_clean":"2024-09-12T22:07:23.497634+0000","last_became_active":"2024-09-12T22:03:32.461041+0000","last_became_peered":"2024-09-12T22:03:32.461041+0000","last_unstale":"2024-09-12T22:07:23.497634+0000","last_undegraded":"2024-09-12T22:07:23.497634+0000","last_fullsized":"2024-09-12T22:07:23.497634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:23.497437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:23.497437+0000","last_clean_scrub_stamp":"2024-09-12T22:07:23.497437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:20.804213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:12.415036+0000","last_change":"2024-09-12T22:07:12.415080+0000","last_active":"2024-09-12T22:07:12.415036+0000","last_peered":"2024-09-12T22:07:12.415036+0000","last_clean":"2024-09-12T22:07:12.415036+0000","last_became_active":"2024-09-12T22:06:50.418648+0000","last_became_peered":"2024-09-12T22:06:50.418648+0000","last_unstale":"2024-09-12T22:07:12.415036+0000","last_undegraded":"2024-09-12T22:07:12.415036+0000","last_fullsized":"2024-09-12T22:07:12.415036+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:12.414901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:12.414901+0000","last_clean_scrub_stamp":"2024-09-12T22:07:12.414901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:12.172982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":178,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:05.559748+0000","last_change":"2024-09-12T22:07:05.559748+0000","last_active":"2024-09-12T22:07:05.559748+0000","last_peered":"2024-09-12T22:07:05.559748+0000","last_clean":"2024-09-12T22:07:05.559748+0000","last_became_active":"2024-09-12T22:06:44.391078+0000","last_became_peered":"2024-09-12T22:06:44.391078+0000","last_unstale":"2024-09-12T22:07:05.559748+0000","last_undegraded":"2024-09-12T22:07:05.559748+0000","last_fullsized":"2024-09-12T22:07:05.559748+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:05.559632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:05.559632+0000","last_clean_scrub_stamp":"2024-09-12T22:07:05.559632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:55.590535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:10.938968+0000","last_change":"2024-09-12T22:07:10.938995+0000","last_active":"2024-09-12T22:07:10.938968+0000","last_peered":"2024-09-12T22:07:10.938968+0000","last_clean":"2024-09-12T22:07:10.938968+0000","last_became_active":"2024-09-12T22:06:44.396783+0000","last_became_peered":"2024-09-12T22:06:44.396783+0000","last_unstale":"2024-09-12T22:07:10.938968+0000","last_undegraded":"2024-09-12T22:07:10.938968+0000","last_fullsized":"2024-09-12T22:07:10.938968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:10.938876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:10.938876+0000","last_clean_scrub_stamp":"2024-09-12T22:07:10.938876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:47.400030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"93'159","reported_seq":326,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:39.353485+0000","last_change":"2024-09-12T22:07:39.353544+0000","last_active":"2024-09-12T22:07:39.353485+0000","last_peered":"2024-09-12T22:07:39.353485+0000","last_clean":"2024-09-12T22:07:39.353485+0000","last_became_active":"2024-09-12T22:06:52.982174+0000","last_became_peered":"2024-09-12T22:06:52.982174+0000","last_unstale":"2024-09-12T22:07:39.353485+0000","last_undegraded":"2024-09-12T22:07:39.353485+0000","last_fullsized":"2024-09-12T22:07:39.353485+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'159","last_scrub_stamp":"2024-09-12T22:07:39.353375+0000","last_deep_scrub":"93'159","last_deep_scrub_stamp":"2024-09-12T22:07:39.353375+0000","last_clean_scrub_stamp":"2024-09-12T22:07:39.353375+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:21.388080+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"93'2","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:38.328206+0000","last_change":"2024-09-12T22:07:38.328248+0000","last_active":"2024-09-12T22:07:38.328206+0000","last_peered":"2024-09-12T22:07:38.328206+0000","last_clean":"2024-09-12T22:07:38.328206+0000","last_became_active":"2024-09-12T22:06:50.422353+0000","last_became_peered":"2024-09-12T22:06:50.422353+0000","last_unstale":"2024-09-12T22:07:38.328206+0000","last_undegraded":"2024-09-12T22:07:38.328206+0000","last_fullsized":"2024-09-12T22:07:38.328206+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-09-12T22:07:38.328124+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-09-12T22:07:38.328124+0000","last_clean_scrub_stamp":"2024-09-12T22:07:38.328124+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:01.915399+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00048545800000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:12.943676+0000","last_change":"2024-09-12T22:07:12.943702+0000","last_active":"2024-09-12T22:07:12.943676+0000","last_peered":"2024-09-12T22:07:12.943676+0000","last_clean":"2024-09-12T22:07:12.943676+0000","last_became_active":"2024-09-12T22:06:44.396659+0000","last_became_peered":"2024-09-12T22:06:44.396659+0000","last_unstale":"2024-09-12T22:07:12.943676+0000","last_undegraded":"2024-09-12T22:07:12.943676+0000","last_fullsized":"2024-09-12T22:07:12.943676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:12.943584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:12.943584+0000","last_clean_scrub_stamp":"2024-09-12T22:07:12.943584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:28.806765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:09.396524+0000","last_change":"2024-09-12T22:07:09.396548+0000","last_active":"2024-09-12T22:07:09.396524+0000","last_peered":"2024-09-12T22:07:09.396524+0000","last_clean":"2024-09-12T22:07:09.396524+0000","last_became_active":"2024-09-12T22:06:50.418443+0000","last_became_peered":"2024-09-12T22:06:50.418443+0000","last_unstale":"2024-09-12T22:07:09.396524+0000","last_undegraded":"2024-09-12T22:07:09.396524+0000","last_fullsized":"2024-09-12T22:07:09.396524+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:09.396436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:09.396436+0000","last_clean_scrub_stamp":"2024-09-12T22:07:09.396436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:16.931640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:10.439511+0000","last_change":"2024-09-12T22:07:10.439544+0000","last_active":"2024-09-12T22:07:10.439511+0000","last_peered":"2024-09-12T22:07:10.439511+0000","last_clean":"2024-09-12T22:07:10.439511+0000","last_became_active":"2024-09-12T22:06:50.418160+0000","last_became_peered":"2024-09-12T22:06:50.418160+0000","last_unstale":"2024-09-12T22:07:10.439511+0000","last_undegraded":"2024-09-12T22:07:10.439511+0000","last_fullsized":"2024-09-12T22:07:10.439511+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:10.439427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:10.439427+0000","last_clean_scrub_stamp":"2024-09-12T22:07:10.439427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:51.021107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:14.933464+0000","last_change":"2024-09-12T22:07:14.933489+0000","last_active":"2024-09-12T22:07:14.933464+0000","last_peered":"2024-09-12T22:07:14.933464+0000","last_clean":"2024-09-12T22:07:14.933464+0000","last_became_active":"2024-09-12T22:06:44.396378+0000","last_became_peered":"2024-09-12T22:06:44.396378+0000","last_unstale":"2024-09-12T22:07:14.933464+0000","last_undegraded":"2024-09-12T22:07:14.933464+0000","last_fullsized":"2024-09-12T22:07:14.933464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:14.933368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:14.933368+0000","last_clean_scrub_stamp":"2024-09-12T22:07:14.933368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:47.246315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":176,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:17.465662+0000","last_change":"2024-09-12T22:07:17.465662+0000","last_active":"2024-09-12T22:07:17.465662+0000","last_peered":"2024-09-12T22:07:17.465662+0000","last_clean":"2024-09-12T22:07:17.465662+0000","last_became_active":"2024-09-12T22:06:44.391809+0000","last_became_peered":"2024-09-12T22:06:44.391809+0000","last_unstale":"2024-09-12T22:07:17.465662+0000","last_undegraded":"2024-09-12T22:07:17.465662+0000","last_fullsized":"2024-09-12T22:07:17.465662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:17.465504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:17.465504+0000","last_clean_scrub_stamp":"2024-09-12T22:07:17.465504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:22.795263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:08.894316+0000","last_change":"2024-09-12T22:07:08.894340+0000","last_active":"2024-09-12T22:07:08.894316+0000","last_peered":"2024-09-12T22:07:08.894316+0000","last_clean":"2024-09-12T22:07:08.894316+0000","last_became_active":"2024-09-12T22:06:44.396596+0000","last_became_peered":"2024-09-12T22:06:44.396596+0000","last_unstale":"2024-09-12T22:07:08.894316+0000","last_undegraded":"2024-09-12T22:07:08.894316+0000","last_fullsized":"2024-09-12T22:07:08.894316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:08.894223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:08.894223+0000","last_clean_scrub_stamp":"2024-09-12T22:07:08.894223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:59.133246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":184,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:32.340264+0000","last_change":"2024-09-12T22:07:32.340264+0000","last_active":"2024-09-12T22:07:32.340264+0000","last_peered":"2024-09-12T22:07:32.340264+0000","last_clean":"2024-09-12T22:07:32.340264+0000","last_became_active":"2024-09-12T22:06:50.418876+0000","last_became_peered":"2024-09-12T22:06:50.418876+0000","last_unstale":"2024-09-12T22:07:32.340264+0000","last_undegraded":"2024-09-12T22:07:32.340264+0000","last_fullsized":"2024-09-12T22:07:32.340264+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:32.340093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:32.340093+0000","last_clean_scrub_stamp":"2024-09-12T22:07:32.340093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:47.371192+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:23.975211+0000","last_change":"2024-09-12T22:07:23.975234+0000","last_active":"2024-09-12T22:07:23.975211+0000","last_peered":"2024-09-12T22:07:23.975211+0000","last_clean":"2024-09-12T22:07:23.975211+0000","last_became_active":"2024-09-12T22:06:44.389680+0000","last_became_peered":"2024-09-12T22:06:44.389680+0000","last_unstale":"2024-09-12T22:07:23.975211+0000","last_undegraded":"2024-09-12T22:07:23.975211+0000","last_fullsized":"2024-09-12T22:07:23.975211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:23.975118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:23.975118+0000","last_clean_scrub_stamp":"2024-09-12T22:07:23.975118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:08.651715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"93'3","reported_seq":194,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:31.367299+0000","last_change":"2024-09-12T22:07:31.367299+0000","last_active":"2024-09-12T22:07:31.367299+0000","last_peered":"2024-09-12T22:07:31.367299+0000","last_clean":"2024-09-12T22:07:31.367299+0000","last_became_active":"2024-09-12T22:06:44.421088+0000","last_became_peered":"2024-09-12T22:06:44.421088+0000","last_unstale":"2024-09-12T22:07:31.367299+0000","last_undegraded":"2024-09-12T22:07:31.367299+0000","last_fullsized":"2024-09-12T22:07:31.367299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-09-12T22:07:31.367151+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-09-12T22:07:31.367151+0000","last_clean_scrub_stamp":"2024-09-12T22:07:31.367151+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:14.840522+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000731428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:06.420142+0000","last_change":"2024-09-12T22:07:06.420187+0000","last_active":"2024-09-12T22:07:06.420142+0000","last_peered":"2024-09-12T22:07:06.420142+0000","last_clean":"2024-09-12T22:07:06.420142+0000","last_became_active":"2024-09-12T22:06:50.423052+0000","last_became_peered":"2024-09-12T22:06:50.423052+0000","last_unstale":"2024-09-12T22:07:06.420142+0000","last_undegraded":"2024-09-12T22:07:06.420142+0000","last_fullsized":"2024-09-12T22:07:06.420142+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:06.420019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:06.420019+0000","last_clean_scrub_stamp":"2024-09-12T22:07:06.420019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:43.805506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:01.910331+0000","last_change":"2024-09-12T22:07:01.910357+0000","last_active":"2024-09-12T22:07:01.910331+0000","last_peered":"2024-09-12T22:07:01.910331+0000","last_clean":"2024-09-12T22:07:01.910331+0000","last_became_active":"2024-09-12T22:06:44.397452+0000","last_became_peered":"2024-09-12T22:06:44.397452+0000","last_unstale":"2024-09-12T22:07:01.910331+0000","last_undegraded":"2024-09-12T22:07:01.910331+0000","last_fullsized":"2024-09-12T22:07:01.910331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:01.910235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:01.910235+0000","last_clean_scrub_stamp":"2024-09-12T22:07:01.910235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:30.512629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:20.424167+0000","last_change":"2024-09-12T22:07:20.424190+0000","last_active":"2024-09-12T22:07:20.424167+0000","last_peered":"2024-09-12T22:07:20.424167+0000","last_clean":"2024-09-12T22:07:20.424167+0000","last_became_active":"2024-09-12T22:06:50.419551+0000","last_became_peered":"2024-09-12T22:06:50.419551+0000","last_unstale":"2024-09-12T22:07:20.424167+0000","last_undegraded":"2024-09-12T22:07:20.424167+0000","last_fullsized":"2024-09-12T22:07:20.424167+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:20.424081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:20.424081+0000","last_clean_scrub_stamp":"2024-09-12T22:07:20.424081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.307657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:04.846724+0000","last_change":"2024-09-12T22:07:04.846748+0000","last_active":"2024-09-12T22:07:04.846724+0000","last_peered":"2024-09-12T22:07:04.846724+0000","last_clean":"2024-09-12T22:07:04.846724+0000","last_became_active":"2024-09-12T22:06:44.396979+0000","last_became_peered":"2024-09-12T22:06:44.396979+0000","last_unstale":"2024-09-12T22:07:04.846724+0000","last_undegraded":"2024-09-12T22:07:04.846724+0000","last_fullsized":"2024-09-12T22:07:04.846724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:04.846632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:04.846632+0000","last_clean_scrub_stamp":"2024-09-12T22:07:04.846632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:01.019176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":182,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:03.572842+0000","last_change":"2024-09-12T22:07:03.572842+0000","last_active":"2024-09-12T22:07:03.572842+0000","last_peered":"2024-09-12T22:07:03.572842+0000","last_clean":"2024-09-12T22:07:03.572842+0000","last_became_active":"2024-09-12T22:06:50.418763+0000","last_became_peered":"2024-09-12T22:06:50.418763+0000","last_unstale":"2024-09-12T22:07:03.572842+0000","last_undegraded":"2024-09-12T22:07:03.572842+0000","last_fullsized":"2024-09-12T22:07:03.572842+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:03.572715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:03.572715+0000","last_clean_scrub_stamp":"2024-09-12T22:07:03.572715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:46.408963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:19.989956+0000","last_change":"2024-09-12T22:07:19.990002+0000","last_active":"2024-09-12T22:07:19.989956+0000","last_peered":"2024-09-12T22:07:19.989956+0000","last_clean":"2024-09-12T22:07:19.989956+0000","last_became_active":"2024-09-12T22:06:44.388887+0000","last_became_peered":"2024-09-12T22:06:44.388887+0000","last_unstale":"2024-09-12T22:07:19.989956+0000","last_undegraded":"2024-09-12T22:07:19.989956+0000","last_fullsized":"2024-09-12T22:07:19.989956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:19.989839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:19.989839+0000","last_clean_scrub_stamp":"2024-09-12T22:07:19.989839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:23.809418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:14.515781+0000","last_change":"2024-09-12T22:07:14.515781+0000","last_active":"2024-09-12T22:07:14.515781+0000","last_peered":"2024-09-12T22:07:14.515781+0000","last_clean":"2024-09-12T22:07:14.515781+0000","last_became_active":"2024-09-12T22:06:44.390260+0000","last_became_peered":"2024-09-12T22:06:44.390260+0000","last_unstale":"2024-09-12T22:07:14.515781+0000","last_undegraded":"2024-09-12T22:07:14.515781+0000","last_fullsized":"2024-09-12T22:07:14.515781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:14.515657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:14.515657+0000","last_clean_scrub_stamp":"2024-09-12T22:07:14.515657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:33.952425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040105099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:27.443371+0000","last_change":"2024-09-12T22:07:27.443371+0000","last_active":"2024-09-12T22:07:27.443371+0000","last_peered":"2024-09-12T22:07:27.443371+0000","last_clean":"2024-09-12T22:07:27.443371+0000","last_became_active":"2024-09-12T22:03:33.464506+0000","last_became_peered":"2024-09-12T22:03:33.464506+0000","last_unstale":"2024-09-12T22:07:27.443371+0000","last_undegraded":"2024-09-12T22:07:27.443371+0000","last_fullsized":"2024-09-12T22:07:27.443371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:27.443262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:27.443262+0000","last_clean_scrub_stamp":"2024-09-12T22:07:27.443262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:37.330036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"93'3","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:25.010706+0000","last_change":"2024-09-12T22:07:25.010755+0000","last_active":"2024-09-12T22:07:25.010706+0000","last_peered":"2024-09-12T22:07:25.010706+0000","last_clean":"2024-09-12T22:07:25.010706+0000","last_became_active":"2024-09-12T22:06:44.389622+0000","last_became_peered":"2024-09-12T22:06:44.389622+0000","last_unstale":"2024-09-12T22:07:25.010706+0000","last_undegraded":"2024-09-12T22:07:25.010706+0000","last_fullsized":"2024-09-12T22:07:25.010706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-09-12T22:07:25.010610+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-09-12T22:07:25.010610+0000","last_clean_scrub_stamp":"2024-09-12T22:07:25.010610+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:27.483245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":69,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:05.846797+0000","last_change":"2024-09-12T22:07:05.846822+0000","last_active":"2024-09-12T22:07:05.846797+0000","last_peered":"2024-09-12T22:07:05.846797+0000","last_clean":"2024-09-12T22:07:05.846797+0000","last_became_active":"2024-09-12T22:06:44.396735+0000","last_became_peered":"2024-09-12T22:06:44.396735+0000","last_unstale":"2024-09-12T22:07:05.846797+0000","last_undegraded":"2024-09-12T22:07:05.846797+0000","last_fullsized":"2024-09-12T22:07:05.846797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:05.846706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:05.846706+0000","last_clean_scrub_stamp":"2024-09-12T22:07:05.846706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:12.877837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:07.864716+0000","last_change":"2024-09-12T22:07:07.864739+0000","last_active":"2024-09-12T22:07:07.864716+0000","last_peered":"2024-09-12T22:07:07.864716+0000","last_clean":"2024-09-12T22:07:07.864716+0000","last_became_active":"2024-09-12T22:06:44.421723+0000","last_became_peered":"2024-09-12T22:06:44.421723+0000","last_unstale":"2024-09-12T22:07:07.864716+0000","last_undegraded":"2024-09-12T22:07:07.864716+0000","last_fullsized":"2024-09-12T22:07:07.864716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:07.864622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:07.864622+0000","last_clean_scrub_stamp":"2024-09-12T22:07:07.864622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:01.376833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"93'2","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:32.993062+0000","last_change":"2024-09-12T22:07:32.993092+0000","last_active":"2024-09-12T22:07:32.993062+0000","last_peered":"2024-09-12T22:07:32.993062+0000","last_clean":"2024-09-12T22:07:32.993062+0000","last_became_active":"2024-09-12T22:06:50.419354+0000","last_became_peered":"2024-09-12T22:06:50.419354+0000","last_unstale":"2024-09-12T22:07:32.993062+0000","last_undegraded":"2024-09-12T22:07:32.993062+0000","last_fullsized":"2024-09-12T22:07:32.993062+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-09-12T22:07:32.992969+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-09-12T22:07:32.992969+0000","last_clean_scrub_stamp":"2024-09-12T22:07:32.992969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:10.979676+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:11.417569+0000","last_change":"2024-09-12T22:07:11.417613+0000","last_active":"2024-09-12T22:07:11.417569+0000","last_peered":"2024-09-12T22:07:11.417569+0000","last_clean":"2024-09-12T22:07:11.417569+0000","last_became_active":"2024-09-12T22:06:50.418444+0000","last_became_peered":"2024-09-12T22:06:50.418444+0000","last_unstale":"2024-09-12T22:07:11.417569+0000","last_undegraded":"2024-09-12T22:07:11.417569+0000","last_fullsized":"2024-09-12T22:07:11.417569+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:11.417469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:11.417469+0000","last_clean_scrub_stamp":"2024-09-12T22:07:11.417469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:27.058849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":182,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:31.378848+0000","last_change":"2024-09-12T22:07:31.378848+0000","last_active":"2024-09-12T22:07:31.378848+0000","last_peered":"2024-09-12T22:07:31.378848+0000","last_clean":"2024-09-12T22:07:31.378848+0000","last_became_active":"2024-09-12T22:06:50.418591+0000","last_became_peered":"2024-09-12T22:06:50.418591+0000","last_unstale":"2024-09-12T22:07:31.378848+0000","last_undegraded":"2024-09-12T22:07:31.378848+0000","last_fullsized":"2024-09-12T22:07:31.378848+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:31.378717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:31.378717+0000","last_clean_scrub_stamp":"2024-09-12T22:07:31.378717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:36.003398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:04.444101+0000","last_change":"2024-09-12T22:07:04.444123+0000","last_active":"2024-09-12T22:07:04.444101+0000","last_peered":"2024-09-12T22:07:04.444101+0000","last_clean":"2024-09-12T22:07:04.444101+0000","last_became_active":"2024-09-12T22:06:50.419642+0000","last_became_peered":"2024-09-12T22:06:50.419642+0000","last_unstale":"2024-09-12T22:07:04.444101+0000","last_undegraded":"2024-09-12T22:07:04.444101+0000","last_fullsized":"2024-09-12T22:07:04.444101+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:04.444011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:04.444011+0000","last_clean_scrub_stamp":"2024-09-12T22:07:04.444011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:41.709278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"93'10","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:35.362574+0000","last_change":"2024-09-12T22:07:35.362613+0000","last_active":"2024-09-12T22:07:35.362574+0000","last_peered":"2024-09-12T22:07:35.362574+0000","last_clean":"2024-09-12T22:07:35.362574+0000","last_became_active":"2024-09-12T22:06:50.420099+0000","last_became_peered":"2024-09-12T22:06:50.420099+0000","last_unstale":"2024-09-12T22:07:35.362574+0000","last_undegraded":"2024-09-12T22:07:35.362574+0000","last_fullsized":"2024-09-12T22:07:35.362574+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'10","last_scrub_stamp":"2024-09-12T22:07:35.362488+0000","last_deep_scrub":"93'10","last_deep_scrub_stamp":"2024-09-12T22:07:35.362488+0000","last_clean_scrub_stamp":"2024-09-12T22:07:35.362488+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:28.480723+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:16.437933+0000","last_change":"2024-09-12T22:07:16.437959+0000","last_active":"2024-09-12T22:07:16.437933+0000","last_peered":"2024-09-12T22:07:16.437933+0000","last_clean":"2024-09-12T22:07:16.437933+0000","last_became_active":"2024-09-12T22:03:54.194697+0000","last_became_peered":"2024-09-12T22:03:54.194697+0000","last_unstale":"2024-09-12T22:07:16.437933+0000","last_undegraded":"2024-09-12T22:07:16.437933+0000","last_fullsized":"2024-09-12T22:07:16.437933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:16.437816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:16.437816+0000","last_clean_scrub_stamp":"2024-09-12T22:07:16.437816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:32.952376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"93'5","reported_seq":200,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:36.465519+0000","last_change":"2024-09-12T22:07:36.465577+0000","last_active":"2024-09-12T22:07:36.465519+0000","last_peered":"2024-09-12T22:07:36.465519+0000","last_clean":"2024-09-12T22:07:36.465519+0000","last_became_active":"2024-09-12T22:06:50.423283+0000","last_became_peered":"2024-09-12T22:06:50.423283+0000","last_unstale":"2024-09-12T22:07:36.465519+0000","last_undegraded":"2024-09-12T22:07:36.465519+0000","last_fullsized":"2024-09-12T22:07:36.465519+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'5","last_scrub_stamp":"2024-09-12T22:07:36.465389+0000","last_deep_scrub":"93'5","last_deep_scrub_stamp":"2024-09-12T22:07:36.465389+0000","last_clean_scrub_stamp":"2024-09-12T22:07:36.465389+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:57.113864+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:05.469217+0000","last_change":"2024-09-12T22:07:05.469261+0000","last_active":"2024-09-12T22:07:05.469217+0000","last_peered":"2024-09-12T22:07:05.469217+0000","last_clean":"2024-09-12T22:07:05.469217+0000","last_became_active":"2024-09-12T22:06:50.420171+0000","last_became_peered":"2024-09-12T22:06:50.420171+0000","last_unstale":"2024-09-12T22:07:05.469217+0000","last_undegraded":"2024-09-12T22:07:05.469217+0000","last_fullsized":"2024-09-12T22:07:05.469217+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:05.469120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:05.469120+0000","last_clean_scrub_stamp":"2024-09-12T22:07:05.469120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:42.616669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:25.989281+0000","last_change":"2024-09-12T22:07:25.989305+0000","last_active":"2024-09-12T22:07:25.989281+0000","last_peered":"2024-09-12T22:07:25.989281+0000","last_clean":"2024-09-12T22:07:25.989281+0000","last_became_active":"2024-09-12T22:06:50.417583+0000","last_became_peered":"2024-09-12T22:06:50.417583+0000","last_unstale":"2024-09-12T22:07:25.989281+0000","last_undegraded":"2024-09-12T22:07:25.989281+0000","last_fullsized":"2024-09-12T22:07:25.989281+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:25.989193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:25.989193+0000","last_clean_scrub_stamp":"2024-09-12T22:07:25.989193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:44.325009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:11.910998+0000","last_change":"2024-09-12T22:07:11.911025+0000","last_active":"2024-09-12T22:07:11.910998+0000","last_peered":"2024-09-12T22:07:11.910998+0000","last_clean":"2024-09-12T22:07:11.910998+0000","last_became_active":"2024-09-12T22:06:44.422217+0000","last_became_peered":"2024-09-12T22:06:44.422217+0000","last_unstale":"2024-09-12T22:07:11.910998+0000","last_undegraded":"2024-09-12T22:07:11.910998+0000","last_fullsized":"2024-09-12T22:07:11.910998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:11.910905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:11.910905+0000","last_clean_scrub_stamp":"2024-09-12T22:07:11.910905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:30:14.118448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:23.024354+0000","last_change":"2024-09-12T22:07:23.024416+0000","last_active":"2024-09-12T22:07:23.024354+0000","last_peered":"2024-09-12T22:07:23.024354+0000","last_clean":"2024-09-12T22:07:23.024354+0000","last_became_active":"2024-09-12T22:06:44.388560+0000","last_became_peered":"2024-09-12T22:06:44.388560+0000","last_unstale":"2024-09-12T22:07:23.024354+0000","last_undegraded":"2024-09-12T22:07:23.024354+0000","last_fullsized":"2024-09-12T22:07:23.024354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:23.024247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:23.024247+0000","last_clean_scrub_stamp":"2024-09-12T22:07:23.024247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:37.145512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:25.434840+0000","last_change":"2024-09-12T22:07:25.434840+0000","last_active":"2024-09-12T22:07:25.434840+0000","last_peered":"2024-09-12T22:07:25.434840+0000","last_clean":"2024-09-12T22:07:25.434840+0000","last_became_active":"2024-09-12T22:03:33.459799+0000","last_became_peered":"2024-09-12T22:03:33.459799+0000","last_unstale":"2024-09-12T22:07:25.434840+0000","last_undegraded":"2024-09-12T22:07:25.434840+0000","last_fullsized":"2024-09-12T22:07:25.434840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:25.434715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:25.434715+0000","last_clean_scrub_stamp":"2024-09-12T22:07:25.434715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:49.661012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:17.944452+0000","last_change":"2024-09-12T22:07:17.944480+0000","last_active":"2024-09-12T22:07:17.944452+0000","last_peered":"2024-09-12T22:07:17.944452+0000","last_clean":"2024-09-12T22:07:17.944452+0000","last_became_active":"2024-09-12T22:06:44.388499+0000","last_became_peered":"2024-09-12T22:06:44.388499+0000","last_unstale":"2024-09-12T22:07:17.944452+0000","last_undegraded":"2024-09-12T22:07:17.944452+0000","last_fullsized":"2024-09-12T22:07:17.944452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:17.944364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:17.944364+0000","last_clean_scrub_stamp":"2024-09-12T22:07:17.944364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:54.139341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:28.944597+0000","last_change":"2024-09-12T22:07:28.944621+0000","last_active":"2024-09-12T22:07:28.944597+0000","last_peered":"2024-09-12T22:07:28.944597+0000","last_clean":"2024-09-12T22:07:28.944597+0000","last_became_active":"2024-09-12T22:06:50.418800+0000","last_became_peered":"2024-09-12T22:06:50.418800+0000","last_unstale":"2024-09-12T22:07:28.944597+0000","last_undegraded":"2024-09-12T22:07:28.944597+0000","last_fullsized":"2024-09-12T22:07:28.944597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:28.944505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:28.944505+0000","last_clean_scrub_stamp":"2024-09-12T22:07:28.944505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:16.884551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:26.968847+0000","last_change":"2024-09-12T22:07:26.968877+0000","last_active":"2024-09-12T22:07:26.968847+0000","last_peered":"2024-09-12T22:07:26.968847+0000","last_clean":"2024-09-12T22:07:26.968847+0000","last_became_active":"2024-09-12T22:06:50.417455+0000","last_became_peered":"2024-09-12T22:06:50.417455+0000","last_unstale":"2024-09-12T22:07:26.968847+0000","last_undegraded":"2024-09-12T22:07:26.968847+0000","last_fullsized":"2024-09-12T22:07:26.968847+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:26.968609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:26.968609+0000","last_clean_scrub_stamp":"2024-09-12T22:07:26.968609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:04.407628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:20.451355+0000","last_change":"2024-09-12T22:07:20.451384+0000","last_active":"2024-09-12T22:07:20.451355+0000","last_peered":"2024-09-12T22:07:20.451355+0000","last_clean":"2024-09-12T22:07:20.451355+0000","last_became_active":"2024-09-12T22:03:33.464727+0000","last_became_peered":"2024-09-12T22:03:33.464727+0000","last_unstale":"2024-09-12T22:07:20.451355+0000","last_undegraded":"2024-09-12T22:07:20.451355+0000","last_fullsized":"2024-09-12T22:07:20.451355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:20.451265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:20.451265+0000","last_clean_scrub_stamp":"2024-09-12T22:07:20.451265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:44.038540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":178,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:10.540810+0000","last_change":"2024-09-12T22:07:10.540843+0000","last_active":"2024-09-12T22:07:10.540810+0000","last_peered":"2024-09-12T22:07:10.540810+0000","last_clean":"2024-09-12T22:07:10.540810+0000","last_became_active":"2024-09-12T22:06:44.390719+0000","last_became_peered":"2024-09-12T22:06:44.390719+0000","last_unstale":"2024-09-12T22:07:10.540810+0000","last_undegraded":"2024-09-12T22:07:10.540810+0000","last_fullsized":"2024-09-12T22:07:10.540810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-12T22:07:10.540723+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-12T22:07:10.540723+0000","last_clean_scrub_stamp":"2024-09-12T22:07:10.540723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:03.575272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:29.413085+0000","last_change":"2024-09-12T22:07:29.413123+0000","last_active":"2024-09-12T22:07:29.413085+0000","last_peered":"2024-09-12T22:07:29.413085+0000","last_clean":"2024-09-12T22:07:29.413085+0000","last_became_active":"2024-09-12T22:06:44.392160+0000","last_became_peered":"2024-09-12T22:06:44.392160+0000","last_unstale":"2024-09-12T22:07:29.413085+0000","last_undegraded":"2024-09-12T22:07:29.413085+0000","last_fullsized":"2024-09-12T22:07:29.413085+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:29.412995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:29.412995+0000","last_clean_scrub_stamp":"2024-09-12T22:07:29.412995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:03.364785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":184,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:30.364234+0000","last_change":"2024-09-12T22:07:30.364260+0000","last_active":"2024-09-12T22:07:30.364234+0000","last_peered":"2024-09-12T22:07:30.364234+0000","last_clean":"2024-09-12T22:07:30.364234+0000","last_became_active":"2024-09-12T22:06:50.418834+0000","last_became_peered":"2024-09-12T22:06:50.418834+0000","last_unstale":"2024-09-12T22:07:30.364234+0000","last_undegraded":"2024-09-12T22:07:30.364234+0000","last_fullsized":"2024-09-12T22:07:30.364234+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-12T22:07:30.364142+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-12T22:07:30.364142+0000","last_clean_scrub_stamp":"2024-09-12T22:07:30.364142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:27.018090+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:22.370132+0000","last_change":"2024-09-12T22:07:22.370155+0000","last_active":"2024-09-12T22:07:22.370132+0000","last_peered":"2024-09-12T22:07:22.370132+0000","last_clean":"2024-09-12T22:07:22.370132+0000","last_became_active":"2024-09-12T22:06:50.418856+0000","last_became_peered":"2024-09-12T22:06:50.418856+0000","last_unstale":"2024-09-12T22:07:22.370132+0000","last_undegraded":"2024-09-12T22:07:22.370132+0000","last_fullsized":"2024-09-12T22:07:22.370132+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:22.370037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:22.370037+0000","last_clean_scrub_stamp":"2024-09-12T22:07:22.370037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:09.796759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"93'3","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:36.343497+0000","last_change":"2024-09-12T22:07:36.343529+0000","last_active":"2024-09-12T22:07:36.343497+0000","last_peered":"2024-09-12T22:07:36.343497+0000","last_clean":"2024-09-12T22:07:36.343497+0000","last_became_active":"2024-09-12T22:06:50.421034+0000","last_became_peered":"2024-09-12T22:06:50.421034+0000","last_unstale":"2024-09-12T22:07:36.343497+0000","last_undegraded":"2024-09-12T22:07:36.343497+0000","last_fullsized":"2024-09-12T22:07:36.343497+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-09-12T22:07:36.343412+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-09-12T22:07:36.343412+0000","last_clean_scrub_stamp":"2024-09-12T22:07:36.343412+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:39.827961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:32.341165+0000","last_change":"2024-09-12T22:07:32.341190+0000","last_active":"2024-09-12T22:07:32.341165+0000","last_peered":"2024-09-12T22:07:32.341165+0000","last_clean":"2024-09-12T22:07:32.341165+0000","last_became_active":"2024-09-12T22:06:50.419417+0000","last_became_peered":"2024-09-12T22:06:50.419417+0000","last_unstale":"2024-09-12T22:07:32.341165+0000","last_undegraded":"2024-09-12T22:07:32.341165+0000","last_fullsized":"2024-09-12T22:07:32.341165+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:32.341080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:32.341080+0000","last_clean_scrub_stamp":"2024-09-12T22:07:32.341080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:43.106443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"93'3","reported_seq":173,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:21.484625+0000","last_change":"2024-09-12T22:07:21.484653+0000","last_active":"2024-09-12T22:07:21.484625+0000","last_peered":"2024-09-12T22:07:21.484625+0000","last_clean":"2024-09-12T22:07:21.484625+0000","last_became_active":"2024-09-12T22:03:32.460851+0000","last_became_peered":"2024-09-12T22:03:32.460851+0000","last_unstale":"2024-09-12T22:07:21.484625+0000","last_undegraded":"2024-09-12T22:07:21.484625+0000","last_fullsized":"2024-09-12T22:07:21.484625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-09-12T22:07:21.484535+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-09-12T22:07:21.484535+0000","last_clean_scrub_stamp":"2024-09-12T22:07:21.484535+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:06.736983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:13.533869+0000","last_change":"2024-09-12T22:07:13.533895+0000","last_active":"2024-09-12T22:07:13.533869+0000","last_peered":"2024-09-12T22:07:13.533869+0000","last_clean":"2024-09-12T22:07:13.533869+0000","last_became_active":"2024-09-12T22:06:44.392020+0000","last_became_peered":"2024-09-12T22:06:44.392020+0000","last_unstale":"2024-09-12T22:07:13.533869+0000","last_undegraded":"2024-09-12T22:07:13.533869+0000","last_fullsized":"2024-09-12T22:07:13.533869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:13.533770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:13.533770+0000","last_clean_scrub_stamp":"2024-09-12T22:07:13.533770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:48.428924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:16.976909+0000","last_change":"2024-09-12T22:07:16.976939+0000","last_active":"2024-09-12T22:07:16.976909+0000","last_peered":"2024-09-12T22:07:16.976909+0000","last_clean":"2024-09-12T22:07:16.976909+0000","last_became_active":"2024-09-12T22:06:44.394195+0000","last_became_peered":"2024-09-12T22:06:44.394195+0000","last_unstale":"2024-09-12T22:07:16.976909+0000","last_undegraded":"2024-09-12T22:07:16.976909+0000","last_fullsized":"2024-09-12T22:07:16.976909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-12T22:07:16.976800+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-12T22:07:16.976800+0000","last_clean_scrub_stamp":"2024-09-12T22:07:16.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:48.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:07.410176+0000","last_change":"2024-09-12T22:07:07.410203+0000","last_active":"2024-09-12T22:07:07.410176+0000","last_peered":"2024-09-12T22:07:07.410176+0000","last_clean":"2024-09-12T22:07:07.410176+0000","last_became_active":"2024-09-12T22:06:50.420176+0000","last_became_peered":"2024-09-12T22:06:50.420176+0000","last_unstale":"2024-09-12T22:07:07.410176+0000","last_undegraded":"2024-09-12T22:07:07.410176+0000","last_fullsized":"2024-09-12T22:07:07.410176+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:07:07.410090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:07:07.410090+0000","last_clean_scrub_stamp":"2024-09-12T22:07:07.410090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:18.108691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T22:07:31.973565+0000","last_change":"2024-09-12T22:07:31.973645+0000","last_active":"2024-09-12T22:07:31.973565+0000","last_peered":"2024-09-12T22:07:31.973565+0000","last_clean":"2024-09-12T22:07:31.973565+0000","last_became_active":"2024-09-12T22:06:50.417229+0000","last_became_peered":"2024-09-12T22:06:50.417229+0000","last_unstale":"2024-09-12T22:07:31.973565+0000","last_undegraded":"2024-09-12T22:07:31.973565+0000","last_fullsized":"2024-09-12T22:07:31.973565+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'6","last_scrub_stamp":"2024-09-12T22:07:31.973463+0000","last_deep_scrub":"93'6","last_deep_scrub_stamp":"2024-09-12T22:07:31.973463+0000","last_clean_scrub_stamp":"2024-09-12T22:07:31.973463+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:41.760666+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2430,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705724,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":564504,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":562878,"kb_avail":93807336,"statfs":{"total":96636764160,"available":96058712064,"internally_reserved":0,"allocated":1646592,"data_stored":1060429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":576387525},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705724,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411812,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":410174,"kb_avail":93960028,"statfs":{"total":96636764160,"available":96215068672,"internally_reserved":0,"allocated":1658880,"data_stored":1061064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":420018629},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285585,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50696,"kb_used_data":1016,"kb_used_omap":6,"kb_used_meta":49657,"kb_avail":94321144,"statfs":{"total":96636764160,"available":96584851456,"internally_reserved":0,"allocated":1040384,"data_stored":468902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6904,"internal_metadata":50849032},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:08:03.876 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T22:08:04.215 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T22:08:04.215 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:08:04.540 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:08:04.540 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"btime":"2024-09-12T22:03:35:455062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:03:32.797994+0000","modified":"2024-09-12T22:03:34.799743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.43:6803/129948218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":129948218},{"type":"v1","addr":"172.21.15.43:6803","nonce":129948218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-09-12T22:08:04.540 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 5 2024-09-12T22:08:04.553 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:08:04.878 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:08:04.878 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"btime":"2024-09-12T22:03:35:455062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:03:32.797994+0000","modified":"2024-09-12T22:03:34.799743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.43:6803/129948218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":129948218},{"type":"v1","addr":"172.21.15.43:6803","nonce":129948218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-09-12T22:08:04.878 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 5 2024-09-12T22:08:04.890 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:08:05.181 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T22:08:05.181 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":93,"fsid":"1e98d2ca-8e26-4ff2-9197-a54cfcd65ae7","created":"2024-09-12T22:03:11.964028+0000","modified":"2024-09-12T22:06:53.975728+0000","last_up_change":"2024-09-12T22:06:43.370158+0000","last_in_change":"2024-09-12T22:03:12.758606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:03:22.281699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:03:26.987767+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:03:31.328134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:03:31.777050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb292153-0043-4981-8743-115f848d2064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":32,"up_from":83,"up_thru":90,"down_at":33,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6801","nonce":4154318214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6803","nonce":4154318214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6807","nonce":4154318214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4154318214},{"type":"v1","addr":"172.21.15.47:6805","nonce":4154318214}]},"public_addr":"172.21.15.47:6801/4154318214","cluster_addr":"172.21.15.47:6803/4154318214","heartbeat_back_addr":"172.21.15.47:6807/4154318214","heartbeat_front_addr":"172.21.15.47:6805/4154318214","state":["exists","up"]},{"osd":1,"uuid":"5f0330a2-15ce-4ffb-a697-da1f930db079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6801","nonce":1334802479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6803","nonce":1334802479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6807","nonce":1334802479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1334802479},{"type":"v1","addr":"172.21.15.110:6805","nonce":1334802479}]},"public_addr":"172.21.15.110:6801/1334802479","cluster_addr":"172.21.15.110:6803/1334802479","heartbeat_back_addr":"172.21.15.110:6807/1334802479","heartbeat_front_addr":"172.21.15.110:6805/1334802479","state":["exists","up"]},{"osd":2,"uuid":"ae0b014f-768c-4f57-82c6-3edf9aa9f856","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6801","nonce":3565874056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6803","nonce":3565874056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6807","nonce":3565874056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3565874056},{"type":"v1","addr":"172.21.15.146:6805","nonce":3565874056}]},"public_addr":"172.21.15.146:6801/3565874056","cluster_addr":"172.21.15.146:6803/3565874056","heartbeat_back_addr":"172.21.15.146:6807/3565874056","heartbeat_front_addr":"172.21.15.146:6805/3565874056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:18.927187+0000","dead_epoch":32},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.386650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:03:19.957366+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.12","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:08:05.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T22:08:05.526 INFO:tasks.ceph.mds.a.smithi043.stderr: -1794> 2024-09-12T22:03:35.441+0000 7f8234243640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T22:08:05.527 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T22:08:05.540 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T22:08:05.552 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2024-09-12T22:08:06.548 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T22:08:07.533 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2024-09-12T22:08:07.548 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T22:08:08.539 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2024-09-12T22:08:08.556 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T22:08:08.556 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T22:08:08.556 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:08:08.566 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T22:08:08.567 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T22:08:08.567 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T22:08:08.567 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:08:08.597 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T22:08:08.597 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T22:08:08.597 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:08:08.653 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T22:08:08.654 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T22:08:08.654 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:08:08.725 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T22:08:08.726 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T22:08:08.726 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T22:08:08.726 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:08:08.755 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T22:08:08.755 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T22:08:08.755 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:08:08.821 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T22:08:08.822 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T22:08:08.822 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T22:08:08.822 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:08:08.875 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T22:08:08.876 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T22:08:08.876 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:08:08.929 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T22:08:08.929 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T22:08:08.929 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:08:08.981 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T22:08:08.981 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T22:08:08.982 DEBUG:teuthology.orchestra.run.smithi043:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-12T22:08:09.058 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T22:08:09.059 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T22:08:09.193 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T22:08:09.193 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T22:08:09.677 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-12T22:08:09.677 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T22:08:09.887 INFO:tasks.ceph:Archiving mon data... 2024-09-12T22:08:09.888 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/data/mon.a.tgz 2024-09-12T22:08:09.888 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-12T22:08:09.907 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.aQ7cUuRfca 2024-09-12T22:08:09.908 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.aQ7cUuRfca 2024-09-12T22:08:10.080 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.aQ7cUuRfca 2024-09-12T22:08:10.166 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.aQ7cUuRfca is 426KB 2024-09-12T22:08:10.263 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.aQ7cUuRfca 2024-09-12T22:08:10.280 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/data/mon.b.tgz 2024-09-12T22:08:10.281 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-12T22:08:10.336 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.piaIhSscDK 2024-09-12T22:08:10.336 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.piaIhSscDK 2024-09-12T22:08:10.519 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.piaIhSscDK 2024-09-12T22:08:10.604 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.piaIhSscDK is 577KB 2024-09-12T22:08:10.703 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.piaIhSscDK 2024-09-12T22:08:10.718 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/data/mon.c.tgz 2024-09-12T22:08:10.718 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-12T22:08:10.773 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.z1iQZWPrQc 2024-09-12T22:08:10.774 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.z1iQZWPrQc 2024-09-12T22:08:10.956 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.z1iQZWPrQc 2024-09-12T22:08:11.041 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.z1iQZWPrQc is 577KB 2024-09-12T22:08:11.113 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.z1iQZWPrQc 2024-09-12T22:08:11.128 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T22:08:11.129 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:08:11.170 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:08:11.173 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:08:11.175 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:08:11.249 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:08:11.273 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:08:11.291 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:08:11.309 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:08:11.309 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T22:08:11.310 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/remote/smithi043/crash 2024-09-12T22:08:11.311 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:08:11.336 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/remote/smithi047/crash 2024-09-12T22:08:11.337 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:08:11.375 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/remote/smithi110/crash 2024-09-12T22:08:11.375 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:08:11.419 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/remote/smithi146/crash 2024-09-12T22:08:11.420 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:08:11.459 INFO:tasks.ceph:Compressing logs... 2024-09-12T22:08:11.459 DEBUG:teuthology.orchestra.run.smithi043:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:08:11.462 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:08:11.464 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:08:11.467 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:08:11.485 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31300.log 2024-09-12T22:08:11.485 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31339.log 2024-09-12T22:08:11.486 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34389.log 2024-09-12T22:08:11.486 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31300.log.gz 2024-09-12T22:08:11.486 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36531.log 2024-09-12T22:08:11.486 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31339.log.gz 2024-09-12T22:08:11.493 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T22:08:11.514 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T22:08:11.514 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790.log 2024-09-12T22:08:11.514 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790.log.gz 2024-09-12T22:08:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30427.log 2024-09-12T22:08:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30387.log 2024-09-12T22:08:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.30427.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T22:08:11.538 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30427.log.gz 2024-09-12T22:08:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.30387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30347.log 2024-09-12T22:08:11.539 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30387.log.gz 2024-09-12T22:08:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.30347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30347.log.gz 2024-09-12T22:08:11.559 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31972.log 2024-09-12T22:08:11.559 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34389.log.gz 2024-09-12T22:08:11.559 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34257.log 2024-09-12T22:08:11.559 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36531.log.gz 2024-09-12T22:08:11.560 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30754.log 2024-09-12T22:08:11.560 INFO:teuthology.orchestra.run.smithi043.stderr: 49.5% -- replaced with /var/log/ceph/ceph-client.admin.31972.log.gz 2024-09-12T22:08:11.560 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32349.log 2024-09-12T22:08:11.560 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34257.log.gz 2024-09-12T22:08:11.560 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37963.log 2024-09-12T22:08:11.560 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30754.log.gz 2024-09-12T22:08:11.560 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33688.log 2024-09-12T22:08:11.560 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32349.log.gz 2024-09-12T22:08:11.560 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33510.log 2024-09-12T22:08:11.560 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37963.log.gz 2024-09-12T22:08:11.560 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34956.log 2024-09-12T22:08:11.560 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33688.log.gz 2024-09-12T22:08:11.560 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38044.log 2024-09-12T22:08:11.560 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33510.log.gz 2024-09-12T22:08:11.561 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34302.log 2024-09-12T22:08:11.561 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34956.log.gz 2024-09-12T22:08:11.561 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29889.log 2024-09-12T22:08:11.561 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38044.log.gz 2024-09-12T22:08:11.561 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38296.log 2024-09-12T22:08:11.561 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34302.log.gz 2024-09-12T22:08:11.561 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.29889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39536.log 2024-09-12T22:08:11.561 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29889.log.gz 2024-09-12T22:08:11.561 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37230.log 2024-09-12T22:08:11.561 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38296.log.gz 2024-09-12T22:08:11.561 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38551.log 2024-09-12T22:08:11.561 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39536.log.gz 2024-09-12T22:08:11.561 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38297.log 2024-09-12T22:08:11.561 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37230.log.gz 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39265.log 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38551.log.gz 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32851.log 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38297.log.gz 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33996.log 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39265.log.gz 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35133.log 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32851.log.gz 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31214.log 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33996.log.gz 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33285.log 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35133.log.gz 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30880.log 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31214.log.gz 2024-09-12T22:08:11.562 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33029.log 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33285.log.gz 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30359.log 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30880.log.gz 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33156.log 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33029.log.gz 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38971.log 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30359.log.gz 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33909.log 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33156.log.gz 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32638.log 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38971.log.gz 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30540.log 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33909.log.gz 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32180.log 2024-09-12T22:08:11.563 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32638.log.gz 2024-09-12T22:08:11.564 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35042.log 2024-09-12T22:08:11.564 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30540.log.gz 2024-09-12T22:08:11.564 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33777.log 2024-09-12T22:08:11.564 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32180.log.gz 2024-09-12T22:08:11.564 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36882.log 2024-09-12T22:08:11.564 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35042.log.gz 2024-09-12T22:08:11.564 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37315.log 2024-09-12T22:08:11.564 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33777.log.gz 2024-09-12T22:08:11.564 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35964.log 2024-09-12T22:08:11.564 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36882.log.gz 2024-09-12T22:08:11.564 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37622.log 2024-09-12T22:08:11.564 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37315.log.gz 2024-09-12T22:08:11.564 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33822.log 2024-09-12T22:08:11.564 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35964.log.gz 2024-09-12T22:08:11.565 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29928.log 2024-09-12T22:08:11.565 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37622.log.gz 2024-09-12T22:08:11.565 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39349.log 2024-09-12T22:08:11.565 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33822.log.gz 2024-09-12T22:08:11.565 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.29928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36357.log 2024-09-12T22:08:11.565 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29928.log.gz 2024-09-12T22:08:11.565 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36093.log 2024-09-12T22:08:11.565 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39349.log.gz 2024-09-12T22:08:11.565 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33116.log 2024-09-12T22:08:11.565 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36357.log.gz 2024-09-12T22:08:11.565 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35787.log 2024-09-12T22:08:11.565 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36093.log.gz 2024-09-12T22:08:11.565 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34344.log 2024-09-12T22:08:11.565 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33116.log.gz 2024-09-12T22:08:11.566 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31426.log 2024-09-12T22:08:11.566 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35787.log.gz 2024-09-12T22:08:11.566 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36399.log 2024-09-12T22:08:11.566 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34344.log.gz 2024-09-12T22:08:11.566 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39223.log 2024-09-12T22:08:11.566 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31426.log.gz 2024-09-12T22:08:11.566 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30796.log 2024-09-12T22:08:11.566 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36399.log.gz 2024-09-12T22:08:11.566 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31048.log 2024-09-12T22:08:11.566 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39223.log.gz 2024-09-12T22:08:11.566 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38422.log 2024-09-12T22:08:11.566 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30796.log.gz 2024-09-12T22:08:11.566 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34914.log 2024-09-12T22:08:11.567 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31048.log.gz 2024-09-12T22:08:11.567 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33238.log 2024-09-12T22:08:11.567 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38422.log.gz 2024-09-12T22:08:11.567 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30069.log 2024-09-12T22:08:11.567 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34914.log.gz 2024-09-12T22:08:11.567 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35832.log 2024-09-12T22:08:11.567 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33238.log.gz 2024-09-12T22:08:11.567 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31446.log 2024-09-12T22:08:11.567 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30069.log.gz 2024-09-12T22:08:11.567 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38803.log 2024-09-12T22:08:11.567 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35832.log.gz 2024-09-12T22:08:11.568 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36618.log 2024-09-12T22:08:11.568 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31446.log.gz 2024-09-12T22:08:11.568 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31485.log 2024-09-12T22:08:11.568 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38803.log.gz 2024-09-12T22:08:11.568 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31804.log 2024-09-12T22:08:11.568 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36618.log.gz 2024-09-12T22:08:11.568 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37409.log 2024-09-12T22:08:11.568 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31485.log.gz 2024-09-12T22:08:11.568 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38169.log 2024-09-12T22:08:11.568 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31804.log.gz 2024-09-12T22:08:11.568 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38045.log 2024-09-12T22:08:11.568 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37409.log.gz 2024-09-12T22:08:11.568 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36576.log 2024-09-12T22:08:11.568 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38169.log.gz 2024-09-12T22:08:11.569 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38635.log 2024-09-12T22:08:11.569 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38045.log.gz 2024-09-12T22:08:11.569 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35567.log 2024-09-12T22:08:11.569 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36576.log.gz 2024-09-12T22:08:11.569 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36312.log 2024-09-12T22:08:11.569 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38635.log.gz 2024-09-12T22:08:11.569 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32547.log 2024-09-12T22:08:11.569 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35567.log.gz 2024-09-12T22:08:11.569 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30712.log 2024-09-12T22:08:11.569 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36312.log.gz 2024-09-12T22:08:11.569 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32547.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T22:08:11.569 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32547.log.gz 2024-09-12T22:08:11.569 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32347.log 2024-09-12T22:08:11.570 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30712.log.gz 2024-09-12T22:08:11.570 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34215.log 2024-09-12T22:08:11.570 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32347.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28835.log 2024-09-12T22:08:11.570 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32347.log.gz 2024-09-12T22:08:11.570 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39055.log 2024-09-12T22:08:11.570 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34215.log.gz 2024-09-12T22:08:11.570 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.tmp-client.admin.28835.log: 0.0%gzip -- replaced with /var/log/ceph/ceph.tmp-client.admin.28835.log.gz 2024-09-12T22:08:11.570 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37451.log 2024-09-12T22:08:11.570 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35873.log 2024-09-12T22:08:11.570 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39055.log.gz 2024-09-12T22:08:11.570 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39307.log 2024-09-12T22:08:11.570 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37451.log.gz 2024-09-12T22:08:11.570 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36795.log 2024-09-12T22:08:11.570 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35873.log.gz 2024-09-12T22:08:11.571 INFO:teuthology.orchestra.run.smithi043.stderr: 95.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T22:08:11.571 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37056.log 2024-09-12T22:08:11.571 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39307.log.gz 2024-09-12T22:08:11.571 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36795.log.gz 2024-09-12T22:08:11.571 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32892.log 2024-09-12T22:08:11.571 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33863.log 2024-09-12T22:08:11.571 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37056.log.gz 2024-09-12T22:08:11.571 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36051.log 2024-09-12T22:08:11.571 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32892.log.gz 2024-09-12T22:08:11.571 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32054.log 2024-09-12T22:08:11.571 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33863.log.gz 2024-09-12T22:08:11.571 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36051.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36051.log.gz -5 2024-09-12T22:08:11.571 INFO:teuthology.orchestra.run.smithi043.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30145.log 2024-09-12T22:08:11.571 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35745.log 2024-09-12T22:08:11.572 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32054.log.gz 2024-09-12T22:08:11.572 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31930.log 2024-09-12T22:08:11.572 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30145.log.gz 2024-09-12T22:08:11.572 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38593.log 2024-09-12T22:08:11.572 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35745.log.gz 2024-09-12T22:08:11.572 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35175.log 2024-09-12T22:08:11.572 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31930.log.gz 2024-09-12T22:08:11.572 INFO:teuthology.orchestra.run.smithi043.stderr:gzip/var/log/ceph/ceph-client.admin.38593.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39141.log 2024-09-12T22:08:11.572 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38593.log.gz 2024-09-12T22:08:11.572 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36704.log 2024-09-12T22:08:11.572 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35175.log.gz 2024-09-12T22:08:11.572 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39391.log 2024-09-12T22:08:11.572 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39141.log.gz 2024-09-12T22:08:11.572 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30489.log 2024-09-12T22:08:11.573 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36704.log.gz 2024-09-12T22:08:11.573 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35481.log 2024-09-12T22:08:11.573 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39391.log.gz 2024-09-12T22:08:11.573 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35220.log 2024-09-12T22:08:11.573 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30489.log.gz 2024-09-12T22:08:11.573 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38170.log 2024-09-12T22:08:11.573 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35481.log.gz 2024-09-12T22:08:11.573 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37669.log 2024-09-12T22:08:11.573 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35220.log.gz 2024-09-12T22:08:11.573 INFO:teuthology.orchestra.run.smithi043.stderr:gzip/var/log/ceph/ceph-client.admin.38170.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35700.log 2024-09-12T22:08:11.573 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38170.log.gz 2024-09-12T22:08:11.573 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35001.log 2024-09-12T22:08:11.573 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37669.log.gz 2024-09-12T22:08:11.574 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log/var/log/ceph/ceph-client.admin.35700.log: 2024-09-12T22:08:11.574 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35700.log.gz 2024-09-12T22:08:11.574 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35613.log 2024-09-12T22:08:11.574 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35001.log.gz 2024-09-12T22:08:11.574 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37010.log 2024-09-12T22:08:11.574 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35613.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-12T22:08:11.574 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35613.log.gz 2024-09-12T22:08:11.574 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37010.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.37010.log.gz 2024-09-12T22:08:11.574 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29695.log 2024-09-12T22:08:11.574 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35307.log 2024-09-12T22:08:11.574 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.29695.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.29695.log.gz 2024-09-12T22:08:11.574 INFO:teuthology.orchestra.run.smithi043.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37921.log 2024-09-12T22:08:11.574 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33599.log 2024-09-12T22:08:11.574 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35307.log.gz 2024-09-12T22:08:11.575 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37921.log.gz 2024-09-12T22:08:11.575 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37538.log 2024-09-12T22:08:11.575 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34608.log 2024-09-12T22:08:11.575 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33599.log.gz 2024-09-12T22:08:11.575 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37538.log.gz 2024-09-12T22:08:11.575 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33196.log 2024-09-12T22:08:11.575 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37188.log 2024-09-12T22:08:11.575 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34608.log.gz 2024-09-12T22:08:11.575 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33196.log.gz 2024-09-12T22:08:11.575 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31090.log 2024-09-12T22:08:11.575 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36444.log 2024-09-12T22:08:11.575 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37188.log.gz 2024-09-12T22:08:11.575 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31090.log.gz 2024-09-12T22:08:11.575 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36484.log 2024-09-12T22:08:11.576 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30445.log 2024-09-12T22:08:11.576 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36444.log.gz 2024-09-12T22:08:11.576 INFO:teuthology.orchestra.run.smithi043.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T22:08:11.576 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33463.log 2024-09-12T22:08:11.576 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36484.log.gz 2024-09-12T22:08:11.576 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38845.log 2024-09-12T22:08:11.576 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30445.log.gz 2024-09-12T22:08:11.576 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34496.log 2024-09-12T22:08:11.576 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33463.log.gz 2024-09-12T22:08:11.576 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31132.log 2024-09-12T22:08:11.576 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38845.log.gz 2024-09-12T22:08:11.576 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38887.log 2024-09-12T22:08:11.576 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34496.log.gz 2024-09-12T22:08:11.576 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33421.log 2024-09-12T22:08:11.577 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31132.log.gz 2024-09-12T22:08:11.577 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38887.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38887.log.gz 2024-09-12T22:08:11.577 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38383.log 2024-09-12T22:08:11.577 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31762.log 2024-09-12T22:08:11.577 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33421.log.gz 2024-09-12T22:08:11.577 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33735.log 0.0% 2024-09-12T22:08:11.577 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38383.log.gz 2024-09-12T22:08:11.577 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34869.log 2024-09-12T22:08:11.577 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31762.log.gz 2024-09-12T22:08:11.577 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35439.log 2024-09-12T22:08:11.577 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33735.log.gz 2024-09-12T22:08:11.577 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34083.log 2024-09-12T22:08:11.577 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34869.log.gz 2024-09-12T22:08:11.577 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35439.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T22:08:11.578 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35439.log.gz 2024-09-12T22:08:11.578 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34083.log.gz 2024-09-12T22:08:11.578 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39013.log 2024-09-12T22:08:11.578 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36138.log 2024-09-12T22:08:11.578 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37364.log 2024-09-12T22:08:11.578 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39013.log.gz 2024-09-12T22:08:11.578 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37753.log 2024-09-12T22:08:11.578 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36138.log.gz 2024-09-12T22:08:11.578 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37364.log.gz 2024-09-12T22:08:11.578 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32138.log 2024-09-12T22:08:11.578 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34563.log 2024-09-12T22:08:11.578 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37753.log.gz 2024-09-12T22:08:11.578 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32138.log.gz 2024-09-12T22:08:11.578 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32242.log 2024-09-12T22:08:11.579 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31573.log 2024-09-12T22:08:11.579 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34563.log.gz 2024-09-12T22:08:11.579 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32242.log.gz 2024-09-12T22:08:11.579 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33954.log 2024-09-12T22:08:11.579 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30838.log 2024-09-12T22:08:11.579 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31573.log.gz 2024-09-12T22:08:11.579 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33954.log.gz 2024-09-12T22:08:11.579 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35262.log 2024-09-12T22:08:11.579 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39451.log 2024-09-12T22:08:11.579 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30838.log.gz 2024-09-12T22:08:11.579 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35262.log.gz 2024-09-12T22:08:11.579 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34128.log 2024-09-12T22:08:11.579 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33374.log 2024-09-12T22:08:11.579 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39451.log.gz 2024-09-12T22:08:11.580 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34128.log.gz 2024-09-12T22:08:11.580 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36969.log 2024-09-12T22:08:11.580 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39183.log 2024-09-12T22:08:11.580 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33374.log.gz 2024-09-12T22:08:11.580 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36969.log.gz 2024-09-12T22:08:11.580 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34736.log 2024-09-12T22:08:11.580 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35394.log 2024-09-12T22:08:11.580 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39183.log.gz 2024-09-12T22:08:11.580 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34736.log.gz 2024-09-12T22:08:11.580 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38719.log 2024-09-12T22:08:11.580 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35394.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T22:08:11.580 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35394.log.gz 2024-09-12T22:08:11.580 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38719.log.gz 2024-09-12T22:08:11.580 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30401.log 2024-09-12T22:08:11.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37275.log 2024-09-12T22:08:11.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30401.log.gz 2024-09-12T22:08:11.581 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31720.log 2024-09-12T22:08:11.581 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35088.log 2024-09-12T22:08:11.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37275.log.gz 2024-09-12T22:08:11.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33552.log 2024-09-12T22:08:11.581 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31720.log.gz 2024-09-12T22:08:11.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30670.log 2024-09-12T22:08:11.581 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35088.log.gz 2024-09-12T22:08:11.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30226.log 2024-09-12T22:08:11.581 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33552.log.gz 2024-09-12T22:08:11.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30670.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.30670.log.gz 2024-09-12T22:08:11.581 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37837.log 2024-09-12T22:08:11.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30226.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.30226.log.gz -- 2024-09-12T22:08:11.582 INFO:teuthology.orchestra.run.smithi043.stderr: /var/log/ceph/ceph.log 2024-09-12T22:08:11.582 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38043.log 2024-09-12T22:08:11.582 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37837.log.gz 2024-09-12T22:08:11.582 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39097.log 2024-09-12T22:08:11.582 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36924.log 2024-09-12T22:08:11.582 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38043.log.gz 2024-09-12T22:08:11.582 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31888.log 2024-09-12T22:08:11.582 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39097.log.gz 2024-09-12T22:08:11.582 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34650.log 2024-09-12T22:08:11.582 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36924.log.gz 2024-09-12T22:08:11.582 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31888.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31888.log.gz 2024-09-12T22:08:11.582 INFO:teuthology.orchestra.run.smithi043.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30964.log 2024-09-12T22:08:11.582 INFO:teuthology.orchestra.run.smithi043.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34650.log.gz 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30964.log.gz 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37491.log 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31213.log 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.37491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37491.log.gz 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34802.log 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr: 94.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31612.log 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31213.log.gz 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39494.log 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34802.log.gz 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34695.log 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31612.log.gz 2024-09-12T22:08:11.583 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32348.log 2024-09-12T22:08:11.584 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39494.log.gz 2024-09-12T22:08:11.584 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38257.log 2024-09-12T22:08:11.584 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34695.log.gz 2024-09-12T22:08:11.584 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35658.log 2024-09-12T22:08:11.584 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32348.log.gz 2024-09-12T22:08:11.584 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38257.log.gz 2024-09-12T22:08:11.584 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32462.log 2024-09-12T22:08:11.584 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32659.log 2024-09-12T22:08:11.584 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35658.log.gz 2024-09-12T22:08:11.584 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32346.log 2024-09-12T22:08:11.584 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32462.log.gz 2024-09-12T22:08:11.584 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.32659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.32659.log.gz 2024-09-12T22:08:11.584 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36663.log 2024-09-12T22:08:11.585 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32940.log 2024-09-12T22:08:11.585 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32346.log.gz 2024-09-12T22:08:11.585 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36663.log.gz 2024-09-12T22:08:11.585 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33326.log 2024-09-12T22:08:11.585 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34782.log 2024-09-12T22:08:11.585 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32940.log.gz 2024-09-12T22:08:11.585 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38761.log 2024-09-12T22:08:11.585 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33326.log.gz 2024-09-12T22:08:11.585 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34782.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34782.log.gz 2024-09-12T22:08:11.585 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30582.log 2024-09-12T22:08:11.585 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32096.log 2024-09-12T22:08:11.585 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38761.log.gz 2024-09-12T22:08:11.585 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30582.log.gz 2024-09-12T22:08:11.585 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30624.log 2024-09-12T22:08:11.586 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35919.log 2024-09-12T22:08:11.586 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32096.log.gz 2024-09-12T22:08:11.586 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31212.log 2024-09-12T22:08:11.586 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30624.log.gz 2024-09-12T22:08:11.586 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35919.log.gz 2024-09-12T22:08:11.586 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36006.log 2024-09-12T22:08:11.586 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38171.log 2024-09-12T22:08:11.586 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31212.log.gz 2024-09-12T22:08:11.586 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36006.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T22:08:11.586 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36006.log.gz 2024-09-12T22:08:11.586 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38171.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38171.log.gz -5 2024-09-12T22:08:11.586 INFO:teuthology.orchestra.run.smithi043.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30201.log 2024-09-12T22:08:11.586 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35526.log 2024-09-12T22:08:11.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.30201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30201.log.gz 2024-09-12T22:08:11.587 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30922.log 2024-09-12T22:08:11.587 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32505.log 2024-09-12T22:08:11.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35526.log.gz 2024-09-12T22:08:11.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37143.log 2024-09-12T22:08:11.587 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30922.log.gz 2024-09-12T22:08:11.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33639.log 2024-09-12T22:08:11.587 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32505.log.gz 2024-09-12T22:08:11.587 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31006.log 2024-09-12T22:08:11.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37143.log.gz 2024-09-12T22:08:11.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34430.log 2024-09-12T22:08:11.587 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33639.log.gz 2024-09-12T22:08:11.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31006.log.gz 2024-09-12T22:08:11.587 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37711.log 2024-09-12T22:08:11.588 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34169.log 2024-09-12T22:08:11.588 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34430.log.gz 2024-09-12T22:08:11.588 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36225.log 0.0% 2024-09-12T22:08:11.588 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37711.log.gz 2024-09-12T22:08:11.588 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36837.log 2024-09-12T22:08:11.588 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34169.log.gz 2024-09-12T22:08:11.588 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37580.log 2024-09-12T22:08:11.588 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36225.log.gz 2024-09-12T22:08:11.588 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36837.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36837.log.gz 2024-09-12T22:08:11.588 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38677.log 2024-09-12T22:08:11.588 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32788.log 2024-09-12T22:08:11.588 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37580.log.gz 2024-09-12T22:08:11.588 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34476.log 2024-09-12T22:08:11.589 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38677.log.gz 2024-09-12T22:08:11.589 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32788.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32788.log.gz 2024-09-12T22:08:11.589 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37101.log 2024-09-12T22:08:11.589 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38929.log 2024-09-12T22:08:11.589 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34476.log.gz 2024-09-12T22:08:11.589 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38509.log 2024-09-12T22:08:11.589 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37101.log.gz 2024-09-12T22:08:11.589 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36270.log 2024-09-12T22:08:11.589 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38929.log.gz 2024-09-12T22:08:11.589 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30297.log 2024-09-12T22:08:11.589 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38509.log.gz 2024-09-12T22:08:11.589 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31678.log 2024-09-12T22:08:11.589 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36270.log.gz 2024-09-12T22:08:11.589 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36179.log 2024-09-12T22:08:11.590 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30297.log.gz 2024-09-12T22:08:11.590 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37879.log 2024-09-12T22:08:11.590 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31678.log.gz 2024-09-12T22:08:11.590 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33076.log 2024-09-12T22:08:11.590 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36179.log.gz 2024-09-12T22:08:11.590 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37879.log.gz 2024-09-12T22:08:11.590 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36750.log 2024-09-12T22:08:11.590 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34041.log 2024-09-12T22:08:11.590 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33076.log.gz 2024-09-12T22:08:11.590 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32980.log 2024-09-12T22:08:11.590 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36750.log.gz 2024-09-12T22:08:11.590 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.34041.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34041.log.gz 2024-09-12T22:08:11.590 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38423.log 2024-09-12T22:08:11.590 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31552.log 2024-09-12T22:08:11.591 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32980.log.gz 2024-09-12T22:08:11.591 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31340.log 2024-09-12T22:08:11.591 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38423.log.gz 2024-09-12T22:08:11.591 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37795.log 2024-09-12T22:08:11.591 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31552.log.gz 2024-09-12T22:08:11.591 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31846.log 2024-09-12T22:08:11.591 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31340.log.gz 2024-09-12T22:08:11.591 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32591.log 2024-09-12T22:08:11.591 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37795.log.gz 2024-09-12T22:08:11.591 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35347.log 2024-09-12T22:08:11.591 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31846.log.gz 2024-09-12T22:08:11.591 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32591.log.gz 2024-09-12T22:08:11.591 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35347.log.gz 2024-09-12T22:08:11.599 INFO:teuthology.orchestra.run.smithi043.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T22:08:11.618 INFO:teuthology.orchestra.run.smithi043.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T22:08:11.694 INFO:teuthology.orchestra.run.smithi043.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T22:08:11.767 INFO:teuthology.orchestra.run.smithi043.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T22:08:11.769 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-12T22:08:11.769 INFO:teuthology.orchestra.run.smithi043.stderr:real 0m0.294s 2024-09-12T22:08:11.769 INFO:teuthology.orchestra.run.smithi043.stderr:user 0m0.638s 2024-09-12T22:08:11.769 INFO:teuthology.orchestra.run.smithi043.stderr:sys 0m0.129s 2024-09-12T22:08:21.553 INFO:teuthology.orchestra.run.smithi047.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T22:08:21.555 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-09-12T22:08:21.555 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m10.077s 2024-09-12T22:08:21.555 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m9.495s 2024-09-12T22:08:21.555 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m0.354s 2024-09-12T22:09:00.324 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.1.log: 92.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T22:09:00.326 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-09-12T22:09:00.326 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m48.844s 2024-09-12T22:09:00.326 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m47.242s 2024-09-12T22:09:00.326 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m1.527s 2024-09-12T22:09:03.510 INFO:teuthology.orchestra.run.smithi146.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T22:09:03.512 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-12T22:09:03.512 INFO:teuthology.orchestra.run.smithi146.stderr:real 0m51.991s 2024-09-12T22:09:03.513 INFO:teuthology.orchestra.run.smithi146.stderr:user 0m50.223s 2024-09-12T22:09:03.513 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m1.692s 2024-09-12T22:09:03.513 INFO:tasks.ceph:Archiving logs... 2024-09-12T22:09:03.513 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/remote/smithi043/log 2024-09-12T22:09:03.514 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:09:03.829 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/remote/smithi047/log 2024-09-12T22:09:03.830 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:09:05.232 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/remote/smithi110/log 2024-09-12T22:09:05.233 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:09:12.951 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/remote/smithi146/log 2024-09-12T22:09:12.952 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:09:20.533 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T22:09:20.543 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T22:09:20.543 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:09:20.546 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:09:20.549 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:09:20.551 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:09:20.667 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T22:09:20.676 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T22:09:20.676 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:09:20.679 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:09:20.682 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:09:20.684 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:09:20.694 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:09:20.697 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:09:20.699 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:09:20.699 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:09:20.700 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-09-12T22:09:20.700 INFO:teuthology.orchestra.run.smithi043.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 -503us[ -503us] +/- 56ms 2024-09-12T22:09:20.700 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 +152us[ +152us] +/- 59ms 2024-09-12T22:09:20.700 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 +498us[ +498us] +/- 72ms 2024-09-12T22:09:20.700 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:09:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:09:20.702 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:09:20.702 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-09-12T22:09:20.702 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv01.front.sepia.ceph.com 3 6 77 43 -514us[ -472us] +/- 56ms 2024-09-12T22:09:20.702 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv02.front.sepia.ceph.com 3 6 77 43 +133us[ +133us] +/- 59ms 2024-09-12T22:09:20.702 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 77 44 +487us[ +528us] +/- 72ms 2024-09-12T22:09:20.702 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:09:20.704 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:09:20.704 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-09-12T22:09:20.704 INFO:teuthology.orchestra.run.smithi110.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 -519us[ -527us] +/- 56ms 2024-09-12T22:09:20.704 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 +126us[ +126us] +/- 59ms 2024-09-12T22:09:20.704 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +488us[ +488us] +/- 72ms 2024-09-12T22:09:20.704 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:09:20.706 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:09:20.706 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-09-12T22:09:20.706 INFO:teuthology.orchestra.run.smithi146.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 -518us[ -525us] +/- 56ms 2024-09-12T22:09:20.706 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 35 +138us[ +138us] +/- 59ms 2024-09-12T22:09:20.706 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 +482us[ +475us] +/- 72ms 2024-09-12T22:09:20.706 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:09:20.707 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T22:09:20.716 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T22:09:20.716 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T22:09:20.725 DEBUG:teuthology.orchestra.run.smithi043:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:09:20.813 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:09:20.932 DEBUG:teuthology.orchestra.run.smithi110:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:09:21.002 DEBUG:teuthology.orchestra.run.smithi146:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:09:21.075 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:09:21.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:09:21.109 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:09:21.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:09:21.143 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:09:21.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:09:21.174 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:09:21.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:09:21.204 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T22:09:21.216 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T22:09:21.223 INFO:teuthology.task.internal:Duration was 728.113098 seconds 2024-09-12T22:09:21.224 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T22:09:21.233 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T22:09:21.233 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:09:21.235 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:09:21.238 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:09:21.240 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:09:21.279 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:09:21.280 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:09:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:09:21.306 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:09:21.736 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T22:09:21.736 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T22:09:21.737 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:09:21.763 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T22:09:21.763 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:09:21.796 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T22:09:21.796 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:09:21.826 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2024-09-12T22:09:21.826 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:09:21.851 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T22:09:21.851 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:09:21.854 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:09:21.856 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:09:21.869 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:09:21.918 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T22:09:21.918 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:09:21.927 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:09:21.929 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:09:21.937 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:09:22.067 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T22:09:22.079 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T22:09:22.079 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:09:22.106 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:09:22.135 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:09:22.161 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:09:22.186 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T22:09:22.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:09:22.199 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:09:22.201 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:09:22.204 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:09:22.222 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2024-09-12T22:09:22.224 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-09-12T22:09:22.238 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-09-12T22:09:22.249 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2024-09-12T22:09:22.278 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:09:22.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:09:22.296 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:09:22.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:09:22.317 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:09:22.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:09:22.332 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:09:22.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:09:22.346 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T22:09:22.356 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T22:09:22.357 DEBUG:teuthology.misc:Transferring archived files from smithi043:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/remote/smithi043 2024-09-12T22:09:22.357 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:09:22.392 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/remote/smithi047 2024-09-12T22:09:22.392 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:09:22.426 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/remote/smithi110 2024-09-12T22:09:22.427 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:09:22.459 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902915/remote/smithi146 2024-09-12T22:09:22.459 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:09:22.492 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T22:09:22.493 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:09:22.496 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:09:22.499 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:09:22.501 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:09:22.542 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T22:09:22.559 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T22:09:22.559 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T22:09:22.575 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T22:09:22.575 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:09:22.578 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:09:22.581 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:09:22.584 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:09:22.591 INFO:teuthology.orchestra.run.smithi043.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:09 /home/ubuntu/cephtest 2024-09-12T22:09:22.596 INFO:teuthology.orchestra.run.smithi110.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:09 /home/ubuntu/cephtest 2024-09-12T22:09:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:09 /home/ubuntu/cephtest 2024-09-12T22:09:22.599 INFO:teuthology.orchestra.run.smithi146.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:09 /home/ubuntu/cephtest 2024-09-12T22:09:22.600 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T22:09:22.610 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T22:09:22.634 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/admin_socket_objecter_requests thrashosds-health} duration: 728.1130983829498 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T22:09:22.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T22:09:22.735 INFO:teuthology.run:pass